-- Logs begin at Wed 2022-10-05 01:44:34 UTC, end at Wed 2022-10-05 04:26:42 UTC. -- Oct 05 02:10:19.296629 n-d-858272-3 systemd[1]: Starting Devstack devstack@keystone.service... Oct 05 02:10:19.303911 n-d-858272-3 devstack@keystone.service[81813]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 02:10:19 2022] *** Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: nodename: n-d-858272-3 Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: machine: x86_64 Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: clock source: unix Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: pcre jit disabled Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: detected number of CPU cores: 4 Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: current working directory: / Oct 05 02:10:19.306048 n-d-858272-3 devstack@keystone.service[81813]: detected binary path: /usr/bin/uwsgi-core Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: your processes number limit is 47680 Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: your memory page size is 4096 bytes Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: detected max file descriptor number: 2048 Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: lock engine: pthread robust mutexes Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: thunder lock: enabled Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 05 02:10:19.306706 n-d-858272-3 devstack@keystone.service[81813]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 02:10:19.347215 n-d-858272-3 devstack@keystone.service[81813]: Python main interpreter initialized at 0x55de998ca9c0 Oct 05 02:10:19.347215 n-d-858272-3 devstack@keystone.service[81813]: python threads support enabled Oct 05 02:10:19.347215 n-d-858272-3 devstack@keystone.service[81813]: your server socket listen backlog is limited to 100 connections Oct 05 02:10:19.347215 n-d-858272-3 devstack@keystone.service[81813]: your mercy for graceful operations on workers is 90 seconds Oct 05 02:10:19.347610 n-d-858272-3 devstack@keystone.service[81813]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 02:10:19.347694 n-d-858272-3 devstack@keystone.service[81813]: *** Operational MODE: preforking *** Oct 05 02:10:19.347937 n-d-858272-3 devstack@keystone.service[81813]: *** uWSGI is running in multiple interpreter mode *** Oct 05 02:10:19.347937 n-d-858272-3 devstack@keystone.service[81813]: spawned uWSGI master process (pid: 81813) Oct 05 02:10:19.348140 n-d-858272-3 systemd[1]: Started Devstack devstack@keystone.service. Oct 05 02:10:19.351009 n-d-858272-3 devstack@keystone.service[81813]: spawned uWSGI worker 1 (pid: 81826, cores: 1) Oct 05 02:10:19.351009 n-d-858272-3 devstack@keystone.service[81813]: spawned uWSGI worker 2 (pid: 81827, cores: 1) Oct 05 02:10:19.351009 n-d-858272-3 devstack@keystone.service[81813]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 02:10:23.648411 n-d-858272-3 devstack@keystone.service[81827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:10:23.648411 n-d-858272-3 devstack@keystone.service[81827]: from cryptography.utils import int_from_bytes Oct 05 02:10:23.649886 n-d-858272-3 devstack@keystone.service[81826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:10:23.649886 n-d-858272-3 devstack@keystone.service[81826]: from cryptography.utils import int_from_bytes Oct 05 02:10:23.649886 n-d-858272-3 devstack@keystone.service[81826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:10:23.649886 n-d-858272-3 devstack@keystone.service[81826]: from cryptography.utils import int_from_bytes Oct 05 02:10:23.650446 n-d-858272-3 devstack@keystone.service[81827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 02:10:23.650446 n-d-858272-3 devstack@keystone.service[81827]: from cryptography.utils import int_from_bytes Oct 05 02:10:23.699227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 02:10:23.699408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 02:10:23.699408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 02:10:23.699561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 02:10:23.699634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] command line args: [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 02:10:23.699728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] command line args: [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 02:10:23.699853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 02:10:23.699979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 02:10:23.700069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ================================================================================ {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 02:10:23.700150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ================================================================================ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 02:10:23.700264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] admin_token = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] admin_token = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] config_dir = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] config_dir = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] config_source = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.700993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] config_source = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] debug = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] debug = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.701899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.702934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_config_append = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_config_append = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_dir = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_dir = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_file = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.703979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.704953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.705959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.706912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] publish_errors = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] publish_errors = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.707877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.708985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] standard_threads = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] standard_threads = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.709971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] use_journal = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] use_journal = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] use_json = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] use_json = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] use_stderr = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] use_stderr = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] use_syslog = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] use_syslog = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.710920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.711035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 02:10:23.711192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.711301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.711918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.712893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.713899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.714973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.715920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.716925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.717979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.718896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.719951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.720879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.721918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.722994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.723923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.724949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.725921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.726995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.727721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.727842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.727959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.728926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.729995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.730944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.731996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.732963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.733903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.734935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.735969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.736976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.external = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.737953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.external = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.password = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.738925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] auth.token = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.password = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] auth.token = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.739991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.740955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.741898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.742905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.743984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.744887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.745971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.746914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.747865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.748880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.749864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.750821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.751995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.752936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.753896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.754947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.755888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.756971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.757909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.758128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.758723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.758874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.758996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.759950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.760886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.761940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.762990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.763926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.764874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.765944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.766910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.767987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.768980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.769937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.770992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] role.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] role.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.771877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] role.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] role.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.772955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.773923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.774581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.774709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.774827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.774943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.775885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.776991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.777810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.778975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.779911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.780983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.781978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.782922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.783892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.784968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.785836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.connection = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.786876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.787927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.788399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 02:10:23.789401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 02:10:23.813654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.813880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.814099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.814811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.815045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.815272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.822944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.824443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.851535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.851765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.854713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.854947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.906017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.906153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.954834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.955064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.955359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:23.955596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.110447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.110672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.110764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.110898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.111762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.135560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.135670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.135796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.135930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.136988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.148026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.148183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.160918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.161990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.162074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.162203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.162283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.162418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81826) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 05 02:10:24.178988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.179193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 02:10:24.179278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.179470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 02:10:24.179551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.179710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 02:10:24.179793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.179977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.180542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 05 02:10:24.180759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.180842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.181042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.181244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.181321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.181395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.181591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.190801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.191915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.199400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.199499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.202313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.202400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.202863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.202952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.203982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.204856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.205069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.205153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.205338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.205418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.227960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.228056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.229449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.229534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.229737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.229822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.234435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.234591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.234715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.234878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.234998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.235159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.241361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.241493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.241647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.241773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.248073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.248292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.248457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.248645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.248787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.249945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.250074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.250200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.250328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.265989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.266277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.267316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.267639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.270095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.271649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.273326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.273841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.275140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.275518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.277959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.279981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.281050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.283179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.284206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.284506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.284791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.285099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.285381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.285664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.286355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.286653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.286936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.287215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.287488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.287764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.301288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.301577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.301843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.302101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.303320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.303610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.303881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.304142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.309435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.310979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.311484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.312519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.312796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.313043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.314569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.314841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.315471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.315758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.316041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.316321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.316714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.317600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.317884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.318481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.318481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.318818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.328820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.329132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.329414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.329695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.330075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.330354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.330642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.330870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.331153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.331431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.331705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.332080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.332366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.332646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.346190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.347906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.349114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.350835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.352130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.353654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.353822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.355130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.355242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.355414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.355820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.356692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.357008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.357407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.362189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.363645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.363735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.365185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.366559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.366953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.367241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.367521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.368702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.369118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.369403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.369679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.375857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.376151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.376444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.377454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.377751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.378027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.383868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81826) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.384153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.384504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.384785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.385088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.385362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.385473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 05 02:10:24.385640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.385760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.385925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.386877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81826) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.387940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.388214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.388595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.388892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.389181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 05 02:10:24.421841 n-d-858272-3 devstack@keystone.service[81826]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de998ca9c0 pid: 81826 (default app) Oct 05 02:10:24.422812 n-d-858272-3 devstack@keystone.service[81827]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de998ca9c0 pid: 81827 (default app) Oct 05 02:10:24.425094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3cad5-ab02-42fe-a450-7385266e0857 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:24.425388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3cad5-ab02-42fe-a450-7385266e0857 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:24.425668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3cad5-ab02-42fe-a450-7385266e0857 None None] PATH_INFO: `/v3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:24.429774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Oct 5 02:10:24 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:31.201904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:31.202427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:31.202534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:31.206963 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:10:31.213602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:31.214065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:31.214223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:31.284267 n-d-858272-3 devstack@keystone.service[81826]: INFO dbcounter [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] Registered counter for database keystone Oct 05 02:10:31.302834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG oslo_db.sqlalchemy.engines [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:10:31.309037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writer thread running {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:10:31.486845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG passlib.handlers.bcrypt [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81826) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 05 02:10:31.487146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG passlib.handlers.bcrypt [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81826) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 05 02:10:31.545015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:31.546600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:31.673103 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 05 02:10:32.173896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:32.242964 n-d-858272-3 devstack@keystone.service[81827]: INFO dbcounter [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] Registered counter for database keystone Oct 05 02:10:32.264697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG oslo_db.sqlalchemy.engines [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 02:10:32.270824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writer thread running {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 02:10:32.390560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa917d1-eef4-4b3b-97cf-7d653750d0ad None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:32.394736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:32.395355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:32.395641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:32.395913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:32.404034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:32.457121 n-d-858272-3 devstack@keystone.service[81827]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 05 02:10:32.457409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39d45c-afaf-4ce7-a82b-ba897c2deaf8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:32.466827 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 5 02:10:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:10:32.472747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:32.489299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcff29-f1e4-4247-bf98-11fcddc64487 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:32.494377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:32.495464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:32.495744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:32.496016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] PATH_INFO: `/v3/projects/d86c8465865f42a8aed631f648876892` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:32.497650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] RBAC: Authorizing `identity:get_project(project_id=d86c8465865f42a8aed631f648876892)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:32.550031 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 05 02:10:32.550381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28259c92-51d6-41d8-b9ed-14632a51b9bf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:32.555368 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Oct 5 02:10:32 2022] GET /identity/v3/projects/d86c8465865f42a8aed631f648876892 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:34.736469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4b0d-95d8-4498-b94c-2df502c33bb2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:34.737022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4b0d-95d8-4498-b94c-2df502c33bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:34.737201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4b0d-95d8-4498-b94c-2df502c33bb2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:34.741130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:34.746662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:34.747063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:34.747231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:34.767433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:34.768998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:34.777713 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 05 02:10:35.049589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c4b0d-95d8-4498-b94c-2df502c33bb2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:35.061666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c4b0d-95d8-4498-b94c-2df502c33bb2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:35.065848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce3d09-a369-4d26-affe-34c90dd7680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:35.066448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce3d09-a369-4d26-affe-34c90dd7680b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:35.066732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce3d09-a369-4d26-affe-34c90dd7680b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:35.067006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce3d09-a369-4d26-affe-34c90dd7680b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:35.075359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce3d09-a369-4d26-affe-34c90dd7680b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:35.077152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce3d09-a369-4d26-affe-34c90dd7680b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:35.085991 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Oct 5 02:10:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:10:35.092226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:35.101264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4da2f-7cf5-43c7-93d7-7c259b5b1fa5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:35.106019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd84d7-bef8-4703-bb40-4f77dead4287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:35.106647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd84d7-bef8-4703-bb40-4f77dead4287 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:35.106939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd84d7-bef8-4703-bb40-4f77dead4287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:35.107220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd84d7-bef8-4703-bb40-4f77dead4287 admin admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:35.108531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd84d7-bef8-4703-bb40-4f77dead4287 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:35.110399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd84d7-bef8-4703-bb40-4f77dead4287 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:35.111903 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Oct 5 02:10:35 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:37.338176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712456-4b26-4102-85b8-641e33e86035 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:37.338714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712456-4b26-4102-85b8-641e33e86035 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:37.338714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712456-4b26-4102-85b8-641e33e86035 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:37.340059 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:37.345409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:37.345820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:37.346075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:37.363796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:37.364991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:37.377996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45388dc-bc24-4a32-b8fc-7a72afe6fb99 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:37.378370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45388dc-bc24-4a32-b8fc-7a72afe6fb99 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:37.378719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45388dc-bc24-4a32-b8fc-7a72afe6fb99 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:37.380114 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:10:37.386463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:37.386749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:37.387021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:37.429616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG passlib.handlers.bcrypt [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81827) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 05 02:10:37.430144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG passlib.handlers.bcrypt [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81827) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 05 02:10:37.446687 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:37.481279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:37.482878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:37.582839 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:37.711120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:37.734541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:37.814990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7e4f5-c191-479d-a8de-6594a14b7748 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:37.847960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:37.848689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:37.849257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:37.849535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:37.849963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:37.861373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:37.870901 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:37.871995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:37.872841 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:10:37.873534 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:37.878018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:37.951013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d4f0e-2988-41de-a517-f8df5d5f5b01 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:37.953557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:37.957558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:37.976067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68ae5d-0e6e-48d3-b11f-d429b077f431 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:37.994301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:37.995178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:37.995460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:37.995736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.012218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:38.012829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:38.013138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:38.013420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.014093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:38.014393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.015786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.027216 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:38.032806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:38.066564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.068075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.130010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882dfd6f-fa4d-44ae-aaeb-ccbd5d2c9540 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:38.161858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:38.162493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:38.162780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:38.163064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.164744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.166103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 02:10:38.166235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.167770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:38 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:38.171610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:38.173000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:38.175262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:38.188269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:38.269894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe0ef7-c1df-40b3-b75b-071988a42896 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:38.274859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c740bd4-3e5a-4304-a3ff-afe5eaf59e75 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:38.304097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:38.305850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:38.306135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:38.306409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.313722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:38.314344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:38.314624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:38.314897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.316010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.317502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.319029 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:38.325045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.325487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:38.326511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:10:38.347113 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:38.348471 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:10:38.349306 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:10:38.349306 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:10:38.349306 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:38.349306 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:38.354140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:38.406186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:38.417371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:38.425557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284883e6-ea27-4602-9a2e-f317b1eed3fc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:38.459743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:38.460343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:38.460876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:38.460876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.461628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.domain.id=default, user.id=ed98d68710e84d4fbf59928bc3712add) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:38.461933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.463368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bbc7-221e-4664-bb9d-7b9a1d093e8f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.463616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5608cfe-789a-44ee-85ce-ee1430f00ee8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:38.469785 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Oct 5 02:10:38 2022] GET /identity/v3/role_assignments?user.id=ed98d68710e84d4fbf59928bc3712add&scope.domain.id=default&role.id=61064a68b37843f5b88e6641075320de => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:38.499872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:38.500508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:38.500796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:38.501107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:38.501774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:38.502086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:38.503521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41342d-7ad1-4a1f-8ef1-aba0127197bb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:38.523229 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:40.909414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016a6a-e3c4-4422-ba08-0b09907ca2f3 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:40.910463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016a6a-e3c4-4422-ba08-0b09907ca2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:40.910924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016a6a-e3c4-4422-ba08-0b09907ca2f3 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:40.912740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:40.934902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f9f4-da56-4844-8c01-c7aa0c107296 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:40.935398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f9f4-da56-4844-8c01-c7aa0c107296 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:40.935473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f9f4-da56-4844-8c01-c7aa0c107296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:40.963017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2140f9f4-da56-4844-8c01-c7aa0c107296 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:40.964222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2140f9f4-da56-4844-8c01-c7aa0c107296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:41.052238 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:41.513557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a710-e5c6-44ec-982a-a73604a0ca8e None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.513846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a710-e5c6-44ec-982a-a73604a0ca8e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.514132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107a710-e5c6-44ec-982a-a73604a0ca8e None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.515644 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:41.526205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.526500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.526781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.549535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:41.550737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:41.574858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a80c-629c-4c50-a5a0-30470870f113 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.575168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a80c-629c-4c50-a5a0-30470870f113 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.575411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189a80c-629c-4c50-a5a0-30470870f113 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.576739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:10:41.601599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f69e2-453f-4dea-9794-b538ce4cc9d0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.602465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f69e2-453f-4dea-9794-b538ce4cc9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.602709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f69e2-453f-4dea-9794-b538ce4cc9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.628401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:41.641330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b73f69e2-453f-4dea-9794-b538ce4cc9d0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:41.642898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b73f69e2-453f-4dea-9794-b538ce4cc9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:41.678405 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 12/26] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:41.679060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:41.764701 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:41.770198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b829fd0-d24c-4345-8d85-7270c7fdf193 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.770489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b829fd0-d24c-4345-8d85-7270c7fdf193 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.770770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b829fd0-d24c-4345-8d85-7270c7fdf193 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.772017 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 16/28] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:41.780570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.780860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.781160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.833915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:41.835467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:41.881298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaec42-2bfb-4c95-bc10-ce7196be6242 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:41.936647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:41.937290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:41.937581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:41.937908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:41.958585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:41.969020 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:41.969948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:41.970713 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 13/29] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:41.971355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:41.998543 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:41.999411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.006028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:42.019056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:42.126512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462999-7c6e-41fc-9ab6-51d325c3c044 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.185868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee3213-4962-4e29-a7eb-2b981cfd9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.186831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee3213-4962-4e29-a7eb-2b981cfd9586 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.187346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee3213-4962-4e29-a7eb-2b981cfd9586 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.187833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee3213-4962-4e29-a7eb-2b981cfd9586 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.188732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee3213-4962-4e29-a7eb-2b981cfd9586 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.190353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee3213-4962-4e29-a7eb-2b981cfd9586 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:42.210049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96586-998c-492d-af2a-53013cd65da9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.280799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.281364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.281652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.281944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.282615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:42.282920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.284313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2006ea8-871e-4341-9ce2-0123d9cbb919 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:42.301463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 18/31] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:42.302804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d5cb-e50d-4d4f-80b3-6ccef1af3d58 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.303092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d5cb-e50d-4d4f-80b3-6ccef1af3d58 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.303370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2d5cb-e50d-4d4f-80b3-6ccef1af3d58 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.308002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 19/32] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:42.308733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d5cb-e50d-4d4f-80b3-6ccef1af3d58 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.383486 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 14/33] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 02:10:41 2022] POST /identity/v3/roles => generated 225 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:42.384283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:42.385470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.385776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.386063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.409829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:42.411438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:42.433578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2d5cb-e50d-4d4f-80b3-6ccef1af3d58 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.484616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.485760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.486338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.486628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.488218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.490511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:42.493000 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 20/34] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:42 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:42.494097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.497933 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 15/35] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:42.500052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.576831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:42.670226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737634c-5dc1-4f09-8436-306fa2c3d6e6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.674256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ebd05-9f99-48b7-8a95-35c13ec366db None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.718571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.719792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.720223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.720670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.721770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.722462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.722818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.723199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.723752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:42.724858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.727036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:42.737841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.739681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:42.748262 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 16/36] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 02:10:42 2022] POST /identity/v3/roles => generated 219 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:42.749520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:10:42.762608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:42.763786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:10:42.764801 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:10:42.764801 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:10:42.764801 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:10:42.767543 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 21/37] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:42.773115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.883605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:42.913493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41596e4a-8680-4dc2-ae30-e92c9e110160 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.933956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f6e6-cc58-4692-832b-f3cdf0c49a69 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:42.952561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.953456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.953802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.954021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.955458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.957037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:42.958848 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 17/38] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:42.960374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:42.980770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:42.981433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:42.981730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:42.982000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:42.982659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:42.982970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:42.984371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:43.007092 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 22/39] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:43.009203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:43.077076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:43.094582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ff44b-f00c-4137-b0ff-d2e6b64bab15 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:43.132245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecb559-4b51-4a4d-a52f-29c2550df2ac None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:43.133977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:43.134528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:43.134812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:43.135090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:43.135768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:43.137196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:43.151414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 18/40] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 02:10:42 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:43.152197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:43.169175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:43.175208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775f97-2912-4775-998a-761489e456e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:43.176188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775f97-2912-4775-998a-761489e456e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:43.176626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775f97-2912-4775-998a-761489e456e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:43.177107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775f97-2912-4775-998a-761489e456e0 None admin] PATH_INFO: `/v3/domains/default/users/ed98d68710e84d4fbf59928bc3712add/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:43.179323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775f97-2912-4775-998a-761489e456e0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ed98d68710e84d4fbf59928bc3712add, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:43.181036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775f97-2912-4775-998a-761489e456e0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:43.265409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47dbe1-f0d1-4ca9-90ae-93dd395de1f3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:43.309359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Oct 5 02:10:43 2022] PUT /identity/v3/domains/default/users/ed98d68710e84d4fbf59928bc3712add/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:10:43.310612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d7420-7110-4871-923d-c86c7b676dbf None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:43.310912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d7420-7110-4871-923d-c86c7b676dbf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:43.311186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d7420-7110-4871-923d-c86c7b676dbf None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:43.316196 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 24/42] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:43.318325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76792992-059b-4363-a464-6b636cc78748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:43.318470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76792992-059b-4363-a464-6b636cc78748 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:43.318736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76792992-059b-4363-a464-6b636cc78748 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:43.319043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76792992-059b-4363-a464-6b636cc78748 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:43.319700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76792992-059b-4363-a464-6b636cc78748 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:43.322181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76792992-059b-4363-a464-6b636cc78748 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:43.323017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:43.323309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:43.323588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:43.346416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:43.348594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:43.357947 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 19/43] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:10:43 2022] POST /identity/v3/projects => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:43.443708 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 25/44] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:43.723299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76792992-059b-4363-a464-6b636cc78748 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:43.787252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:43.822691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76792992-059b-4363-a464-6b636cc78748 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:43.856101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c60842-f450-4e22-962b-abfc4bbb33fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:43.856734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60842-f450-4e22-962b-abfc4bbb33fd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:43.857054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60842-f450-4e22-962b-abfc4bbb33fd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:43.857332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c60842-f450-4e22-962b-abfc4bbb33fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:43.858437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c60842-f450-4e22-962b-abfc4bbb33fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:43.859880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c60842-f450-4e22-962b-abfc4bbb33fd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:43.861462 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 20/45] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:43.866972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:43.902212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:44.072333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d765e-570c-445c-8aeb-eff0226fd30c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:44.105381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7092a-8fad-4570-92ee-fa92d4221360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:44.105991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7092a-8fad-4570-92ee-fa92d4221360 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:44.106274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7092a-8fad-4570-92ee-fa92d4221360 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:44.106550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7092a-8fad-4570-92ee-fa92d4221360 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:44.107216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7092a-8fad-4570-92ee-fa92d4221360 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:44.108795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7092a-8fad-4570-92ee-fa92d4221360 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:44.136612 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 26/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:10:43 2022] POST /identity/v3/projects => generated 312 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:10:45.496340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674312dc-2ae2-4aa0-bd51-b4a53be25303 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:45.496890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674312dc-2ae2-4aa0-bd51-b4a53be25303 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:45.496890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674312dc-2ae2-4aa0-bd51-b4a53be25303 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:45.498288 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 21/47] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:45.503643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:45.504026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:45.504210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:45.522578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:45.524320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:45.589092 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 27/48] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:45.869056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674312dc-2ae2-4aa0-bd51-b4a53be25303 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:45.968835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674312dc-2ae2-4aa0-bd51-b4a53be25303 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:46.001486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:46.002117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.002400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.002673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.004525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:46.013919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:46.018775 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:46.019794 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:46.020556 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 22/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:46.026274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:46.044302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:46.125846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790425d-e0d9-4061-8745-d3e14386ae14 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:46.159553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:46.160194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.160484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.160766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.161505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:46.161818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:46.163282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572287db-6dc3-4ae2-a1a9-ef4486df7e92 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:46.173539 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 28/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:46.179765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:46.280704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79fe1c-c248-4993-99e2-80c7002d7fcd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:46.281120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa6e2-ce07-4d75-8925-bcfb1816f703 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.281419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa6e2-ce07-4d75-8925-bcfb1816f703 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.281703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa6e2-ce07-4d75-8925-bcfb1816f703 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.283055 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 29/51] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:10:46.287768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.288058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.288340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.306135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:46.307549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:46.317147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:46.317787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.318062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.318342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.319694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:46.321921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:46.323493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 23/52] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:46 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:46.329057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:46.373117 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 30/53] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:46.389976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:46.428099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcafa3-55a9-4b5f-8619-7755217c38bf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:46.460180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:46.461444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.461719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.461996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.463112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:46.464564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:46.466140 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 24/54] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:46.471802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:46.483663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:46.571868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021d4d2-26ac-47a7-9b4a-9fbbe7479af4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:46.604547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:46.605188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.605470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.605748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.606474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.domain.id=default, user.id=ed98d68710e84d4fbf59928bc3712add) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:46.606781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:46.608234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:46.613823 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 31/55] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Oct 5 02:10:46 2022] GET /identity/v3/role_assignments?user.id=ed98d68710e84d4fbf59928bc3712add&scope.domain.id=default&role.id=61064a68b37843f5b88e6641075320de => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:46.641751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:46.852669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04a519-0045-40ef-9c0d-d582d74fe645 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:46.880770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:46.887295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da547544-f979-47fc-bba7-7f72e64c5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:46.887922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da547544-f979-47fc-bba7-7f72e64c5e50 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:46.888203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da547544-f979-47fc-bba7-7f72e64c5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:46.888479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da547544-f979-47fc-bba7-7f72e64c5e50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:46.889589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da547544-f979-47fc-bba7-7f72e64c5e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:46.891026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da547544-f979-47fc-bba7-7f72e64c5e50 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:46.892607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 25/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:46.898830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:46.972233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:46.997618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a4ac5-9806-461a-b7b0-7441073a60bb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:47.030569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674a956-15c0-4254-9faa-6e33429933fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:47.031169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a956-15c0-4254-9faa-6e33429933fe None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:47.031455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a956-15c0-4254-9faa-6e33429933fe None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:47.031733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a956-15c0-4254-9faa-6e33429933fe None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:47.032388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674a956-15c0-4254-9faa-6e33429933fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:47.033850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674a956-15c0-4254-9faa-6e33429933fe None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:47.058682 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 32/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 5 02:10:46 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:49.205999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43001c-6a35-4d5c-8565-478248297af7 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:49.206515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43001c-6a35-4d5c-8565-478248297af7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:49.206600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43001c-6a35-4d5c-8565-478248297af7 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:49.207892 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 26/58] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:49.213214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:49.213697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:49.213779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:49.231826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:49.233043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:49.296563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 33/59] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:49.566669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43001c-6a35-4d5c-8565-478248297af7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:49.665937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43001c-6a35-4d5c-8565-478248297af7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:49.699117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70010c68-84bd-41ed-b7b3-f28f1cc52a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:49.699743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010c68-84bd-41ed-b7b3-f28f1cc52a2b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:49.700027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010c68-84bd-41ed-b7b3-f28f1cc52a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:49.700301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70010c68-84bd-41ed-b7b3-f28f1cc52a2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:49.701437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010c68-84bd-41ed-b7b3-f28f1cc52a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:49.703130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70010c68-84bd-41ed-b7b3-f28f1cc52a2b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:49.704706 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 27/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:49.717315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:49.770751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:49.819444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53cea3-7d7f-4cb6-be85-beab3b3ea89e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:49.853409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d6a17-f887-4cc6-9fb9-1b1e4fdd5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:49.854040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d6a17-f887-4cc6-9fb9-1b1e4fdd5a85 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:49.854328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d6a17-f887-4cc6-9fb9-1b1e4fdd5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:49.854602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d6a17-f887-4cc6-9fb9-1b1e4fdd5a85 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:49.855260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d6a17-f887-4cc6-9fb9-1b1e4fdd5a85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:49.856698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d6a17-f887-4cc6-9fb9-1b1e4fdd5a85 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:49.882274 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 34/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:10:49 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:53.221381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd7e8-4447-40b7-91ba-2a9befb2990f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.221901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd7e8-4447-40b7-91ba-2a9befb2990f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.222007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bd7e8-4447-40b7-91ba-2a9befb2990f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.223315 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 28/62] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:53.229272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb657-9180-4adc-8bb6-92984a52fd95 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.230259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb657-9180-4adc-8bb6-92984a52fd95 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.230762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56eb657-9180-4adc-8bb6-92984a52fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.254934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a56eb657-9180-4adc-8bb6-92984a52fd95 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:53.256534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a56eb657-9180-4adc-8bb6-92984a52fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:53.330753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1750a-030a-4f8f-bb80-61dc6219bc85 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.331070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1750a-030a-4f8f-bb80-61dc6219bc85 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.331328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1750a-030a-4f8f-bb80-61dc6219bc85 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.332951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 29/63] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:53.344737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.345054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.345342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.366813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:53.368585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:53.370416 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 35/64] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:53.406302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9bc93-9542-46fc-b1d0-01878d772a18 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.406595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9bc93-9542-46fc-b1d0-01878d772a18 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.406877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9bc93-9542-46fc-b1d0-01878d772a18 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.408229 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 36/65] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:10:53.413284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09654-5fa6-4c84-b773-3ed322d4f7f2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.413578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09654-5fa6-4c84-b773-3ed322d4f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.413863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09654-5fa6-4c84-b773-3ed322d4f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.435778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-53f09654-5fa6-4c84-b773-3ed322d4f7f2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:53.436519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:53.437323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-53f09654-5fa6-4c84-b773-3ed322d4f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:53.463345 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 30/66] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:53.493332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:53.538162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 37/67] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:53.686431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:53.768402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96126-befe-4d7e-8905-ba5b97e2e16a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.768688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96126-befe-4d7e-8905-ba5b97e2e16a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.768881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96126-befe-4d7e-8905-ba5b97e2e16a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.770241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 38/68] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:53.778316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.778604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.778887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.799501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88d5ea-5173-419f-adbe-dc43446ee99a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:53.821914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:53.823118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:53.838502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:53.839643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:53.839935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:53.840219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:53.853736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:53.859003 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:53.859837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:53.860607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 31/69] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:53.866537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:53.917432 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 39/70] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:53.918785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:53.929630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:53.985539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f200f-ff1b-4b74-9b0a-d5e985058901 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.027181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.028112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.028566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.029052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.039701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:54.044448 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:54.045336 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:10:54.046092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:54.050424 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 32/71] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:54.051287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.058785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c1f8-d77d-40aa-946a-902696ce6c0f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.060964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.109644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.110803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.111092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.111751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.112431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:54.112739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.114570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.125248 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 40/72] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:54.125248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.166175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dfd5b-d810-443c-b956-e727155c8a0a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.183655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.202487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5c89c-527d-459e-ad6f-7c6e97dbbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.203370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5c89c-527d-459e-ad6f-7c6e97dbbdce None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.203650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5c89c-527d-459e-ad6f-7c6e97dbbdce None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.203924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5c89c-527d-459e-ad6f-7c6e97dbbdce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.215346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5c89c-527d-459e-ad6f-7c6e97dbbdce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a6b5c89c-527d-459e-ad6f-7c6e97dbbdce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:54.220077 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:54.221033 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 33/73] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:54.222387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885362e5-9289-4554-bc24-1b6ad1f24785 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.223115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885362e5-9289-4554-bc24-1b6ad1f24785 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.223115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885362e5-9289-4554-bc24-1b6ad1f24785 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.224551 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 34/74] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:54.225278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885362e5-9289-4554-bc24-1b6ad1f24785 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.235599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce989e81-5de4-4c9c-9087-9c7cf3cb9c98 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.268276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.268889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.269210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.269489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.270155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:54.270738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.272121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.285167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 41/75] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:54.285167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.312059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.325206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885362e5-9289-4554-bc24-1b6ad1f24785 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.360012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.360640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.360964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.361251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.376632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.378606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.380234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 35/76] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:54.381045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.391570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d53c6-99d0-40a5-afc2-520ac3a3a458 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.413358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.426037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a755d-e812-4ec0-a5ef-66ccfaf8c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.426675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a755d-e812-4ec0-a5ef-66ccfaf8c398 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.426963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a755d-e812-4ec0-a5ef-66ccfaf8c398 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.427247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a755d-e812-4ec0-a5ef-66ccfaf8c398 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.428388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a755d-e812-4ec0-a5ef-66ccfaf8c398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.430242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a755d-e812-4ec0-a5ef-66ccfaf8c398 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.431812 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 42/77] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:54.432930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.433238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.433503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.450744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:54.451925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:54.481499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf462c17-88c0-48d3-85d9-53df05723caf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.514846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.515458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.515744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.516025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.516399 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 43/78] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:54.516698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:54.517038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.517255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.518497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.534231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 36/79] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:54.535044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.548831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.625753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0c3bd-f179-4f29-b8c2-755cc786aff2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.643155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.650983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cfd6c-4831-4ab1-9542-eab6b5be1312 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.671049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.672122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.672390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.672813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.673979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.675459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.677051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 44/80] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:54.681822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.691519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.692309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.692999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.693295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.767632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.769142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.775146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.787112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32be5e-cfcf-42ff-9162-772b3407a3e4 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:54.819971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:54.821204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:54.821489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:54.821764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:54.822427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:54.823875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:54.846723 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 45/81] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:10:54 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:54.847548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.886692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:54.899753 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 37/82] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:10:54.899753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:54.964761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5e791-7252-4273-8858-c98662e82cf3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.006426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.007088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.007369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.008555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.010440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.011940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.018237 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 46/83] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:55.018237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.028676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5ad84-b6cc-4c54-958d-8517d7e201b7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.037561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.074029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.074815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.075389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.075670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.148061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f5a81-da15-442f-a236-0ba7cac05197 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.165936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.170687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.174848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.192084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.192725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.193052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.193330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.209271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:55.216218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:55.217407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:10:55.218173 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 47/84] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:55.218807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.301293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.314275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 38/85] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:10:55.314974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.333468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b731a-63f9-4f69-a2f1-a29bcab31f3d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.368144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.369285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.369776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.370249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.371698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.373489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.375537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 48/86] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:55.376491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.432971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.439414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f4b3b-828a-457f-bc2b-2022c4a1461c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.483540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.484160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.484445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.484722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.491275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806553e4-c9b3-450e-8b0d-f642a4445ff3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.528652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.529675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.530262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.530737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.531601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:55.532118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.533899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.544223 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 49/87] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:55.545631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.567787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.569574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.577263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.665165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b603d0-a09f-4b49-aa0c-7987755add50 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.684846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.693869 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 39/88] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:10:55.694995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.713935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.714592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.714878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.715163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.717066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.718743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.720873 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 50/89] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:55.721506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.821902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:55.828434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33baaeb7-d7f8-419d-80f0-2973d68260a6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.850049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec59e6-1d28-4608-96aa-984b89cd68f5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:55.872131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.872478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.872771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.873081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.873827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=0d2eaab00594469bb62d452f4b394f15) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:55.874148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.875743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.889346 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 40/90] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/role_assignments?user.id=0d2eaab00594469bb62d452f4b394f15&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:55.893205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:55.897889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:55.899404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:55.900447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:55.901255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:55.904591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:55.906531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:55.909213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 51/91] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:55.913811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:56.049054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:56.133052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e4801-d126-42ed-ae6b-5b6c93c7a538 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:56.133629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f14b34-793a-4eda-9845-2b317c78a4dd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:56.171303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:56.172170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:56.172598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:56.173057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:56.174463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:56.176157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:56.177715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:56.178156 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 41/92] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:56.178537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:56.178922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:56.179299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:56.180236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:56.181107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=ed98d68710e84d4fbf59928bc3712add) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:56.181501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:56.183106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:56.198907 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 52/93] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:10:55 2022] GET /identity/v3/role_assignments?user.id=ed98d68710e84d4fbf59928bc3712add&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:56.199882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:56.214914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:56.295844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba70ed8-5a95-4c76-b187-9220301762ec None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:56.326480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:56.336625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:56.337885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:56.338314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:56.338740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:56.340465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a576c51-e28c-45b8-9f82-322e3c45a134 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:56.380142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:56.380974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:56.381365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:56.381874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:56.382838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] RBAC: Adding query filter params (role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=0d2eaab00594469bb62d452f4b394f15) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:56.383482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:56.385287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:56.392273 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 53/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:10:56 2022] GET /identity/v3/role_assignments?user.id=0d2eaab00594469bb62d452f4b394f15&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:56.422189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:56.424087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:56.542571 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 42/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:10:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:10:56.548526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:56.628283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:56.674034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b780-1f46-4633-84e8-02e29452e9ba None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:56.720339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1488670-70a9-4d38-b1b0-90cd79358b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:56.721045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488670-70a9-4d38-b1b0-90cd79358b17 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:56.721335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488670-70a9-4d38-b1b0-90cd79358b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:56.721684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488670-70a9-4d38-b1b0-90cd79358b17 None admin] PATH_INFO: `/v3/projects/7c62ad40d62a40beb70666eef1a775c9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:56.722888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1488670-70a9-4d38-b1b0-90cd79358b17 None admin] RBAC: Authorizing `identity:get_project(project_id=7c62ad40d62a40beb70666eef1a775c9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:56.724481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1488670-70a9-4d38-b1b0-90cd79358b17 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:56.726159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 54/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:10:56 2022] GET /identity/v3/projects/7c62ad40d62a40beb70666eef1a775c9 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:56.733532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:56.763134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:56.840933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b0c8-3c5c-465f-b5e6-997db3dbb12c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:56.877814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:56.878482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:56.878712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:56.878996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:56.879731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=7c62ad40d62a40beb70666eef1a775c9, user.id=0d2eaab00594469bb62d452f4b394f15) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:56.880044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:56.881535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926beed-149c-47a4-9157-cbe845fa43a1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:56.887547 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 43/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:10:56 2022] GET /identity/v3/role_assignments?user.id=0d2eaab00594469bb62d452f4b394f15&scope.project.id=7c62ad40d62a40beb70666eef1a775c9&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:57.691427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e376f7-2377-4e5f-a6b9-f31c637736eb None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:57.692385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e376f7-2377-4e5f-a6b9-f31c637736eb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:57.692866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e376f7-2377-4e5f-a6b9-f31c637736eb None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:57.694461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 55/98] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:57.700677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:57.702845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:57.703601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:57.723657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:57.725224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:57.753507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589765-8f5a-42b2-bfe6-d15872df66fd None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:57.754114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589765-8f5a-42b2-bfe6-d15872df66fd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:57.754617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589765-8f5a-42b2-bfe6-d15872df66fd None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:57.756147 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 56/99] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:10:57.773871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013366-6266-4162-83a5-21f72c5222bc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:57.774470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013366-6266-4162-83a5-21f72c5222bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:57.774945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013366-6266-4162-83a5-21f72c5222bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:57.799939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-00013366-6266-4162-83a5-21f72c5222bc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:57.806784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00013366-6266-4162-83a5-21f72c5222bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:57.873030 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 44/100] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:57.900103 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 57/101] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:58.308294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:58.333681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:58.410789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50050-533d-4d2c-abad-641b04670f1d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:58.422374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013366-6266-4162-83a5-21f72c5222bc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:58.470556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:58.471542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:58.472072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:58.472354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:58.501821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:10:58.506729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:10:58.508376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:10:58.509269 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 45/102] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:10:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:10:58.518182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:58.521556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:58.558797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013366-6266-4162-83a5-21f72c5222bc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:58.598013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:58.599006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:58.599488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:58.599959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:58.601618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:58.603591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:58.605650 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 58/103] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:10:58.611386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:58.689772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:58.728191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56272d-1c07-42f9-a779-9c7eb98a4b7c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:58.807189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:58.807812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:58.808097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:58.808374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:58.809135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:10:58.809389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:58.811603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:58.834185 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 46/104] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:10:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:58.841319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:58.850865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718f750-13c7-472d-8359-3d59b891d111 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:58.937617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:58.938511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:58.938938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:58.939356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:58.940165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:58.941779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:58.960154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:59.017327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 59/105] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:10:58 2022] POST /identity/v3/projects => generated 302 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:10:59.071515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9d5c-fccf-4062-912e-3c3c00035956 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:59.116488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5453c-4f70-4dd7-87ce-eda2718a6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:59.118217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5453c-4f70-4dd7-87ce-eda2718a6644 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.118671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5453c-4f70-4dd7-87ce-eda2718a6644 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.119095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5453c-4f70-4dd7-87ce-eda2718a6644 None admin] PATH_INFO: `/v3/users/0a498ef7531241fc8640d314982c1fce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.138548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5453c-4f70-4dd7-87ce-eda2718a6644 None admin] RBAC: Authorizing `identity:get_user(user_id=0a498ef7531241fc8640d314982c1fce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:59.140115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5453c-4f70-4dd7-87ce-eda2718a6644 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:59.141897 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 47/106] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:10:58 2022] GET /identity/v3/users/0a498ef7531241fc8640d314982c1fce => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:10:59.149881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:59.317058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e4813-4a00-477b-8105-a27b5a4fcb9b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:59.374577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:10:59.375848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.376508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.377234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.472116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:59.478465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191484f9-a578-4a23-b5ed-80c7a0636771 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.478757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191484f9-a578-4a23-b5ed-80c7a0636771 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.479044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191484f9-a578-4a23-b5ed-80c7a0636771 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.480396 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 48/107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:59.490538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:10:59.490720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0d01-7656-4e3e-9198-1568e29c2ab7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.490825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0d01-7656-4e3e-9198-1568e29c2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.491336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0d01-7656-4e3e-9198-1568e29c2ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.493070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:10:59.498985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:59.513995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-57be0d01-7656-4e3e-9198-1568e29c2ab7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:59.515190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-57be0d01-7656-4e3e-9198-1568e29c2ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:59.645789 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 49/108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:10:59.647028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c0d0-6302-4fbd-adca-d6559d063e10 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.647326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c0d0-6302-4fbd-adca-d6559d063e10 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.647612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804c0d0-6302-4fbd-adca-d6559d063e10 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.651460 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 50/109] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:59.657006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19a1e-dd6f-49c2-aca2-0c59770298a5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.657519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19a1e-dd6f-49c2-aca2-0c59770298a5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.657948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19a1e-dd6f-49c2-aca2-0c59770298a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.668861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 60/110] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:10:59.673169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:10:59.684816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e8f19a1e-dd6f-49c2-aca2-0c59770298a5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:59.686851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8f19a1e-dd6f-49c2-aca2-0c59770298a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:59.786917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 51/111] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:10:59.789318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032f0b-7e7e-4a33-8476-104d03c2a676 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.790054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032f0b-7e7e-4a33-8476-104d03c2a676 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.790462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4032f0b-7e7e-4a33-8476-104d03c2a676 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.792243 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 52/112] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:10:59.798886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164b82-efc9-43ba-8a54-682658760940 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:10:59.799412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164b82-efc9-43ba-8a54-682658760940 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:10:59.799862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25164b82-efc9-43ba-8a54-682658760940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:10:59.834565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-25164b82-efc9-43ba-8a54-682658760940 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:10:59.836280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-25164b82-efc9-43ba-8a54-682658760940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:10:59.910748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:59.942486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666f23-b963-4072-990a-c4e3a3f1b392 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:10:59.962383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:10:59.980846 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 53/113] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:00.025385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.026041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.026325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.026606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.033700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:00.035187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:00.036916 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 61/114] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:10:59 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:00.043515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164b82-efc9-43ba-8a54-682658760940 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.113674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.264668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6467-f4d6-4f1d-bc3a-36dc71f2850a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:00.277479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25164b82-efc9-43ba-8a54-682658760940 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:00.337243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2989a-92b8-4411-9a76-a52368bc75ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.338751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2989a-92b8-4411-9a76-a52368bc75ae None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.339583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2989a-92b8-4411-9a76-a52368bc75ae None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.340527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2989a-92b8-4411-9a76-a52368bc75ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.345551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.346392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.348991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.349472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.350401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] RBAC: Adding query filter params (role.id=378dbb9d27a14004ab139fb7a260a390, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=0a498ef7531241fc8640d314982c1fce) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:00.350907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:00.353232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:00.361848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2989a-92b8-4411-9a76-a52368bc75ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:00.368397 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 54/115] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/role_assignments?user.id=0a498ef7531241fc8640d314982c1fce&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=378dbb9d27a14004ab139fb7a260a390 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a2e2989a-92b8-4411-9a76-a52368bc75ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:00.369084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:00.370101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:00.370862 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:00.371431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.373209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 62/116] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:00.378941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df1cc3-9f2c-44d9-9258-71500c107f10 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.379519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df1cc3-9f2c-44d9-9258-71500c107f10 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.379993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df1cc3-9f2c-44d9-9258-71500c107f10 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.381632 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 63/117] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:00.386075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df1cc3-9f2c-44d9-9258-71500c107f10 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.420170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:00.467942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:00.522912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df1cc3-9f2c-44d9-9258-71500c107f10 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:00.526612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14cdf0-b1a5-45ca-8080-5510a949804c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:00.563850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.565072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.565407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.565798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.566604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:00.566917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:00.567954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.568339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4ebe-a967-47aa-b61d-74ffe08a2c61 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:00.568590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.568873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.569181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.579501 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 64/118] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:00.581127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.581804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.582282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.588996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:00.594528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:00.595472 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:00.596240 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 55/119] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:00.596876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.612937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:00.614141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:00.697617 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:00.698906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.709347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:00.720871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ee4ef-b77c-43c4-95b1-09f995696492 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:00.740931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:00.766652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.767812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.768242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.768662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.782578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:00.788550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:00.790562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:00.791515 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:00.794065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 56/121] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:00.794995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.819003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c20ad9-4279-46f3-be25-934ef2941898 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:00.886846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:00.887730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:00.889468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:00.889920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:00.892083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:00.894866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:00.897766 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 66/122] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:00.901239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:00.982610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9400b-ed41-4e62-83c9-c62189067074 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.027446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.028064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.028344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.028618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.029319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:01.029623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.031071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.040479 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 57/123] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.041183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.055996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.089319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.105881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b595849-a373-4ab8-b6d5-80fb37f75171 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.153903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.154856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.155337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.155834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.157255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:01.158040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.160285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.169947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf611e4-66b8-4e43-a258-561029d9f104 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.171822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 67/124] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.177273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.219429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.220069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.220353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.220628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.222004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.224283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.226014 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 58/125] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.229666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.311480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf539a2-af29-4f6f-a30b-87ec36fafc27 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.348692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.349381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.349848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.349951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.351047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.353255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.355017 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 68/126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.359943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.362330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3ef31-9573-4533-b869-ad85e295673a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.371769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.373086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.411569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.412206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.412487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.412760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.427208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:01.434740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:01.435624 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:01.436398 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 59/127] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:01.437077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.490952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb694-2819-43c1-b4e7-ad6664642398 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.527036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.527681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.527952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.528233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.529417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.530883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.536878 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 69/128] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.536878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.558274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2e01-c66e-4be5-8bc7-4f5eafeff25a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.604156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.604779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.605157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.605436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/ed98d68710e84d4fbf59928bc3712add/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.608365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f7e1221a2e4593bf4d129297775e1a, user_id=ed98d68710e84d4fbf59928bc3712add, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.610248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.630560 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 60/129] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:01 2022] PUT /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/ed98d68710e84d4fbf59928bc3712add/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:01.631709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.633953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.672859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661315b-e753-4000-a62c-9cde1ae2877e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.687887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.719104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.720286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.720768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.721314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.722835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.724673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.726828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 70/130] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.733020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.788034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96162d-70d0-4500-b744-e65b9247c975 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.839904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.839904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.839904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.839904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.840730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:01.840730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.840730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.852477 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 61/131] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.857032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.925918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b211449-765b-4739-99ff-8f5e6d91618f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:01.962503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:01.963515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:01.964077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:01.964693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:01.966106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:01.967663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:01.969125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:01.971167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 71/132] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:01.977131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:01.980579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ceb72-6106-46db-9bc2-0fc7540e44a1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:02.018316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d93ae-15b2-47fd-bf6c-9869b0e1d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:02.018978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d93ae-15b2-47fd-bf6c-9869b0e1d654 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.019259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d93ae-15b2-47fd-bf6c-9869b0e1d654 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.019536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d93ae-15b2-47fd-bf6c-9869b0e1d654 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/0d2eaab00594469bb62d452f4b394f15/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.021475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d93ae-15b2-47fd-bf6c-9869b0e1d654 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f7e1221a2e4593bf4d129297775e1a, user_id=0d2eaab00594469bb62d452f4b394f15, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:02.021973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:02.022940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d93ae-15b2-47fd-bf6c-9869b0e1d654 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:02.040058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 62/133] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:01 2022] PUT /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/0d2eaab00594469bb62d452f4b394f15/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:02.045027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21636717-dc1b-4a86-974d-64609260d94e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.045027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21636717-dc1b-4a86-974d-64609260d94e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.045027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21636717-dc1b-4a86-974d-64609260d94e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.045027 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 63/134] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:02.045027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21636717-dc1b-4a86-974d-64609260d94e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:02.113495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa9ccc-083c-4a6d-9e86-81af80f41e2b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:02.154175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad1610-355f-45bd-adec-8522558f8ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:02.155366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1610-355f-45bd-adec-8522558f8ada None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.155811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1610-355f-45bd-adec-8522558f8ada None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.156099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad1610-355f-45bd-adec-8522558f8ada None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.157378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad1610-355f-45bd-adec-8522558f8ada None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:02.158939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad1610-355f-45bd-adec-8522558f8ada None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:02.160808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 72/135] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:01 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:02.162249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.162586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.162862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.184336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:02.185618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:02.270283 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 73/136] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:02.271594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:02.284517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:02.295492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21636717-dc1b-4a86-974d-64609260d94e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:02.337427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:02.338507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.339092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.339374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/0d2eaab00594469bb62d452f4b394f15/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.341580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f7e1221a2e4593bf4d129297775e1a, user_id=0d2eaab00594469bb62d452f4b394f15, role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:02.343153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:02.364893 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 64/137] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:02 2022] PUT /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/0d2eaab00594469bb62d452f4b394f15/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:02.407839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da0fc2-a244-4dfd-80c6-3690731f9cad None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:02.447785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:02.448766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.449285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.449769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] PATH_INFO: `/v3/projects/7c62ad40d62a40beb70666eef1a775c9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.451478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] RBAC: Authorizing `identity:get_project(project_id=7c62ad40d62a40beb70666eef1a775c9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:02.453442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:02.455266 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 74/138] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:02 2022] GET /identity/v3/projects/7c62ad40d62a40beb70666eef1a775c9 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:02.461336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:02.473774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:02.589526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4272b1-36fc-4d16-a4ac-1af9e4f1c9bc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:02.631216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:02.632230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.632995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.633655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] PATH_INFO: `/v3/projects/7c62ad40d62a40beb70666eef1a775c9/users/0d2eaab00594469bb62d452f4b394f15/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.635812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] RBAC: Authorizing `identity:create_grant(project_id=7c62ad40d62a40beb70666eef1a775c9, user_id=0d2eaab00594469bb62d452f4b394f15, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:02.637484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:02.672734 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 65/139] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:02 2022] PUT /identity/v3/projects/7c62ad40d62a40beb70666eef1a775c9/users/0d2eaab00594469bb62d452f4b394f15/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:02.826477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:02.927111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:02.951808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d4034-05d1-4c99-938d-bf58a8c0e425 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:02.990095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2958e-e4ec-4fd5-8b6a-96a8ebf4019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:02.990735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2958e-e4ec-4fd5-8b6a-96a8ebf4019b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:02.991016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2958e-e4ec-4fd5-8b6a-96a8ebf4019b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:02.991288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2958e-e4ec-4fd5-8b6a-96a8ebf4019b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:02.992524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2958e-e4ec-4fd5-8b6a-96a8ebf4019b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:02.994136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2958e-e4ec-4fd5-8b6a-96a8ebf4019b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:02.995893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 75/140] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:03.001273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:03.109226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:03.114403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c4162-9dde-4d09-a19d-ebcd4caf59d7 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:03.115427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c4162-9dde-4d09-a19d-ebcd4caf59d7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:03.115903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c4162-9dde-4d09-a19d-ebcd4caf59d7 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:03.118653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 76/141] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:03.127438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:03.128024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:03.128579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:03.157717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:03.158918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:03.168348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7defde4-5826-476b-bc56-fbd08729259c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:03.238347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:03.238880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:03.239164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:03.239442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:03.241096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:03.242856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:03.293354 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 77/142] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 05 02:11:03.300559 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 66/143] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:03 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:03.576521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:03.687277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:03.720660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7122d0-264a-4ed4-aadc-d272b466fcd1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:03.763536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:03.764187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:03.764724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:03.765056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:03.776066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:03.780856 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:03.781888 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:03.783307 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 78/144] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:03.791085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:03.896063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fc188-d1b0-41a8-ac42-9f708cf50c6c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:03.922104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:03.934808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:03.935940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:03.936806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:03.937152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:03.937843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:03.938165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:03.939884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:03.949948 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 67/145] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:03.955856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:04.065986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a2c00-f530-4a82-9b94-1bf41aa760ad None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:04.105430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:04.106074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:04.106349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:04.106662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] PATH_INFO: `/v3/users/0a498ef7531241fc8640d314982c1fce` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:04.107754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] RBAC: Authorizing `identity:get_user(user_id=0a498ef7531241fc8640d314982c1fce)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:04.109228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:04.110786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 79/146] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:03 2022] GET /identity/v3/users/0a498ef7531241fc8640d314982c1fce => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:04.116629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:04.230568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446c8b2-1765-4d8f-8fdf-5e66c93e2b18 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:04.265251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a25be-1b73-4d8c-9747-9fed0efdac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:04.265889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a25be-1b73-4d8c-9747-9fed0efdac42 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:04.266171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a25be-1b73-4d8c-9747-9fed0efdac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:04.266448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a25be-1b73-4d8c-9747-9fed0efdac42 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:04.267590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a25be-1b73-4d8c-9747-9fed0efdac42 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:04.269064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a25be-1b73-4d8c-9747-9fed0efdac42 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:04.275917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 68/147] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:04 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:04.277259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:04.280187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:04.391743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3b1f-d7a2-429f-b610-1c37a50fabea None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:04.428594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a0c1-16d2-492f-9568-868d14f55cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:04.429419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a0c1-16d2-492f-9568-868d14f55cc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:04.429868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a0c1-16d2-492f-9568-868d14f55cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:04.430168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a0c1-16d2-492f-9568-868d14f55cc1 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/0a498ef7531241fc8640d314982c1fce/roles/378dbb9d27a14004ab139fb7a260a390` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:04.432098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a0c1-16d2-492f-9568-868d14f55cc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f7e1221a2e4593bf4d129297775e1a, user_id=0a498ef7531241fc8640d314982c1fce, role_id=378dbb9d27a14004ab139fb7a260a390)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:04.433618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a0c1-16d2-492f-9568-868d14f55cc1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:04.451293 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 80/148] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:04 2022] PUT /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/users/0a498ef7531241fc8640d314982c1fce/roles/378dbb9d27a14004ab139fb7a260a390 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:04.869396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1902c-6982-4b35-9f89-c5a10dfefe15 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:04.870000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1902c-6982-4b35-9f89-c5a10dfefe15 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:04.870419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1902c-6982-4b35-9f89-c5a10dfefe15 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:04.871895 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 69/149] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:04.877554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb435-eba0-4c70-bddf-1dc65e5060a3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:04.877840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb435-eba0-4c70-bddf-1dc65e5060a3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:04.878118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bb435-eba0-4c70-bddf-1dc65e5060a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:04.901578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c32bb435-eba0-4c70-bddf-1dc65e5060a3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:04.902772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c32bb435-eba0-4c70-bddf-1dc65e5060a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:04.975478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:04.987579 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 81/150] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:05.276723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66012-ee42-4155-9a91-7878907b649a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:05.277819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66012-ee42-4155-9a91-7878907b649a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:05.278105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c66012-ee42-4155-9a91-7878907b649a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:05.279876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 70/151] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:05.285526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:05.285991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:05.286081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:05.313910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:05.315127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:05.391158 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 82/152] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:05.616138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66012-ee42-4155-9a91-7878907b649a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:05.692688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:05.745775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c66012-ee42-4155-9a91-7878907b649a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:05.781214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:05.782072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:05.782356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:05.782676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:05.794636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:05.800211 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:05.801746 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:05.803275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 71/153] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:05.814106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:05.962353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa82ec-e4ea-4b58-8b1c-fec42da66caa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:05.991765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:06.004841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:06.005488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.005767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.006039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.006711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:06.007012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:06.009045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:06.020421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 83/154] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:06.026552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:06.087639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:06.179164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bfe61-7fb5-4580-a870-74549e8e0bc0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:06.207019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:06.250026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cad4b9-d937-4eca-a0ac-f3eedd032e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:06.250902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cad4b9-d937-4eca-a0ac-f3eedd032e8c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.251340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cad4b9-d937-4eca-a0ac-f3eedd032e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.251761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cad4b9-d937-4eca-a0ac-f3eedd032e8c None admin] PATH_INFO: `/v3/users/ed98d68710e84d4fbf59928bc3712add` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.254127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cad4b9-d937-4eca-a0ac-f3eedd032e8c None admin] RBAC: Authorizing `identity:get_user(user_id=ed98d68710e84d4fbf59928bc3712add)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:06.259930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cad4b9-d937-4eca-a0ac-f3eedd032e8c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:06.261790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 72/155] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:06 2022] GET /identity/v3/users/ed98d68710e84d4fbf59928bc3712add => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:06.263098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d749fc-9960-400e-8c72-fa343c150363 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.265249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d749fc-9960-400e-8c72-fa343c150363 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.265677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d749fc-9960-400e-8c72-fa343c150363 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.267068 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 73/156] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:06.268101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d749fc-9960-400e-8c72-fa343c150363 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:06.309892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853157ab-4d9d-4ff4-a92d-0af76d63afbf None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:06.387410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d749fc-9960-400e-8c72-fa343c150363 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:06.398554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1dcb5-4449-4b13-aaae-2578d93b0e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:06.400467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1dcb5-4449-4b13-aaae-2578d93b0e96 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.401173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1dcb5-4449-4b13-aaae-2578d93b0e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.402241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1dcb5-4449-4b13-aaae-2578d93b0e96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.415151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1dcb5-4449-4b13-aaae-2578d93b0e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ebe1dcb5-4449-4b13-aaae-2578d93b0e96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:06.420821 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:06.422012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:06.422994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:06.424994 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 84/157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:06.426400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28079-fb78-4165-b477-0512e47068ae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.426980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28079-fb78-4165-b477-0512e47068ae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.427448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28079-fb78-4165-b477-0512e47068ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.448328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1cc28079-fb78-4165-b477-0512e47068ae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:06.449878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1cc28079-fb78-4165-b477-0512e47068ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:06.464307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:06.465069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.465572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.466051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.520526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:06.570460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:06.577537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 85/158] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:06.579341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0f0a0-c0d9-45b6-b05f-880f0979a549 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.579920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0f0a0-c0d9-45b6-b05f-880f0979a549 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.580434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0f0a0-c0d9-45b6-b05f-880f0979a549 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.582010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 86/159] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:06.582920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0f0a0-c0d9-45b6-b05f-880f0979a549 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:06.608251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:06.609752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:06.701433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0f0a0-c0d9-45b6-b05f-880f0979a549 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:06.738963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:06.739974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.740504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.741038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.742573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:06.743127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:06.744919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62241534-6b0d-476f-8802-14bf531ca941 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:06.757079 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 87/160] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:06.759596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:06.760106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:06.760586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:06.763492 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 74/161] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:06.767617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:06.784164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:06.785813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:06.820364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:06.875830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 88/162] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:06.877388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:06.999825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:07.036930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e09ec-d65e-4a47-8876-8286aefe99de None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.088591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d534f-01fa-45a2-a4b1-cc170568125e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.113632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.114273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.114547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.114835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.115997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:07.118246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:07.120836 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 75/163] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:06 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:07.126029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.158393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999557ff-b971-4086-928d-dd2276869226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.159459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999557ff-b971-4086-928d-dd2276869226 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.159996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999557ff-b971-4086-928d-dd2276869226 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.160470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999557ff-b971-4086-928d-dd2276869226 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.166196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999557ff-b971-4086-928d-dd2276869226 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:07.168169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999557ff-b971-4086-928d-dd2276869226 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:07.170325 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 89/164] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:06 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:07.182824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999557ff-b971-4086-928d-dd2276869226 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.252378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:07.326881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999557ff-b971-4086-928d-dd2276869226 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.356869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f1f89-81ac-4b5a-8a6e-ef4d6febc967 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.365039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.366008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.366495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.366993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.367917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=ed98d68710e84d4fbf59928bc3712add) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:07.368492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:07.370168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:07.377072 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 90/165] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/role_assignments?user.id=ed98d68710e84d4fbf59928bc3712add&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:07.378126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.422726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.423293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.423372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.423632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.459810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:07.486701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:07.491150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2f66c-3157-440b-a5fd-857774a1a453 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.547017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:07.547949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:07.548509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.549426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.550034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.550524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.566681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:07.577056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:07.578054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:07.579237 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:07.589189 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 91/166] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:07.590009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.714006 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 76/167] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 02:11:07.715005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.795931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:07.888327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc26ee-2152-426a-aedf-bfc24426f7be None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.891009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6e84-92a2-40f2-9e31-9941528ae755 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:07.936020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.936666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.936974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.937258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.940767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:07.941539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:07.941917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:07.942559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:07.943535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:07.943939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:07.946733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:07.953791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:07.957451 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 77/168] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:07.958439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:07.959397 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:07.960289 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:07.961371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 92/169] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:07.966082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:07.989726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:08.112500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1afa8-7e46-4bcd-91f5-a34f757164f0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:08.137268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:08.144932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf710b-17be-4ce0-b84b-a4012efa6aa3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:08.192005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:08.192663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.192977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.193260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.198688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:08.199911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:08.201628 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 78/170] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:08.202400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:08.221680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:08.222338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.222619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.222896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.225602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:08.227129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:08.228998 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 93/171] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:07 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:08.229592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:08.391605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab874e2-b696-4a62-85e6-39307b2583bb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:08.437382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:08.453369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:08.454336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.454621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.455175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.455852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:08.456157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:08.457630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:08.464678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab1f99-0cc4-41a9-b056-38ccf2430ac1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:08.476323 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 79/172] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:08.477371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:08.551023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:08.551643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.551927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.552207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.552969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=0d2eaab00594469bb62d452f4b394f15) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:08.553284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:08.554717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:08.554904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:08.571295 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 94/173] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:08 2022] GET /identity/v3/role_assignments?user.id=0d2eaab00594469bb62d452f4b394f15&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:08.571959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:08.691264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c81049-e5df-447d-bf28-f7e1a0892169 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:08.746422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:08.747073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.747357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.747637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.794666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbf422-29f9-47b7-9b6f-b9e96fb5ec91 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:08.833778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:08.835381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:08.863473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0fc20-a85e-42dd-8ed2-bdbba479c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:08.864518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0fc20-a85e-42dd-8ed2-bdbba479c201 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.865028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0fc20-a85e-42dd-8ed2-bdbba479c201 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.865518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0fc20-a85e-42dd-8ed2-bdbba479c201 None admin] PATH_INFO: `/v3/users/0d2eaab00594469bb62d452f4b394f15` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.869861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0fc20-a85e-42dd-8ed2-bdbba479c201 None admin] RBAC: Authorizing `identity:get_user(user_id=0d2eaab00594469bb62d452f4b394f15)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:08.871730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0fc20-a85e-42dd-8ed2-bdbba479c201 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:08.874090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 95/174] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:08 2022] GET /identity/v3/users/0d2eaab00594469bb62d452f4b394f15 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:08.875529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427ed27-66c1-45c0-ad20-6c7db03e2150 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.876022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427ed27-66c1-45c0-ad20-6c7db03e2150 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.876505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427ed27-66c1-45c0-ad20-6c7db03e2150 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.884796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:08.885117 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 96/175] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:08.890379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:08.890905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:08.891537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:08.930220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:08.931934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:08.951649 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 80/176] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:08.952434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:08.957880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.030142 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 97/177] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:09.031331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.077531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee24c22-cd05-4bbf-aa2e-9ca09039b9b3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.123211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d3ae7-b87f-4bb6-96a1-083d37e4ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.123863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d3ae7-b87f-4bb6-96a1-083d37e4ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.124581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d3ae7-b87f-4bb6-96a1-083d37e4ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.124861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d3ae7-b87f-4bb6-96a1-083d37e4ffa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.136999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1a5ae-a633-4d94-8bc3-209d019ae005 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.145650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.175337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962006e8-8047-4ef3-872e-c92aba4a8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.176351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962006e8-8047-4ef3-872e-c92aba4a8c06 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.176980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962006e8-8047-4ef3-872e-c92aba4a8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.177458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962006e8-8047-4ef3-872e-c92aba4a8c06 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.178880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962006e8-8047-4ef3-872e-c92aba4a8c06 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:09.180798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962006e8-8047-4ef3-872e-c92aba4a8c06 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:09.183375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 98/178] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:09.188941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbad2a-67ea-4a39-b800-9684b5023eb0 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.189832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbad2a-67ea-4a39-b800-9684b5023eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.190312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbad2a-67ea-4a39-b800-9684b5023eb0 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.192121 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 99/179] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:09.193858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678feb-e00b-4798-9c3a-d9dd919faf89 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.194399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678feb-e00b-4798-9c3a-d9dd919faf89 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.195267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4678feb-e00b-4798-9c3a-d9dd919faf89 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.198272 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 100/180] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:09.199860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.200410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.200990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.227918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:09.229495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:09.230752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d3ae7-b87f-4bb6-96a1-083d37e4ffa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:09.232477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d3ae7-b87f-4bb6-96a1-083d37e4ffa6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:09.261306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.303391 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 101/181] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:09.305392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.361969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 81/182] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:09.363851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.364143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.364418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.388231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:09.389440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:09.415642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56ddf1-0839-482d-b165-f06fce93f465 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.430596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.451837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.452745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.453367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.453788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.454518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] RBAC: Adding query filter params (role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=0d2eaab00594469bb62d452f4b394f15) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:09.454825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:09.456264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab7f7d-1b10-407b-807b-38398198c674 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:09.462749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 102/183] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/role_assignments?user.id=0d2eaab00594469bb62d452f4b394f15&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:09.463862 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 82/184] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:09.464595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.477305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34503-8381-455d-8f3a-bfa2989988bc None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.477305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34503-8381-455d-8f3a-bfa2989988bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.477305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34503-8381-455d-8f3a-bfa2989988bc None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.477305 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 103/185] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:09 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:09.477832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34503-8381-455d-8f3a-bfa2989988bc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.510890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.580463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4c99-6c5e-4f26-b113-21e0d04c32dc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.619717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93775b03-704f-4c64-9a89-a2358a50a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.620401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93775b03-704f-4c64-9a89-a2358a50a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.620679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93775b03-704f-4c64-9a89-a2358a50a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.620990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93775b03-704f-4c64-9a89-a2358a50a4f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.633328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93775b03-704f-4c64-9a89-a2358a50a4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-93775b03-704f-4c64-9a89-a2358a50a4f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:09.638659 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:09.639613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:09.640410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 83/186] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:09.641127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.644958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.644958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.671934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:09.673501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:09.679462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34503-8381-455d-8f3a-bfa2989988bc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.708590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.729200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.730199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.730481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.730752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] PATH_INFO: `/v3/projects/7c62ad40d62a40beb70666eef1a775c9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.732512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] RBAC: Authorizing `identity:get_project(project_id=7c62ad40d62a40beb70666eef1a775c9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:09.735670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:09.738559 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 104/187] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/projects/7c62ad40d62a40beb70666eef1a775c9 => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:09.739627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.759671 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 84/188] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:09.760540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.834194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:09.861132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c815a-ecec-4beb-8532-d068f72b2a6f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.878619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8276cd-69ec-4eb8-ad32-14914282d65a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:09.897767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.898538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.899117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.899117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.900230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:09.901837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:09.903562 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 105/189] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:09.904265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.918254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:09.918865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:09.919145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:09.919426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:09.920102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:09.920399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:09.921884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:09.931404 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 85/190] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:09.932036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:09.963661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.009017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d0fc-df04-44b8-9c27-0ed63f200d8e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.044532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.045195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.045477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.045573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fba8b-7c4e-48a1-a005-c26184f36ea9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.045747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.056859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:10.061706 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:10.062758 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 106/191] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:10.065741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.072663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.083617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.084280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.084495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.084764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.085587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=7c62ad40d62a40beb70666eef1a775c9, user.id=0d2eaab00594469bb62d452f4b394f15) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:10.086138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.087578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.093237 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 86/192] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:09 2022] GET /identity/v3/role_assignments?user.id=0d2eaab00594469bb62d452f4b394f15&scope.project.id=7c62ad40d62a40beb70666eef1a775c9&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:10.094020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.169125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760538-ab1d-4437-8f13-e1fe7f6864e0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.193449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.206840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.207461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.207741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.208017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.208688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.208791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff45e41-a6b0-4793-b089-9aa12beca3cb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.210213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.237711 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 107/193] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:10 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:10.245174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.260024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.260947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.261296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.261677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] PATH_INFO: `/v3/users/0a498ef7531241fc8640d314982c1fce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.263066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] RBAC: Authorizing `identity:get_user(user_id=0a498ef7531241fc8640d314982c1fce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.264942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.266963 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 87/194] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/users/0a498ef7531241fc8640d314982c1fce => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:10.267902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.327303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.385834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049954b2-4e7e-4920-8464-f1c3085391c6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.414187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd1fa-c2e0-406e-adc2-15c69b91fe1e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.438019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.438229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.438335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.438610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.450950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:10.457281 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:10.458599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:10.459389 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 108/195] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:10.460040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.462276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.462899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.463181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.463459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.464421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:10.464951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.466564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.477084 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 88/196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:10.478102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.510126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.602837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4eb26-aba6-4691-8900-6aafe6bf9206 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.626147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ec91f-35e4-447b-ae30-9932b3de1931 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.632309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.651454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.651454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.651454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.651454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.687989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.688610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.688891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.689187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.689856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:10.690163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.691529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.703426 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 89/197] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:10.708681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.762837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.765016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.801139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:10.825034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49641144-f437-423a-a621-eb2e20ac273a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:10.862954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:10.862954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:10.863353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:10.863511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] PATH_INFO: `/v3/users/21059106b8274e11995e31cfc64825ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:10.878850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] RBAC: Authorizing `identity:get_user(user_id=21059106b8274e11995e31cfc64825ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:10.880406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:10.883085 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 90/198] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/users/21059106b8274e11995e31cfc64825ba => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:10.884107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.906248 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 109/199] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:10.908003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:10.938665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.013542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed01949-7b61-4da7-978c-16571738d484 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.022721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ba4cd-4782-47a0-b378-a88ce5d6b9d7 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.055226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.056484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.057434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.058179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] PATH_INFO: `/v3/users/21059106b8274e11995e31cfc64825ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.060138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] RBAC: Authorizing `identity:get_user(user_id=21059106b8274e11995e31cfc64825ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.062434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.064615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.064858 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 91/200] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/users/21059106b8274e11995e31cfc64825ba => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:11.065253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.065530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.065799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.066598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.078528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.140707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.142379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.168352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.204769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09290a45-f01a-4325-94ca-f99d8d4d8fdf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.243308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.244767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.245317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.245739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.247250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.249659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.252558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 92/201] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:11.253508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.267795 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 110/202] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:11.268864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.354028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.382076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047307-6c4a-4a5f-9331-8f9297cd9155 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.394342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694254b-0a22-4bb6-adbb-b15feef472de None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.418464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.426504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.427934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.428470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.429613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.432340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.433070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.433460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.433827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.435019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] RBAC: Adding query filter params (role.id=378dbb9d27a14004ab139fb7a260a390, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a, user.id=0a498ef7531241fc8640d314982c1fce) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:11.435019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.436598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.442530 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 111/203] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/role_assignments?user.id=0a498ef7531241fc8640d314982c1fce&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=378dbb9d27a14004ab139fb7a260a390 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:11.443399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.524447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.526563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.554729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd623a-c5d0-46a7-ac65-f3ba23176335 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.595758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.596669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.597120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.597541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.599611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.602637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.605477 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 112/204] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:11.611619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.633457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.664928 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 93/205] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:11.665743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.732068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.815104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de6cc-9fda-4008-ad8c-dda42bbd3b1d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.816131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b240fe-758f-48cb-8f99-2b38a5337525 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:11.860334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.861403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.861901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.862393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.863328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=21059106b8274e11995e31cfc64825ba) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:11.863665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:11.864075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.864321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:11.864604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:11.864877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:11.866073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:11.866639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c43580-7c86-447a-be9c-7edccbbc2466 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.867574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:11.869272 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 94/206] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:11.876482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:11.877989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 113/207] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/role_assignments?user.id=21059106b8274e11995e31cfc64825ba&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:11.927845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:11.994431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3baa9f-aa72-4756-9951-867b5a311322 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:12.031299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:12.031919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:12.032200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:12.032473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:12.033241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] RBAC: Adding query filter params (role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=21059106b8274e11995e31cfc64825ba) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:12.033557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:12.035003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b2d49-d043-412a-91ce-cc7ba60e551f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:12.042026 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 95/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:11 2022] GET /identity/v3/role_assignments?user.id=21059106b8274e11995e31cfc64825ba&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:12.722919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f73d-d831-4930-9dac-518ef67f2df1 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:12.723456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f73d-d831-4930-9dac-518ef67f2df1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:12.723456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369f73d-d831-4930-9dac-518ef67f2df1 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:12.724796 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 114/209] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:12.730406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:12.730843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:12.730947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:12.732667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9ffb-dc81-4d9c-b04f-ec4d8e311b8c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:12.732982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9ffb-dc81-4d9c-b04f-ec4d8e311b8c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:12.733262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df9ffb-dc81-4d9c-b04f-ec4d8e311b8c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:12.734799 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 115/210] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:12.739971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:12.740259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:12.740538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:12.750861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:12.752049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:12.759279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:12.760465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:12.832804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 96/211] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:12.840544 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 116/212] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:13.108916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:13.117562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:13.148599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:13.184443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:13.229536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91331d2f-ff87-4288-9b36-819e964406cc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:13.248054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99de765-e3b5-4954-b1bc-5e99c523a72e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:13.268374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:13.268874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:13.269191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:13.269466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:13.270590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:13.272035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:13.278386 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 97/213] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:13.279263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:13.287370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:13.288929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:13.289545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:13.289940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:13.301228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:13.307101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:13.308012 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:13.308802 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 117/214] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:13.315933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:13.395939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8a8f1-cf47-44e9-b1c4-abc077ba70c7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:13.399858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:13.423305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380fad-0ef3-4de8-87eb-d4b9d2275cd3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:13.438067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:13.438822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:13.439000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:13.439231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:13.439896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:13.441461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:13.455112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:13.462886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:13.463820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:13.464528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:13.465415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:13.466393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:13.467008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:13.468981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:13.470044 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 98/215] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:13 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:13.486063 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 118/216] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:13.493269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:13.612262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66f19-328a-4149-8e9d-be4422727a44 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:13.652660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10285f3-631f-454e-975f-8db767716318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:13.653686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10285f3-631f-454e-975f-8db767716318 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:13.654169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10285f3-631f-454e-975f-8db767716318 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:13.654662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10285f3-631f-454e-975f-8db767716318 None admin] PATH_INFO: `/v3/users/ea0f23bb98e64c09b0656bdb1c704a1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:13.670696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10285f3-631f-454e-975f-8db767716318 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0f23bb98e64c09b0656bdb1c704a1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:13.672171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10285f3-631f-454e-975f-8db767716318 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:13.673873 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 99/217] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:13 2022] GET /identity/v3/users/ea0f23bb98e64c09b0656bdb1c704a1a => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:13.681995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:13.793574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa44da-f178-4319-a419-d13644ec13d7 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:13.830428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3806ed-ef28-44e3-834c-bcba3fdf07fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:13.831047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3806ed-ef28-44e3-834c-bcba3fdf07fa None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:13.831325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3806ed-ef28-44e3-834c-bcba3fdf07fa None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:13.831604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3806ed-ef28-44e3-834c-bcba3fdf07fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:13.879870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:13.911961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3806ed-ef28-44e3-834c-bcba3fdf07fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:13.913894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3806ed-ef28-44e3-834c-bcba3fdf07fa None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:14.045917 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 119/218] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:14.051679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10285f3-631f-454e-975f-8db767716318 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:14.072070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:14.169605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10285f3-631f-454e-975f-8db767716318 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:14.174491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfbe9e-89a3-4b65-895e-3a1b5ff4f85a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.174781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfbe9e-89a3-4b65-895e-3a1b5ff4f85a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.175064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfbe9e-89a3-4b65-895e-3a1b5ff4f85a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.176583 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 120/219] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:14.181592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7461c3-8c26-411a-840a-e107be691876 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.181875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7461c3-8c26-411a-840a-e107be691876 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.182153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7461c3-8c26-411a-840a-e107be691876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.206311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-eb7461c3-8c26-411a-840a-e107be691876 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:14.207650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eb7461c3-8c26-411a-840a-e107be691876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:14.234793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:14.235438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.235720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.235994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.239319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:14.241003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:14.242927 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 100/220] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:14 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:14.248527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:14.304564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:14.325177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 121/221] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:14.361309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:14.385013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77328d-0b81-43e0-8947-833ba6cd63bb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:14.420511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:14.421072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.421359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.421635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.422362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=ea0f23bb98e64c09b0656bdb1c704a1a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:14.422674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:14.424116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a5d3c-3256-4bc8-b294-3a717b268309 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:14.430205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 101/222] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:14 2022] GET /identity/v3/role_assignments?user.id=ea0f23bb98e64c09b0656bdb1c704a1a&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:14.507774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8473d-507c-4797-a6d1-eef59e8ccbb7 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.508020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8473d-507c-4797-a6d1-eef59e8ccbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.508307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8473d-507c-4797-a6d1-eef59e8ccbb7 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.510026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 122/223] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:14.515350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.515638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.515908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.540382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:14.541614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:14.622768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 102/224] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:14.699826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8473d-507c-4797-a6d1-eef59e8ccbb7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:14.812964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8473d-507c-4797-a6d1-eef59e8ccbb7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:14.855487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:14.856179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:14.856464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:14.856736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:14.867936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:14.872796 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:14.873693 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:14.874859 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 123/225] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:14.882072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:14.992400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:15.004690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:15.012283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f43c3-3585-4191-843b-d56dc14c9c66 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.048622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.049270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.049552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.049823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.050604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:15.050914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:15.052284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:15.061465 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 103/226] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:15.071626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:15.161976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:15.184620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d30a3-f105-4483-80a7-989e710e7a84 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.227888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.228837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.229287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.229702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] PATH_INFO: `/v3/users/21059106b8274e11995e31cfc64825ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.230985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=21059106b8274e11995e31cfc64825ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:15.232571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:15.234467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 104/227] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:15 2022] GET /identity/v3/users/21059106b8274e11995e31cfc64825ba => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:15.241942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:15.248127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdf9b-57a7-4e7d-8d28-0d76c6875539 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.264729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:15.287613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.288253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.289324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.289663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.318027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:15.326870 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:15.327768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:15.328831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:15.330856 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 124/228] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:15.334914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:15.398417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7e3f8-6cf8-4008-96ee-c5e919589ab7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.474254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.474903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.475188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.475468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.477685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:15.479345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:15.481043 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 105/229] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:15 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:15.487323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:15.566850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b129ab-79ee-42d7-911a-b92c18cd7635 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.592687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f884-0556-4366-9ac1-8cc43f4c870d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.614201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:15.616369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:15.627891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.628567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.628854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.629166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5/users/21059106b8274e11995e31cfc64825ba/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.631329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cde41380d54f509e11695bf0a261b5, user_id=21059106b8274e11995e31cfc64825ba, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:15.633643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:15.649325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 106/230] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:15 2022] PUT /identity/v3/projects/40cde41380d54f509e11695bf0a261b5/users/21059106b8274e11995e31cfc64825ba/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:15.669269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.669920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.670207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.670490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.671187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:15.671557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:15.673119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:15.692683 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 125/231] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:15.698799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:15.831314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65601269-3a30-4a7c-a9dd-31718bcdc742 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:15.869746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:15.870386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:15.870670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:15.870950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] PATH_INFO: `/v3/users/21059106b8274e11995e31cfc64825ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:15.872095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] RBAC: Authorizing `identity:get_user(user_id=21059106b8274e11995e31cfc64825ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:15.873651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:15.875266 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 107/232] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:15 2022] GET /identity/v3/users/21059106b8274e11995e31cfc64825ba => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:15.882020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:16.012215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961496-87ce-49ae-8002-13206ab5905e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:16.052529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab86ac-2679-4f9f-a816-20107dced446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:16.053207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab86ac-2679-4f9f-a816-20107dced446 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.053483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab86ac-2679-4f9f-a816-20107dced446 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.053760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab86ac-2679-4f9f-a816-20107dced446 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.055412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab86ac-2679-4f9f-a816-20107dced446 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:16.056857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab86ac-2679-4f9f-a816-20107dced446 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:16.058881 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 126/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:15 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:16.064401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:16.079181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:16.143402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4dcc3-dfee-4f7a-a3dd-954d533926e8 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.143778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4dcc3-dfee-4f7a-a3dd-954d533926e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.144229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4dcc3-dfee-4f7a-a3dd-954d533926e8 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.145865 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 127/234] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:16.151845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fcc78-338c-461e-b0b3-401eabeff382 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.152228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fcc78-338c-461e-b0b3-401eabeff382 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.152601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fcc78-338c-461e-b0b3-401eabeff382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.171575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-577fcc78-338c-461e-b0b3-401eabeff382 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:16.172997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-577fcc78-338c-461e-b0b3-401eabeff382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:16.226656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380177f4-77d5-41a6-b60e-baf739be193f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:16.247498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:16.285567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 128/235] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:16.289786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb044b42-3cde-4c0d-8938-906c40d5c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:16.290458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044b42-3cde-4c0d-8938-906c40d5c8be None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.290743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044b42-3cde-4c0d-8938-906c40d5c8be None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.291021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb044b42-3cde-4c0d-8938-906c40d5c8be None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5/users/21059106b8274e11995e31cfc64825ba/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.293341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044b42-3cde-4c0d-8938-906c40d5c8be None admin] RBAC: Authorizing `identity:create_grant(project_id=40cde41380d54f509e11695bf0a261b5, user_id=21059106b8274e11995e31cfc64825ba, role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:16.294798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb044b42-3cde-4c0d-8938-906c40d5c8be None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:16.310699 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 108/236] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:16 2022] PUT /identity/v3/projects/40cde41380d54f509e11695bf0a261b5/users/21059106b8274e11995e31cfc64825ba/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:16.535628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29fde8-d9a7-4395-adca-4471bff47885 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.535975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29fde8-d9a7-4395-adca-4471bff47885 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.536143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29fde8-d9a7-4395-adca-4471bff47885 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.537663 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 129/237] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:16.543820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.544093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.544377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.567464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:16.568674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:16.593639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29fde8-d9a7-4395-adca-4471bff47885 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:16.653274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:16.657750 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 109/238] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:16.764279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29fde8-d9a7-4395-adca-4471bff47885 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:16.809237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:16.809874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:16.810151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:16.810422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:16.825813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:16.830852 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:16.832882 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:16.834872 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 130/239] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:16.843604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:16.950179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:16.995993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946a39-6e9b-4004-927a-be99573f2f0c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:17.003566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:17.043108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:17.043794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.044078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.044353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.045062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:17.045368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:17.047406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:17.057282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 110/240] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:17.062982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:17.126683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089ed2b-1134-4a8c-ba49-167e8260c6bf None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:17.168991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:17.199105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:17.199755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.200043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.200317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.201612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:17.203075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:17.206450 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 131/241] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:17.211283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:17.247289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5f126-6a86-429b-b849-ca5f59da1ab9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:17.312036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:17.312571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.312855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.313206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] PATH_INFO: `/v3/users/9fc935c4c0794eb7abd6e58d95aa89bb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.340984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] RBAC: Authorizing `identity:get_user(user_id=9fc935c4c0794eb7abd6e58d95aa89bb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:17.342375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:17.346256 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 111/242] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:17 2022] GET /identity/v3/users/9fc935c4c0794eb7abd6e58d95aa89bb => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:17.349708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:17.396196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8778c1-d54c-4130-9230-47d1ca4657dc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:17.417589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:17.467621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aa7ff-3714-4bfa-af6e-eeb6b647f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:17.468305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aa7ff-3714-4bfa-af6e-eeb6b647f590 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.468593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aa7ff-3714-4bfa-af6e-eeb6b647f590 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.468873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aa7ff-3714-4bfa-af6e-eeb6b647f590 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.470289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9aa7ff-3714-4bfa-af6e-eeb6b647f590 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:17.471740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9aa7ff-3714-4bfa-af6e-eeb6b647f590 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:17.512389 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 132/243] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:17 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:17.513849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277679fe-abb0-4e73-91a9-8c3c6f150e5c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.514143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277679fe-abb0-4e73-91a9-8c3c6f150e5c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.514750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277679fe-abb0-4e73-91a9-8c3c6f150e5c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.516391 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 133/244] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:17.530401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.530925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.531203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.551516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e1b6-8c21-493c-81e0-2d7dba36f221 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:17.572516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:17.573685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:17.606879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:17.667183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:17.667880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:17.668210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:17.668486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:17.711411 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 134/245] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:17.770294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:17.771841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:17.880837 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 112/246] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:17.888930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.006726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:18.017225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989c38e-c453-417c-8d70-5963da3e72da None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:18.032767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.055291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:18.063691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:18.064331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.064819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.065126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.066355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:18.067806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:18.070645 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 135/247] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:17 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:18.078184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.158549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdc7ed-837b-42f0-9f52-0563f28d7a46 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:18.214145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:18.214899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.215090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.215338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.226784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3835e-19bb-484f-877d-0cffbf9ce5e3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:18.230766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:18.236429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:18.237411 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:18.238299 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:18.239775 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 113/248] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:18.247559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.275279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:18.276270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.276801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.277297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.278233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] RBAC: Adding query filter params (role.id=378dbb9d27a14004ab139fb7a260a390, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=9fc935c4c0794eb7abd6e58d95aa89bb) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:18.278761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:18.280485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e0f5a-2bc4-44d6-86d8-49ec09ab7276 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:18.287275 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 136/249] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:18 2022] GET /identity/v3/role_assignments?user.id=9fc935c4c0794eb7abd6e58d95aa89bb&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=378dbb9d27a14004ab139fb7a260a390 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:18.339640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:18.341901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce3a4-7a8c-4796-8968-c5a99afc1af2 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.342413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce3a4-7a8c-4796-8968-c5a99afc1af2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.342918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce3a4-7a8c-4796-8968-c5a99afc1af2 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.344601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 137/250] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:18.350648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.351007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.351250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.369645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776f73e-6c64-4f31-8992-95ad514fd9e4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:18.379050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:18.380346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:18.415920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:18.416467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.416748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.417056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.417746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:18.418052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:18.419485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:18.433467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:18.437036 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 114/251] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:18.443526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.530331 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 138/252] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:18.575305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fcb71-3e5d-4542-984a-7d6c24e0ab91 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:18.616099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:18.617293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.617565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.617841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] PATH_INFO: `/v3/users/ea0f23bb98e64c09b0656bdb1c704a1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.621262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] RBAC: Authorizing `identity:get_user(user_id=ea0f23bb98e64c09b0656bdb1c704a1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:18.622830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:18.624489 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 115/253] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:18 2022] GET /identity/v3/users/ea0f23bb98e64c09b0656bdb1c704a1a => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:18.630395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.777431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaadd3-ab05-4042-9092-35ab42de448d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:18.829602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:18.830611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:18.831114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:18.831580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:18.832955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:18.834592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:18.837056 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 139/254] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:18 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:18.844755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:18.862033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:18.988797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9dac9-64f1-42dc-8641-62b6efb7be7d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:19.037886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae80e-6999-4254-8308-0dc18e3545c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:19.039112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae80e-6999-4254-8308-0dc18e3545c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.039402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae80e-6999-4254-8308-0dc18e3545c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.039679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae80e-6999-4254-8308-0dc18e3545c5 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5/users/ea0f23bb98e64c09b0656bdb1c704a1a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.041846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae80e-6999-4254-8308-0dc18e3545c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cde41380d54f509e11695bf0a261b5, user_id=ea0f23bb98e64c09b0656bdb1c704a1a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:19.043326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae80e-6999-4254-8308-0dc18e3545c5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:19.072471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 116/255] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:18 2022] PUT /identity/v3/projects/40cde41380d54f509e11695bf0a261b5/users/ea0f23bb98e64c09b0656bdb1c704a1a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:19.091135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:19.132706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:19.141746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6a027-0230-4d4f-a9e7-cc7c72b7bd4e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.142074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6a027-0230-4d4f-a9e7-cc7c72b7bd4e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.142300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6a027-0230-4d4f-a9e7-cc7c72b7bd4e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.143867 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 117/256] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:11:19.154206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.154506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.154759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.190119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:19.191383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:19.285898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124e36-b15a-4715-8ee9-4484787559f2 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:19.343134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:19.344171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.344703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.345228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.356639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:19.361865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:19.362737 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:19.363533 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:19.366150 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 140/257] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:19.373492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:19.377263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:19.390769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 118/258] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:19.470402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:19.492362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0cd71-ae03-43e1-9a46-a26f30d517e8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:19.545998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:19.546626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.546907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.547177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.547867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:19.548167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:19.549624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:19.565217 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 141/259] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:19.571131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:19.707256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f7fa-49f4-4af2-8a29-0f063da3b8b5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:19.722893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:19.767973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:19.768614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.768896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.769190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] PATH_INFO: `/v3/users/21059106b8274e11995e31cfc64825ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.774015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] RBAC: Authorizing `identity:get_user(user_id=21059106b8274e11995e31cfc64825ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:19.776493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:19.778691 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 119/260] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:19 2022] GET /identity/v3/users/21059106b8274e11995e31cfc64825ba => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:19.784139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:19.852032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:19.893619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49f250-9647-4eb1-961b-9b836e3d0b27 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:19.936025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:19.936558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:19.936839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:19.937137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:19.950720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3244f08-1c90-462b-bbbc-47eb8bd26a04 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:20.029609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:20.029985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:20.030250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:20.030529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:20.030803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:20.031465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:20.062275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:20.080124 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:20.081131 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:20.081920 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:20.084119 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 142/261] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:20.089375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:20.102224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:20.113329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:20.144131 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 120/262] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 02:11:20.152779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:20.303711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb84fa-53cf-4028-aac1-6e94ad08379d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:20.313080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c532f-3c95-4ff4-9df6-542b5c82abed None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:20.352714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:20.353376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:20.353658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:20.353934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:20.355647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:20.357110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:20.358913 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 121/263] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:20 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:20.365952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:20.374798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:20.375425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:20.375738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:20.375984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:20.376658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:20.376984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:20.378382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:20.395036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 143/264] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:20.401403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:20.426297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:20.534198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:20.560085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4232e0-6e7a-45a3-97ed-b27442e01b65 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:20.590789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa1da2-0974-42f8-be3a-7c630448695b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:20.647831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:20.648456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:20.648739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:20.649042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:20.649786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=21059106b8274e11995e31cfc64825ba) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:20.650099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:20.651558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:20.652085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:20.652740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:20.653051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:20.653332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] PATH_INFO: `/v3/users/21059106b8274e11995e31cfc64825ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:20.654500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] RBAC: Authorizing `identity:get_user(user_id=21059106b8274e11995e31cfc64825ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:20.655948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:20.658066 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 122/265] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:20 2022] GET /identity/v3/role_assignments?user.id=21059106b8274e11995e31cfc64825ba&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:20.662313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 144/266] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:20 2022] GET /identity/v3/users/21059106b8274e11995e31cfc64825ba => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:20.666111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:20.808690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:20.814941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02950-c5f9-4b21-94bc-aa30c7e81b6a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:20.869587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955bbb2-bf46-4c32-a2d7-bbf962978bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:20.870221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955bbb2-bf46-4c32-a2d7-bbf962978bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:20.870504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955bbb2-bf46-4c32-a2d7-bbf962978bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:20.870782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955bbb2-bf46-4c32-a2d7-bbf962978bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:20.968885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955bbb2-bf46-4c32-a2d7-bbf962978bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:20.970400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955bbb2-bf46-4c32-a2d7-bbf962978bf7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:21.101095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:21.109357 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 123/267] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:21.119512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:21.279563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d96c-560c-4c8b-bf4b-4757e83d6320 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:21.281841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbe864-3584-4cff-ab38-6dcdd3c76a37 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.282045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbe864-3584-4cff-ab38-6dcdd3c76a37 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.282309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbe864-3584-4cff-ab38-6dcdd3c76a37 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.283808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 124/268] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:21.289241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a390e8-e026-4c3e-a1f1-eff5167f8dbe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.289814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a390e8-e026-4c3e-a1f1-eff5167f8dbe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.290318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a390e8-e026-4c3e-a1f1-eff5167f8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.326167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-86a390e8-e026-4c3e-a1f1-eff5167f8dbe None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:21.327902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86a390e8-e026-4c3e-a1f1-eff5167f8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:21.350144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:21.353015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.353499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.353969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.355497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:21.358206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:21.360218 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 145/269] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:21 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:21.365916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:21.374905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:21.448393 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 125/270] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:21.466850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53918-600c-4cae-9baa-4d7bd8893c6d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.467139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53918-600c-4cae-9baa-4d7bd8893c6d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.467417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f53918-600c-4cae-9baa-4d7bd8893c6d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.468844 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 126/271] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:21.480428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7c4ae-5c66-4d37-9875-b6ed13ad50a9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.480702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7c4ae-5c66-4d37-9875-b6ed13ad50a9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.480879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7c4ae-5c66-4d37-9875-b6ed13ad50a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.513474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bd4dd-a0ff-4f6f-9b0c-2e0afec8a24d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:21.515408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3da7c4ae-5c66-4d37-9875-b6ed13ad50a9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:21.517045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3da7c4ae-5c66-4d37-9875-b6ed13ad50a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:21.554584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:21.555533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.556087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.556551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.557549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] RBAC: Adding query filter params (role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=21059106b8274e11995e31cfc64825ba) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:21.558087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:21.559765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7be1b4-572a-47b8-9a45-2aabb5411733 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:21.569519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 146/272] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:21 2022] GET /identity/v3/role_assignments?user.id=21059106b8274e11995e31cfc64825ba&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:21.617666 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 127/273] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:21.740781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350bdce-f30a-411a-b143-841443ed7eef None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.741133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350bdce-f30a-411a-b143-841443ed7eef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.741428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350bdce-f30a-411a-b143-841443ed7eef None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.743385 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 147/274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:21.749118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:21.749414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:21.749690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:21.773682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:21.774871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:21.845861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:21.867432 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 128/275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:21.883345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350bdce-f30a-411a-b143-841443ed7eef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:21.961719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:21.986198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.001117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350bdce-f30a-411a-b143-841443ed7eef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.049229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.049876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.050155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.050423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.052387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.053055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.060024 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 148/276] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:22.061550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.132950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80176cf8-36f6-4e65-8254-74a39c36deb2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.174864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d4d93-6014-45a2-882c-389f57bfcbd2 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.179932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.180991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.180991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.182072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.196198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:22.201807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:22.202819 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:22.203884 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 129/277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:22.209552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.215709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.216341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.216624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.216945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.217656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.219245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.229967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:22.245349 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 149/278] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:22 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:22.254260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.266254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:22.341250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be48c49-822d-47f3-b9b4-459b3cb43251 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.373197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7bf45-c6dc-4d38-aa37-3a3e11a2d05b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.379205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586fc26-b236-43b3-9c1d-06aabe78feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.379855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586fc26-b236-43b3-9c1d-06aabe78feea None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.380135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586fc26-b236-43b3-9c1d-06aabe78feea None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.380413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586fc26-b236-43b3-9c1d-06aabe78feea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.392707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586fc26-b236-43b3-9c1d-06aabe78feea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a586fc26-b236-43b3-9c1d-06aabe78feea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:22.397740 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:22.398698 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:22.399488 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 130/279] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:22.400714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205471a-3e1c-47b7-9c79-0a33051f2d3f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.400714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205471a-3e1c-47b7-9c79-0a33051f2d3f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.400991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205471a-3e1c-47b7-9c79-0a33051f2d3f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.403651 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 131/280] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:22.405600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205471a-3e1c-47b7-9c79-0a33051f2d3f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.419909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.420526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.420805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.421110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.421780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:22.422077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.425554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d7dc7-0bda-4a64-87aa-59324a50d518 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.433661 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 150/281] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:22.434908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.435189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.435464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.455382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:22.456589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:22.518656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:22.535123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205471a-3e1c-47b7-9c79-0a33051f2d3f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.541600 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 151/282] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:22.542449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.544493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:22.588631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.589355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.589591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.589861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.590581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:22.590884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.592255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.605241 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 132/283] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:22.608261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.684514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f00fe-c20b-4caa-9451-2c34c4757280 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.732811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.733810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.734256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.734669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] PATH_INFO: `/v3/users/9fc935c4c0794eb7abd6e58d95aa89bb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.735247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4b31a-6fad-4222-a478-317e3dca0ada None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.736110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=9fc935c4c0794eb7abd6e58d95aa89bb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.738663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.740779 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 152/284] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/users/9fc935c4c0794eb7abd6e58d95aa89bb => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:22.746624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.772618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.773512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.773924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.774289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] PATH_INFO: `/v3/users/73069d86d0084795b2204d8ef3b02eac` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.790286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] RBAC: Authorizing `identity:get_user(user_id=73069d86d0084795b2204d8ef3b02eac)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.791948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.794032 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 133/285] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/users/73069d86d0084795b2204d8ef3b02eac => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:22.799854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.818784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:22.836668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:22.915784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b8533-44e1-40e8-ab19-130e0051b4e0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.921218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73805a1c-86e2-459f-ad32-d872a5d4e447 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:22.958175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.959231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.959730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.961383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.962457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, user.id=73069d86d0084795b2204d8ef3b02eac, scope.system=all) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:22.963038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.964722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.971295 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 134/286] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/role_assignments?user.id=73069d86d0084795b2204d8ef3b02eac&scope.system=all&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:22.972518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:22.981065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:22.981944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:22.982313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:22.982682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:22.989929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:22.992447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:22.994489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 153/287] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:23.000253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:23.083581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:23.091952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58affd7-bb9d-4f66-af17-19d6439b9a85 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:23.134090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:23.135645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:23.136077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:23.136520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:23.149920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:23.155620 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:23.156546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:23.157381 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:23.159941 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 135/288] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:23.174026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:23.235644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffbf22-9311-4d94-8467-681df8742f2d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:23.267662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:23.294290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:23.294963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:23.295241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:23.295516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5/users/9fc935c4c0794eb7abd6e58d95aa89bb/roles/378dbb9d27a14004ab139fb7a260a390` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:23.304779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cde41380d54f509e11695bf0a261b5, user_id=9fc935c4c0794eb7abd6e58d95aa89bb, role_id=378dbb9d27a14004ab139fb7a260a390)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:23.304779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:23.318931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 154/289] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:11:22 2022] PUT /identity/v3/projects/40cde41380d54f509e11695bf0a261b5/users/9fc935c4c0794eb7abd6e58d95aa89bb/roles/378dbb9d27a14004ab139fb7a260a390 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:11:23.360499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877c457-ad73-4f8a-b260-c91b1bfa693a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:23.401937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:23.402607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:23.402886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:23.403202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:23.403881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:23.404183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:23.405600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:23.415955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 136/290] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:23.421863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:23.537019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b86385-ab23-4ab3-a8d0-98d693367b64 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:23.584021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:23.584021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:23.584021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:23.584021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] PATH_INFO: `/v3/users/ea0f23bb98e64c09b0656bdb1c704a1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:23.588934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0f23bb98e64c09b0656bdb1c704a1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:23.590435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:23.592517 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 155/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:23 2022] GET /identity/v3/users/ea0f23bb98e64c09b0656bdb1c704a1a => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:23.598315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:23.640279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:23.775622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6540c9-4662-4dbf-b51e-ac73b5f8ac0c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:23.813780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:23.814445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:23.814728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:23.814997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:23.887751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:23.889251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:23.903581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:24.031684 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 137/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:24.037270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:24.120711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:24.206960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b47a1-be66-476d-98d9-97fe20270055 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:24.275662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020f086-bbf1-4b5f-8e41-6a4d3cacdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:24.277771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f086-bbf1-4b5f-8e41-6a4d3cacdd9c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:24.278908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f086-bbf1-4b5f-8e41-6a4d3cacdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:24.281608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f086-bbf1-4b5f-8e41-6a4d3cacdd9c None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:24.284000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020f086-bbf1-4b5f-8e41-6a4d3cacdd9c None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:24.287666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020f086-bbf1-4b5f-8e41-6a4d3cacdd9c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:24.294742 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 156/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:24 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:24.302010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:24.555300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533151e-3c34-4610-965a-2ed2fed3fea5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:24.571636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:24.594367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:24.594972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:24.595306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:24.595578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:24.596351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=ea0f23bb98e64c09b0656bdb1c704a1a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:24.596663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:24.598130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8e6e4-6e45-44ab-be92-116ab31bcf87 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:24.604311 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 138/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:24 2022] GET /identity/v3/role_assignments?user.id=ea0f23bb98e64c09b0656bdb1c704a1a&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:25.102081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f984b-9847-4380-8efe-2bd391787506 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.102473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f984b-9847-4380-8efe-2bd391787506 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.102647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f984b-9847-4380-8efe-2bd391787506 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.104245 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 157/295] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:25.109767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.110055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.110332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.130092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:25.131446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:25.150038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c2e0a-376e-4051-9851-5cede826f510 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.150365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c2e0a-376e-4051-9851-5cede826f510 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.150582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c2e0a-376e-4051-9851-5cede826f510 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.151917 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 158/296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:25.157155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.157438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.157712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.177107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:25.178350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:25.214229 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 139/297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:25.253291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 159/298] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:25.498121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:25.529649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:25.594577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:25.603150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3707a-6a59-4159-9900-d78b91166899 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:25.610650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:25.636540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844cb66-ee37-4f6c-b2ec-7e1be54af9d4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:25.654449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:25.655460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.655969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.656528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.675626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:25.676076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:25.676712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.677014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.677287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.678385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:25.680441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:25.683021 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:25.684082 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:25.684884 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:25.686910 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 160/299] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:25.687471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 140/300] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:25.688047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:25.696862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:25.800209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fb111-bc3f-47c8-8413-8a06fe33b37d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:25.800572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8adc32-9a9b-48dd-9565-68dfcd5c09bd None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:25.816236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:25.839043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aefc02-2147-4f9b-b295-730bbdd74c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:25.839567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:25.839689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aefc02-2147-4f9b-b295-730bbdd74c82 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.839920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aefc02-2147-4f9b-b295-730bbdd74c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.840194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aefc02-2147-4f9b-b295-730bbdd74c82 None admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.840843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aefc02-2147-4f9b-b295-730bbdd74c82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:25.841069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.841487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.841916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.842306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aefc02-2147-4f9b-b295-730bbdd74c82 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:25.842897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:25.843340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:25.844833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd86fd1-72e0-48cb-a53c-b4cfeddcf924 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:25.854153 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 141/301] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:25.855571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f846-0e9e-4940-a6d4-b9e969d79c18 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.856000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f846-0e9e-4940-a6d4-b9e969d79c18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.856418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59f846-0e9e-4940-a6d4-b9e969d79c18 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.857784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 142/302] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:25.859802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59f846-0e9e-4940-a6d4-b9e969d79c18 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:25.865740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 161/303] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 5 02:11:25 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:25.867798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:25.868290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:25.869052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:25.890456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:25.891842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:25.904151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:25.993749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 162/304] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:26.008551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59f846-0e9e-4940-a6d4-b9e969d79c18 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.052036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7b5c6-e374-40cb-9951-38d3e27b71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.053040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7b5c6-e374-40cb-9951-38d3e27b71bc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.053551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7b5c6-e374-40cb-9951-38d3e27b71bc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.054603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7b5c6-e374-40cb-9951-38d3e27b71bc None admin] PATH_INFO: `/v3/users/68794b00b3c14af585db88a63da455d0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.070465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7b5c6-e374-40cb-9951-38d3e27b71bc None admin] RBAC: Authorizing `identity:get_user(user_id=68794b00b3c14af585db88a63da455d0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:26.072182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7b5c6-e374-40cb-9951-38d3e27b71bc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:26.074392 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 143/305] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:25 2022] GET /identity/v3/users/68794b00b3c14af585db88a63da455d0 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:26.080573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.120406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c9ce4-adf6-498c-b6f4-97a68bc69fb1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.120694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c9ce4-adf6-498c-b6f4-97a68bc69fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.124031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c9ce4-adf6-498c-b6f4-97a68bc69fb1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.125467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 144/306] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:26.131170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.131445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.131715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.152686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:26.154022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:26.196310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400e4e-3443-4127-bc68-3f246ed9d08c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.198705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:26.236202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.236836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.237139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.237412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.238140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] RBAC: Adding query filter params (role.id=378dbb9d27a14004ab139fb7a260a390, user.id=68794b00b3c14af585db88a63da455d0, scope.system=all) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:26.238448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:26.244926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:26.245491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 145/307] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:26.245691 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 163/308] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/role_assignments?user.id=68794b00b3c14af585db88a63da455d0&scope.system=all&role.id=378dbb9d27a14004ab139fb7a260a390 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:26.265764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.286056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:26.378354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4062b69-12ab-4afe-be0c-94be97f2731b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.421215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.422175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.422663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.423112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.436540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:26.441966 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:26.442984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:26.443766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:26.446154 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 146/309] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:26.455688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.531535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.570569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d2ea2-cd7c-4fa4-ba3c-e785220c22c7 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.617902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.619731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.620195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.620646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.621522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:26.622020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:26.624132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:26.626836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:26.638172 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 164/310] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:26.644793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.668039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27051804-3009-4559-b8dc-b17273c778bc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.686252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:26.713536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.714921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.715613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.716035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.729980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:26.735578 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:26.736469 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:26.737298 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:26.739489 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 147/311] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:26.746658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.769770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f611-042f-456b-82c1-03c568ebc12e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.806079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.806738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.807020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.807555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] PATH_INFO: `/v3/users/73069d86d0084795b2204d8ef3b02eac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.809190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] RBAC: Authorizing `identity:get_user(user_id=73069d86d0084795b2204d8ef3b02eac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:26.810643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:26.813071 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 165/312] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/users/73069d86d0084795b2204d8ef3b02eac => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:26.818653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.869869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21aefc-94d0-4658-a76e-97f470f35128 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:26.909172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:26.909978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:26.910404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:26.910822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:26.911735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:26.912199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:26.914575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:26.917897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:26.932166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 148/313] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:26.936051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:26.965383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:26.970304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20114-0cf5-43f3-a274-ce7320d7299e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:27.016768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:27.017764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:27.018187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:27.018673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] PATH_INFO: `/v3/system/users/73069d86d0084795b2204d8ef3b02eac/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:27.020328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=73069d86d0084795b2204d8ef3b02eac, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:27.021947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:27.032874 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 166/314] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 5 02:11:26 2022] PUT /identity/v3/system/users/73069d86d0084795b2204d8ef3b02eac/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:27.064566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b6e4-dfb7-4c27-8d5a-ac1a48be54a8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:27.106093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:27.106750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:27.107035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:27.107314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] PATH_INFO: `/v3/users/9fc935c4c0794eb7abd6e58d95aa89bb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:27.108624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] RBAC: Authorizing `identity:get_user(user_id=9fc935c4c0794eb7abd6e58d95aa89bb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:27.110242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:27.112319 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 149/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:26 2022] GET /identity/v3/users/9fc935c4c0794eb7abd6e58d95aa89bb => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:27.118621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:27.245359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664bae6-3ca1-42c3-9c59-f073c284cab6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:27.280161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:27.280775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:27.281086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:27.281362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:27.318325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:27.358996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:27.360465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:27.464042 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 167/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:27.469620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:27.542998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:27.580025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72209e-9f60-4aa0-b41d-3f1d5b8e9851 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:27.615811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8628e-4022-4c4d-8248-f0c3f3511941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:27.616871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8628e-4022-4c4d-8248-f0c3f3511941 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:27.617375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8628e-4022-4c4d-8248-f0c3f3511941 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:27.617845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8628e-4022-4c4d-8248-f0c3f3511941 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:27.619180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8628e-4022-4c4d-8248-f0c3f3511941 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:27.620878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8628e-4022-4c4d-8248-f0c3f3511941 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:27.623096 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 150/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:27 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:27.629223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:27.691858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:27.732827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc404b-307f-460e-9b83-6df99eb13827 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:27.767721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:27.768693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:27.769257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:27.769748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:27.770729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] RBAC: Adding query filter params (role.id=378dbb9d27a14004ab139fb7a260a390, scope.project.id=40cde41380d54f509e11695bf0a261b5, user.id=9fc935c4c0794eb7abd6e58d95aa89bb) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:27.771237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:27.773509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c303e75-88d1-4a68-95f9-1b9eab4783f8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:27.779973 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 168/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:27 2022] GET /identity/v3/role_assignments?user.id=9fc935c4c0794eb7abd6e58d95aa89bb&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=378dbb9d27a14004ab139fb7a260a390 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:28.202177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ca69-4120-4159-8309-7cb0d03855b8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:28.202694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ca69-4120-4159-8309-7cb0d03855b8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:28.202769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6ca69-4120-4159-8309-7cb0d03855b8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:28.204560 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 151/319] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:28.209729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977809-37c4-4a1b-9843-d3afa8cfeec9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:28.210635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977809-37c4-4a1b-9843-d3afa8cfeec9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:28.210947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977809-37c4-4a1b-9843-d3afa8cfeec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:28.230169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a0977809-37c4-4a1b-9843-d3afa8cfeec9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:28.231370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a0977809-37c4-4a1b-9843-d3afa8cfeec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:28.300500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 169/320] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:28.523855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3368-7806-4a19-b645-5ec3c3ada2f1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:28.524208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3368-7806-4a19-b645-5ec3c3ada2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:28.524379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3368-7806-4a19-b645-5ec3c3ada2f1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:28.525829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 152/321] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:28.530704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:28.531035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:28.531340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:28.550179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:28.551341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:28.579776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3368-7806-4a19-b645-5ec3c3ada2f1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:28.602814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:28.623906 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 170/322] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:28.688613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3368-7806-4a19-b645-5ec3c3ada2f1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:28.723651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:28.724336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:28.724624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:28.724971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:28.726769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:28.728203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:28.732930 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 153/323] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:28.735455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:28.837979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c524-cdaa-4a41-9f64-471786a3cfd9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:28.872912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:28.873546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:28.873825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:28.874120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:28.874755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:28.876178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:28.889174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:28.891588 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 171/324] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Oct 5 02:11:28 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:28.893551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:29.005706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30f445-0427-4ab3-8de8-08fa8875f7c1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:29.043085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:29.043734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.044014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.044285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.056316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:29.061219 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:29.062139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:29.062939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 154/325] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:29.068113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:29.124109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:29.191466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992d3f-d5ce-430a-aca4-9d20fd99e9ce None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:29.228893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:29.229535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.229816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.230086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.230755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:29.231055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:29.232422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7e3d4-0821-44b9-bb0a-11bfc5cdaa37 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:29.242351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 172/326] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:29.247850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:29.267253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd735392-76d5-4e46-9630-c0dad9c5b65d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.267534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd735392-76d5-4e46-9630-c0dad9c5b65d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.267816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd735392-76d5-4e46-9630-c0dad9c5b65d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.270509 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 173/327] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:29.274754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.275043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.275338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.300279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:29.301191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:29.328064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:29.370579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145f08f-f991-4f98-9c2b-1f22216ac261 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:29.401160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 174/328] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:29.411921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:29.412552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.412832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.413697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] PATH_INFO: `/v3/users/68794b00b3c14af585db88a63da455d0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.414851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] RBAC: Authorizing `identity:get_user(user_id=68794b00b3c14af585db88a63da455d0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:29.416304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:29.418073 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 155/329] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:29 2022] GET /identity/v3/users/68794b00b3c14af585db88a63da455d0 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:29.424219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:29.468112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:29.542341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bb8c7-1709-465e-8720-f4e70eca6951 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:29.577059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:29.578003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.578673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.579086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] PATH_INFO: `/v3/system/users/68794b00b3c14af585db88a63da455d0/roles/378dbb9d27a14004ab139fb7a260a390` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.580623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=68794b00b3c14af585db88a63da455d0, role_id=378dbb9d27a14004ab139fb7a260a390)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:29.582176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:29.599611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 175/330] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Oct 5 02:11:29 2022] PUT /identity/v3/system/users/68794b00b3c14af585db88a63da455d0/roles/378dbb9d27a14004ab139fb7a260a390 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:29.704120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:29.823173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a166b-ebfa-4e71-80f4-1c4b21a0493f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:29.853177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:29.860034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:29.860739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:29.861229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:29.861505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:29.872539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:29.877455 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:29.878331 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:29.879139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 156/331] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:29.885129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:30.008089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ccd51-01ba-4634-9d06-224d168a70df None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:30.009750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:30.049317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:30.049930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:30.050209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:30.050490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:30.051160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:30.051468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:30.052838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:30.063029 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 176/332] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:30.068494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:30.204674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df3fc1-8b60-46fc-9991-bed3ed2a7f05 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:30.245830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7934661-7a32-4970-8645-eb2c3e5abbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:30.246468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7934661-7a32-4970-8645-eb2c3e5abbec None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:30.246746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7934661-7a32-4970-8645-eb2c3e5abbec None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:30.247022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7934661-7a32-4970-8645-eb2c3e5abbec None admin] PATH_INFO: `/v3/users/73069d86d0084795b2204d8ef3b02eac` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:30.248174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7934661-7a32-4970-8645-eb2c3e5abbec None admin] RBAC: Authorizing `identity:get_user(user_id=73069d86d0084795b2204d8ef3b02eac)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:30.249636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7934661-7a32-4970-8645-eb2c3e5abbec None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:30.251512 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 157/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:30 2022] GET /identity/v3/users/73069d86d0084795b2204d8ef3b02eac => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:30.257264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:30.401535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b8225-bde7-4bc6-be32-018806325034 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:30.442186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:30.442804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:30.443086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:30.443477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:30.444236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] RBAC: Adding query filter params (role.id=c633580ee7eb4b5c829edbee3bd1ca81, user.id=73069d86d0084795b2204d8ef3b02eac, scope.system=all) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:30.444556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:30.446042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ab718-b93c-4b86-8395-0924b458fc4b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:30.465080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 177/334] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 02:11:30 2022] GET /identity/v3/role_assignments?user.id=73069d86d0084795b2204d8ef3b02eac&scope.system=all&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:31.861946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dabe9-5efd-421e-952a-9faf46d51866 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:31.862942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dabe9-5efd-421e-952a-9faf46d51866 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:31.863425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dabe9-5efd-421e-952a-9faf46d51866 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:31.865536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 158/335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:31.871246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fab1d-8b30-4424-9e42-d12b65e70fa9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:31.872175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fab1d-8b30-4424-9e42-d12b65e70fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:31.872677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fab1d-8b30-4424-9e42-d12b65e70fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:31.893867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-980fab1d-8b30-4424-9e42-d12b65e70fa9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:31.895080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-980fab1d-8b30-4424-9e42-d12b65e70fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:31.917590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:31.982745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 178/336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:32.137395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2275cd-c041-4a21-b751-72f8648c9a81 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:32.138042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2275cd-c041-4a21-b751-72f8648c9a81 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:32.138526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2275cd-c041-4a21-b751-72f8648c9a81 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:32.140165 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 159/337] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:32.146162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17a04b-4cbb-4d96-b0b7-dc93407229c7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:32.146507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17a04b-4cbb-4d96-b0b7-dc93407229c7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:32.146798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17a04b-4cbb-4d96-b0b7-dc93407229c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:32.170545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9d17a04b-4cbb-4d96-b0b7-dc93407229c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:32.171651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9d17a04b-4cbb-4d96-b0b7-dc93407229c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:32.253832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 179/338] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:32.319726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a704-d518-4dff-babc-b1215e505d6e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:32.320366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a704-d518-4dff-babc-b1215e505d6e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:32.320845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a704-d518-4dff-babc-b1215e505d6e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:32.322426 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 160/339] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:32.334523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:32.335644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:32.336171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:32.365028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:32.367464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:32.450606 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 180/340] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:32.478039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a704-d518-4dff-babc-b1215e505d6e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:32.566255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:32.610904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a704-d518-4dff-babc-b1215e505d6e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:32.637743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:32.661658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:32.662305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:32.662584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:32.662858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:32.670989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:32.689901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:32.695441 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:32.696369 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:32.697669 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 161/341] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:32.704980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:32.856617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923b4b1-4dc3-44e0-8c50-9dbd5f66fb88 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:32.946232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312450b0-49de-41ae-a108-75c68e2e0ac3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:32.948567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:32.949428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:32.949713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:32.949990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:32.967853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:32.974115 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:32.975004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:32.976265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 181/342] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:32.977305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:32.986314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.054425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.055048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.055330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.055605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.056268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:33.056571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.057968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.071553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.072285 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 162/343] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:33.073157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:33.114299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4a40-23d0-4e28-a754-d2eb7ab55af7 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.159977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e61e8-ebe8-4288-949e-4bd822246c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.160870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e61e8-ebe8-4288-949e-4bd822246c22 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.161186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e61e8-ebe8-4288-949e-4bd822246c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.161467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e61e8-ebe8-4288-949e-4bd822246c22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.176299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e61e8-ebe8-4288-949e-4bd822246c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-037e61e8-ebe8-4288-949e-4bd822246c22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:33.184469 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:33.185641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:33.186449 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 182/344] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:33.187686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30254d9e-b566-47c6-8231-6db847cd136c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.187982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30254d9e-b566-47c6-8231-6db847cd136c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.188261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30254d9e-b566-47c6-8231-6db847cd136c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.191163 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 183/345] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:33.193730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30254d9e-b566-47c6-8231-6db847cd136c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:33.219175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72c8c-4759-4e73-a300-eedf6c339c9d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.258387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.259343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.259844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.260359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.262364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:33.262908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.264491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.275101 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 163/346] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:33.276264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:33.326440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30254d9e-b566-47c6-8231-6db847cd136c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.341272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.363083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.370322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.371198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.371696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.372260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.419827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57666c75-ff7f-48fa-b891-3b8ba9f0b95b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.459568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.461899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.463955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.464860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.465375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.465898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.466770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:33.467271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.468979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da2742-ed83-494e-aa8c-994de09ce037 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.478338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 164/347] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:33.479876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.480379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.480868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.501089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:33.502724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:33.587191 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 184/348] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:33.588427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:33.596517 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 165/349] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:33.597300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:33.637201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.656692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.738366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27936b-e5f4-4638-82d3-cddc0fb160f1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.781464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.782665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.783098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.783524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] PATH_INFO: `/v3/users/68794b00b3c14af585db88a63da455d0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.785129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] RBAC: Authorizing `identity:get_user(user_id=68794b00b3c14af585db88a63da455d0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.787340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.790115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 166/350] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/users/68794b00b3c14af585db88a63da455d0 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:33.791576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:33.801255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38e8e8-0069-4dd0-adb2-7c51b80b2c34 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.845972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd24338-3f3c-4419-8bb7-bd8d8c39bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.848238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24338-3f3c-4419-8bb7-bd8d8c39bf8a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.848623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24338-3f3c-4419-8bb7-bd8d8c39bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.850014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24338-3f3c-4419-8bb7-bd8d8c39bf8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.923636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22413570-9b6b-4678-8bc7-31aeeffc9f31 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:33.926756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.934145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd24338-3f3c-4419-8bb7-bd8d8c39bf8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.936553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd24338-3f3c-4419-8bb7-bd8d8c39bf8a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.979923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:33.981210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:33.981210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:33.981210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:33.984226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:33.984731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:33.986324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:33.990867 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 167/351] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:33.992397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.068325 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 185/352] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:34.069678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3b60-d2cf-4f3c-9c19-45959bf7efef None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.071054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3b60-d2cf-4f3c-9c19-45959bf7efef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.071358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb3b60-d2cf-4f3c-9c19-45959bf7efef None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.072664 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 186/353] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:34.073503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3b60-d2cf-4f3c-9c19-45959bf7efef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.136407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c899ea2-5315-488d-a92a-8af313888fe2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.192470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.193137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.193422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.193697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.194742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] RBAC: Adding query filter params (role.id=378dbb9d27a14004ab139fb7a260a390, user.id=68794b00b3c14af585db88a63da455d0, scope.system=all) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:34.195056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:34.197891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:34.199632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb3b60-d2cf-4f3c-9c19-45959bf7efef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.212806 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 168/354] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 02:11:33 2022] GET /identity/v3/role_assignments?user.id=68794b00b3c14af585db88a63da455d0&scope.system=all&role.id=378dbb9d27a14004ab139fb7a260a390 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:34.214139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.235676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:34.243261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.243824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.244100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.244377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.251933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:34.252124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:34.253596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:34.255636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 187/355] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:34.256511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.368094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f6731-2618-4e70-99fc-80fc23b31b67 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.408938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4237f-3ac5-49f6-af80-2a5ada64a572 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.427090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a289bb3-c915-4a22-a7ae-2162551fc1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.427732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289bb3-c915-4a22-a7ae-2162551fc1da None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.428013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289bb3-c915-4a22-a7ae-2162551fc1da None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.428287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a289bb3-c915-4a22-a7ae-2162551fc1da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.443016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a289bb3-c915-4a22-a7ae-2162551fc1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4a289bb3-c915-4a22-a7ae-2162551fc1da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:34.449061 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:34.449999 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:34.450805 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 169/356] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:34.451482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.451674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.457033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.468125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.469238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.469766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.470231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.471622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:34.474133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:34.475970 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 188/357] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:34.476824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.478889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:34.480158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:34.563105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:34.566529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 170/358] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:34.567449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.590798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:34.615185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a52ff-5d60-4152-b6a2-cfec9f815543 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.658781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.663696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.663696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.663696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.663696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:34.663696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:34.663696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:34.670854 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 189/359] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:34.673607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.699293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfc10e-8abe-4c84-820e-23d2cd8bd8eb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.757573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.758211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.758489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.758759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.759457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:34.759758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:34.761243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69b2c1-bb64-42e4-af4b-651b60fee500 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:34.775818 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 171/360] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:34.778053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5a80-645a-4650-8d9b-2ef7040a876c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.778053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5a80-645a-4650-8d9b-2ef7040a876c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.778053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e5a80-645a-4650-8d9b-2ef7040a876c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.779089 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 172/361] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:34.781729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5a80-645a-4650-8d9b-2ef7040a876c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:34.839038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a80e-211a-4bc0-8476-e4174b774418 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.867533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:34.876771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ce58-2d43-45c3-b615-462756564267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.877519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ce58-2d43-45c3-b615-462756564267 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.877859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ce58-2d43-45c3-b615-462756564267 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.878140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ce58-2d43-45c3-b615-462756564267 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.879442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9ce58-2d43-45c3-b615-462756564267 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:34.882319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9ce58-2d43-45c3-b615-462756564267 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:34.884673 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 190/362] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:34.885669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.885950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.886336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:34.888411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:34.905347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:34.906567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:34.915909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e5a80-645a-4650-8d9b-2ef7040a876c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:34.953715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:34.954331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:34.954772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:34.955089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.008681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 191/363] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:35.013194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.051167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.052678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.143306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f690bc-6eb9-4a47-9027-361b49941338 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.161088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:35.193337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 173/364] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 02:11:35.193524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:35.199426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.223229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.223866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.224154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.224436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.246051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:35.250989 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:35.251886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:35.252730 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:35.257806 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 192/365] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:35.258091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.353130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412d3ed-2f3e-4930-8b90-bc8dc0e5062d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.385862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc421e4-7dd9-41d7-b9a4-4fa3e64a2fb1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.394903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.395440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.395722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.395992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.396725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:35.397078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.399040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.404997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 174/366] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:35.405701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.429413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.430407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.430833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.431246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.435357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.435357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.437719 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 193/367] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:35.438956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.466845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:35.521775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:35.532704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62499-f664-4080-8c0b-b883dc44405a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.578240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.579132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.579417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.579694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.580372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:35.580683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.582453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.589415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b589fe-21a2-43cc-8af7-48e7fe6ebac2 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.592328 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 175/368] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:35.593315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.643787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.644588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.645048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.645494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.665290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:35.672942 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:35.674045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:35.675024 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:35.677248 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 194/369] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:35.680927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.732413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe29a4f-6e88-482c-b5fd-ca6eb507c23e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.746745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:35.780519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.781197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.781487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.781911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.783143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.785348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.787021 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 176/370] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:35.787803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:35.822619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f2f32-f43f-491a-9ae6-ff43a3e5089a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.839594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:35.862785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.863446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.863726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.863997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.918196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b91583-2c66-49c3-a005-62528ec0af78 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:35.939923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.941425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.959459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:35.960417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:35.960706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:35.961036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:35.962118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:35.962431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:35.963800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:35.974959 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 177/371] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:35.976342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.020389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:36.067748 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 195/372] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:36.068615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.088437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:36.115333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db7a98-6b5e-4566-a304-355ad3a3478c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.156943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.157994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.158280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.158558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.159712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=40cde41380d54f509e11695bf0a261b5) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:36.160029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:36.161799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:36.169275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 178/373] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:35 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:36.170047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.186756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98a48-c01b-4401-a610-91b8c7df4453 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.227741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.228359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.228624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.228895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.305266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:36.312201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9defd-3ec4-4bb1-9318-16576146e19f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.319562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:36.321085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:36.348936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:36.373671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.374473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.377955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.378237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.379513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:36.381023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:36.384312 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 179/374] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:36 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:36.391246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.497326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 196/375] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:36.503012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.576737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c8fa3-d64d-4295-97c2-fce4e5dc1ecd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.638557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.639513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.639980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.640437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.642680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:36.644311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:36.646256 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 180/376] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:36 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:36.655153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.669433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008307e8-c500-47e7-a709-acc9f9741c29 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.692517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:36.725569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:36.741516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.743026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.743304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.743578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] PATH_INFO: `/v3/projects/d86c8465865f42a8aed631f648876892` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.746627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] RBAC: Authorizing `identity:get_project(project_id=d86c8465865f42a8aed631f648876892)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:36.748189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:36.750047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 197/377] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:36 2022] GET /identity/v3/projects/d86c8465865f42a8aed631f648876892 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:36.758678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:36.854570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20b29-8293-4dff-8109-e75b71158e07 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.894526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.895147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.895422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.895690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.896473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=40cde41380d54f509e11695bf0a261b5) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:36.896784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:36.899371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:36.905800 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 181/378] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:36 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:36.946633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbdfe5-d9cb-460f-a73e-168119c922fc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:36.991988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409287e-f81a-461b-978f-64459ffd802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:36.992638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409287e-f81a-461b-978f-64459ffd802f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:36.992945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409287e-f81a-461b-978f-64459ffd802f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:36.993255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409287e-f81a-461b-978f-64459ffd802f None admin] PATH_INFO: `/v3/groups/7329916341564a7491127904bc9aae9c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:36.998732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409287e-f81a-461b-978f-64459ffd802f None admin] RBAC: Authorizing `identity:get_group(group_id=7329916341564a7491127904bc9aae9c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:37.000111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409287e-f81a-461b-978f-64459ffd802f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:37.002039 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 198/379] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:36 2022] GET /identity/v3/groups/7329916341564a7491127904bc9aae9c => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:37.008045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:37.164918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:37.168255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9572b-0dc0-4be4-8079-fa0bae13155a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:37.207093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:37.207767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:37.208053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:37.208327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:37.209109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] RBAC: Adding query filter params (group.id=7329916341564a7491127904bc9aae9c, role.id=61064a68b37843f5b88e6641075320de, scope.project.id=d86c8465865f42a8aed631f648876892) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:37.209421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:37.210979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac1ddd-f36e-4e08-8229-6245f13defc3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:37.219121 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 182/380] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:37 2022] GET /identity/v3/role_assignments?group.id=7329916341564a7491127904bc9aae9c&scope.project.id=d86c8465865f42a8aed631f648876892&role.id=61064a68b37843f5b88e6641075320de => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:37.422981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabc08e-9cb1-486e-893b-052327d64eeb None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:37.423993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabc08e-9cb1-486e-893b-052327d64eeb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:37.424492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabc08e-9cb1-486e-893b-052327d64eeb None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:37.426509 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 199/381] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:37.433013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523a0b8-5168-4095-bb75-5777ac6857d2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:37.433308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523a0b8-5168-4095-bb75-5777ac6857d2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:37.433583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523a0b8-5168-4095-bb75-5777ac6857d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:37.458886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7523a0b8-5168-4095-bb75-5777ac6857d2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:37.460876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7523a0b8-5168-4095-bb75-5777ac6857d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:37.548734 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 183/382] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:37.923079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabc08e-9cb1-486e-893b-052327d64eeb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:37.990430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:38.002423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f6669-b82e-49d7-8d5b-9efb4feaecbe None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.002736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f6669-b82e-49d7-8d5b-9efb4feaecbe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.002977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f6669-b82e-49d7-8d5b-9efb4feaecbe None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.004458 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 184/383] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:38.012013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.012608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.013124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.042280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:38.043483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:38.091280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabc08e-9cb1-486e-893b-052327d64eeb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:38.148055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:38.149212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.149714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.149998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.165732 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 185/384] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:38.173844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:38.179009 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:38.179948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:38.180768 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 200/385] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:38.187778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:38.229428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:38.324250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d47eaa-fbe5-45ae-bd96-d1b8cd287179 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:38.369609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:38.370221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.370500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.370772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.371439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:38.371743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:38.373190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:38.381684 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 186/386] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:38.387227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:38.473906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:38.506442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7707f-e748-4317-8a68-10e55efcf510 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:38.516504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:38.551760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:38.552409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.553037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.553323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.555504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:38.557176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:38.559897 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 201/387] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:38 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:38.567182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:38.584248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:38.603868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd62b19-e87b-4d66-a72e-77fdcf5afa99 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:38.680250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:38.681299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.682584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.683069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.705526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:38.712076 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:38.713229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:38.714166 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:38.722021 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 187/388] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:38.729148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:38.789435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db8eb1-4ce4-46cf-a2bd-906de5e5ed6c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:38.832247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:38.833282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:38.833761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:38.834242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:38.836242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:38.839392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:38.841614 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 202/389] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:38 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:38.848503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:38.931516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:38.937070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2502368-0a0a-4968-a6ad-633c9d498a59 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:39.007698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:39.008237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.008525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.008798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.009533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] RBAC: Adding query filter params (name=member) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:39.009844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:39.014229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:39.037408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 188/390] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:39.039946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:39.057532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc88a-fc65-4188-8a8d-45fcd4bdac6a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:39.067223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:39.120875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:39.121569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.121849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.122128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.130719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f7e1221a2e4593bf4d129297775e1a, group_id=9f1b8542051442f4ad24c5c5d5c94e5a, role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:39.132207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:39.168079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3e39e-0ed9-4ace-8cc3-90bcee0291db None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:39.168620 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 203/391] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 02:11:38 2022] PUT /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:11:39.207021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83467c0-6340-4e5b-8b12-b43d6c418a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:39.207680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83467c0-6340-4e5b-8b12-b43d6c418a36 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.207963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83467c0-6340-4e5b-8b12-b43d6c418a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.208306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83467c0-6340-4e5b-8b12-b43d6c418a36 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.209493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83467c0-6340-4e5b-8b12-b43d6c418a36 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:39.211526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83467c0-6340-4e5b-8b12-b43d6c418a36 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:39.213582 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 189/392] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:39 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:39.219399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:39.340221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98eaa-005e-41bf-8f55-b39c1168a4be None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:39.342053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:39.390696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:39.391347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.391630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.391908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.393118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:39.394641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:39.396333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 204/393] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:39 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:39.402471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af633d6b-8bf5-439d-a1dd-3ce7424ac2f2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.402771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af633d6b-8bf5-439d-a1dd-3ce7424ac2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.403037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af633d6b-8bf5-439d-a1dd-3ce7424ac2f2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.404396 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 190/394] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:39.405887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:39.410271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c6885-baf2-41d2-9caf-afd5d97c999b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.410561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c6885-baf2-41d2-9caf-afd5d97c999b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.410838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c6885-baf2-41d2-9caf-afd5d97c999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.438597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8b3c6885-baf2-41d2-9caf-afd5d97c999b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:39.439871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b3c6885-baf2-41d2-9caf-afd5d97c999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:39.528939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 191/395] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:39.575016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ef0c-0188-47f5-a336-6b0af5204d79 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:39.634129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5995d4-8aa6-4dd6-88f9-13644f3b8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:39.634713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5995d4-8aa6-4dd6-88f9-13644f3b8da1 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.634991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5995d4-8aa6-4dd6-88f9-13644f3b8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.635265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5995d4-8aa6-4dd6-88f9-13644f3b8da1 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.639406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5995d4-8aa6-4dd6-88f9-13644f3b8da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0f7e1221a2e4593bf4d129297775e1a, group_id=9f1b8542051442f4ad24c5c5d5c94e5a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:39.640831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5995d4-8aa6-4dd6-88f9-13644f3b8da1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:39.668505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 205/396] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 02:11:39 2022] PUT /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:39.720743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1d75d-d4c8-40fd-8cb2-4a005d86ace7 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.721471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1d75d-d4c8-40fd-8cb2-4a005d86ace7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.721981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1d75d-d4c8-40fd-8cb2-4a005d86ace7 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.723927 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 192/397] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:39.730010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:39.730304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:39.730581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:39.759156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:39.760410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:39.799315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:39.852864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1d75d-d4c8-40fd-8cb2-4a005d86ace7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:39.863499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:39.870679 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 206/398] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:39.982372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1d75d-d4c8-40fd-8cb2-4a005d86ace7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.031615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.032652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.033158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.033638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.051682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:40.057231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:40.058133 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:40.059338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 193/399] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:40.064964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.206128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca84b0-be17-4ec3-af8e-9f1c35a3883b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.255054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.259574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.260207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.260489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.260767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.261473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:40.261778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:40.263165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:40.272001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 207/400] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:40.278593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.330856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:40.369292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:40.422025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f026a-6d57-4680-9659-d83408abfde3 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.437139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d24bc-6367-4960-b99f-fb0cd9efb6d0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.461012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.462018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.462643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.463121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.477958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:40.481090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde9dd3-cd31-45e0-97d8-35b2d8ac40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.481859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9dd3-cd31-45e0-97d8-35b2d8ac40e6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.482142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9dd3-cd31-45e0-97d8-35b2d8ac40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.482407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9dd3-cd31-45e0-97d8-35b2d8ac40e6 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.483555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde9dd3-cd31-45e0-97d8-35b2d8ac40e6 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:40.484551 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:40.485463 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:40.486275 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:40.486873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde9dd3-cd31-45e0-97d8-35b2d8ac40e6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:40.486873 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 208/401] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:40.488057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a8d7-bc06-4fe1-89cc-86fc9febf5e0 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.488338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a8d7-bc06-4fe1-89cc-86fc9febf5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.488611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a8d7-bc06-4fe1-89cc-86fc9febf5e0 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.489521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 194/402] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:40.494833 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 209/403] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:40.496027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.497212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a8d7-bc06-4fe1-89cc-86fc9febf5e0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.597360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:40.609442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3a8d7-bc06-4fe1-89cc-86fc9febf5e0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.610185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7021-83a0-45b4-b711-24c7fff9fc89 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.637036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:40.646958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41fe19-2dc8-45fb-8c9a-dd69996fc690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.648438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41fe19-2dc8-45fb-8c9a-dd69996fc690 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.648558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.649507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.649623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.651590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.651590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:40.651590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:40.652258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41fe19-2dc8-45fb-8c9a-dd69996fc690 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.652553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:40.652925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41fe19-2dc8-45fb-8c9a-dd69996fc690 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.654339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41fe19-2dc8-45fb-8c9a-dd69996fc690 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:40.656006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41fe19-2dc8-45fb-8c9a-dd69996fc690 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:40.658376 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 195/404] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:40.662426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 210/405] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:40.665651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.665977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.666089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.666352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.686303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:40.687592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:40.763226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 196/406] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:40.768958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:40.803062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c5ca1-4886-46b1-9a8b-b3a15c72d37e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.872541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.873850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.874383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.875132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.878217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cde41380d54f509e11695bf0a261b5, group_id=9f1b8542051442f4ad24c5c5d5c94e5a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:40.880559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:40.899577 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 211/407] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 02:11:40 2022] PUT /identity/v3/projects/40cde41380d54f509e11695bf0a261b5/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:40.932972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cfb27-2dfa-44e1-9b2d-a1bb95f9433e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:40.961986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:40.974069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:40.975722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:40.976384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:40.977157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:40.979006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:40.980970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:40.983350 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 197/408] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:40.990390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.011477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:41.113417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.133829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea81647-3ab7-461e-ba8d-155e2169b368 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:41.169779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:41.170411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:41.170690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:41.170961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:41.172241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:41.173823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:41.175985 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 212/409] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:40 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:41.182632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.261051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398411-9e47-44eb-a900-9310c06c886c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:41.332219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:41.332940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:41.333266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:41.333542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:41.336423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:41.348954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:41.355137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:41.356036 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:41.356834 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 198/410] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:41.362415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.379888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6115-1a40-4141-b685-92aec03f99c9 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:41.433973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:41.465449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:41.466421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:41.466704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:41.467254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:41.479434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] RBAC: Authorizing `identity:create_grant(project_id=40cde41380d54f509e11695bf0a261b5, group_id=9f1b8542051442f4ad24c5c5d5c94e5a, role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:41.480883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:41.509247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 213/411] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 02:11:41 2022] PUT /identity/v3/projects/40cde41380d54f509e11695bf0a261b5/groups/9f1b8542051442f4ad24c5c5d5c94e5a/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:41.511849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea1aef-e135-441f-b3f3-140abd3bc274 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:41.555617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:41.556219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:41.556501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:41.556772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:41.557642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:41.557949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:41.559427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:41.569826 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 199/412] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:41.578235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.718305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64093c8d-6e7d-477e-9190-a052daafdce5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:41.772021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:41.772708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:41.773075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:41.773284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] PATH_INFO: `/v3/groups/7329916341564a7491127904bc9aae9c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:41.774467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] RBAC: Authorizing `identity:get_group(group_id=7329916341564a7491127904bc9aae9c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:41.775926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:41.777505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 214/413] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:41 2022] GET /identity/v3/groups/7329916341564a7491127904bc9aae9c => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:41.783033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.916618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664d63d-39e6-45e6-9623-ff250f3754ae None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:41.933488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:41.956285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab41267-d1f8-45a0-9ff5-39ddbf0a3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:41.956931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41267-d1f8-45a0-9ff5-39ddbf0a3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:41.957223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41267-d1f8-45a0-9ff5-39ddbf0a3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:41.957493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab41267-d1f8-45a0-9ff5-39ddbf0a3cc2 None admin] PATH_INFO: `/v3/projects/d86c8465865f42a8aed631f648876892` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:41.958631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab41267-d1f8-45a0-9ff5-39ddbf0a3cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=d86c8465865f42a8aed631f648876892)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:41.960118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab41267-d1f8-45a0-9ff5-39ddbf0a3cc2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:41.962246 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 200/414] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:41 2022] GET /identity/v3/projects/d86c8465865f42a8aed631f648876892 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:41.967711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:41.979450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:42.062445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d19f6-d749-4cbe-bb18-b55743e83ed8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.062813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d19f6-d749-4cbe-bb18-b55743e83ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.063050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d19f6-d749-4cbe-bb18-b55743e83ed8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.064506 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 201/415] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:11:42.072154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248cf5-bdae-4b8e-ad79-adb45b8d2529 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.072475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248cf5-bdae-4b8e-ad79-adb45b8d2529 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.072700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248cf5-bdae-4b8e-ad79-adb45b8d2529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.101380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-53248cf5-bdae-4b8e-ad79-adb45b8d2529 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:42.103655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53248cf5-bdae-4b8e-ad79-adb45b8d2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:42.138363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bbc02-f844-47ff-b5bd-46caf3290c97 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:42.186202 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 202/416] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 05 02:11:42.208342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47dac5-7066-4901-9667-cfb7a1123baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:42.209302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47dac5-7066-4901-9667-cfb7a1123baf None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.210233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47dac5-7066-4901-9667-cfb7a1123baf None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.210644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47dac5-7066-4901-9667-cfb7a1123baf None admin] PATH_INFO: `/v3/projects/d86c8465865f42a8aed631f648876892/groups/7329916341564a7491127904bc9aae9c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.212821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47dac5-7066-4901-9667-cfb7a1123baf None admin] RBAC: Authorizing `identity:create_grant(project_id=d86c8465865f42a8aed631f648876892, group_id=7329916341564a7491127904bc9aae9c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:42.214420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47dac5-7066-4901-9667-cfb7a1123baf None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:42.235540 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 215/417] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Oct 5 02:11:41 2022] PUT /identity/v3/projects/d86c8465865f42a8aed631f648876892/groups/7329916341564a7491127904bc9aae9c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:11:42.419077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01f53-867c-4222-9bd3-30e7959e6cbd None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.419927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01f53-867c-4222-9bd3-30e7959e6cbd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.420463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01f53-867c-4222-9bd3-30e7959e6cbd None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.422518 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 203/418] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:42.435311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.436257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.437011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.464790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:42.466548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:42.538681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:42.546535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 216/419] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:42.563007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01f53-867c-4222-9bd3-30e7959e6cbd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:42.669604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01f53-867c-4222-9bd3-30e7959e6cbd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:42.685250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:42.706359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:42.706981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.707258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.707530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.717898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:42.722704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:42.723577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:42.724373 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:42.729037 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 204/420] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:42.731005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:42.837755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79b382-80d9-4c35-a980-7ea9ba91441d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:42.875765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:42.876375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:42.876653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:42.876941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:42.877613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:42.877971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:42.879395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:42.892846 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 217/421] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:42.894225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:42.999878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e777b-0eaa-4c23-b4ae-29a52a495b1b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:43.040391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:43.041026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.041310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.041586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.044431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:43.101321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:43.150601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:43.153227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:43.157157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:43.230992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e913ad9-3b72-41fe-8cc9-0ea83c95bd5f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:43.298471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:43.299517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.299996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.300478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.322086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:43.329206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:43.330185 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:43.331005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:43.333561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 218/422] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:43.343998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:43.353764 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 205/423] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:43.362131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:43.444735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:43.487056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94856120-f02e-4e71-97d7-8903af979442 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:43.537403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347955f3-bc1f-4fc7-bde2-e9f47176793a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:43.547766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:43.548783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.549284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.549777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.553667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:43.555520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:43.557395 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 206/424] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:43 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:43.562878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:43.582670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:43.613372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:43.613983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.614272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.614545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.615210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:43.615513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:43.621057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d723b-347a-4ec1-b2b5-bde2a498a459 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:43.636036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 219/425] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:43.637657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d4c6-21c0-4c81-86e3-aef4d993d489 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.638143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d4c6-21c0-4c81-86e3-aef4d993d489 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.638675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d4c6-21c0-4c81-86e3-aef4d993d489 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.640066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 220/426] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:43.643307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d4c6-21c0-4c81-86e3-aef4d993d489 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:43.704487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917883-d15d-4b2a-b963-0d101b27a8bf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:43.738405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025ad87-a41a-4c3c-bccc-76d6db9a88f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:43.739324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ad87-a41a-4c3c-bccc-76d6db9a88f3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.739786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ad87-a41a-4c3c-bccc-76d6db9a88f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.740264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ad87-a41a-4c3c-bccc-76d6db9a88f3 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.742397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ad87-a41a-4c3c-bccc-76d6db9a88f3 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:43.744057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ad87-a41a-4c3c-bccc-76d6db9a88f3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:43.746242 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 207/427] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:43 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:43.747594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.748115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.748620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.767639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d4c6-21c0-4c81-86e3-aef4d993d489 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:43.768416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:43.769109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:43.771173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:43.814513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:43.815181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:43.815461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:43.815864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:43.840051 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 208/428] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:43.841084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:43.874148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:43.891078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:43.892816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:43.954403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d31e5-f742-43b6-a448-0ea5fe683847 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.000400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.001125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.001411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.001687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.002428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:44.002743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:44.003560 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 221/429] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 02:11:44.004194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:44.010632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.011343 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 209/430] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:43 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:44.140567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:44.171730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c32af-bdf1-4626-a480-be2cb1612cef None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.224573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.227065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.227629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:44.227752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.228220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.228512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] PATH_INFO: `/v3/projects/b0f7e1221a2e4593bf4d129297775e1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.230865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] RBAC: Authorizing `identity:get_project(project_id=b0f7e1221a2e4593bf4d129297775e1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:44.232414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:44.234342 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 222/431] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/projects/b0f7e1221a2e4593bf4d129297775e1a => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:44.240074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.406548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a034320-809c-4d31-81b9-92b8e0120e92 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.442512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260faeb7-2a3c-46c8-a475-20db1f65ec3f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.451562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e173a-add8-4e42-afa4-b6a7ce717bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.452525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e173a-add8-4e42-afa4-b6a7ce717bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.453034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e173a-add8-4e42-afa4-b6a7ce717bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.454084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e173a-add8-4e42-afa4-b6a7ce717bb7 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.455767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e173a-add8-4e42-afa4-b6a7ce717bb7 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:44.457914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e173a-add8-4e42-afa4-b6a7ce717bb7 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:44.461326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 223/432] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:44.462778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26771f6-0968-4001-a931-20d9b118ab1a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.463260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26771f6-0968-4001-a931-20d9b118ab1a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.463726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26771f6-0968-4001-a931-20d9b118ab1a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.465973 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 224/433] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:44.471438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.471989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.472273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.493910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.493910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.493910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.494601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.496012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:44.499891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:44.509254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:44.514052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:44.515200 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:44.516278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 210/434] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:44.517213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.578202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 225/435] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:44.589138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.591842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:44.640573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a579-ea9f-4cd3-bead-9a396d73b328 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.680875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.681563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.681920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.682206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.682932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=b0f7e1221a2e4593bf4d129297775e1a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:44.683270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:44.684681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:44.692067 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 211/436] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=b0f7e1221a2e4593bf4d129297775e1a&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:44.714529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5a06c-e1c7-4de9-a067-e45fc1ac9c23 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.760572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.761545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.762008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.762450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.763331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:44.763801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:44.765564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262184df-3fce-4177-99fe-1c7f32e79f5a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:44.776357 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 226/437] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:44.788957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.870522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f56f5-0d28-42f6-9821-56caaa12ff7b None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.870854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f56f5-0d28-42f6-9821-56caaa12ff7b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.871089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f56f5-0d28-42f6-9821-56caaa12ff7b None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:44.872582 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 227/438] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:11:44.877510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f56f5-0d28-42f6-9821-56caaa12ff7b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:44.893149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:44.915644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7b155-7df6-4337-8085-c8bcf6f3aed4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:44.949161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:44.961714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:44.962611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:44.963068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:44.963849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.018973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f56f5-0d28-42f6-9821-56caaa12ff7b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.053202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.055684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.064448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c35e-9e4b-4960-b0d8-c21e29d4378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.064448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c35e-9e4b-4960-b0d8-c21e29d4378b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.064448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c35e-9e4b-4960-b0d8-c21e29d4378b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.064448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c35e-9e4b-4960-b0d8-c21e29d4378b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.076165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334c35e-9e4b-4960-b0d8-c21e29d4378b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-1334c35e-9e4b-4960-b0d8-c21e29d4378b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:45.081890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:45.082789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:45.083610 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 228/439] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:45.084261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.085036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.085036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.103551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:45.104624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:45.177153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.182727 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 212/440] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:45.183381 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 229/441] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:45.183588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.189578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.215892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.307212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8fef4-50e3-46ff-9a4e-30de88a5d5bd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.318190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7fd4e-c200-4692-9b70-336e2aa6615b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.345080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.345699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.345985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.346261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.346930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:45.347235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.348761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.358632 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 213/442] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:45.360860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.361606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.361885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.362152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.363449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.364295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.364879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.369036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 230/443] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:45.372516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.442112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.462105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.476404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e505c-63c5-4073-a8ad-0b7d66ef37fb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.478461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeafa0-1a44-4fbb-a0ca-7cac07e35cf4 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.509329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.509934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.510213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.510485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.511879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.512497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.512779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.513080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.514168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.515581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.517144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 231/444] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:45.517892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.577890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.579592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.617467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288ed29-7750-4adc-8cf7-5b8834c2576d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.650651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.651278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.651563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.651839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.654572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.664233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:45.665434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:45.669430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:45.670442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:45.671246 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 232/445] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:45.672527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.686018 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 214/446] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:45.686018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.774042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf13d-1e5e-4672-960a-25948931edfb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.780639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26c59-4eb7-4cc2-bbcf-5f615409d4fd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.808123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.808722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.809035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.809311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.810036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=c633580ee7eb4b5c829edbee3bd1ca81, scope.project.id=40cde41380d54f509e11695bf0a261b5) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:45.810342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.811780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.814464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.815068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.815347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.815620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.816273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:45.816576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.827455 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 233/447] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=c633580ee7eb4b5c829edbee3bd1ca81 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:45.827689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.827771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.827842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 215/448] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:45.833467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.886325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.893996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:45.933965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31347f4f-045d-4478-a32a-c42f38c6a5ca None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.954168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03388e48-11d8-44be-bdcb-7dbdffa309d9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:45.971386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.972027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.972309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.972618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] PATH_INFO: `/v3/projects/40cde41380d54f509e11695bf0a261b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:45.973787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] RBAC: Authorizing `identity:get_project(project_id=40cde41380d54f509e11695bf0a261b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:45.975949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:45.978157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 234/449] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/projects/40cde41380d54f509e11695bf0a261b5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:45.984566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:45.995663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:45.996327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:45.996608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:45.997663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:46.081320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:46.083036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:46.105414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1803b70-7a8e-46ab-afc6-477ae2b87efb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:46.134172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:46.141616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:46.146217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:46.146217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:46.146217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:46.146217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] PATH_INFO: `/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:46.149639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1b8542051442f4ad24c5c5d5c94e5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:46.149639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:46.150647 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 235/450] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/groups/9f1b8542051442f4ad24c5c5d5c94e5a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:46.156609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:46.206351 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 216/451] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:46.210709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:46.264937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb7bfb-e03a-48f6-8f26-8ee27de24863 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:46.298757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:46.299362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:46.299643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:46.299919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:46.300638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] RBAC: Adding query filter params (group.id=9f1b8542051442f4ad24c5c5d5c94e5a, role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=40cde41380d54f509e11695bf0a261b5) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:46.300966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:46.302414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:46.307885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70849e-8a08-49a7-ae5e-f5fe15395be8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:46.308140 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 236/452] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:46 2022] GET /identity/v3/role_assignments?group.id=9f1b8542051442f4ad24c5c5d5c94e5a&scope.project.id=40cde41380d54f509e11695bf0a261b5&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:46.344736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:46.345323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:46.345605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:46.345882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] PATH_INFO: `/v3/projects/d86c8465865f42a8aed631f648876892` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:46.347087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] RBAC: Authorizing `identity:get_project(project_id=d86c8465865f42a8aed631f648876892)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:46.348570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:46.351261 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 217/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:11:46 2022] GET /identity/v3/projects/d86c8465865f42a8aed631f648876892 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:46.356863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:46.420273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:46.465072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025afdd5-ee51-4abc-93dc-8ebe66b75a05 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:46.500091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed63de9-d05f-47e5-98fe-ac28fa2c4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:46.500404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63de9-d05f-47e5-98fe-ac28fa2c4b1c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:46.500687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63de9-d05f-47e5-98fe-ac28fa2c4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:46.500991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed63de9-d05f-47e5-98fe-ac28fa2c4b1c None admin] PATH_INFO: `/v3/groups/7329916341564a7491127904bc9aae9c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:46.502537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63de9-d05f-47e5-98fe-ac28fa2c4b1c None admin] RBAC: Authorizing `identity:get_group(group_id=7329916341564a7491127904bc9aae9c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:46.503537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed63de9-d05f-47e5-98fe-ac28fa2c4b1c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:46.505146 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 237/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Oct 5 02:11:46 2022] GET /identity/v3/groups/7329916341564a7491127904bc9aae9c => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:46.511552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:46.530975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:46.615008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7476-05a5-43cf-9317-86f7b57775fe None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:46.649330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:46.650172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:46.650450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:46.650725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:46.651516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] RBAC: Adding query filter params (group.id=7329916341564a7491127904bc9aae9c, role.id=61064a68b37843f5b88e6641075320de, scope.project.id=d86c8465865f42a8aed631f648876892) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:46.651829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:46.653290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027b5f0-3360-4083-8829-66d36e5bea77 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:46.659387 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 218/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Oct 5 02:11:46 2022] GET /identity/v3/role_assignments?group.id=7329916341564a7491127904bc9aae9c&scope.project.id=d86c8465865f42a8aed631f648876892&role.id=61064a68b37843f5b88e6641075320de => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:49.301165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abf44e-5bf0-4e4b-803f-0edcfaca265c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.302205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abf44e-5bf0-4e4b-803f-0edcfaca265c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.302684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abf44e-5bf0-4e4b-803f-0edcfaca265c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:49.304782 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 238/456] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:49.310115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8eeb5-0847-47a3-b886-e9e8318ce839 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.310552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8eeb5-0847-47a3-b886-e9e8318ce839 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.310670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8eeb5-0847-47a3-b886-e9e8318ce839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:49.336015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b0c8eeb5-0847-47a3-b886-e9e8318ce839 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:49.337697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b0c8eeb5-0847-47a3-b886-e9e8318ce839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:49.440131 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 219/457] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:49.561808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f7b5-b026-42da-b818-c7576fb8552e None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.563647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f7b5-b026-42da-b818-c7576fb8552e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.563647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f7b5-b026-42da-b818-c7576fb8552e None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:49.564074 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 239/458] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:49.569120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.569416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.569697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:49.593883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:49.595143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:49.603372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:49.656929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac045-161d-4792-8c01-d835cc9caa87 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.656929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac045-161d-4792-8c01-d835cc9caa87 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.656929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac045-161d-4792-8c01-d835cc9caa87 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:49.658307 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 240/459] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:11:49.663909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.665535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.666022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:49.685327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 220/460] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:49.698532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:49.699735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:49.793202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 241/461] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:49.843040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:49.952362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b756bad-0fe7-4cc9-8c7e-3c806b75a83b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:49.971209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:49.998021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:49.998658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:49.998942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:49.999219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.018913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.020407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.026109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:50.050089 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:50.051277 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:50.052348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:50.052348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:50.052348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:50.054532 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 221/462] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:50.061008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.086693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:50.158440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258b8e-4927-4341-a21f-da242e1aa411 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.203666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dd97f-b223-45ed-bb5b-8d6aac7d5162 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.206945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.207259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.207526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.207797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.219811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.222079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.240143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.240853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.241295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.241568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.242208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:50.242508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:50.242697 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:50.243577 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:50.245122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:50.245122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:50.245122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:50.245286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed253e54-dbb9-45e0-b136-19d619fe1d93 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.245369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 242/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:50.245369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.267965 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 222/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:50.269725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd399b-59a2-4a87-b161-c4fa03497bea None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.270018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd399b-59a2-4a87-b161-c4fa03497bea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.270292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd399b-59a2-4a87-b161-c4fa03497bea None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.271679 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 223/465] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:50.273895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd399b-59a2-4a87-b161-c4fa03497bea None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.339296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:50.354465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ec97-6f6b-4669-b039-d9f99b51b66c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.366306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:50.391301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd399b-59a2-4a87-b161-c4fa03497bea None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.393465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.394106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.394379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.394658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.405240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.406694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:50.421252 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:50.422172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:50.423005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:50.423005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:50.423005 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:50.423005 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 243/466] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:50.423005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.435080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.435700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.435984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.436260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.436928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:50.437258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.438671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e524-0d30-44c8-a091-5c69888fe726 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.450600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 224/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:50.451923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.452214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.452495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.470649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:50.471848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:50.537413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc07c88-da50-4203-a20b-86a63e96ac31 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.543968 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 225/468] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:50.544816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.590253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.591161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.592144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.592603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.593465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.595916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.598132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:50.626418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 244/469] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:50 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:50.627659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.671441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:50.726310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9a28d-f396-43f4-8550-a7d9f8541a77 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.768049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90eec3-8276-419d-b0dc-d6dc7466ad73 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:50.816506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.817546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.817827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.818102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.819580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.820799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.826479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:50.827175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:50.827456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:50.827727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:50.828384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:50.828983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:50.830376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:50.858204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 226/470] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:50.866663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.879029 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 245/471] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:50 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:50.880369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:50.985647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:51.004423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc9a24-4965-461f-a24c-5ba9481e40fa None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:51.009472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:51.016651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91859746-25b5-4cee-932a-9392b2b18161 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:51.056363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375d336-f3f6-48a0-a06f-61afdaae9723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:51.057078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d336-f3f6-48a0-a06f-61afdaae9723 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.057359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d336-f3f6-48a0-a06f-61afdaae9723 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.057636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375d336-f3f6-48a0-a06f-61afdaae9723 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.058300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375d336-f3f6-48a0-a06f-61afdaae9723 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:51.060052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375d336-f3f6-48a0-a06f-61afdaae9723 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:51.065086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:51.066005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.066484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.066955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.082835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:51.083922 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 227/472] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:50 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:51.084431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:51.085091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aec5c-62c8-4e5d-9c32-78cbbd185b13 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.085326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aec5c-62c8-4e5d-9c32-78cbbd185b13 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.085600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aec5c-62c8-4e5d-9c32-78cbbd185b13 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.087217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 228/473] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:51.092629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.093044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.093321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:51.101446 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:51.102425 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:51.103294 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:51.103294 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:51.103294 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:51.107765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 246/474] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:51.109162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:51.117674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:51.118947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:51.224993 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 229/475] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:51.257628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d294f-827b-4b87-9375-cfc1401f33c4 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:51.294855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:51.305023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:51.305638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.305923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.306199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.306855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:51.307159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:51.308529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:51.321541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 247/476] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:51.327026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:51.436139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:51.446782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9ee2-1568-406c-a2de-a18a440b591d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:51.483863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:51.484473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.484752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.485059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.485721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:51.487154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:51.513036 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 230/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:51 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:51.527886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:51.669233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9477-83a4-49ea-8b99-991848f3efba None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:51.722857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:51.723480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.723762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.724038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.724746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:51.726840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:51.737925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.sql.core [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 05 02:11:51.737925 n-d-858272-3 devstack@keystone.service[81826]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 05 02:11:51.737925 n-d-858272-3 devstack@keystone.service[81826]: [parameters: {'id': '5055266aeb204f74bb30d946ebcece58', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 05 02:11:51.737925 n-d-858272-3 devstack@keystone.service[81826]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81826) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application result.read() Oct 05 02:11:51.755828 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return ref.to_dict() Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:11:51.757232 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application yield resource Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise self.value Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application session.commit() Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 02:11:51.758995 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.session.flush() Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application compat.raise_( Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:11:51.760394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:11:51.761588 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application result.read() Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:11:51.765620 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [parameters: {'id': '5055266aeb204f74bb30d946ebcece58', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:51.766657 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 05 02:11:51.768053 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:51.770351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 248/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 02:11:51 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:51.770488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:51.878650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37480fee-091d-4eaa-a680-d491e0a65be2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:51.914340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39762d-b37c-405e-804e-4638f35a6da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:51.915082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39762d-b37c-405e-804e-4638f35a6da1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:51.915329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39762d-b37c-405e-804e-4638f35a6da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:51.915587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39762d-b37c-405e-804e-4638f35a6da1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:51.926626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39762d-b37c-405e-804e-4638f35a6da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fb39762d-b37c-405e-804e-4638f35a6da1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:51.932199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:51.934348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:51.935791 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 231/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:11:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:51.942208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:52.010382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:52.064628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8f1c1-f06e-4005-916e-832e0b0867d5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:52.101534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:52.102149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:52.102428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:52.102703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:52.103382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:52.103686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:52.105092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e288d7-1179-4c08-b0ea-721f59058402 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:52.114126 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 249/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:53.450574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03c74-3e23-403e-9371-ef01068d191b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:53.451118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03c74-3e23-403e-9371-ef01068d191b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:53.451118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03c74-3e23-403e-9371-ef01068d191b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:53.452713 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 232/481] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:53.457854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edfe6f-1997-4672-8bce-56f62ed83ad6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:53.458249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edfe6f-1997-4672-8bce-56f62ed83ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:53.458428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edfe6f-1997-4672-8bce-56f62ed83ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:53.489923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b8edfe6f-1997-4672-8bce-56f62ed83ad6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:53.491164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8edfe6f-1997-4672-8bce-56f62ed83ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:53.571682 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 250/482] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:53.635371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358bd2-d7c7-480c-bca4-33deab0724ee None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:53.635799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358bd2-d7c7-480c-bca4-33deab0724ee None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:53.636178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358bd2-d7c7-480c-bca4-33deab0724ee None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:53.637899 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 233/483] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:53.646041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105708-3f49-4dfa-8cad-dd6577bf9f6c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:53.646041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105708-3f49-4dfa-8cad-dd6577bf9f6c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:53.646041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105708-3f49-4dfa-8cad-dd6577bf9f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:53.669572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7a105708-3f49-4dfa-8cad-dd6577bf9f6c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:53.670741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7a105708-3f49-4dfa-8cad-dd6577bf9f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:53.722800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:53.764134 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 251/484] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:53.884450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29358bd2-d7c7-480c-bca4-33deab0724ee None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:53.898367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.023495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29358bd2-d7c7-480c-bca4-33deab0724ee None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.032660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250ae5-5bd8-43f3-a0e6-dc10b82f7228 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.032967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250ae5-5bd8-43f3-a0e6-dc10b82f7228 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.033245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8250ae5-5bd8-43f3-a0e6-dc10b82f7228 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.039482 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 252/485] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:54.044856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.045395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.045869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.074525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:54.078526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:54.086061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.086975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.087453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.087921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.104301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:54.109633 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:54.110604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:54.111562 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 234/486] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:11:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:54.117685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.203706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.236574 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 253/487] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:11:54.238072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.264255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aa2a-7d52-4f7c-b3f9-979cc20e1899 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.337589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.338571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.338995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.339408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.340239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:54.340544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:54.341937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:54.362988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 235/488] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:54.368646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.371449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8d08c-8c20-4228-92d4-f08ba40037c9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.373546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.422893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.424306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.425204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.426282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.446391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:54.454764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:54.455650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:54.456458 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:54.460129 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 254/489] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:54.467188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.537521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c089c5-268c-4022-9604-82f4cc00544e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.574132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.585751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.586384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.586687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.586952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.599692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:54.601204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:54.609226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73464b7a-51ed-495a-b617-1f1012695212 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:54.618628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:54.619541 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:54.620399 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:54.620399 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:54.620399 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:54.620399 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 236/490] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:11:54.621060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.650315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.651319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.651798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.652309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.653203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:54.653833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:54.655510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:54.665538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 255/491] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:54.672051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.699295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.743485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4e7ef-75a5-4281-bfc6-b8a137fd2ae8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.778097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.778717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.778999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.779267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.780975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0edd8-6250-4e4c-b607-2dfc6bfb326b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.790095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:54.795202 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:54.796112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:54.797309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 237/492] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:54.798001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.819771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.820386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.820714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.821018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.821667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:54.821973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:54.823404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb1bf4-82cb-4eb5-81b9-54a3a918842d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:54.835976 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 256/493] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:54.837329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8edee2-00c4-4240-995e-2304a27e3403 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.837616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8edee2-00c4-4240-995e-2304a27e3403 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.837894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8edee2-00c4-4240-995e-2304a27e3403 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.840943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 257/494] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:54.840943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8edee2-00c4-4240-995e-2304a27e3403 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:54.852042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.915694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd66f-2608-4eda-9dcb-95f0d858f143 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.927731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:54.947774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8edee2-00c4-4240-995e-2304a27e3403 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:54.956719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.957399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.957676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.958278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.970336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:54.971912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:54.986859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:54.987480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:54.987765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:54.987943 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:54.988864 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:54.989766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:54.989766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:54.989766 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:54.989928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:54.989928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:54.989928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:54.990097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 238/495] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:54.991258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f36f4-a0e5-41b6-be00-08e2b9505061 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:54.995102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.005215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 258/496] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:55.005215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.005215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.005215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.020844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:55.022102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:55.094666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 259/497] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:55.095507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.104213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294bb29-7e83-42cd-b3fb-c792e0b64f36 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.105723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.140335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.140981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.141263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.141537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.149431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.150854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:11:55.164165 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:55.165151 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:11:55.166060 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:55.170006 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 239/498] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:11:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:55.170715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.186210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.211494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a7e3f-a409-4d03-bc78-027c1ba0437f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.245892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.246842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.247124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.247399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.248036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:55.248337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.249736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea6ca6-35e7-4cae-a5ad-01297b6bb6ea None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.265604 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 260/499] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:55.265604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973a0cf-7b96-4f19-aa9c-32ed474cc87d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.265604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973a0cf-7b96-4f19-aa9c-32ed474cc87d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.265604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973a0cf-7b96-4f19-aa9c-32ed474cc87d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.268609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 261/500] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:11:55.269333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973a0cf-7b96-4f19-aa9c-32ed474cc87d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.284464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5dab-e051-4f11-9d50-e86bec0bd470 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.326526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.327434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.327721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.327995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.340878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.342612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:55.357863 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:55.358773 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:55.359613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:55.359613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:55.359613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:55.359613 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 240/501] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:55.359613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.364725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.379871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973a0cf-7b96-4f19-aa9c-32ed474cc87d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.413902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.414501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.414784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.415062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.415782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:55.416086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.417547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cdf36-1f7a-4529-a946-13a2695374d6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.429195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.454950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 262/502] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:55.456174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.456458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.456731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.472448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ec81a-3f04-466b-bf7a-e301544bb433 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.476170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:55.477412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:55.504735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.505372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.505650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.505926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.514032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.515475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:11:55.526906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:55.527804 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 241/503] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:55.528704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.544825 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 263/504] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:11:55.545695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.601464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.646440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308c8f-dc21-4b64-b453-873a51caa633 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.683790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91e3d-e2f0-4395-bfe2-8fbc9aec44f5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.685129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.685843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.686245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.686522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.687169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:55.687474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.688845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.705814 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 242/505] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:55.705814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.714913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.727418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.728057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.728338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.728612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.739686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:11:55.744980 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:55.745894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:11:55.746708 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:55.750977 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 264/506] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:55.751748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.809758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146929-8668-43e8-86d6-60d82992d33c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.833996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:55.845299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.845900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.846182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.846452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.855123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4798b-e8bb-4f55-9912-761b326da1a9 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:55.890692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:55.891293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:55.891572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:55.891852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:55.892572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:55.892873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.894349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.911171 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 265/507] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:55.911902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:55.919102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:55.920555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:55.953701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.010969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f475aae-f873-409d-b48f-7cf51d4e2715 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.022141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 243/508] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:56.022141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.042998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.045331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.045953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.046235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.046509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.053834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.055438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:11:56.067892 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:56.069205 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 266/509] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:11:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:56.070329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.117036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307a11-19f3-4bce-81fa-db5419507712 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.150209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.150884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.151173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.151448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.152107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:56.152414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.153813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.161507 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 244/510] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:56.162228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.170301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dfa98-accd-43a7-8e15-b941185fe55e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.171818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.205298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.205922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.206201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.206478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.216999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.218456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:56.233160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:56.234246 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:56.235109 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:56.235109 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.235109 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:56.235109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 267/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:56.235424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.247559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.262622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453910ba-4096-48fe-b683-b80fac54ebd8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.296366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.296987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.297270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.297540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.335612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6d00-3d58-442a-93c8-8abddf9c4207 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.364665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.366383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.368084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.368703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.369018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.369288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.379511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.380994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:56.395074 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:56.395975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:56.397360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:56.397360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.397360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:56.397360 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 268/512] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:56.397591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.405965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.454040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.470260 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 245/513] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:56.471076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.496970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3c7d-4505-482c-8f23-0b8fb0b217a0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.529941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.530552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.530843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.531121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.531848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:56.532163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.533659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.550372 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 269/514] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:56.551167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.575825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1768b-94f3-4acc-b245-176b5b6dccd7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.608459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.609182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.609372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.609637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.613645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.620495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.622134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:56.636888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:56.637904 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:56.638792 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:56.638792 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.638792 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:56.642632 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 246/515] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:56.643508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.654014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe6770-7552-4da9-8579-6b9066ff0934 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.683705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.688775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.689416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.689696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.689969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.690602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:56.690903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.692271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.704369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 270/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:56.705194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.751251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb794a5-9eab-4b6c-9003-4fb429a39cf1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.783631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.784225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.784504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.784775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.785440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:56.785741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.787114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.798871 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 247/517] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:56.799650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.810422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815bbc3-5aed-40eb-8ce2-1ec76fa6fc6c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.834516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.845439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.846062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.846342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.846608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.857383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:56.858869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:56.873415 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:56.874333 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:56.875177 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:56.875177 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:56.875177 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:56.875177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 271/518] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:56.875389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:56.894997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:56.899261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35505d3-7546-41a5-9bd0-2ff37fb4e00e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:56.934676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:56.935279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:56.935565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:56.935838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:56.978796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2608-c54f-45c2-a4a1-ae7af9932f8c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.001647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.003100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.011544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.012133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.012417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.012688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.013359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:57.013670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.015031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.026635 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 272/519] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:57.027327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.061637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.100713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.105220 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 248/520] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:57.106026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.130798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d46d-ebd4-47c2-96b1-962a2379237c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.164354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.164972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.165253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.165529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.166165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.167593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.188978 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 273/521] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:11:57 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:11:57.189964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.221319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791017ea-7406-4a79-aab3-e7a9e05f1e57 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.265067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.265829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.266114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.266961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.276074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.277655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:11:57.292989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:57.293925 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:57.294762 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:57.296961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.297443 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 249/522] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:57.298652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.314728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4959-d277-4a2b-a711-cc88678a7ed1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.352779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.353427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.353748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.353979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.354630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:57.354937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.356355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.372943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 274/523] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:57.372943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.374073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.423135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f73d1-5887-4e02-b5b2-47a9713d7e9d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.462014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.462631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.462913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.463185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.472872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.474360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.482411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb571c-1fd6-4273-8ff4-ea6a610d61f0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:11:57.488670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:57.489732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:57.491716 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 250/524] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:57.492297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.524190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.525019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.525306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.525590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.536244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.538007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:57.552772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:57.554298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:57.555378 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:57.555378 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:57.555378 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:57.558262 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 275/525] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:57.559436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.563346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.602301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e27449-d9c8-492e-a256-7df02adc4b95 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.620417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.639883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.640491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.640773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.641584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.642284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:57.642654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.644783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.669387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5595808-1f19-4b79-a22b-7d8045e901bb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.671586 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 251/526] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:57.672455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.710334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.710962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.711244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.711520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.718341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.719813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:11:57.733292 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:57.734170 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:57.735066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 276/527] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:57.736459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.789206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9dbac-e884-4db4-a1a0-98fa3a5fb3e4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.799243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.823693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.824299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.824603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.824876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.825626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:57.825935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.827463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.841245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30676f6-6d9a-48fa-9113-22fb06caee0b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:57.873318 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 252/528] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:57.873318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.880405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:57.881077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:57.881376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:57.881790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:57.882455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:57.882762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:57.884147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:57.897285 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 277/529] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:57.897285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:57.915392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:57.991067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f498e4-d3be-461c-a20a-26fa4a4836bf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.015748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f79c-c698-4676-b55f-bba7ffa1d623 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.026448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.027056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.027509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.027633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.028315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=33ae6b3ef0964315be1bc1983fe65939) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:58.028626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.030099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.045021 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 253/530] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/role_assignments?user.id=33ae6b3ef0964315be1bc1983fe65939&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:58.045021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.050208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:58.069567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.070364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.070769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.071045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.071758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:58.072063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.073574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.100527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 278/531] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:58.101778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.167377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:58.171123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6837843-4e31-427d-af7b-2a9a759b54be None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.216931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.217672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.218047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.218395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.223682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71311-cd15-4c6b-a757-5b6c37ec59b9 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.269165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.270643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.271123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.271560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.281353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.283453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.296555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.297975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:11:58.298829 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:58.299641 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:58.300487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:58.307923 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 279/532] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:58.307923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.368513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:58.414428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:58.422952 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 254/533] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:11:58.424112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.444164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe940b5-1b4b-4574-afa8-c5a329a13e43 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.487172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.488084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.488991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.489471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.491264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=c7ebd0b9ab9a48f0a5505863a7d729e4) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:58.492077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.494361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.501562 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 280/534] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/role_assignments?user.id=c7ebd0b9ab9a48f0a5505863a7d729e4&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:58.503329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.577855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e742f-0398-4de7-ade0-0c661add6e50 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.661715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.663055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.663961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.664251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.672971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:58.672971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.672971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.673928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a84a-1cb5-4218-8856-a096f0a57c1d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.681866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 255/535] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:58.689309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:58.691138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.728085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.728867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.729193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.729475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.748253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.749873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:11:58.767004 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:58.767946 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:11:58.768790 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:11:58.768790 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:11:58.768790 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:11:58.769531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 281/536] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:58.775672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:58.780048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:58.825674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b99c-2ef5-4074-9cca-ab9cc716e2c4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.897295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484ee8-0038-4151-8e0d-e64e1c6d029b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:58.899785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.900749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.900749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.901233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.902036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=b074e2c621494cdfa6efc21e4a5c021b) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:58.902415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.903918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.917247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 256/537] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/role_assignments?user.id=b074e2c621494cdfa6efc21e4a5c021b&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:58.937016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:58.937932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:58.938482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:58.938932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:58.939818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:58.940309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:58.941952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:58.956699 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 282/538] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:11:58.964953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:59.144289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27f77-a33b-45a0-94ee-10220491b4e4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:59.171377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:59.184220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:59.185120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:59.185505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:59.185878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:59.204496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:59.204496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:11:59.217520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:11:59.218598 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:11:59.219628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:11:59.221651 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 257/539] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:11:59.227237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:59.258839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:11:59.371249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47b02-9f89-42f5-9ded-95bcc459fa57 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:59.416469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089af988-8742-4130-a11e-65df534294fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:59.417112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af988-8742-4130-a11e-65df534294fd None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:59.417398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af988-8742-4130-a11e-65df534294fd None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:59.417676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089af988-8742-4130-a11e-65df534294fd None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:59.418383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af988-8742-4130-a11e-65df534294fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:59.418702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af988-8742-4130-a11e-65df534294fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:59.420192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089af988-8742-4130-a11e-65df534294fd None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:59.438376 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 283/540] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:59.444606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:11:59.551915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c8eb-9bfd-416d-a65a-9f22e4b92156 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:59.552201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c8eb-9bfd-416d-a65a-9f22e4b92156 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:59.552486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c8eb-9bfd-416d-a65a-9f22e4b92156 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:59.554051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 284/541] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:11:59.559563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:59.559848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:59.560139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:59.590254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:11:59.591727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:11:59.612369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9616-e370-4357-8a47-96b6b511435c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:11:59.683897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:11:59.684543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:11:59.684787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:11:59.685085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:11:59.685838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=c91c97c8ca6f457ab50e78a75b852db6) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:11:59.686151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:11:59.687643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:11:59.703264 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 258/542] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:11:59 2022] GET /identity/v3/role_assignments?user.id=c91c97c8ca6f457ab50e78a75b852db6&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:11:59.727756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 285/543] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:00.048980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:00.102401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:00.171683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f1715-ee6f-4063-9cfa-df40b933e4b0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:00.206036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:00.206682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:00.206968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:00.207244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:00.219651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:00.227012 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:00.227987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:00.229236 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 259/544] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:00.235287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:00.256777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:00.402115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db019a-4dff-473e-a8f2-79098472c85f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:00.458227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:00.458852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:00.459174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:00.459978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:00.460656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:00.460984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:00.462386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54510f44-30f2-49af-94dd-4e4b5cce8b74 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:00.477290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 286/545] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:00.483185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:00.652283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0051b-d69d-437b-afdb-a639819131ee None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:00.673540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:00.719386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:00.720136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:00.720293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:00.720570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:00.739117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:00.740683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:00.759582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de8c0-8bfe-4072-855b-d206805e4452 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:00.760985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de8c0-8bfe-4072-855b-d206805e4452 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:00.761707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950de8c0-8bfe-4072-855b-d206805e4452 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-69a615dd-02ba-4969-ab5c-0aa20a1142b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:00.767680 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:00.768648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:00.769981 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:00.769981 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:00.769981 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:00.769981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 260/547] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:00.770385 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 287/547] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:00.773067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:00.773370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:00.773654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:00.777927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de8c0-8bfe-4072-855b-d206805e4452 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:00.796930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:00.796930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:00.909314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:00.949453 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 261/548] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:00.982660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950de8c0-8bfe-4072-855b-d206805e4452 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:01.045736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:01.046366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.046651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.046927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.047602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:01.047909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:01.049313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:01.063236 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 288/549] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:01.070315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:01.201251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:01.216306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c691f-103c-4a8b-b71f-746ba261fcb2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:01.260238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:01.260238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.260502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.260771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.270965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:01.273921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:01.288603 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:01.290473 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:01.291466 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:01.299850 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 262/550] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:01.307283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:01.330001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:01.460773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7e08-0028-4c6c-83fb-ffb82fe770cf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:01.472473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504f32e-0cd4-4d97-a291-eebaec663e31 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:01.499880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d74fd-c602-468b-93fb-e6c842bb44ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:01.500604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d74fd-c602-468b-93fb-e6c842bb44ac None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.501013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d74fd-c602-468b-93fb-e6c842bb44ac None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.501339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d74fd-c602-468b-93fb-e6c842bb44ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.504405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:01.510605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:01.511333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.511687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.512045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.512861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:01.513269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:01.514792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851499c-d715-454b-b489-f4c3fdb87ae9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:01.515467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d74fd-c602-468b-93fb-e6c842bb44ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-899d74fd-c602-468b-93fb-e6c842bb44ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:01.521316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:01.522800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:01.523622 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:01.527118 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 263/551] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:01.528502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018214-ea02-4a9c-9aab-77aaae3a9e88 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.528935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018214-ea02-4a9c-9aab-77aaae3a9e88 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.529339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018214-ea02-4a9c-9aab-77aaae3a9e88 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.534763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 264/552] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:01.535721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018214-ea02-4a9c-9aab-77aaae3a9e88 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:01.543792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 289/553] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 02:12:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:01.544865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.545189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.545472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.562075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:01.570707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:01.571932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:01.649086 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 290/554] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:01.649993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:01.684857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018214-ea02-4a9c-9aab-77aaae3a9e88 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:01.733645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056278d-9401-4385-a28c-d053b449888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:01.734252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056278d-9401-4385-a28c-d053b449888a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.734501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056278d-9401-4385-a28c-d053b449888a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.734779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056278d-9401-4385-a28c-d053b449888a None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.735511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056278d-9401-4385-a28c-d053b449888a None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:01.735816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056278d-9401-4385-a28c-d053b449888a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:01.738965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056278d-9401-4385-a28c-d053b449888a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:01.756661 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 265/555] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:01.764508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056278d-9401-4385-a28c-d053b449888a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:01.855463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0934e-cf6c-4158-8c40-f17617489150 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:01.899570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:01.912777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:01.928930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:01.929654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:01.929998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:01.930278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:01.965218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056278d-9401-4385-a28c-d053b449888a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.009178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.010119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.010398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.010667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.019180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.020648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.022581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.024120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-401ec4cf-80ea-4d35-a2bd-28f733668a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:02.039137 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:02.040270 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:02.041179 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:02.041179 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:02.041179 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:02.041179 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 266/556] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:02.041419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed9eb-a6fc-4324-a35a-05f4a67b4a9d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.041863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed9eb-a6fc-4324-a35a-05f4a67b4a9d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.041863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed9eb-a6fc-4324-a35a-05f4a67b4a9d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.043216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 267/557] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:02.043734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed9eb-a6fc-4324-a35a-05f4a67b4a9d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.143575 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 291/558] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:02.143575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.156596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed9eb-a6fc-4324-a35a-05f4a67b4a9d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.164245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.182158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.194442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03676-e551-4738-80e1-22bd20073a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.195074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03676-e551-4738-80e1-22bd20073a0f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.195356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03676-e551-4738-80e1-22bd20073a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.195634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03676-e551-4738-80e1-22bd20073a0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.207406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a03676-e551-4738-80e1-22bd20073a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-27a03676-e551-4738-80e1-22bd20073a0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:02.212851 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:02.214043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:02.215034 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 268/559] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:02.219801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.220085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.220373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.238390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:02.239577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:02.251820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c123d-5d85-4609-875b-1a04a14cd495 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.291153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.291664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.291960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.292214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.292862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:02.293191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.294567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.306600 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 292/560] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:02.309830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.314490 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 269/561] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:02.317922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.396005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.417231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af98a6-f9dc-44a8-86a2-4206a7b39696 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.438056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420eff9-5d24-42d9-988b-48aa9038e919 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.451187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.451808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.452088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.452366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.452930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.464177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.465641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.477274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.477876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.478153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.478424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.479083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:02.479424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:02.480145 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:02.481039 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:02.486772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:02.486772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:02.486772 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:02.486968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04dc9-a5d5-4d48-b5af-7622d57a0de1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.487039 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 293/562] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:02.487039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.494165 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 270/563] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:02.496194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa6bc-74bf-482b-aca8-3c3ab141ec01 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.496666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa6bc-74bf-482b-aca8-3c3ab141ec01 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.497149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa6bc-74bf-482b-aca8-3c3ab141ec01 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.498853 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 271/564] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:02.499729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa6bc-74bf-482b-aca8-3c3ab141ec01 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.583474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86cead-35b6-4aa5-9bc8-76b4bf18e515 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.610399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa6bc-74bf-482b-aca8-3c3ab141ec01 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.612591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.618149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.618772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.619060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.619336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.627810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.629284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:02.640295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:02.641349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 294/565] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:02.642327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.648420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.649060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.649340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.649612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.650255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:02.650559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.652412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb207a-275d-4d82-ad94-8c02e4483ba2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.667009 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 272/566] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:02.668222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.668549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.668792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.687033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:02.688207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:02.717912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.742973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c63f5-0e91-4539-b35e-17fc81b4be52 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.756668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 273/567] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:02.757538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.775740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.776574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.777059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.777483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.788495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.790211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:02.804720 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:02.805898 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:02.806993 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:02.806993 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:02.806993 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:02.812958 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 295/568] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:02.813928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.859843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e31861-fa35-4fc9-8629-e5f4c21bb1c7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.863162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.895707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.896333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.896671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.897470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.908396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:02.913514 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:02.914446 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:02.915695 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 274/569] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:02.916407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:02.927220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05687dfe-8604-4f84-a1cf-61ab869270b6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:02.946011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:02.964267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:02.964935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:02.965230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:02.965506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:02.966234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:02.966540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:02.968042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:02.988932 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 296/570] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:02.989788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.026415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6973123-dd21-4e20-bf6e-da06f1db4aa7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.059912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.060533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.060809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.061115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.067471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.069555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:03.080594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:03.081645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 275/571] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:03.082540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.096318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d602-9eec-4c84-a565-8de0f617ac1e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.097875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.134104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.134622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.134900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.135179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.135810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.136108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.137530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.148412 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 297/572] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.149213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.170004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.185838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097df8f-a6b5-4ceb-9623-819495170048 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.219515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.220150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.220433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.220706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.221389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.221697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.223057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.231135 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 276/573] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.231910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.254341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4d857-b179-4040-8064-a91287c35503 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.288830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.289582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.289868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.290184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.300311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.301778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:03.316550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:03.317741 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:03.319660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:03.319660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:03.319660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:03.319660 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 298/574] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:03.321061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.335033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef007f-374b-4755-b730-bcb3ffbb6010 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.337441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.369098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.369725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.370008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.370275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.380062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:03.386083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:03.387147 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 277/575] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:03.388008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.401535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.423668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1e0ae-be5e-40a8-bb65-37c7c0d29505 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.456576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.457201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.457481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.457751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.458432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.458731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.460818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.472522 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 299/576] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.473328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.497900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3210-f044-41b3-969e-bb3238eb5e90 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.531223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.531839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.532114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.532395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.539606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.541075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.546845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:03.552259 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:03.553557 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 278/577] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:03.554827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.577563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaf168-cac2-4435-a8aa-cb2a0764281b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.611762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.612389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.612679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.612987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.623060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.623440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.625196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:03.639590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:03.640740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:03.641886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:03.641886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:03.641886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:03.641886 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 300/578] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:03.641886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.661970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc74d-9317-46be-a79b-49e3bfca1512 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.696548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.697205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.697487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.697762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.698398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.698705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.700067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.711697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 279/579] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.712478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.744024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d8b53-e6bc-4d50-b438-cfe8d5397f76 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.768748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.779529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.780131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.780407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.780682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.781405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.781706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.783060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.790733 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 301/580] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.791509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.822699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34dd57-72d3-45ab-ad5b-fc87eb60d312 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.849270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:03.857129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.857737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.858016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.858291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.859019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=4c0d9417ce05468695abebca3b0abde3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.859325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.860746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.866471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 280/581] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/role_assignments?user.id=4c0d9417ce05468695abebca3b0abde3&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.867249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.906233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb07fa-b3e0-4e30-ac31-d0e6539d18aa None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:03.944995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:03.946494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:03.946785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:03.947061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:03.947826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:03.948198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:03.949701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:03.971024 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 302/582] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:03.971891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:03.986380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a3cf1-cc56-4543-94b3-3f0061045fca None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.026893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.027525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.027807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.028083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.028730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.029288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:04.029939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.031620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.044553 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 281/583] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:04.045501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.089794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76e535-1660-435d-9ee2-7436fb4012b4 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.103675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.127467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.128101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.128387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.128779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.136649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.138226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:04.150536 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:04.151466 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:04.152358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:04.153335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d03674-246f-4dcd-b50c-eefb54ea044e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.156421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 303/584] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:04.157243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.190176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.190826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.191106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.191378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.205241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.206720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:04.222594 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:04.223591 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:04.224485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:04.224485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:04.224485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:04.224485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 282/585] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:04.224485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.269671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4094e4-1c8d-4b6b-9531-4e7eacf7a05f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.277921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.308589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.309251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.309534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.310101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.320355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.321850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.337100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b20b2-d918-475a-aed8-d0e8bad46d2c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:04.338349 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:04.339291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:04.340167 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:04.340167 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:04.340167 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:04.340167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 304/586] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:04.340941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.344933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.379704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.380341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.380621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.381628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.389111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.390560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:04.402758 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:04.403754 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 283/587] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:04.404706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.455373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf4189-3158-4fd9-837e-900f1cc3a5ad None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.489101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.489712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.489997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.490381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.491648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:04.491811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.493289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.505008 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 305/588] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:04.505811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.519035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808f7e3-fe7f-488b-afb2-ddc88e534895 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.525936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.557245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.557979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.558258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.558532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.559176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:04.559474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.561001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.577934 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 284/589] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:04.579567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.608962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.618143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c48d-fba2-49d0-974c-161faf71ab48 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.656234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.656846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.657158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.657435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.658081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:04.658386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.659762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.677804 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 306/590] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:04.679189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.700253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc4875-e6d0-4f43-ad9c-a376c1a061c5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.739804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.741232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.741775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.742057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.742796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:04.743103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.744535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.763592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.768813 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 285/591] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:04.768813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.789094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b78f-7d8c-4f04-9533-2210b07ad7c5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.826924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701385bb-8d86-4850-a254-a00635217136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.827581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701385bb-8d86-4850-a254-a00635217136 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.827862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701385bb-8d86-4850-a254-a00635217136 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.828137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701385bb-8d86-4850-a254-a00635217136 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/33ae6b3ef0964315be1bc1983fe65939/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.843033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701385bb-8d86-4850-a254-a00635217136 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=33ae6b3ef0964315be1bc1983fe65939, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.844731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701385bb-8d86-4850-a254-a00635217136 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.855149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:04.860508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 307/592] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:04 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/33ae6b3ef0964315be1bc1983fe65939/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:04.861524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701385bb-8d86-4850-a254-a00635217136 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:04.885711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c305eb-c2d4-4ad4-adc8-36f8755449dd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:04.936308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:04.937201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:04.937480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:04.937759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:04.950606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:04.952279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:04.971131 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:04.972748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 02:12:04.973761 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:04.977416 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 286/593] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:04.978564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.041270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701385bb-8d86-4850-a254-a00635217136 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.075596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:05.086973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.087624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.087909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.088190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.096123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.098537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:05.112265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:05.113608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 308/594] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:05.114519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.123014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066198b-d7b2-4c0e-b816-dc48ec4cc02d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.166681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.167611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.168115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.168625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.182652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.184689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.186726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:05.202732 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:05.203721 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:05.204865 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:05.204865 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:05.204865 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:05.207697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 287/595] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:05.208960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.227210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446536c6-679d-483f-8065-d5e94160ea24 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.272243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.273029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.273631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.274022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.274822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:05.275430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.277702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.303670 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 309/596] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:05.304935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.328814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31632d-4a3e-4d15-9be7-da97e582877f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.355907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:05.382517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.383713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.384337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.384964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.386069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:05.386568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.388183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.405158 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 288/597] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:05.406318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.427893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffe52d-5d67-4153-b2b2-ab4514d85d72 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.468131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:05.478372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.479005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.479343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.479621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.480264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:05.480565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.482371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.498421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 310/598] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:05.499316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.524663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d920b40-24ac-49d2-a130-9503e9c92553 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.568419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.569739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.570347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.570738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.586144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.588399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:05.608926 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:05.609930 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:05.615528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:05.615528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:05.615528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:05.615528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 289/599] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:05.615528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.635476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6653060-a4d2-4dcf-b81f-e67beae00ad6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.643535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:05.679497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.680741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.681424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.682034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/c7ebd0b9ab9a48f0a5505863a7d729e4/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.699299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=c7ebd0b9ab9a48f0a5505863a7d729e4, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.701456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.716940 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 311/600] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:05 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/c7ebd0b9ab9a48f0a5505863a7d729e4/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:05.718384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.767252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478489dc-954f-423f-9c52-a7e5d32ad68f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.785273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:05.849443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.852500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.853109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.854164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.875222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.877645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.901735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694de551-c847-45e5-8aff-5dead7f32653 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:05.907588 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:05.908497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:05.909425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:05.913583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 290/601] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:05.919427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:05.953785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:05.954681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:05.954959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:05.955233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:05.955997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:05.956312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:05.960567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:05.976380 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 312/602] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:05.982165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:06.008288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:06.078667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e927d-1486-4258-a33c-5b0dbdf817cf None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:06.105688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a96a42-caa7-452d-9e1f-9833f03c43f5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:06.113953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:06.114691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.115071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.116113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.116984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:06.117372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:06.118860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab1912-ab50-458b-99a7-154a74d0f390 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:06.131461 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 291/603] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:06.137645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413ae2b-bbc6-451c-b1d7-95fdb67ccf7f None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.138003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413ae2b-bbc6-451c-b1d7-95fdb67ccf7f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.138350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413ae2b-bbc6-451c-b1d7-95fdb67ccf7f None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.139953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 292/604] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:06.141124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413ae2b-bbc6-451c-b1d7-95fdb67ccf7f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:06.148106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:06.149490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.149775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.153192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.164004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:06.166476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:06.174432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b585779a-9a04-4607-9553-25cbd370736a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:06.186450 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:06.187412 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:06.188291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:06.191167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 313/605] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:06.192596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.193117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.193621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.219237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:06.220482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:06.267866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413ae2b-bbc6-451c-b1d7-95fdb67ccf7f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:06.308308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:06.309363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.316932 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 314/606] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:06.316932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:06.317623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.318163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/b074e2c621494cdfa6efc21e4a5c021b/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.318476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:06.350984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=b074e2c621494cdfa6efc21e4a5c021b, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:06.352577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:06.393009 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 293/607] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:06 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/b074e2c621494cdfa6efc21e4a5c021b/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:12:06.439087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b75c9-e3b6-4704-823a-0fcabf4b572c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:06.488281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:06.489237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.489724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.490177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.491101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:06.491588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:06.493229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:06.510478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 315/608] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:06.516414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:06.633132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:06.671852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804315e-8ec2-4871-827d-17b1812e2a35 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:06.711138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:06.719862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:06.720537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.720819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.721121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/c91c97c8ca6f457ab50e78a75b852db6/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.738657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=c91c97c8ca6f457ab50e78a75b852db6, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:06.740099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:06.757908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 294/609] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:06 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/c91c97c8ca6f457ab50e78a75b852db6/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:06.798102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:06.840657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2dcd7-b0e1-40ec-856c-ae68d8090778 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:06.879947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:06.881070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:06.881638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:06.882162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:06.893346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:06.900742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:06.902035 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:06.903148 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:06.905564 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 316/610] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:06.912967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:07.045249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec0a1d-11c5-43eb-8de6-2ee1f5fa214e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:07.072463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:07.085208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:07.086666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:07.086948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:07.087220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:07.087891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:07.088194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:07.089581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:07.102866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 295/611] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:07.105549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:07.251777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0b9fd-6397-4aae-9ba8-c5e5bd50c2d1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:07.287498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:07.300840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:07.301825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:07.302405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:07.302917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:07.321899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:07.323368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-bdcb701b-1070-4f42-b434-013741285221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:07.339248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:07.340236 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:07.341179 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:07.341179 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:07.341179 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:07.345420 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 317/612] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:07.351835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:07.452028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277bc76-77bd-4190-8138-c07ef17099c6 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:07.455069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277bc76-77bd-4190-8138-c07ef17099c6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:07.455554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277bc76-77bd-4190-8138-c07ef17099c6 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:07.459751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 318/613] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:07.462883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:07.463131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:07.463438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:07.496674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:07.498084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:07.505150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549957-1796-4b67-8bf0-f8f9fd505546 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:07.542364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:07.543418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:07.543915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:07.544394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:07.545266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:07.545779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:07.547441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:07.560375 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 296/614] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:07.565976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:07.628941 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 319/615] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:07.629180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:07.704931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fa262-a07f-42a5-a5eb-33cac2d93b9f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:07.783010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:07.783652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:07.783931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:07.784198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:07.794668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:07.796107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:07.816987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:07.817965 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:07.818947 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 297/616] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:07.826020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:07.964151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16030-cec4-4387-a4a0-d0206f6f07e4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:07.977291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:07.982681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.014852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.015694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.015902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.016126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.016929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:08.017249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:08.018807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:08.049561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 320/617] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 02:12:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:08.058087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.119723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9cd41-71dc-4277-a3a0-d7626206ee60 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:08.137872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:08.155646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.156605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.157151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.159610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.180705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:08.189664 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:08.190630 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:08.191486 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:08.192678 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 298/618] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:08.202165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.277329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d4b83-65e9-4470-b03c-fb9b2e7223d2 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:08.358215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.358869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.359151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.359429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.374904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf9f28-ea55-4609-a5cc-30b1491bd376 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:08.380239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:08.389970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-02f340ef-5cd9-4e4a-8062-7d1216ce355e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:08.413001 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:08.414261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:08.415600 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:08.415600 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:08.415600 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:08.415809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.415809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.415809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.415809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.416088 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 321/619] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:08.416157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:08.416157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:08.417205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40adac-49c7-48e6-a881-489cb4d2074a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.417503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40adac-49c7-48e6-a881-489cb4d2074a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.417824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40adac-49c7-48e6-a881-489cb4d2074a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.421267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:08.423144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 322/620] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:08.424448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.424839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.425305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.430860 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 299/621] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:08.433318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.447150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:08.448698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:08.466806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:08.471004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:08.542529 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 323/622] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:12:08.542529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.564510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ff61d-3c29-474d-aa58-073db6c60a0b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:08.634225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.634749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.635023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.635294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.635938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:08.636238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:08.637618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:08.657338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 300/623] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:08.666064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.700458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aa6de-07f5-4882-9907-118c87b899dd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:08.747415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.748105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.748388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.748659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.768668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:08.770420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:08.789248 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:08.790231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:08.791116 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:08.791116 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:08.791116 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:08.791116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:08.791116 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 324/624] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:08.797946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.853294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:08.868003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17069-2a0e-45f8-8e35-cc3b8f357a53 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:08.918597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:08.919157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:08.919438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:08.919712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:08.928281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:08.930415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:08.945586 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:08.946531 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:08.947431 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 301/625] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:08.948378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:08.962809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f7823-8d3f-4c6f-a5cf-38a0dcb13e2d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.005363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.007331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.008022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.008503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.009600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:09.010477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.012033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.029256 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 325/626] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:09.030957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.078219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca3b7-872e-4520-89f7-3921ee700156 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.109291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.117492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.118590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.118940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.119286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.132707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:09.138573 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:09.139506 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:09.140329 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:09.141010 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 302/627] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:09.141795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.157566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aad664-34a8-44aa-aec7-ad374f74b128 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.157872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.206482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.207006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.207682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.207985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.208683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:09.209553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.210991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.222733 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 326/628] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:09.223557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.261236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebe646-b31c-41b8-a55b-fb084020a1b6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.298163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.298792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.299072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.299374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.307547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.309053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e0a55c55-d56c-4dd8-a942-a48f373b2439 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:09.321918 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:09.322953 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:09.324595 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 303/629] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:09.325288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404dc1-e5ae-4528-96f5-6848b10ad2d6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.325288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404dc1-e5ae-4528-96f5-6848b10ad2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.325288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80404dc1-e5ae-4528-96f5-6848b10ad2d6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.326842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 304/630] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:09.328050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404dc1-e5ae-4528-96f5-6848b10ad2d6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.342655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3340c97-2c42-4d87-9f10-d195d68d0519 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.365026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.379873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.380480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.380760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.381107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.381981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:09.382288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.383655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.391762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 327/631] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:09.392365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.411535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.445527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80404dc1-e5ae-4528-96f5-6848b10ad2d6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.479535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ae4a8-732e-44c9-8ca7-4048b6bcbeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.480111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae4a8-732e-44c9-8ca7-4048b6bcbeb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.480387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae4a8-732e-44c9-8ca7-4048b6bcbeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.480660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ae4a8-732e-44c9-8ca7-4048b6bcbeb5 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/4c0d9417ce05468695abebca3b0abde3/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.494349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ae4a8-732e-44c9-8ca7-4048b6bcbeb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=4c0d9417ce05468695abebca3b0abde3, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.494748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f870d-738f-4c39-aaee-660bb1b0bae5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.495778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ae4a8-732e-44c9-8ca7-4048b6bcbeb5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.508320 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 305/632] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:09 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/4c0d9417ce05468695abebca3b0abde3/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:09.509524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c578-507a-4c6c-9fac-19e3c534865e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.509808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c578-507a-4c6c-9fac-19e3c534865e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.510072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c578-507a-4c6c-9fac-19e3c534865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.528795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-82d3c578-507a-4c6c-9fac-19e3c534865e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:09.530064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82d3c578-507a-4c6c-9fac-19e3c534865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:09.531115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.531740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.532054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.532417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.533312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:09.533622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.535106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.556861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 328/633] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:09.557736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.607948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.614336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 306/634] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:09.615982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260c27-fb49-4f99-b7c0-680c81a1ba96 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.616270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260c27-fb49-4f99-b7c0-680c81a1ba96 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.616544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08260c27-fb49-4f99-b7c0-680c81a1ba96 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.618107 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 307/635] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:09.622667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260c27-fb49-4f99-b7c0-680c81a1ba96 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.691070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094740-f905-4220-affb-4f7656b6c596 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.693791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.736644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.738017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.738569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.739123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.750517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08260c27-fb49-4f99-b7c0-680c81a1ba96 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:09.752632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.755134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8b15ea9e-5553-4c4b-b22c-5a8b2500f121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:09.776451 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:09.777509 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:09.778379 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:09.778379 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:09.778379 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:09.779954 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 329/636] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:09.781361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.781833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.782279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.789245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:09.789934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:09.790283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:09.790625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:09.801301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:09.802775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:09.865940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:09.867690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:09.882734 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 330/637] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:09.888925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:09.912083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.941584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:09.999605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb504f0-75e0-46ff-ab2f-efa41ed6c907 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.001005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 308/638] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:10.001882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.047532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.048646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.049035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.049321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.050387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:10.050974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.052615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.069224 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 331/639] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:10.070171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.118417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cb79d-4a09-4c42-9aae-6b7e31f72364 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.154355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.154986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.155265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.155532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.171789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:10.176556 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:10.177526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:10.178498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 309/640] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:10.179203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.180138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.192247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.201930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb4da-f3db-427c-9284-4e9c2b12e201 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.240052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.240848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.241280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.241560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.252812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.254203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:10.268683 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:10.269865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:10.270764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:10.270764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:10.270764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:10.270764 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 332/641] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:10.270764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.292398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b06b7a-524d-415c-9614-f8d1745d7420 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.330161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.330795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.331071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.331334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.339375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.340807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:10.352829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:10.358694 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 310/642] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:10.359994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.386006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19afb45-caad-4b95-9f86-abdde6da4443 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.420980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.421607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.421885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.422156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.424282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.427308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.434634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:10.440153 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:10.441101 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 333/643] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:10.442034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.466768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a089c-04f6-41fe-9f5c-ccc49149a09a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.508091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.508617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.508895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.509192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.509852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:10.510150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.511541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.524762 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 311/644] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:10.524762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.559049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ba4a6-03e8-4c61-af4e-1e990ee3b9d5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.595181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.595786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.596067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.596341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.597007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:10.597312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.599142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.619317 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 334/645] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:10.619317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.623022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a007a-b87f-4fb8-8219-ac190f73425f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.654454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.658411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.661750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.661750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.661750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.661750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:10.661750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.662821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.683135 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 312/646] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:10.684418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.688219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.736243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3d30-787e-4a90-8594-80e3f7c48c7a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.777141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.777674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.777955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.778230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.778895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:10.779224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.780579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.788825 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 335/647] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:10.789655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.796291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f53d2-f1d0-4f9c-8f81-6909d35ef60a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.832993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.833630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.833948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.834225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.844166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.845667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:10.861092 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:10.862255 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:10.863345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:10.863345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:10.863345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:10.867195 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 313/648] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:10.867998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.906662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d2938-41f0-495e-ab50-3eecfad30828 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:10.916189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.926772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:10.947610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:10.947870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:10.948115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:10.948395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:10.955400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:10.956946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:10.969554 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:10.970479 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 336/649] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:10.971363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:10.986498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a04fc0-be66-4940-bdc8-edc31693a232 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.022859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.023614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.023901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.024171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.081168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918edb2c-ce40-4505-9e10-bf5580ca824f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.101661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.103109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.118364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.119115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.119399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.119677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.131977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.133464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:11.147562 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:11.148504 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:11.149460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:11.149460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:11.149460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:11.149460 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 337/650] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:11.149460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.150530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.178972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.217205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 314/651] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:11.218573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.261036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31afc9-9b1d-478e-b1ef-3aa8b769fd59 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.298774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.299791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.300079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.300358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.301393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:11.301704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.303801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.324773 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 338/652] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:11.324773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.325057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023482-e4b4-489c-8d83-42cbee3bbae9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.359746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.360275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.360551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.360820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.361532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:11.361838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.363266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.379942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 315/653] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:11.379942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.383078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.427468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.440382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433843e-82fb-4680-966f-7259b99bb9cc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.479774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.480655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.481143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.481666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.482513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:11.483013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.484390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.488684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c07e-deee-42b6-96a9-037f823f8875 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.502049 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 339/654] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:11.502049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.524635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.525292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.525571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.525844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.537094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.539227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:11.552896 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:11.553883 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:11.554763 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:11.554763 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:11.554763 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:11.554763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 316/655] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:11.554997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.615819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2b58-3b34-4154-8ba4-b5eea3a5e043 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.616085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.651571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.652210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.652495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.652774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.664381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.665644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.671490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d5632-3e8f-4e20-b41b-38db055dc04d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:11.678967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:11.680007 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:11.680965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 340/656] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:11.681569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.695863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.714516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.715114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.715399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.715809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.716448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=33ae6b3ef0964315be1bc1983fe65939) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:11.716698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.718252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.732926 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 317/657] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/role_assignments?user.id=33ae6b3ef0964315be1bc1983fe65939&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:11.732926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.811010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11f6f2-7467-477f-8ed0-e3641d0acee0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.848483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.849153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.849438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.850321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.857437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a23bd-b056-4bc8-8dce-cebf847c8202 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:11.858709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.860195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:11.875985 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:11.877020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 05 02:12:11.877996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:11.879992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 341/658] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:11.881658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.886155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:11.908948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:11.909568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.909911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.910366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.910853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:11.911163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:11.912887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265537ec-ec83-4552-b483-1f3a7a9ce0c2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:11.925684 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 318/659] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:11.927134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fbaae-1938-4388-ac24-d97a2fdd6ce0 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:11.927423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fbaae-1938-4388-ac24-d97a2fdd6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:11.927736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fbaae-1938-4388-ac24-d97a2fdd6ce0 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:11.930280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 319/660] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:11.930280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fbaae-1938-4388-ac24-d97a2fdd6ce0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:11.966606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.010508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1b02-564d-41e3-8bc6-2fa85fc3dd33 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.043141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fbaae-1938-4388-ac24-d97a2fdd6ce0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.044936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.045551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.045831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.046109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.046842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:12.047149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.048579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.066022 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 342/661] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:12.069986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.081794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.082387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.082673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.082939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.083656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:12.084033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.085693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c142c-ef79-43b7-bdd9-482d47f24146 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.107951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 320/662] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Oct 5 02:12:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:12.107951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.107951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.107951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.123641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:12.124824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:12.154786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.181179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29be68-f189-428e-8c00-79b6013a41ab None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.205331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 321/663] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:12.205331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.211591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.222066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.222940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.223312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.223654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.232026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.233626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:12.246694 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:12.247791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:12.248886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:12.250080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 343/664] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:12.250973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.332703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96762c-3bbf-441b-84ed-b5af0a2d3f32 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.370422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.371186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.371581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.371946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.379197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe67a2-5909-4cf6-9e53-975e3d1b170d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.407943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.424558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.425474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.425706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.426079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.453513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.456151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.484549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.498849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.500332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.578105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 322/665] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:12.579309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.602542 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 344/666] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:12.603663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.654013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.694795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7cb89-54c0-4d3e-aeec-10740b455040 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.706742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.720325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abccff-fe6b-4506-bcec-33834fc58265 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.733756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.734359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.734648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.734897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.735574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:12.735882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.737400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.753016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 323/667] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:12.753016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.762332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.762973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.763255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.763537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.776780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:12.781610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:12.782534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:12.783391 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 345/668] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:12.784097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.866372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad158991-ac11-4942-83ef-e55d10daf361 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.886272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a68f-15dd-4a09-a92a-64dd9a276143 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:12.893428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.904938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.905572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.905851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.906123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.917883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.919258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.920923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:12.921556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:12.921832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:12.922101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:12.932376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:12.933832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:12.936550 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:12.937674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:12.938757 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:12.938757 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:12.938757 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:12.940103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 324/669] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:12.940518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:12.941748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:12.955846 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:12.957023 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:12.958110 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:12.958110 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:12.958110 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:12.958110 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 346/670] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:12.962226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.048192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779650e2-a6a5-45b7-8384-a48a4bf65347 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.072451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01850f6b-b8b7-499b-af1f-f9bf1afbdacc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.082387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.082985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.083260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.083530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.084308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=c7ebd0b9ab9a48f0a5505863a7d729e4) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.084788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.086251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.091902 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 325/671] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/role_assignments?user.id=c7ebd0b9ab9a48f0a5505863a7d729e4&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.092678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.118177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.119613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.119995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.120365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.121241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.121644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.123254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.138493 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 347/672] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.139735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.155816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:13.213482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:13.226300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed53f8-178b-40d6-a89a-3c204725e04a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.275278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bfe8a-0142-4794-b420-d0bb81736647 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.277277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.278044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.278328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.278602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.280172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.280172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.281053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.295623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 326/673] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.296498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.321593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.322756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.323260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.324077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.325244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.325919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.328053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.346590 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 348/674] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.347502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.433738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2abf13-7b37-49f4-9097-e742518ae653 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.435391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:13.465768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685235-a159-44cf-93ad-532e5dedbceb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.476024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.476660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.476957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.477348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.487831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:13.488749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.490436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.503803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.504433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.504717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.505031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:13.508037 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:13.509043 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:13.509948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:13.509948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:13.509948 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:13.509948 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 327/675] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:13.510577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.520753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.523079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:13.536042 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:13.537122 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:13.538019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:13.538446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 349/676] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:13.538945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.639598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6823e-2b1e-4f00-9674-a2682daba453 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.651812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82ef0b-4784-43b8-b551-76fef0659cfc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.683022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.683999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.684489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.685240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.695507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.697047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.699898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.700811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.701321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.701791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.702696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.703340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.705296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:13.709729 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:13.710641 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:13.711521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 328/677] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:13.712023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.729430 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 350/678] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.730120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.738084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:13.779561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:13.844444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8471e-5fce-4eca-8924-920644268283 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.845510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38c8df-7a3b-45fd-b8d0-03c3e3881697 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:13.891895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.892524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.892809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.893113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.893827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.894179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.895628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.901408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:13.902457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:13.902934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:13.903399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:13.905175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:13.905731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:13.908300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:13.914572 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 329/679] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.914572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:13.931909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 351/680] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:13.933364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.010021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:14.038034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e94b-c965-4e3e-a757-46f27a9040f5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.042423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:14.046028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad03d-1722-474a-a1bc-6ffacd974c59 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.078952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.080073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.080527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.080978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.082424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.083027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.083315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.083596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.085285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=b074e2c621494cdfa6efc21e4a5c021b) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:14.085602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:14.087056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:14.090838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:14.092793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:14.093211 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 352/681] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/role_assignments?user.id=b074e2c621494cdfa6efc21e4a5c021b&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:14.094005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4b72c7ba-a882-43e2-91d5-575f5db65d65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:14.114317 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:14.115670 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:14.116843 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 330/682] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:14.117490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e38b2-28a9-47ec-afd8-db9e8f76dad2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.117490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e38b2-28a9-47ec-afd8-db9e8f76dad2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.117747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e38b2-28a9-47ec-afd8-db9e8f76dad2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.123189 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 331/683] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:14.124640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.124963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.125251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.147833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:14.149165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:14.232630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321177-8fe9-4309-9be4-d0689a1e2c1e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.261203 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 332/684] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:14.261203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.283432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.284858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.286246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.286732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.288346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=c91c97c8ca6f457ab50e78a75b852db6) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:14.288812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:14.290782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:14.299707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 353/685] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:14 2022] GET /identity/v3/role_assignments?user.id=c91c97c8ca6f457ab50e78a75b852db6&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:14.349453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:14.395345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c1f06-2afd-4d07-82b4-59d454ad11c1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.438066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.438703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.438984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.439256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.440001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:14.440307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:14.441785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:14.463205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 333/686] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 02:12:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:14.468821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.507863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:14.547874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.596726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b8913-3e27-4873-92c7-14b00fbad4ab None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.636207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.637248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.637729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.638192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.679832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05fe86-391c-4600-b17a-4db24033c8f9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.717270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:14.726682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.727662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.728098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.728524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.738961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:14.740586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:14.745486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:14.750458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:14.751602 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:14.752651 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:14.756672 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 334/687] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:14.763980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.834916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:14.932096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 354/688] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:14.938824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:14.939233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a275cc-fc79-4a77-b192-ab16eb791f7b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:14.979910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:14.980672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:14.981299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:14.982260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:14.983188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:14.984521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:14.986850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.011205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 335/689] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:15.016974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.104251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac0a1-0570-4c49-903c-61832c694d2a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:15.129435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:15.157760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:15.176401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:15.177226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.177647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.178036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.195038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:15.199317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:15.219171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:15.220363 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:15.221530 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:15.221530 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:15.221530 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:15.222951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 355/690] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:15.228667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a10b6-2b8d-43b4-a0e0-4be729235e44 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:15.230146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.301536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:15.302340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.302759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.303303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.324657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:15.326291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:15.365499 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:15.366839 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:15.368015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:15.368015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:15.368015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:15.368015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 336/691] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:15.374226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.393321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395c0ac-eb7a-40bf-9a77-a527237aea93 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:15.463444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:15.464149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.464428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.464704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.465428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:15.465729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:15.467187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.495233 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 356/692] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:15.501782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.565704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:15.576738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:15.579491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbf197-18dc-4868-90b2-effadb743bba None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:15.625418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:15.625961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.626224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.626501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.627143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:15.627456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:15.628824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fd34b-f194-4cf1-a3d9-1fe18f4f667a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.643515 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 337/693] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:15.645118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a71fda-1d79-448d-89c7-57a3dce5a076 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.645408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a71fda-1d79-448d-89c7-57a3dce5a076 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.645703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a71fda-1d79-448d-89c7-57a3dce5a076 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.648618 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 338/694] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:15.650174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a71fda-1d79-448d-89c7-57a3dce5a076 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.658425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5c2b-ce95-4ae9-bd05-baebf96245d8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:15.703934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:15.705045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.705890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.706279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.716430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:15.718695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-482bd8e9-b151-4473-9875-9322689b42c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:15.735609 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:15.736670 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:15.737791 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:15.744663 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 357/695] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:15.746199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.746558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.746938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.772378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:15.774009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:15.774689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a71fda-1d79-448d-89c7-57a3dce5a076 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:15.820545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:15.821198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:15.821474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:15.821742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:15.830701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:15.832137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:15.844435 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:15.845513 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:15.846489 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 339/696] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:15.847087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.870263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:15.881632 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 358/697] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:15.882101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:15.941260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:16.020517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f68a-1351-423b-9b94-5b204487bf19 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.064190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734748-3eb7-4b72-bc67-d9360ccbceec None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.081617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.082201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.082482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.082755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.083439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:16.086004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.087454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.115913 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 340/698] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:16.117141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.127886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.128532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.128811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.129139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.129864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:16.130162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.135342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.164938 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 359/699] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:12:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:16.167656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.270075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:16.308296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d798cc-c09b-4fb8-acc7-8c48899cc783 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.314144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:16.328174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267b628-714a-4f45-841f-1a959b940727 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.357077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.357990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.358490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.358840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.359783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=4c0d9417ce05468695abebca3b0abde3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:16.360173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.362312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.365911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.366734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.367243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.367719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.374851 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 341/700] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:16 2022] GET /identity/v3/role_assignments?user.id=4c0d9417ce05468695abebca3b0abde3&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:16.374851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.504964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b645e-dba7-48d4-a2e0-26432bc8f33b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.506400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.508103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.549339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.549985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.550275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.550703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.562551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:16.566338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.567967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:16.589959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:16.591665 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:16.592894 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:16.592894 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:16.592894 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:16.592894 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 342/701] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:16.597615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.721102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:16.738932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c75a3-0f6c-42ba-a6b1-4536dabdece9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.740646 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 360/702] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:16.746574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.782545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.783317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.783618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.783929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.785233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:16.785549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.786978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.805079 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 343/703] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:16.810407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.873744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2411f0d-7956-469b-ae05-dcb007cd67f6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.883114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:16.918885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.919674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.919966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.920245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.931973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.933478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:16.942182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734d6ac-3663-4e28-b23e-84bd0360a39d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b4b023c1-890e-43ba-8da8-5383e529f1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:16.950381 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:16.951365 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:16.952461 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:16.952461 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:16.952461 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:16.952461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 361/704] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:16.953523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b320-3515-4cbd-aaac-f204bd265258 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.953875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b320-3515-4cbd-aaac-f204bd265258 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.954475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b320-3515-4cbd-aaac-f204bd265258 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.961133 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 362/705] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:16.962167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b320-3515-4cbd-aaac-f204bd265258 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:16.984155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b662a0f-87ed-458f-a38f-7eff1e9e2ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:16.985110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662a0f-87ed-458f-a38f-7eff1e9e2ab3 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:16.985584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662a0f-87ed-458f-a38f-7eff1e9e2ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:16.986042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b662a0f-87ed-458f-a38f-7eff1e9e2ab3 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:16.986700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b662a0f-87ed-458f-a38f-7eff1e9e2ab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:16.988120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b662a0f-87ed-458f-a38f-7eff1e9e2ab3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.008192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:17.012819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 344/706] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:12:16 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:17.014164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7e444-9bf6-43af-98da-74720a4d41fd None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.014456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7e444-9bf6-43af-98da-74720a4d41fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.014728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7e444-9bf6-43af-98da-74720a4d41fd None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.020125 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 345/707] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:17.020125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ca68-b901-47f7-ae83-8f19417e7547 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.020125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ca68-b901-47f7-ae83-8f19417e7547 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.020125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0ca68-b901-47f7-ae83-8f19417e7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.041931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e6a0ca68-b901-47f7-ae83-8f19417e7547 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:17.043144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e6a0ca68-b901-47f7-ae83-8f19417e7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:17.089788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b320-3515-4cbd-aaac-f204bd265258 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:17.129005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:17.130033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.130528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.131541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.132482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:17.132893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:17.134455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.140962 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 346/708] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:17.142615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.143116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.143567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.160470 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 363/709] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:17.166483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.173525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:17.176456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:17.235645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:17.282069 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 347/710] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:17.323470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:17.326479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46a14f-dde2-4b04-9a3a-a2f593e4dc78 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:17.364452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:17.365703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.365983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.366254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.373266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:17.374780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:17.386273 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:17.387176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.388083 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 364/711] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:17.395096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.442128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.521795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0c3ac-9937-42bd-9ac6-daf61a75828e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:17.560360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:17.561027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.561299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.561569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.562266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:17.562570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:17.563996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.577899 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 348/712] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:17.581967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1352b-7653-407b-b92b-06ca4421ab75 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:17.589236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.623198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:17.623939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.624203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.624483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.625458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:17.627156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:17.643047 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:17.644330 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.645238 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 365/713] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:17.647543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.648094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:17.691300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:17.730839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248cee-1858-4598-aeb0-ecd0dd13bee4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:17.774316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:17.775357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.775756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.776034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.776760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=33ae6b3ef0964315be1bc1983fe65939) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:17.777237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:17.779248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.780646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec38473-7ef0-4b25-a31f-9d0625993a38 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:17.786040 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 349/714] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/role_assignments?user.id=33ae6b3ef0964315be1bc1983fe65939&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:17.787222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.825797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:17.826647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:17.827076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:17.827446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:17.828173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:17.829923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:17.852032 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:17.853169 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:17.854041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:17.862860 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 366/715] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:17.868330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:17.946129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:17.978989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d2a2f-4b17-4a29-b30f-6832bb91ea97 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:18.000690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:18.008360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e32a8e-497e-4a1f-adde-74903bd587f4 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:18.045433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:18.046055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:18.046334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:18.046610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:18.047340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:18.047648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:18.049262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:18.054521 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 367/716] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:18.055478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:18.056340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:18.056827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:18.057336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:18.058197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:18.058781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:18.060364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:18.063262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:18.066225 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 350/717] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 02:12:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:18.072513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:18.243109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4c917-d0ba-472c-90ca-79f6bf44b305 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:18.261178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e97ff5-d589-4048-9868-84326c5351e6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:18.308033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:18.309049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:18.309558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:18.310046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:18.310904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:18.311414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:18.313013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273b96b-c32a-45a3-9103-294b701aa845 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:18.320671 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 351/718] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 02:12:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:18.328946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:18.328946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:18.328946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:18.328946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:18.329621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] RBAC: Adding query filter params (type=network) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:18.329621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:18.330150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa54d04-56b0-4c40-9516-c78c4dbab0ae None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:18.345346 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 368/719] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:19.115861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944781-0378-43a8-8720-7b1e09fa85be None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:19.116417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944781-0378-43a8-8720-7b1e09fa85be None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:19.116417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944781-0378-43a8-8720-7b1e09fa85be None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:19.118020 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 352/720] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:19.123759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a336e15-6299-4320-8965-78fb6488187d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:19.124225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a336e15-6299-4320-8965-78fb6488187d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:19.124307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a336e15-6299-4320-8965-78fb6488187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:19.143128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2a336e15-6299-4320-8965-78fb6488187d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:19.144323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2a336e15-6299-4320-8965-78fb6488187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:19.155995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:19.229363 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 369/721] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:12:19.507597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba944781-0378-43a8-8720-7b1e09fa85be None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:19.537427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:19.643859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba944781-0378-43a8-8720-7b1e09fa85be None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:19.691569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:19.692219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:19.692504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:19.692784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:19.713911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:19.718933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:19.721093 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:19.723117 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 353/722] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:19.728499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a336e15-6299-4320-8965-78fb6488187d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:19.872519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a336e15-6299-4320-8965-78fb6488187d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:19.908314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:19.909346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:19.909832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:19.910308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:19.911170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:19.911672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:19.913767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb1bd-2881-4bad-8e80-3f7ebb5c26f2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:19.922548 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 370/723] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:19.928594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:20.072037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:20.105571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cb4d0-d322-4519-b35d-bb447830fb31 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:20.136994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2433124-9f30-4192-aa7f-0dc9da9c471e None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.137857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2433124-9f30-4192-aa7f-0dc9da9c471e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.138287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2433124-9f30-4192-aa7f-0dc9da9c471e None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.140026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 371/724] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:20.144641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdadeb8-1320-473f-a7b0-f904ecc76ba2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.145129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdadeb8-1320-473f-a7b0-f904ecc76ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.145571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdadeb8-1320-473f-a7b0-f904ecc76ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.147173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:20.147813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.148097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.148372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.159421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:20.160984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:20.176376 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:20.178310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:20.179567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:20.179567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:20.179567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:20.181406 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 354/725] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:20.184976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bbdadeb8-1320-473f-a7b0-f904ecc76ba2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:20.184976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bbdadeb8-1320-473f-a7b0-f904ecc76ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:20.186146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:20.189994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:20.324798 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 372/726] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:20.334693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb985be-d05c-4f65-9c64-b118c46f38c0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:20.335665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc097-6ac4-493f-a487-8065747e25f4 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.336045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc097-6ac4-493f-a487-8065747e25f4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.336329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc097-6ac4-493f-a487-8065747e25f4 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.338585 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 373/727] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:20.342868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.343157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.343766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.362275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:20.363456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:20.368958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:20.374866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:20.376100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.376609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.377111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.378391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:20.378961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:20.380481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:20.394088 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 355/728] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:20.402864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:20.452132 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 374/729] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:12:20.559635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893c21e-302e-490f-9257-9c8f6373d0d6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:20.605604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:20.606248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.606528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.606799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.614237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:20.615887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:20.628249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:20.629224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:20.630216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 356/730] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:20.635396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:20.640748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:20.721525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:20.764562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:20.796944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ba734-e8a8-493d-82f9-4b6462b548c4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:20.833426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae539-78a8-44b3-a298-098e6b67d4aa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:20.859314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:20.860312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.862180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.862679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.894282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:20.896524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:20.897601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:20.898124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:20.898617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:20.899657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:20.900159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:20.900959 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:20.901906 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:20.902768 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:20.904727 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 357/731] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:20.905104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:20.905585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:20.930569 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 375/732] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 02:12:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:20.931704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.013458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d7ae1-e21d-4ff5-9c88-0bd435b50f7b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.026770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.046257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f456e9-da13-4276-88e7-8410ab9ef4f6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.050886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a715122-d9ff-47fd-9afe-ac131d712984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.051520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715122-d9ff-47fd-9afe-ac131d712984 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.051800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715122-d9ff-47fd-9afe-ac131d712984 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.052074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a715122-d9ff-47fd-9afe-ac131d712984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.063678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a715122-d9ff-47fd-9afe-ac131d712984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2a715122-d9ff-47fd-9afe-ac131d712984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:21.070029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:21.071155 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:21.071978 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 358/733] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:21.072666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb5ec-e2bb-491a-b87e-60f9c2e085cf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.072666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb5ec-e2bb-491a-b87e-60f9c2e085cf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.072799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb5ec-e2bb-491a-b87e-60f9c2e085cf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.074166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 359/734] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:21.076952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcb5ec-e2bb-491a-b87e-60f9c2e085cf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.078094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.088674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.089319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.089604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.089882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.090556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:21.090893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.092267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.100841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 376/735] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:21.101661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.197833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcb5ec-e2bb-491a-b87e-60f9c2e085cf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.208330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7afff-942f-4263-9724-7a108904819b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.237803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.238709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.239168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.239645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.242552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.243168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.243455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.243733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.244410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:21.244719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.246118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bfe91-ee7a-4f2d-bbfe-583b6601137d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.254225 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 377/736] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:21.255388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.256259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.256543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.274253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:21.275747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:21.289968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.321534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.322994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.324319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.352931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 378/737] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:21.352931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.446045 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 360/738] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:12:21.446963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.492827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35da3f-161c-4c60-9a05-36bb73b4f941 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.529381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.530367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.531021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.531303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.531680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.542191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.543640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:21.558299 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:21.559264 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:21.560753 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:21.560753 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:21.560753 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:21.560753 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 379/739] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:21.560753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.561093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df360fe8-db71-4d87-bf99-c07870348284 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.596443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.597099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.597380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.597654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.598532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.608298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.609777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-02df9a71-8d92-475d-8f87-4bd23d00d403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:21.624942 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:21.625897 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:21.626829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:21.626829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:21.626829 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:21.631898 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 361/740] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:21.633430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcf4ff-57e2-45a6-a2c7-75c395a3ed37 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.633719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcf4ff-57e2-45a6-a2c7-75c395a3ed37 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.634000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcf4ff-57e2-45a6-a2c7-75c395a3ed37 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.636942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 362/741] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:21.636942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcf4ff-57e2-45a6-a2c7-75c395a3ed37 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.677326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f242fd-f6f7-45f4-b9f7-7a8c4105cc14 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.710989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.711619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.711900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.712177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.722389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.723840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:21.738542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:21.739482 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:21.740428 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:21.740428 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:21.740428 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:21.740428 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 380/742] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:21.740663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.744980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcf4ff-57e2-45a6-a2c7-75c395a3ed37 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.768223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.779597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.780202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.780485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.780756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.781416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:21.781758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.783116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f512-02ce-4e57-8e65-9d14ce8bf37a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.795048 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 363/743] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:21.796202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359474-e53f-4582-964f-4762653981f4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.796488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359474-e53f-4582-964f-4762653981f4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.796762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d359474-e53f-4582-964f-4762653981f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.814770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0d359474-e53f-4582-964f-4762653981f4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:21.816021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d359474-e53f-4582-964f-4762653981f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:21.831553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:21.847141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b079350-83d3-456a-a5b7-b9df33e033ad None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:21.881471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 364/744] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:12:21.882332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d359474-e53f-4582-964f-4762653981f4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.882946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:21.883554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:21.883831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:21.884095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:21.884734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:21.885068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:21.886445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:21.904366 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 381/745] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:21.905116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:21.987964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d359474-e53f-4582-964f-4762653981f4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.002486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.014386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746823d-36a7-495c-b4b3-644990a2c164 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.024660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.025611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.025903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.026340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.026993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.028354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.044840 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 365/746] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:21 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:22.045673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.063828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.064923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.065408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.065925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.066924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:22.067487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.069876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.080611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.086478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 382/747] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:22.087892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.163754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045e89-449e-4368-ad62-c6ddf78fa2a0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.202333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70682155-8887-4ced-a744-565500794e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.203435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70682155-8887-4ced-a744-565500794e04 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.203948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70682155-8887-4ced-a744-565500794e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.204707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70682155-8887-4ced-a744-565500794e04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.213961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70682155-8887-4ced-a744-565500794e04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.215460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70682155-8887-4ced-a744-565500794e04 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.218410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e375c-4464-4961-b546-b77725d3ce02 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-70682155-8887-4ced-a744-565500794e04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:22.228597 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:22.229923 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:22.231230 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:22.234664 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 366/748] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:22.235628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70682155-8887-4ced-a744-565500794e04 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.262872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.263995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.264427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.265018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.273459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.274907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.276589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:22.287658 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:22.288662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 383/749] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:22.290002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.356202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.356659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70682155-8887-4ced-a744-565500794e04 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.394724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.395403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.395833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.396155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.399259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99141-b0cd-439e-87d3-8a8f4cea3e6f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.403880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.405355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:22.419041 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:22.419989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 367/750] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:22.426232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.440411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.441070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.441467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.441751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.442421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.444492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.463953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 384/751] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:22 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:22.465280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.548239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.557258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15959-a706-4476-9fdf-65c58e72efcc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.596805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea04deb-b2d1-4159-8926-6d11995235ca None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.599554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.600510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.601053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.601534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.602509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:22.603037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.604733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.625297 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 368/752] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:22.626509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.635426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.636140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.636426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.636700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.637939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:22.637939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.639460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.642604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.669840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 385/753] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:22.671206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.757204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403fdbc-0cd4-4fb6-9813-aa284dafc464 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.791712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797b0f3-8e3d-4b17-9bb4-d1c9099ff9cb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.795576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.796305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.796676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.797080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.797946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:22.798406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.799875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.816957 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 369/754] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:22.816957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:22.830008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.839154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.840843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.841345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.841814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.894943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:22.925984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd097b02-be7e-4cfe-a7d1-25bc6fa0d7c0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:22.927090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.929000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.961499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:22.962379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:22.962841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:22.963276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:22.975081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:22.976790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:22.994785 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:22.996029 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:22.997248 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:22.997248 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:22.997248 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:22.998969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 370/755] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:22.999896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.064997 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 386/756] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:12:23.066135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.073657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:23.121528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5133a9d-6ad7-4422-ae3e-8318b40bfd1e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:23.157591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:23.161590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:23.163230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:23.163517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:23.163783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:23.164581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=4c0d9417ce05468695abebca3b0abde3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:23.165037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:23.166498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:23.173557 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 371/757] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:22 2022] GET /identity/v3/role_assignments?user.id=4c0d9417ce05468695abebca3b0abde3&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:23.174683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.207283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3730-2f9c-4d3c-be11-6f16b5ce949f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:23.299208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:23.299842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:23.300124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:23.300376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:23.301074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:23.301381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:23.304249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:23.319551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 387/758] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:23.325613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.383869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac940652-3846-44cf-95b5-1ae528321abd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:23.414243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:23.423472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:23.424258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:23.424635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:23.425559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:23.438432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:23.440269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:23.457242 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:23.458289 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:23.459226 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:23.459226 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:23.459226 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:23.463456 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 372/759] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:23.464664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.580736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb4f28-8c86-4f84-ac9c-ba8d18b1c846 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:23.591047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61594b7d-eebf-4e54-a08e-62d5f546e95e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:23.617473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:23.618489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:23.618967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:23.619434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:23.620286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:23.620783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:23.622355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:23.635068 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 373/760] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:23.643077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.676670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:23.681126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:23.681634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:23.682108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:23.686034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:23.696229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:23.701110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:23.725682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:23.726781 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:23.727644 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:23.728553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:23.731515 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 388/761] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:23.739528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.821594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434aea5-26d2-4cf7-b393-9b211a00ebca None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:23.899422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:23.899976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:23.900255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:23.900527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:23.912593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:23.918183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:23.936947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:23.937892 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:23.938777 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 374/762] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:23.945832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:23.950981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ff89c-578d-47d2-b38b-77255d496024 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:24.024432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:24.029094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:24.029370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:24.029693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:24.030395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:24.030695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:24.033321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:24.060883 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 389/763] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:24.066473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:24.177420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:24.188815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:24.198887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733057-fa5b-435b-98b7-ee85f6d60791 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:24.217894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9e788-046f-40c0-8924-9d0d442f9af4 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:24.262726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:24.263421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:24.263800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:24.264232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/33ae6b3ef0964315be1bc1983fe65939/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:24.266795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=33ae6b3ef0964315be1bc1983fe65939, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:24.268290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:24.286155 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 390/764] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:24 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/33ae6b3ef0964315be1bc1983fe65939/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:24.292885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:24.293606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:24.293891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:24.294212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:24.295043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:24.295353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:24.297064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfd53e-b6e2-4d4f-b613-2daf1df4c1f4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:24.312282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 375/765] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:24.317872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:24.423522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40eb00-d646-49ef-9ff7-270ebc4f2d08 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:24.424274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40eb00-d646-49ef-9ff7-270ebc4f2d08 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:24.424274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40eb00-d646-49ef-9ff7-270ebc4f2d08 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:24.425468 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 376/766] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:24.431070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2dca0-ee76-4965-90a5-236412b3cd3c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:24.431308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2dca0-ee76-4965-90a5-236412b3cd3c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:24.431560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2dca0-ee76-4965-90a5-236412b3cd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:24.442530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281d4c4-fd4e-446a-84d3-42f926715828 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:24.460318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:24.478051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-71a2dca0-ee76-4965-90a5-236412b3cd3c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:24.479295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-71a2dca0-ee76-4965-90a5-236412b3cd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:24.490650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:24.491335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:24.491744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:24.492024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:24.492772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=e2750dbbaa7c460d95e1b273f1dd7166) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:24.493110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:24.494701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9145-3929-43a2-ab22-c06241968eb0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:24.501656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 391/767] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:24 2022] GET /identity/v3/role_assignments?user.id=e2750dbbaa7c460d95e1b273f1dd7166&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:24.591900 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 377/768] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:25.122698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc8c08-583f-4d71-bec0-546f4bb16753 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.122698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc8c08-583f-4d71-bec0-546f4bb16753 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.122698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc8c08-583f-4d71-bec0-546f4bb16753 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.123343 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 392/769] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:25.130362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.130921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.131413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.165889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:25.167204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc8c08-583f-4d71-bec0-546f4bb16753 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:25.176698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:25.296625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 378/770] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:25.342122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc8c08-583f-4d71-bec0-546f4bb16753 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:25.378037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:25.378994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.379472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.379941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.381382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:25.382941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:25.392113 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:25.393163 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:25.394008 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:25.396729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 393/771] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 5 02:12:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:25.404963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:25.449264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:25.572661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb2b74-1055-4940-9a07-2f3c59ab93cf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:25.623460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:25.624071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.624347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.624618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.625262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:25.625564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:25.626969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:25.636933 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 379/772] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 02:12:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:25.642384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:25.681657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:25.705094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:25.804560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7dcfa-a400-43fa-9883-92b419e71426 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:25.820931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:25.839245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13debd-1514-46fb-b6ac-9a883778c3d1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:25.843868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:25.844538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.844881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.845243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.845937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:25.846302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:25.847856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923dd79-44d2-4f6b-afbf-75de248910db None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:25.854061 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 394/773] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 02:12:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:25.855457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaea099-8732-4b7a-b3ed-122f76b5d21d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.855805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaea099-8732-4b7a-b3ed-122f76b5d21d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.856144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaea099-8732-4b7a-b3ed-122f76b5d21d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.860991 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 395/774] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:25.862754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaea099-8732-4b7a-b3ed-122f76b5d21d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:25.886655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:25.887376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.887599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.887881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.888482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:25.890070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-47161de3-7bc2-403d-9946-e502262809a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:25.904750 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:25.905843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:25.906682 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 380/775] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:25 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:25.907497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:25.907497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:25.908160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:25.928533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:25.929752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:25.982303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaea099-8732-4b7a-b3ed-122f76b5d21d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:25.992129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:26.017000 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 381/776] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:26.017889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.038632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.040962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.041250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.041519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.042281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] RBAC: Adding query filter params (interface=public, service_id=1befea47a7ed4e16b4b9813c23fa0fa1, region_id=RegionOne) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:26.042592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.043964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.062732 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 396/777] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:12:25 2022] GET /identity/v3/endpoints?service_id=1befea47a7ed4e16b4b9813c23fa0fa1&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:26.068355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.160533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:26.186766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb6e18-2722-4548-b783-11a4f4daa835 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.227678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.228723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.229245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.229861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.230700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] RBAC: Adding query filter params (name=network) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:26.231223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.232789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.243364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 382/778] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:26.246510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.307079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438523f3-405a-4bd8-8a9b-3136799bf13e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.355286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.356615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.357148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.357602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.358386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.359961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.361959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876e8ec-85d5-4aca-8add-0253b9eee228 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.373232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 397/779] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/services => generated 772 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:26.374555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.403834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.404610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.408931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.408931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.408931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] RBAC: Adding query filter params (type=network) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:26.408931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.408931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.421028 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 383/780] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:26.422384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.432896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:26.452924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:26.548619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713901-6a1d-474c-a6d4-1b071de2df43 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.590651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.591272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.591550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.591891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.592598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] RBAC: Adding query filter params (interface=public, service_id=7c8dcd9bb522416eb6f18c384c1d5d5e, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:26.592927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.594437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.609639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 384/781] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/endpoints?service_id=7c8dcd9bb522416eb6f18c384c1d5d5e&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:26.612144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.639402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e05f-f5e6-48db-b39b-054f39399f69 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.692390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:26.696579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.697539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.698090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.698581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.711775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:26.717740 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:26.718714 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:26.719557 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:26.722485 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 398/782] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:26.728395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54727a-0b43-42ba-b784-7b29cae6733c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.729378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.767660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.769160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.769160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.769160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.770072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.771607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.780756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 385/783] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:26.844752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:26.853280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979ddd9-2eee-479a-8744-d4cdcaa643ab None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:26.906545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:26.907165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.907451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.907789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.908467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:26.908820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:26.910236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eb7c8-64b9-4430-9056-fbca1feb3370 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:26.925330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 399/784] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:26.931640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:26.982493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3674510-59c1-46d9-acd9-31d75fab956a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.982966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3674510-59c1-46d9-acd9-31d75fab956a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.983251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3674510-59c1-46d9-acd9-31d75fab956a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:26.984870 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 400/785] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:26.990716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:26.991010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:26.991428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.023698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:27.025054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:27.061515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5bbd-e63d-4ca1-b58a-b054213aebcc None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:27.100042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:27.100722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.101045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.101321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.103391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:27.116193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:27.118461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:27.138038 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:27.139229 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:27.140356 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:27.140356 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:27.140356 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:27.142294 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 386/786] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:27.147608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:27.165985 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 401/787] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:27.287366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855571db-0f8a-497c-baf1-0cf2619edcea None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:27.330989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:27.331646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.331934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.332207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.332849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:27.333176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:27.335156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4e89c-7752-4db9-b89d-16a6b943eca7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:27.351868 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 387/788] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:27.356986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:27.367938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895c13-f988-4a85-abe4-e740492a84aa None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.368216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895c13-f988-4a85-abe4-e740492a84aa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.368487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df895c13-f988-4a85-abe4-e740492a84aa None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.375440 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 388/789] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:27.376731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216077-2540-4413-962b-5611001041f0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.377057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216077-2540-4413-962b-5611001041f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.377328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7216077-2540-4413-962b-5611001041f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.414549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f7216077-2540-4413-962b-5611001041f0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:27.415757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f7216077-2540-4413-962b-5611001041f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:27.469852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:27.487232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9356d08-560d-46ca-922d-df394dee7987 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:27.511149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:27.533923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:27.534555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.534908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.535096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.553617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:27.555082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:27.559509 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 389/790] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:27.560437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7216077-2540-4413-962b-5611001041f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:27.568637 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:27.569631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:27.570591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 402/791] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:27.577902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:27.682904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7216077-2540-4413-962b-5611001041f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:27.731589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:27.732222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.732498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.732766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.757695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:27.764178 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:27.765139 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:27.765971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 390/792] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:27.767161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bb3f0-168c-4842-882f-466b3b661078 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:27.775573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:27.830384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:27.830915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:27.831193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:27.831467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:27.832194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:27.832496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:27.834637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:27.841994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:27.868573 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 403/793] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 02:12:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:27.873883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:27.883524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:27.967940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c0d60-10ad-4075-9c58-cc8a48257873 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.004582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8886-4399-4eb1-bd1e-46fbf8bb3f59 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.007750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.008442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.008795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.009165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.009961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:28.010319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.011691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.025746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 391/794] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:28.026770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.043405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.044068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.044346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.044621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.055039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.056479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:28.071735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:28.073954 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:28.076207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:28.076207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:28.076207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:28.076207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 404/795] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:28.076207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.133180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.135316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.139504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8d657-fb6f-4c87-8400-9aee5394d525 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.177996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.178500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a358b9-e592-4613-9d64-c425f76596ce None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.179090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.179545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.180152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.191719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:28.198264 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:28.199423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:28.200443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:28.207816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 392/796] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:28.209516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.215605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.216244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.216522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.216793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.230015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.231590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:28.248432 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:28.249681 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:28.250780 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:28.250780 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:28.250780 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:28.254242 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 405/797] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:28.255095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.328287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2f2dc-8744-4347-ac15-d5b1fe2f0659 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.357433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a25057-232b-4c17-ac7b-358c9784443c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.366790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.370541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.371339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.371899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.372326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.373149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:28.373625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.375144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.390706 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 393/798] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:28.391795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.393441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.394049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.394331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.394603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.395496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:28.395805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.398088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.411164 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 406/799] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:28.412769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.416527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.506569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908132e-90e9-4e60-96c2-6076be4f8637 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.521588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961e793-8f3b-457e-860c-e6262fa18bdf None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.560209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.560890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.561197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.561477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.569708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.571205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:28.590310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:28.591460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:28.592565 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 407/800] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:28.593105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.630140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.678504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.679641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.680077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.680522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.681355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:28.681923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.683555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.697485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 394/801] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:28.698638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.717159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e7a0-f1d2-42df-bb7f-40bd77681ac5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.757076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.757430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.757719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.757998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.769936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.772467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.784938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:28.790372 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:28.791889 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:28.793041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:28.793041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:28.793041 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:28.799178 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 408/802] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:28.800791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.808988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48761165-55f4-4164-89ed-9a7d74c0d4e2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.855918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.856545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.856825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.857154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.857864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:28.858165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.859754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.873439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 395/803] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:28.874145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:28.917691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:28.939813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66172b8b-0b37-4607-87ec-c136da32e2f0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.976079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:28.976702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:28.977009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:28.977375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:28.984813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:28.985602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11521bab-31f7-4938-9694-d1fe9e025b4a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:28.986281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:28.998044 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:28.999017 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:12:28.999961 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:29.003729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 409/804] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:29.004430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.024125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.024875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.025189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.025767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.026411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:29.026721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.028505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b686-9cf3-4f78-9444-b8b7f1ee6ba7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.036203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.046230 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 396/805] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:29.047560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a22bd-7878-4bb4-8d35-dbb620672edb None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.047849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a22bd-7878-4bb4-8d35-dbb620672edb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.048122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a22bd-7878-4bb4-8d35-dbb620672edb None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.049658 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 397/806] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:29.050354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a22bd-7878-4bb4-8d35-dbb620672edb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.115721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c350cc9-f853-4d44-9a40-f846633c2956 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.149596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.150256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.150539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.150817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/4c0d9417ce05468695abebca3b0abde3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.152715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=4c0d9417ce05468695abebca3b0abde3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.154185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.165737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a22bd-7878-4bb4-8d35-dbb620672edb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.168643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 410/807] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:29 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/4c0d9417ce05468695abebca3b0abde3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:29.168976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.181474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.220863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.221450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.221732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.222005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.222757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:29.223323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.224603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d74167-899d-48d0-af8a-d3421ecdafbf None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.249308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 398/808] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:29.250700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.250992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.251266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.270867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:29.272120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:29.329670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.337330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faedcb-7867-4f65-b04c-7e939032dd81 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.356629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 399/809] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:29.356629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.383590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.384794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.385243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.385660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.394001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.395440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-98876056-be7d-46dc-bd6d-ad0565fee536 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:29.409430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:29.410506 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:29.411460 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:29.414180 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 411/810] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:29.414284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953fc60-d80f-478b-a9f9-d0fec169c6a7 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.414506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953fc60-d80f-478b-a9f9-d0fec169c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.414782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953fc60-d80f-478b-a9f9-d0fec169c6a7 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.416182 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 412/811] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:29.425758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953fc60-d80f-478b-a9f9-d0fec169c6a7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.476396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae79bf7-9128-4568-abdb-a585d78dd969 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.501315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.511856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.512462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.512743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.513050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.545715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953fc60-d80f-478b-a9f9-d0fec169c6a7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.570117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.584081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.585591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.585874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.586750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.587544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.588045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.589763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:29.590109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.591496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9cee-9efc-4096-afb8-140ea1c454b5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.609829 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 413/812] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:29.611134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.611594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.611882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.630076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:29.631958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:29.705200 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 414/813] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:29.706043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.706365 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 400/814] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:12:29.707689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.769363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.821689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:29.824603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81520936-cf4a-48c4-a774-4f06eb0252b4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.834641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c60e2-5380-4f36-a747-33bae11aec3f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:29.861211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.862020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.862375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.862923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.876354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:29.877055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:29.877332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:29.877605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:29.878183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.879535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.881994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:29.883516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:29.893946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:29.895182 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 05 02:12:29.896284 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:29.898801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 401/815] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:29.899851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:29.901411 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:29.902542 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:29.903742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:29.903742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:29.903742 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:29.908805 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 415/816] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:29.908805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.008099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e193-6522-40d8-a4b4-04738bb648ab None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.009671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.033251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d2037-8689-4369-812e-2187a5aaa92c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.046993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.047604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.047882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.048152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.048790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.049179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.050555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.055416 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 416/817] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:30.056210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.071522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.072159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.072443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.072742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.085722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.087155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:30.102407 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:30.103543 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:30.104443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:30.104443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:30.104443 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:30.104443 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 402/818] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:30.104668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.110488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.174125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f92ef-adb6-45d6-87e2-e46538d50699 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.214224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.215104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.215389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.215664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.216264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcbdc1-b812-40e6-b532-377d4222254e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.216369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.216597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.218008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.235067 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 417/819] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:30.235067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.257812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.258543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.258928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.259265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] PATH_INFO: `/v3/services/network` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.259855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.261256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.264372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:30.270567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:30.272976 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:30.273978 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 403/820] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:30.274806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.347621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.356505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77774ce9-fc23-434d-b554-d3ca503b51fd None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.387258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8c124-c1f9-4d7c-814e-8de86a648f6d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.391702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.392309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.392587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.392859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.393581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.393883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.395271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.405228 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 418/821] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:30.405228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.427472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.428080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.428359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.428630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.429304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.429599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.430953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.442399 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 404/822] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:30.443552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.506899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.518239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52af730-e4ce-4ff6-902f-900a5f758186 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.553504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a19f6b-190d-4998-9937-c9775673c714 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.555322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.556016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.556365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.556708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.563495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.565025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:30.577599 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:30.578711 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 419/823] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:30.585493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.590398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.602576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.603211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.603561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.603906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.604631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] RBAC: Adding query filter params (name=network) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.605046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.606400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.615350 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 405/824] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:30.615350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.699176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0e26b-bed4-46c7-8615-0722665a32a5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.726214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9c28-12b1-49fc-aea6-9a5a9008bc20 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.734983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.735786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.736066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.736401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.737099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.738508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.762148 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 420/825] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:30.763223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.783383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.792602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.793551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.794032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.794517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.804151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.806104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:30.820496 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:30.821687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:30.822776 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:30.829697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 406/826] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:30.830446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.891882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:30.901837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9897dd2-38ad-4910-9238-d5c27254b2f5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.941310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.941930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.942217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.942583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.943628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.944039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.945547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:30.953059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322d1e-507f-44f5-a07e-71ee5afcc1eb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:30.965395 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 421/827] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:30.966430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:30.993592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:30.994343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:30.994721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:30.995093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:30.995819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] RBAC: Adding query filter params (type=network) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:30.996226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:30.997724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:31.002908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 407/828] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:31.007982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:31.041150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:31.089709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ca026-44f2-4f20-a95b-2888c9e4de30 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:31.122515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c88cd-4224-45d2-b776-18fbd112ee99 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:31.134201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:31.140602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:31.141762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:31.142773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:31.143273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:31.144212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:31.144715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:31.147290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:31.160006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:31.160613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:31.160892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:31.161192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/e2750dbbaa7c460d95e1b273f1dd7166/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:31.170756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 422/829] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:31.170756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:31.178608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=e2750dbbaa7c460d95e1b273f1dd7166, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:31.180054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:31.195716 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 408/830] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:31 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/e2750dbbaa7c460d95e1b273f1dd7166/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:31.196651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:31.315282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e4c73-9171-4ebc-9c31-b9e561ef3bab None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:31.320972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac8eab-251f-4073-93c4-e91aa25ff595 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:31.346649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:31.358484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a943a-fd98-472e-a779-5c6ff0ffa34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:31.359585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a943a-fd98-472e-a779-5c6ff0ffa34a None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:31.359825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:31.360312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a943a-fd98-472e-a779-5c6ff0ffa34a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:31.360420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:31.360709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:31.361010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:31.361314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a943a-fd98-472e-a779-5c6ff0ffa34a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:31.361750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=33ae6b3ef0964315be1bc1983fe65939) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:31.362058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:31.362728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a943a-fd98-472e-a779-5c6ff0ffa34a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:31.363510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936145aa-1f23-4d42-9677-bd497680a2c9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:31.364534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a943a-fd98-472e-a779-5c6ff0ffa34a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:31.376937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 409/831] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:31 2022] GET /identity/v3/role_assignments?user.id=33ae6b3ef0964315be1bc1983fe65939&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:31.414909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 423/832] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:31.573213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98322982-4ef5-4350-989c-94f979a08ef8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:31.573556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98322982-4ef5-4350-989c-94f979a08ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:31.573889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98322982-4ef5-4350-989c-94f979a08ef8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:31.575560 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 410/833] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:31.582030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912204-49de-43b2-ada2-2db586116504 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:31.582342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912204-49de-43b2-ada2-2db586116504 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:31.582592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c912204-49de-43b2-ada2-2db586116504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:31.603894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3c912204-49de-43b2-ada2-2db586116504 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:31.605175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3c912204-49de-43b2-ada2-2db586116504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:31.700051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 424/834] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:31.991023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98322982-4ef5-4350-989c-94f979a08ef8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:32.018202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:32.100468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98322982-4ef5-4350-989c-94f979a08ef8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:32.135759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:32.136575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:32.136857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:32.137158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:32.148993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:32.153954 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:32.155096 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:32.156128 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 411/835] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:32.161222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c912204-49de-43b2-ada2-2db586116504 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:32.266879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c912204-49de-43b2-ada2-2db586116504 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:32.277464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:32.304952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:32.305988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:32.306447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:32.306867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:32.307695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:32.308147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:32.309713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:32.319628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 425/836] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:32.325273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:32.419736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:32.436943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c75b8-7a89-4f18-a900-0572d79321b7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:32.471455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:32.472305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:32.472747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:32.473191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:32.484501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:32.486131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:32.501832 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:32.503032 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:32.504146 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:32.504146 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:32.504146 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:32.506046 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 412/837] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:32.514118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:32.618598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bdc14-f70b-4cce-abe8-0d2c915ee0eb None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:32.666038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:32.666659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:32.666939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:32.667210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:32.667854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:32.668157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:32.669555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:32.682300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 426/838] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:32.687628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:32.797613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8223c0-c1e8-413c-b42e-dd2903fa2579 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:32.833504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:32.834242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:32.834525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:32.834803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:32.837582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:32.844594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:32.846283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:32.857725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:32.858679 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 05 02:12:32.859653 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:32.862188 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 413/839] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:12:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:32.872999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:32.905485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:32.978454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32aab-782b-42a2-a516-a5b8c5fc2f8d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:33.013504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:33.014115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.014397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.014665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.015392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:33.015698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:33.017157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa2c56-c416-4d9d-b270-417c3ea0872a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:33.035219 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 427/840] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Oct 5 02:12:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:33.040807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.151511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56659a0d-6c43-4394-b822-2a1b421d9344 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:33.171229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e6b67-55fd-4694-a9b6-c00078abda2c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.171516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e6b67-55fd-4694-a9b6-c00078abda2c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.171782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e6b67-55fd-4694-a9b6-c00078abda2c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.173394 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 428/841] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:33.178320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.178606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.178883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.185300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:33.185905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.186180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.186451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.200350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:33.201827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:33.253976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:33.262298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:33.263742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:33.295371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 429/842] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:33.378693 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 414/843] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:12:33.384869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.421510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:33.492605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d75c4-2064-4154-a56c-12acf1c6df91 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:33.527792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:33.528415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.528736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.529044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.540282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:33.541764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:33.556999 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:33.557979 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:33.558877 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:33.558877 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:33.558877 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:33.558877 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 430/844] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:33.564692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.569899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.648546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:33.690875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226a5e-c36d-4aee-a6b9-9f11919e4f42 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:33.696421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:33.703168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430cf73-5287-4e46-b9e5-ef79b8d760b8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:33.731574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:33.732599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.733112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.733632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.734406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:33.736056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8d428f68-64f5-4577-b99c-efaa9b774e67 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:33.746206 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:33.747207 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:33.748070 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:33.749330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:33.749533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.749778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.750053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.751031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:33.751330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:33.751595 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 431/845] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:33.752797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cb35-fdb7-44d9-b11d-2a6e9f3714ef None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:33.752953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90840-2942-4fac-820e-3d03955042c6 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.753182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90840-2942-4fac-820e-3d03955042c6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.753462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90840-2942-4fac-820e-3d03955042c6 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.755176 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 432/846] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:33.760524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90840-2942-4fac-820e-3d03955042c6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.767838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 415/847] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:33.769187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.769561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.769847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.794584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:33.795787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:33.866769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 416/848] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:33.867958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.877569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90840-2942-4fac-820e-3d03955042c6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:33.914191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:33.914799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.915084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.915360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.915993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:33.916302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:33.917798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3092ed-e2a5-4858-8599-f55c352e2453 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:33.919006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:33.924239 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 433/849] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:33.925371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d177-0c48-4d96-b5ec-8bf73d9620c2 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:33.925663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d177-0c48-4d96-b5ec-8bf73d9620c2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:33.925939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d177-0c48-4d96-b5ec-8bf73d9620c2 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:33.929076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 434/850] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:33.929076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d177-0c48-4d96-b5ec-8bf73d9620c2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:33.966921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:33.984150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c925cdd-9d5f-4d8f-b7b5-15b498ed8d01 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.019127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.019949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.020235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.020508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.028555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.030063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-91c7fba7-462e-4545-94f7-e79f9545c413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:34.043217 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:34.044650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:34.045604 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:34.049464 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 417/851] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:34.050799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.051094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.051371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.071815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:34.073078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:34.147541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 418/852] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:34.148282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.157436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41d177-0c48-4d96-b5ec-8bf73d9620c2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.196570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.197293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.197570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.197842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.198474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:34.198772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.200130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.212940 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 435/853] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:34.212940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.242078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:34.276753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160ee7c-8eae-4f60-84ec-19a99c05f351 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.296020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:34.325561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.326918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.327657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.328083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.329104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:34.329813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.331678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.351916 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 419/854] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:34.353218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.355399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927f295-979a-436d-9b47-4875e346f601 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.404889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.405546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.405822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.406091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.421895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:34.427631 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:34.428598 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:34.429500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 436/855] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:34.430192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.481586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c52cd-64a9-4221-b5cb-ba94794e7273 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.517738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.518286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.518569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.518843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.519594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=4c0d9417ce05468695abebca3b0abde3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:34.519931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.521925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.525548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:34.528838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 420/856] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/role_assignments?user.id=4c0d9417ce05468695abebca3b0abde3&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:34.534848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.541577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c229db5-c947-43e9-9c1a-beddf0bb937b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.567597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:34.582192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.582796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.583079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.583887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.584569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.586119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:34.596343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:34.597430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:34.603982 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 437/857] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:34.607547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.679525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458de4c2-7d76-47e3-9593-7147605c41c0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.723622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.725237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.725518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.725793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.726456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:34.726758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.728115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.738241 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 421/858] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:34.744020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.756882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781d36b-d7b1-4412-9444-2c6dbdde43ac None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.795395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.796063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.796351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.796632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.797393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:34.797731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.799105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.808560 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 438/859] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:34.809841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.821433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:34.864290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:34.868058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92e7a-717d-4a58-a505-6a66d35a9b09 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:34.908666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:34.909489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:34.909867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:34.910244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:34.923178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:34.924658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:34.941392 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:34.943458 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:34.945484 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:34.945484 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:34.945484 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:34.945484 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 422/860] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:34.956963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:34.957341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5ba15-e098-4fdb-9f53-a401074936c5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:35.015668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:35.016722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:35.017230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:35.017697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:35.018794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:35.019319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:35.021883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:35.030135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 439/861] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:35.061685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc72c86-1496-468a-9e61-9b2a12aa8efa None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:35.078297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:35.103176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:35.103789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:35.104068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:35.104340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:35.105020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:35.105328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:35.106710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:35.121809 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 423/862] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:35.127296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:35.242290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315627e-8b35-4f4f-9bb3-efa23f20ab02 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:35.258328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:35.283797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:35.284645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:35.285127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:35.285542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:35.293849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:35.295596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:35.308452 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:35.309650 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:35.310855 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:35.313089 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 440/863] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:12:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:35.324940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:35.423162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab600406-abfd-489d-b66c-e9115416883c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:35.459584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:35.460189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:35.460463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:35.460731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:35.461487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:35.461794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:35.463206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:35.484892 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 424/864] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 02:12:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:35.490337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:35.601768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d6e29-cdf5-492f-a697-d78022fc52a8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:35.637945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac5805-2036-4183-a566-51190358395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:35.638922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac5805-2036-4183-a566-51190358395c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:35.639527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac5805-2036-4183-a566-51190358395c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:35.639978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac5805-2036-4183-a566-51190358395c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:35.685077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:35.713143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac5805-2036-4183-a566-51190358395c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:35.714584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac5805-2036-4183-a566-51190358395c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:35.815798 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 441/865] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:12:35.822241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:35.855212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:35.941028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcdf3d-db59-4d99-a0b7-2e24609b839f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:35.978075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:35.978753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:35.979034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:35.979306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:35.991954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:35.993460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:36.010090 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:36.011108 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:36.011987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:36.011987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:36.011987 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:36.011987 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 425/866] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:36.017943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac5805-2036-4183-a566-51190358395c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:36.098289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:36.123979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac5805-2036-4183-a566-51190358395c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:36.157762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:36.158358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:36.158638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:36.158910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:36.159552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:36.159854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:36.161291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:36.173481 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 442/867] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:36.179023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:36.270911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:36.291345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9795b-9e59-40cc-b7e8-5421cc3e8dec None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:36.326472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:36.327131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:36.327408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:36.327679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:36.336492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:36.338004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5320bb3a-88e4-4be9-9cd6-82cda7145ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:36.353153 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:36.354199 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:36.355224 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 426/868] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:36.362380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:36.450197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d610cd-39a4-4fa8-9319-e653116f59b0 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:36.450911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d610cd-39a4-4fa8-9319-e653116f59b0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:36.451416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d610cd-39a4-4fa8-9319-e653116f59b0 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:36.452968 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 427/869] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:36.458233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:36.459189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:36.459466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:36.477752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244337e-b03d-4d0e-a218-96dbd995420e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:36.479271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:36.480446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:36.524605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:36.526229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:36.526745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:36.527277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:36.528665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:36.529597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:36.531924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:36.534755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:36.558839 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 443/870] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:36.559940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:36.565193 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 428/871] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:36.670821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9981a1-01f5-4d7e-86a6-d633dd5c5564 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:36.708045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:36.708786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:36.709105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:36.709386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:36.710119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=e2750dbbaa7c460d95e1b273f1dd7166) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:36.710431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:36.711979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f052a-7a10-40db-a4f5-61e5b2145a67 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:36.718436 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 444/872] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:36 2022] GET /identity/v3/role_assignments?user.id=e2750dbbaa7c460d95e1b273f1dd7166&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:36.845056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:36.938155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:36.966042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21260fa-7a7b-4ec6-bb30-02266339e407 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:37.004172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f570a4-390c-41e9-8740-785fea41e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:37.004791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f570a4-390c-41e9-8740-785fea41e47f None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.005203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f570a4-390c-41e9-8740-785fea41e47f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.005399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f570a4-390c-41e9-8740-785fea41e47f None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.006229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f570a4-390c-41e9-8740-785fea41e47f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:37.007665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f570a4-390c-41e9-8740-785fea41e47f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:37.021935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a748-c8d4-49b6-ba4d-b0a7d2624dcb None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.022423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a748-c8d4-49b6-ba4d-b0a7d2624dcb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.022541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171a748-c8d4-49b6-ba4d-b0a7d2624dcb None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.024157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 445/873] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:37.024462 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 429/874] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:36 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:37.034542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785826a-6c68-40e1-b2d3-afd1b55f1154 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.034835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785826a-6c68-40e1-b2d3-afd1b55f1154 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.035096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785826a-6c68-40e1-b2d3-afd1b55f1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.060084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c785826a-6c68-40e1-b2d3-afd1b55f1154 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:37.061550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c785826a-6c68-40e1-b2d3-afd1b55f1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:37.125874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:37.150047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 446/875] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:37.333839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18d06-6acb-44b8-a498-3d0c6788aec9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.334365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18d06-6acb-44b8-a498-3d0c6788aec9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.334478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b18d06-6acb-44b8-a498-3d0c6788aec9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.336054 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 430/876] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:37.341355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.341641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.341918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.361824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:37.363016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:37.422711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b18d06-6acb-44b8-a498-3d0c6788aec9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:37.436476 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 447/877] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:37.528495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b18d06-6acb-44b8-a498-3d0c6788aec9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:37.563927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:37.564558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.564836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.565135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.565712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:37.567069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:37.569605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:37.577214 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:37.578328 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:37.579253 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:37.583535 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 431/878] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:37.585467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:37.688331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530bc62-fa19-49da-b69d-03cca305a519 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:37.702457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:37.711957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:37.725276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:37.726207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.726703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.727187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.728023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:37.728543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:37.730210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:37.735207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 448/879] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:37.742266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:37.826399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51b0c-bc63-4bd2-a787-6d41ff1cb2df None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:37.856131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c23ce9-f523-4ab4-ac1a-3f1ecf15f72b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:37.862559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb05b6-894b-4507-8ab1-ce10fd567120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:37.863448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb05b6-894b-4507-8ab1-ce10fd567120 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.863932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb05b6-894b-4507-8ab1-ce10fd567120 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.864432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb05b6-894b-4507-8ab1-ce10fd567120 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.865987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb05b6-894b-4507-8ab1-ce10fd567120 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:37.867577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb05b6-894b-4507-8ab1-ce10fd567120 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:37.893132 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 432/880] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:37 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:12:37.906619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:37.907240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:37.907520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:37.907793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:37.908438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:37.908738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:37.910308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c02466-9367-482d-a9b7-cb15ea1f186c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:37.916503 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 449/881] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:39.088316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5fba4-12c3-491c-9011-f0cfbb0c227b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.088846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5fba4-12c3-491c-9011-f0cfbb0c227b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.088846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5fba4-12c3-491c-9011-f0cfbb0c227b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.090457 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 433/882] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:39.095837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38849436-af5b-4559-9188-f86ce5ebfee6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.096244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38849436-af5b-4559-9188-f86ce5ebfee6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.096420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38849436-af5b-4559-9188-f86ce5ebfee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.116047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-38849436-af5b-4559-9188-f86ce5ebfee6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:39.117247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38849436-af5b-4559-9188-f86ce5ebfee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:39.145931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:39.187485 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 450/883] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:39.347105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c015-76bc-4142-9ef7-8fdf61128622 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.347362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c015-76bc-4142-9ef7-8fdf61128622 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.347644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707c015-76bc-4142-9ef7-8fdf61128622 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.349342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 434/884] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:39.354839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.355128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.355405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.380020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:39.382157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:39.448813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 451/885] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:39.477957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707c015-76bc-4142-9ef7-8fdf61128622 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:39.538402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:39.589196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707c015-76bc-4142-9ef7-8fdf61128622 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:39.629439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:39.629987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.630917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.631198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.642279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:39.647560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:39.648517 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:39.649801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 435/886] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 02:12:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:39.656844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:39.736881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:39.769456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:39.774150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2a70-895d-4a2d-b209-dacaf2016374 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:39.812036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:39.813371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.813851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.814408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.815289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:39.815797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:39.817542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:39.832611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 452/887] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:12:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:39.834335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:39.857370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d0ff4-88c1-495c-9c30-febe12f04b3a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:39.878726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:39.901733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:39.902260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.902487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.902759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:39.903340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:39.905434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:39.916646 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:39.917811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:39.920099 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 436/888] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:39.925840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:39.957875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4816c86-7e5a-4f79-bfaf-22f5db4ea91a None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:39.995762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:39.996870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:39.997367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:39.997869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.009734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.011466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:40.030194 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:40.031250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:40.032137 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:40.032137 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:40.032137 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:40.033920 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 453/889] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:40.040579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ac17-40ec-43e1-b6ef-b6d4a1b947be None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.041105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.059429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.087071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.087817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.088431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.088996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.089532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:40.090853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.092318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.101057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 437/890] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:40.104641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.159981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.179398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd8135-6c17-44d7-9e85-c43b46fc4c02 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.216725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0230560-6d35-49a3-9c1f-0b03fb28cfdd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.219273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.220169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.220658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.221273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.222135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:40.222653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.224490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fb90-c2f0-48be-b1ce-408d5176123c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.237726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 454/891] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:40.239217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cad89-0e57-4de3-97f7-a98d23984592 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.240060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cad89-0e57-4de3-97f7-a98d23984592 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.240769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cad89-0e57-4de3-97f7-a98d23984592 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.242026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 455/892] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:40.243204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850a35-ec11-4dad-a9ba-17926077f961 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.243509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850a35-ec11-4dad-a9ba-17926077f961 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.243744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850a35-ec11-4dad-a9ba-17926077f961 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.244955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 456/893] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:40.245691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850a35-ec11-4dad-a9ba-17926077f961 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.254438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.255045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.255892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.256167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.257007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:40.257318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.258680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774aec2-a2c5-4855-9e1a-9358281db8b3 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.263409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 438/894] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:40.264527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb036df-318e-4a29-b3ac-ebe6bcca4ace None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.264810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb036df-318e-4a29-b3ac-ebe6bcca4ace None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.265118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb036df-318e-4a29-b3ac-ebe6bcca4ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.282872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5eb036df-318e-4a29-b3ac-ebe6bcca4ace None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:40.284061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5eb036df-318e-4a29-b3ac-ebe6bcca4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:40.314976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.345771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850a35-ec11-4dad-a9ba-17926077f961 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.351712 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 439/895] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:40.357641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.357641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.357641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.374297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:40.376446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:40.384934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.385592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.385899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.386144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.394082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.395609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:40.407251 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:40.408442 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 457/896] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:40.409474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.420002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.461065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 440/897] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:40.461065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.533051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f4ce7-16c3-4276-a12c-545b98a1b353 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.567274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf72628-14ec-4ebf-8937-a24bdf03069f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.571513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.578791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.579763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.580135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.580808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.581946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] RBAC: Adding query filter params (interface=public, service_id=698796df3b0349dd8e186d6aec1cf01e, region_id=RegionOne) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:40.582351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.584069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.593046 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 458/898] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/endpoints?service_id=698796df3b0349dd8e186d6aec1cf01e&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:40.596094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.613678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.614389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.614894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.615355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.616093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:40.616546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.617960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.641422 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 441/899] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:40.641422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.682060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.714048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22615ad-43ae-4390-a8b5-a936f57c4672 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.749139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.749745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.750028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.750306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.750912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.752290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.758531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 459/900] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:12:40.759308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.759858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acd30b-136f-4fa4-9409-85d9a20f279e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.805942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.806602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.806880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.807473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.808360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.809984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:40.822170 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:40.823201 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:40.824083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 442/901] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:40.824892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:40.832082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.881867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d579-c855-4b93-bfd4-089c29d5474e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.918483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.919107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.919388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.919669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.931685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:40.943501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d898-c062-4565-823f-b3f391aa0a79 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:40.979435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:40.980161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:40.980445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:40.980718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:40.981399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.982756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:40.997766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:40.999220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.008950 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 443/902] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:40 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:41.008950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.080444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:41.138202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 460/903] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:40 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:12:41.139342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.148471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbc09-b384-4640-be0d-2e1ffb025b78 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.200641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.201464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.201857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.202263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.202896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:41.203205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.204830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.210316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 444/904] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:41.217146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.233194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:41.260949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dd2ab-1aa9-4e26-92ba-7be941325135 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.309312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.309956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.310233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.310504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.322614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.324059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:41.339941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:41.341305 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:41.342610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:41.342610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:41.342610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:41.342610 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 461/905] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:41.343673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9d2b1-9901-4438-883f-8a9f5093a1b8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.350408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.379392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:41.383711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.384730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.385642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.386106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.387236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:41.387964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.389502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.395587 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 445/906] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:41.402782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.484686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78bb5a5-0735-41eb-a802-e738344d3bbc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.501248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:41.528463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.529571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.530017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb1979-1fd7-484c-a0f6-1d77a03a5168 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.530171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.530581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.531384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:41.532163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.534344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.555342 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 462/907] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:41.556699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.580145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.581223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.581691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.582273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.583162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] RBAC: Adding query filter params (interface=public, service_id=8f8718abac614408b22c3b555997d7b4, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:41.584189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.585867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.592387 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 446/908] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/endpoints?service_id=8f8718abac614408b22c3b555997d7b4&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:41.597863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.655837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:41.703924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473dec6-5ab0-4368-bccd-4d3d614d16da None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.725642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67f586-e0bf-4e17-867c-593832bc7429 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.751729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.752709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.753209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.753682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.762195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.762618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.763227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.763505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.763778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.764377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.764974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.765761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.780934 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 447/909] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:41.782171 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:41.783051 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:41.784318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 463/910] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:41.789718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:41.793941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:41.908472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73517c31-946c-4d76-a1fb-fd29e15639e4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:41.947967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244905-4149-4e97-974c-00152f784193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:41.948572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244905-4149-4e97-974c-00152f784193 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:41.948913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244905-4149-4e97-974c-00152f784193 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:41.949208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244905-4149-4e97-974c-00152f784193 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:41.949903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244905-4149-4e97-974c-00152f784193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:41.950308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244905-4149-4e97-974c-00152f784193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:41.952441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244905-4149-4e97-974c-00152f784193 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:41.966380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 448/911] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:41.972448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:42.087140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d9cc-ddbe-442e-b306-48eaafec69d0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:42.117827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:42.122625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:42.123242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:42.123810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:42.128219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:42.128219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] RBAC: Adding query filter params (role.id=5a7c9c56b8ad40a4b733984a132e0777, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=e2750dbbaa7c460d95e1b273f1dd7166) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:42.128219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:42.128219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18819803-401e-41a0-ae6e-f5d2c193071d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:42.133505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 464/912] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:41 2022] GET /identity/v3/role_assignments?user.id=e2750dbbaa7c460d95e1b273f1dd7166&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=5a7c9c56b8ad40a4b733984a132e0777 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:42.963019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7c65-813d-490e-abf0-99aed378d41b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:42.963528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7c65-813d-490e-abf0-99aed378d41b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:42.963751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd7c65-813d-490e-abf0-99aed378d41b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:42.965495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 449/913] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:42.970922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089127-342a-45f8-8c67-e26b28ea0ca3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:42.971339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089127-342a-45f8-8c67-e26b28ea0ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:42.971517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78089127-342a-45f8-8c67-e26b28ea0ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:42.990922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-78089127-342a-45f8-8c67-e26b28ea0ca3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:42.992138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-78089127-342a-45f8-8c67-e26b28ea0ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:43.063384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 465/914] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:43.306859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16550c2-3859-4a91-9ee9-611e346f73ff None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:43.307223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16550c2-3859-4a91-9ee9-611e346f73ff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:43.307415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16550c2-3859-4a91-9ee9-611e346f73ff None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:43.308988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 450/915] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:43.314306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:43.314597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:43.314873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:43.335084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:43.336941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16550c2-3859-4a91-9ee9-611e346f73ff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:43.337538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:43.412124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:43.413119 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 466/916] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:43.460875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16550c2-3859-4a91-9ee9-611e346f73ff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:43.495894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:43.496525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:43.496804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:43.497096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:43.497678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:43.499032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:43.508608 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:43.509605 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 05 02:12:43.510438 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:43.514545 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 451/917] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:43.515900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:43.573440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:43.619849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dd694-da74-4678-8abb-f2efe21cd50c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:43.656928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:43.656928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:43.656928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:43.656928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:43.657326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:43.657326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:43.658688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:43.673643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 467/918] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:43.679624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:43.699815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:43.799754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de6a8-e5e8-4336-b9ac-ad736bf3fec1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:43.822107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4b13-05a4-401b-897b-12c229dab2b1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:43.831734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:43.840790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:43.841908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:43.842752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:43.843503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:43.844337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:43.844842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:43.846557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:43.848674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:43.853069 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 452/919] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Oct 5 02:12:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:43.858643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:43.870314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:43.871480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:43.871961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:43.872466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:43.873371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:43.874945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:43.885660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:43.886675 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:43.887548 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:43.895153 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 468/920] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:43.896619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:43.972733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c57f1-4fc8-4e51-b985-2c6eecebc7c8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.012296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe24c1-ff03-4a0c-8779-0a015174282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.012932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe24c1-ff03-4a0c-8779-0a015174282b None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.013226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe24c1-ff03-4a0c-8779-0a015174282b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.013494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe24c1-ff03-4a0c-8779-0a015174282b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.014159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe24c1-ff03-4a0c-8779-0a015174282b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.015468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d66702-1132-4dc5-be4e-1666c9e80d77 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.015907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe24c1-ff03-4a0c-8779-0a015174282b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.044319 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 453/921] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:44.055800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99f48b-d7c3-4634-b3b9-b93b4b757e47 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.056176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99f48b-d7c3-4634-b3b9-b93b4b757e47 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.056365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99f48b-d7c3-4634-b3b9-b93b4b757e47 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.058219 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 454/922] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:44.066684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.066999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.067243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.078878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.079759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.080036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.080309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.080991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:44.081299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.082978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.090492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 469/923] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:44.091306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:44.092529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:44.096226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.145600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:44.154517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:44.184483 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 455/924] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:44.219874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e7351-d022-4df7-9d3d-a23d2a7199c7 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.260546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.261217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.261501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.261840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.262546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:44.262853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.264328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba96d56-1522-4ebb-b6dd-d36e31a5306d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.270287 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 470/925] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:44.276782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.361429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d68b-2849-45e1-b22e-f6d0a2760f35 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.361632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d68b-2849-45e1-b22e-f6d0a2760f35 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.361890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953d68b-2849-45e1-b22e-f6d0a2760f35 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.363447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 471/926] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:44.369381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.369664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.369936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.385286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce4bbd-8e82-40e4-8cb7-62baa4c4537c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.391555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:44.392747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:44.429468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e649-884e-466a-9924-4690854be942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.430844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e649-884e-466a-9924-4690854be942 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.431423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e649-884e-466a-9924-4690854be942 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.432073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8e649-884e-466a-9924-4690854be942 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.432878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e649-884e-466a-9924-4690854be942 None admin] RBAC: Adding query filter params (interface=public, service_id=e6303548f34c4c31bd36bc08f999bfa7, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:44.433301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e649-884e-466a-9924-4690854be942 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.435051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8e649-884e-466a-9924-4690854be942 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.444981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 456/927] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/endpoints?service_id=e6303548f34c4c31bd36bc08f999bfa7&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:44.449677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e649-884e-466a-9924-4690854be942 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.478979 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 472/928] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:44.479990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.502089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:44.528302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:44.564212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8e649-884e-466a-9924-4690854be942 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.596252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f115c6-03f7-4926-b975-7b83871fe933 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.600891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.601651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.602028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.602397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.603105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.604551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.617427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 457/929] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:12:44.639024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.639683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.639967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.640247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.640845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.642299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:44.652955 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:44.654003 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:44.654929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 473/930] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:44.666085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.787174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dfdbc-2338-4072-a613-21bff1225987 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.799874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.800079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:44.833053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.834648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.835168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.836307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.836749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:44.837944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:44.838784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:44.844715 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 458/931] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:44.850486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:44.928014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b418b-bbb5-460d-8138-9f0ddc23505b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.929672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:44.966813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286756-9285-49fc-a3a6-ed39c96ae27e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:44.975686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:44.976326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:44.976605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:44.976878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:44.987617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:44.993770 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:44.994941 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:12:44.995983 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:44.999841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 474/932] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:45.000820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:45.019696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.021774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.022057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.022334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.022976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:45.023285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.024653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.034942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 459/933] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:45.035910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:45.089337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:45.125509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07cab-7d49-4d75-9b75-1654b164a3b8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:45.167553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.168185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.168452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.168729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.169432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:45.169745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.171144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.185010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 475/934] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:12:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:45.188635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:45.189210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df2bda6-3bd8-424e-912e-57db795fe45f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:45.226256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:45.229570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.230182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.230994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.231277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.232474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.233984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.261174 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 460/935] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:45.327919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa520e-e711-48b1-ad5d-7a4ede010d54 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:45.378595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.379304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.379588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.379865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.392949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.394536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:45.410779 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:45.411967 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:45.413107 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:45.413107 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:45.413107 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:45.413107 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 476/936] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:45.418243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:45.518620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:45.530332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacbf88-03f2-4db9-a87f-39d1c42c6c9e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:45.566328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.566937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.567216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.568206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.568835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:45.569188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.570603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.584258 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 461/937] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:45.589871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:45.668309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:45.704842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d88e-4e0d-46df-844d-ae899ee4c54f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:45.744451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.745175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.745461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.745785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.754500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.756029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:45.767332 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:45.768291 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:45.769322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 477/938] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:12:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:45.774370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:45.883534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571bba6-8404-415d-8f0c-1f29b19be2b9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:45.919275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:45.919941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:45.920219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:45.920493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:45.921300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:45.921605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:45.923030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:45.941729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 462/939] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 02:12:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:45.947569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.065646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805a7cd-9d34-4c84-8073-60b40ac89384 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:46.097147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:46.103642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:46.104284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.104565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.104842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.117932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:46.119433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:46.134407 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:46.137059 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:46.139204 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:46.139204 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:46.139204 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:46.139204 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 478/940] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:46.144964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.153457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:46.245781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0c474-a472-499e-8a70-ebfe1666f43e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:46.285929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:46.287122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.287370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.287645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.288301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:46.288610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:46.290010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a5bc8-c5db-4c2e-8b61-4128849a7d58 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:46.302303 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 463/941] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:46.307729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.377967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ade82-ad04-4dd1-b412-50926cfd6d54 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.378270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ade82-ad04-4dd1-b412-50926cfd6d54 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.378446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ade82-ad04-4dd1-b412-50926cfd6d54 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.381751 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 464/942] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:46.385694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.385977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.386253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.404401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:46.405615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:46.417887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e586-be34-448d-b75a-c7ceee4d7f9f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:46.453557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:46.454199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.454467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.454998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.462245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:46.463766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:46.475453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:46.477318 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:46.478838 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:46.480510 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:46.481080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 465/943] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:46.481167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 479/944] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:46.483811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.592146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2df399-daf9-4b7b-b2db-1ac6ac425604 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:46.628677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:46.629231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.629513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.629789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.630613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:46.630970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:46.632448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:46.644668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 466/945] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:46.651310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.701622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:46.745581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.759530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace474-7269-4c53-8e2c-7ac68389dcd3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:46.794386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:46.795048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.795329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.795608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/e2750dbbaa7c460d95e1b273f1dd7166/roles/5a7c9c56b8ad40a4b733984a132e0777` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.797816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=e2750dbbaa7c460d95e1b273f1dd7166, role_id=5a7c9c56b8ad40a4b733984a132e0777)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:46.799258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:46.815061 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 480/946] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:12:46 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/e2750dbbaa7c460d95e1b273f1dd7166/roles/5a7c9c56b8ad40a4b733984a132e0777 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:12:46.838310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:46.880759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46f17f-3dc1-4563-9e61-0abbd6a40303 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:46.918693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:46.919421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.919763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.920101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.920864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:46.922424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:46.925200 n-d-858272-3 devstack@keystone.service[81827]: WARNING keystone.server.flask.common [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 05 02:12:46.945066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.sql.core [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 05 02:12:46.945066 n-d-858272-3 devstack@keystone.service[81827]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 02:12:46.945066 n-d-858272-3 devstack@keystone.service[81827]: [parameters: {'id': '4a76ffe451d646fe9511be96ac3f6031', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 05 02:12:46.945066 n-d-858272-3 devstack@keystone.service[81827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6e7a9657-6d19-4d95-9a7d-e1fb90979659 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a76ffe451d646fe9511be96ac3f6031.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a76ffe451d646fe9511be96ac3f6031. Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:12:46.963028 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 05 02:12:46.963933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application yield resource Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise self.value Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application session.commit() Oct 05 02:12:46.964920 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.flush() Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application compat.raise_( Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:12:46.965840 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 02:12:46.966811 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:12:46.967628 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [parameters: {'id': '4a76ffe451d646fe9511be96ac3f6031', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:46.970429 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:46.971748 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4a76ffe451d646fe9511be96ac3f6031. Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:46.972833 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 467/947] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Oct 5 02:12:46 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:46.973536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:46.977003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859966-3986-4445-ad5b-d794b9328ddc None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.977003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859966-3986-4445-ad5b-d794b9328ddc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.977003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859966-3986-4445-ad5b-d794b9328ddc None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:46.981033 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 468/948] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:46.986696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:46.987058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:46.987402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.013430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:47.015116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:47.099797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641444a4-2395-45cf-b236-7ed749092d0e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:47.103125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:47.107724 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 469/949] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:47.143049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:47.143691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.143880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.144151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.152323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:47.153807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:47.165652 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:47.166613 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:47.167514 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 481/950] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:47.174383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:47.222886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:47.282800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7d1ff-b8b9-4184-8e2b-72bdd465c695 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:47.317989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:47.318823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.319100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.319368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.320028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:47.320326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:47.322022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:47.345054 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 470/951] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:47.429909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:47.546489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c0315-b168-4f45-b146-6c04664f848b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:47.585680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:47.586324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.586600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.586867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.587462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:47.588850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-34b05b4c-78ee-4e67-bf64-209208fba29b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:47.598084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:47.599756 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:47.601472 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 482/952] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:47.606239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:47.662971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ce6b-e9af-412d-9434-98deb5bad7f1 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.663321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ce6b-e9af-412d-9434-98deb5bad7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.663533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ce6b-e9af-412d-9434-98deb5bad7f1 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.665148 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 483/953] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:47.670284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.670573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.670848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.689754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:47.690875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:47.719560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:47.737024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fdc17-6d15-4bd8-8e7e-dfebc9c130c1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:47.740169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:47.769576 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 484/954] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:47.781763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:47.782430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.782713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.782983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.783609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:47.783913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:47.785291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:47.790859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 471/955] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:47.796235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:47.904004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d767e-dfb5-401d-a948-0f724aa0192e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:47.941116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:47.941652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:47.941934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:47.942208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:47.942870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:47.943173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:47.944540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:47.949881 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 485/956] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:47.955728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:48.048838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:48.072418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e56b1-aff7-491b-923e-1f3ecd301965 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:48.077922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:48.114990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:48.115826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:48.116107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:48.116380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:48.117435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:48.119154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:48.146192 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 472/957] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:48.163773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110e7c-5da3-44a3-9514-a17a408784d2 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:48.211829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:48.212397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:48.212756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:48.213067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:48.213668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:48.215085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:48.225563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:48.226716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:48.227581 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 486/958] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:48.235421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:48.267414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:48.358102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f3ae-16b7-4b14-bd27-45a6897443a7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:48.394514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:48.395128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:48.395410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:48.396368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:48.397121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:48.397215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:48.398535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dc9fb-4b1e-4280-8f72-6fba922955b9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:48.403791 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 473/959] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:48.410100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:48.503792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:48.523185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355418e8-a28a-4419-b5e2-ed6520e25552 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:48.559251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:48.559858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:48.560142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:48.560415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:48.561076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:48.561380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:48.562740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457566b-0f61-4d83-8107-af9e72a925e4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:48.568630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 487/960] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:49.137075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7f04-3317-45d5-96fc-8508c494f490 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:49.137495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7f04-3317-45d5-96fc-8508c494f490 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:49.137710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7f04-3317-45d5-96fc-8508c494f490 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:49.139427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 474/961] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:49.145367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:49.146554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:49.146554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:49.165204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:49.166395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:49.241018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 488/962] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:49.510157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e7f04-3317-45d5-96fc-8508c494f490 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:49.609530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:49.625659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e7f04-3317-45d5-96fc-8508c494f490 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:49.666935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b742ab-881c-483f-ad4e-e17e1c784b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:49.667588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b742ab-881c-483f-ad4e-e17e1c784b1c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:49.667868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b742ab-881c-483f-ad4e-e17e1c784b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:49.668143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b742ab-881c-483f-ad4e-e17e1c784b1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:49.679590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b742ab-881c-483f-ad4e-e17e1c784b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f1b742ab-881c-483f-ad4e-e17e1c784b1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:12:49.684450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:49.685394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:49.686279 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 475/963] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 02:12:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:49.693994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:49.745408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c745cb-9ec3-4e7d-b3aa-a6c73e3613c8 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:49.745729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c745cb-9ec3-4e7d-b3aa-a6c73e3613c8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:49.745957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c745cb-9ec3-4e7d-b3aa-a6c73e3613c8 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:49.748537 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 476/964] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:49.752495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:49.752783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:49.753085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:49.775755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:49.775755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:49.776021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:49.801610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef1287-fb51-4054-8b10-944bae7ead9b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:49.840610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:49.841510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:49.841793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:49.842068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:49.842981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:49.843677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:49.845352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:49.847961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 477/965] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:49.857628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 489/966] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:12:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:49.869249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:49.960004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:49.975776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de97512-3d49-4ef9-b029-759e5239390b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.012327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.012979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.013261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.013530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.024449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.025973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:50.041450 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:50.042460 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:50.043386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:50.043386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:50.043386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.043386 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 478/967] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:50.049888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.159467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d96496-758a-4a37-8f7a-8fba5d9559b5 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.163960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.197670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.199030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.199567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.200186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.201100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:50.201626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.203309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.212435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:50.219537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 490/968] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:50.225829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.283012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e796c84-6119-4d0d-8bf6-a562dfdb80d6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.317201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:50.325095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.326094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.326477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.326840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.327582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.329948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.342437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e76f7-724c-47e1-b1af-9c3cf8064d31 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.347583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.sql.core [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 05 02:12:50.347583 n-d-858272-3 devstack@keystone.service[81827]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 05 02:12:50.347583 n-d-858272-3 devstack@keystone.service[81827]: [parameters: {'user_id': 'ce89ca8a1e2b4b00a21bdd070f1c24f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 05 02:12:50.347583 n-d-858272-3 devstack@keystone.service[81827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:12:50.357974 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:12:50.358946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application yield resource Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise self.value Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application session.commit() Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 02:12:50.359933 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.flush() Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application compat.raise_( Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:12:50.361451 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:12:50.362386 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:12:50.363759 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ce89ca8a1e2b4b00a21bdd070f1c24f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:50.366220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 05 02:12:50.367348 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 479/969] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Oct 5 02:12:50 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:50.369528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.403250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.404575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.405294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.405750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.416809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.418477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:50.434239 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:50.435546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 05 02:12:50.436735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:50.445140 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 491/970] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:12:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:50.445881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.504311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61092-549f-4614-aae1-e3aa7aa1e70a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.516092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:50.541460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.541993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.542286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.542641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.552176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.554089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.562711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedab214-6473-498c-92ad-36d7acf233b0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-46959e27-f862-44d3-b54e-67252a434acd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:12:50.565968 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:50.567114 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 05 02:12:50.568507 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:50.571854 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 480/971] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:12:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:50.573149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016569-905e-4ef8-94d8-aa15f663e606 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.573439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016569-905e-4ef8-94d8-aa15f663e606 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.573718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016569-905e-4ef8-94d8-aa15f663e606 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.577790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 481/972] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:50.578490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016569-905e-4ef8-94d8-aa15f663e606 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.608027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.608640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.608944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.609227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.609958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:50.610262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.611706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f5456-623e-4fb6-9daf-fe671d70420a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.629213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 492/973] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Oct 5 02:12:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:50.630563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.630876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.631129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.645186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:50.650309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:50.651581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:50.706047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016569-905e-4ef8-94d8-aa15f663e606 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.725817 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 493/974] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:50.729422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:50.744166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.744786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.745107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.745491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.746060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:50.746363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.747970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7872e1-51cc-4d40-8d57-e267ae3e2a91 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:50.781399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:50.801646 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 482/975] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Oct 5 02:12:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:50.840587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edeeb-9aa9-4e60-be9b-00a094abaf54 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.840871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edeeb-9aa9-4e60-be9b-00a094abaf54 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.841166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edeeb-9aa9-4e60-be9b-00a094abaf54 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.842204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc19a9-09e5-4569-b101-da6bd0c01b9d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:50.842657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 483/976] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:50.847932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.848207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.848477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.869674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:50.871249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:50.882155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:50.882951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:50.883335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:50.883710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:50.956212 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 484/977] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:50.965042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:50.966690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.002927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.027823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.059600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.105284 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 494/978] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:12:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:12:51.110857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.138787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878d037-019a-4246-b8b1-f27080ef80ff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.176557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.178283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.178909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.178909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.179400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.180766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:51.190105 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:51.191101 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:51.191951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 485/979] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:51.197646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.216845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2936e7-836e-494c-a2e7-ce827ac5fd00 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.251061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.251690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.251972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.252249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.262851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.264283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.271338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:12:51.279916 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:51.281075 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:12:51.282212 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:12:51.282212 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:12:51.282212 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:51.285058 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 495/980] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:51.285888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.304015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6011-f35a-4922-8542-74c2dd077cb2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.306399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.338856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.339387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.339671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.339946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.340565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:51.340869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.342248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.346810 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 486/981] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:51.347579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.391895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a31dcc-9e11-4ae5-b581-cf7903ab33fa None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.425725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.426334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.426621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.427547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.428263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.429671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.444370 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 496/982] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:51 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:51.445214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.459651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fcee0-ed60-4fa5-9b9f-85eb3e5126d5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.510059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.510688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.510970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.511246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.511913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:51.512279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.513734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.515946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.531467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 487/983] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:51.532637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.561879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.568090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eb684-02c1-4dcc-a2b5-a464b336c072 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.607824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.608452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.608738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.609050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.609689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:51.609995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.611370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.618429 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 497/984] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:51.624283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.653223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7a775-a93b-442c-9111-b9afa0025594 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.690383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.691017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.691355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.691630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.698504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.699948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:12:51.711912 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:51.713134 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:51.714215 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 488/985] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:51.718951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.754308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27efb35-9088-4c5e-a2bb-4ec87baf75b6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.779489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.793433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.794205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.794596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.794882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.795604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] RBAC: Adding query filter params (interface=admin, service_id=e6303548f34c4c31bd36bc08f999bfa7, region_id=RegionOne) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:51.795923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.797329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.803383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 498/986] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/endpoints?service_id=e6303548f34c4c31bd36bc08f999bfa7&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:51.808714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.824002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:51.843866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c147c-5d6c-4c87-a2f0-1c1c2d0c2126 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.882752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.883276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.883560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.883836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.884521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:51.884828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.886283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.898939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 489/987] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:51.905549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:51.921701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d08a2b-97cf-40f5-8a9f-30491be6b42e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:51.957014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc78ebc-b350-40b2-9c34-0de9ac350c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:51.957654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78ebc-b350-40b2-9c34-0de9ac350c56 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:51.957952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78ebc-b350-40b2-9c34-0de9ac350c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:51.958247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc78ebc-b350-40b2-9c34-0de9ac350c56 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:51.958854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78ebc-b350-40b2-9c34-0de9ac350c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:51.960325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc78ebc-b350-40b2-9c34-0de9ac350c56 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:51.976937 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 499/988] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:12:52.036842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6bc40-8cf5-4fb1-9e75-813d67b33d2c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:52.073709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:52.074400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:52.074686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:52.074960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:52.075700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] RBAC: Adding query filter params (role.id=5a7c9c56b8ad40a4b733984a132e0777, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=e2750dbbaa7c460d95e1b273f1dd7166) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:52.076010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:52.077509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125050-69cd-49da-867a-774733b1a100 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:52.089336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 490/989] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:12:51 2022] GET /identity/v3/role_assignments?user.id=e2750dbbaa7c460d95e1b273f1dd7166&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=5a7c9c56b8ad40a4b733984a132e0777 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:53.653194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346ab55-42d6-4d0f-a3c8-0fd843b4a846 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:53.654172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346ab55-42d6-4d0f-a3c8-0fd843b4a846 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:53.654521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346ab55-42d6-4d0f-a3c8-0fd843b4a846 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:53.656081 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 500/990] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:53.664168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a8988-96e4-498a-a55c-a0b66c03bb36 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:53.664638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a8988-96e4-498a-a55c-a0b66c03bb36 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:53.664719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a8988-96e4-498a-a55c-a0b66c03bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:53.683674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-703a8988-96e4-498a-a55c-a0b66c03bb36 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:53.684858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-703a8988-96e4-498a-a55c-a0b66c03bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:53.687099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:53.755788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 491/991] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:54.025862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346ab55-42d6-4d0f-a3c8-0fd843b4a846 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.082329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.147882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346ab55-42d6-4d0f-a3c8-0fd843b4a846 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.175810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05169e-d3aa-47d4-bb5e-9694bcf803e1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.176103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05169e-d3aa-47d4-bb5e-9694bcf803e1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.176372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05169e-d3aa-47d4-bb5e-9694bcf803e1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.177788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 492/992] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:54.184129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac374-fd41-44bb-a07f-c89ed74c90c5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.184330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.184472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac374-fd41-44bb-a07f-c89ed74c90c5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.184731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ac374-fd41-44bb-a07f-c89ed74c90c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.184832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.185157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.185436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.186045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.187454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:54.198297 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:54.199865 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:54.201099 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 501/993] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:54.206061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.211737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f9ac374-fd41-44bb-a07f-c89ed74c90c5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:54.213005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f9ac374-fd41-44bb-a07f-c89ed74c90c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:54.293029 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 493/994] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:54.307764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ba283-e385-49cb-a143-ef74c11c2f0e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.308057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ba283-e385-49cb-a143-ef74c11c2f0e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.308333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ba283-e385-49cb-a143-ef74c11c2f0e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.309813 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 494/995] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:54.313727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f69fe-f8e4-458f-ac19-d630bb5de982 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.314426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.314737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.314988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.330029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.334387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:54.335570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:54.355320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.356069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.356191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.356479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.357132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:54.357443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.358799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.363754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 502/996] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:54.369647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.399563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.413298 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 495/997] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:54.486480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ff7f-5379-4157-8c5e-55a9aeeca82d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.521870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.522473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.522754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.523031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.523657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:54.523961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.525356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.530232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 503/998] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:54.535940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.566469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.618550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.642166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7faef-638f-402a-ad91-6ded2291faf4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.681720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d979fc-9fdb-4d66-9e9c-4b30941848b1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.686661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.687273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.687555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.687831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.688529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] RBAC: Adding query filter params (interface=public, service_id=8d7b17f10c054059879d665e7f197780, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:54.688843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.690249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.695216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 496/999] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/endpoints?service_id=8d7b17f10c054059879d665e7f197780&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:54.695984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.719619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.720253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.720535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.720805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.721416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.722808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:54.732176 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:54.733219 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:54.734093 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 504/1000] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:54.734968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.759620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.802084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9c1ca-efe0-48c5-8919-41ef4d27a9e5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.837573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.838119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.838398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.838674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] PATH_INFO: `/v3/services/image` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.839247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.840588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:54.849577 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:54.850632 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:12:54.851511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 497/1001] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:12:54.852317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.855410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d877-1425-42e3-abbb-c1b14158f4cd None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.862444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.889787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:54.890390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:54.890672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:54.890944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:54.891544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:54.892935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:54.899123 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 505/1002] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:12:54.899895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:54.960369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebec3c-283a-40f3-889f-bbf512d61f9f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:54.991655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:54.999974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:55.000588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:55.000867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:55.001447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:55.001812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:55.002121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:55.003492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:55.014345 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 498/1003] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:55.015778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:55.025878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37922-9aca-450a-b4ad-42ac11444782 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:55.064295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:55.064936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:55.065218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:55.065607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:55.066241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] RBAC: Adding query filter params (name=image) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:55.066546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:55.069001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:55.074920 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 506/1004] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:55.081614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:55.126738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:55.133835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1db9-2612-401e-84a9-8ab4ebc94277 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:55.172290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:55.172932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:55.173205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:55.173476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:55.174469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:55.174772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:55.176443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:55.181953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 499/1005] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Oct 5 02:12:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:55.187757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:55.198332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def7fe-8732-40cc-9321-7a90fbbf1948 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:55.233860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:55.234470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:55.234750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:55.235025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:55.235643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] RBAC: Adding query filter params (type=image) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:55.235945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:55.237365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7ef9-28af-43b9-a8de-3090a0053868 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:55.242790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 507/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:55.251656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:55.303485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6cc24d-983f-4b3b-8cf7-cb091f0b8f3d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:55.340673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8cb12-455a-4d41-a9c6-703ce807fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:55.341322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8cb12-455a-4d41-a9c6-703ce807fdef None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:55.341599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8cb12-455a-4d41-a9c6-703ce807fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:55.341868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8cb12-455a-4d41-a9c6-703ce807fdef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:55.342543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8cb12-455a-4d41-a9c6-703ce807fdef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:55.343928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8cb12-455a-4d41-a9c6-703ce807fdef None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:55.362026 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 500/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:12:57.091571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c175e43-3fc1-481f-b6f7-e9e66219013a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.092141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c175e43-3fc1-481f-b6f7-e9e66219013a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.092141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c175e43-3fc1-481f-b6f7-e9e66219013a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.093636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 508/1008] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:57.099066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828feb2c-6079-4d26-9409-e25d6093bfe8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.099451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828feb2c-6079-4d26-9409-e25d6093bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.099650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828feb2c-6079-4d26-9409-e25d6093bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.118247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-828feb2c-6079-4d26-9409-e25d6093bfe8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:57.119436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-828feb2c-6079-4d26-9409-e25d6093bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:57.193786 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 501/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:57.414271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915c656-f454-4997-b811-615d661ba65a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.414683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915c656-f454-4997-b811-615d661ba65a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.415193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915c656-f454-4997-b811-615d661ba65a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.417084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 509/1010] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:12:57.425662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994fc9-2385-452a-9fd0-4bee9df34bca None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.425955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994fc9-2385-452a-9fd0-4bee9df34bca None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.426234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61994fc9-2385-452a-9fd0-4bee9df34bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.448758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-61994fc9-2385-452a-9fd0-4bee9df34bca None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:57.450013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-61994fc9-2385-452a-9fd0-4bee9df34bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:57.465330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915c656-f454-4997-b811-615d661ba65a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:57.490374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:57.527678 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 502/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:12:57.562930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d994b-74f7-412b-a112-0ca6a879326e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.563223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d994b-74f7-412b-a112-0ca6a879326e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.563508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d994b-74f7-412b-a112-0ca6a879326e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.564938 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 503/1012] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:12:57.569885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.570175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.570456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.572332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:57.578617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915c656-f454-4997-b811-615d661ba65a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:57.589558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:12:57.590752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:12:57.614726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:57.615588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.616029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.616307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.616892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:57.618296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:12:57.626948 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:12:57.627953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:12:57.629160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 510/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:12:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:12:57.634476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:57.673120 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 504/1014] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:12:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:12:57.745631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b8455-5b8b-4593-aa5e-53b4a9c2046e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:57.780310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:57.780939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.781228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.781517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.782129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:57.782437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:57.783804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:57.788816 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 511/1015] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:57.794344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:57.794513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:57.823475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:57.902224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:57.903093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27800-cff2-421c-9c7e-84f747bc4b12 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:57.905629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4a9bd-4726-457a-9d93-112f7a835447 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:57.938651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:57.939180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.939463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.939737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.940406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:57.941413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:57.941807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:57.942019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:57.942947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:57.943185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:57.943810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:12:57.944114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:57.945493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:57.951204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 505/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Oct 5 02:12:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:12:57.952011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:57.958492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 512/1017] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:57 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:12:57.959488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:58.058837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:58.076424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422a8c3-c6c4-4693-ad85-5d1d7128d05e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:58.091226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16638243-6645-4966-9162-4bb3f60c8445 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:58.119419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:58.120064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:58.120362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:58.120609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:58.121788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:58.123228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:58.124805 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 506/1018] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:12:58.129131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a140062-d8cf-43c9-a6a7-3e40b05e8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:58.130642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a140062-d8cf-43c9-a6a7-3e40b05e8e78 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:58.130762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:12:58.130960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a140062-d8cf-43c9-a6a7-3e40b05e8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:58.131202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a140062-d8cf-43c9-a6a7-3e40b05e8e78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:58.131886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a140062-d8cf-43c9-a6a7-3e40b05e8e78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:58.133651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a140062-d8cf-43c9-a6a7-3e40b05e8e78 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:58.155695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 513/1019] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:12:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:12:58.169710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:12:58.247319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aead8cb-f466-4359-b0fd-626a16502332 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:12:58.291629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df5801-95cc-4497-a8b4-4e2b131c33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:12:58.292256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5801-95cc-4497-a8b4-4e2b131c33e7 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:12:58.292533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5801-95cc-4497-a8b4-4e2b131c33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:12:58.292803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df5801-95cc-4497-a8b4-4e2b131c33e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:12:58.293489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df5801-95cc-4497-a8b4-4e2b131c33e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:12:58.294929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df5801-95cc-4497-a8b4-4e2b131c33e7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:12:58.328932 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 507/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:12:58 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:13:00.166033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e61af4-d46c-4002-baf3-2b5d965a925e None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.166593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e61af4-d46c-4002-baf3-2b5d965a925e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.166593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e61af4-d46c-4002-baf3-2b5d965a925e None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.168948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 514/1021] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:00.173393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039718e-a5ef-4dff-8e32-461db12c7627 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.173810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039718e-a5ef-4dff-8e32-461db12c7627 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.173976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039718e-a5ef-4dff-8e32-461db12c7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.192913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a039718e-a5ef-4dff-8e32-461db12c7627 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:00.194233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a039718e-a5ef-4dff-8e32-461db12c7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:00.274537 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 508/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:00.471793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08cfd-1378-4286-9bd6-bac6f0f04da9 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.472034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08cfd-1378-4286-9bd6-bac6f0f04da9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.472377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08cfd-1378-4286-9bd6-bac6f0f04da9 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.473752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 515/1023] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:00.482463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222237d-7721-446e-a693-da4a5358618d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.482762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222237d-7721-446e-a693-da4a5358618d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.483077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222237d-7721-446e-a693-da4a5358618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.505532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2222237d-7721-446e-a693-da4a5358618d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:00.506890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2222237d-7721-446e-a693-da4a5358618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:00.512113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:00.554804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf2d1-cdec-4fd9-9704-57c786e0c075 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.555132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf2d1-cdec-4fd9-9704-57c786e0c075 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.555365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf2d1-cdec-4fd9-9704-57c786e0c075 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.556932 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 516/1024] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:13:00.562145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.562429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.562706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.583696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:00.584951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:00.597237 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 509/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:00.602156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222237d-7721-446e-a693-da4a5358618d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:00.672085 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 517/1026] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:13:00.716541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222237d-7721-446e-a693-da4a5358618d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:00.751463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:00.752015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.752295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.752567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] PATH_INFO: `/v3/services/image` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.753228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:00.755148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:00.764645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:00.769300 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:00.770278 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 510/1027] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 5 02:13:00 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:00.772793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:00.845000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:00.883535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55965-6193-4c1a-86c8-d22a6be946a1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:00.913141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:00.918181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:00.924484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:00.925233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:00.925522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:00.925937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:00.927114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] RBAC: Adding query filter params (name=image) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:00.927631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:00.929303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:00.935970 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 518/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:00.941996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.041312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca4d93-9249-4e5c-81a6-ef2b131fc27c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.047848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478faa-ac52-46ed-8a1d-5b489f3b5398 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.078117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:01.085111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.085524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.085735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.085987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.086158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.086315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.086467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.086743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.086907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] RBAC: Adding query filter params (type=image) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:01.087170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.088536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.093795 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 519/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:01.095831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.104055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:01.110648 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:01.111807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:01.112944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 511/1030] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 02:13:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:01.113800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.188367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:01.210702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e55ebb-bb71-4b32-9d90-55a20f36ee60 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.229899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeaabe-aad3-44a2-9e96-d7ab0312b6c4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.244423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.245076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.245372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.245643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.246735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.248158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.249773 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 520/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:01.250522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.263565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.264178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.264459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.264736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.265769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] RBAC: Adding query filter params (interface=public, service_id=9bbcebd6c08241b0b237e9cbe27f0f51, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:01.265769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.267282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.273172 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 512/1032] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/endpoints?service_id=9bbcebd6c08241b0b237e9cbe27f0f51&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:01.273944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.315236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:01.353920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b137c80-cf6d-460d-afd9-30bcdfbd6119 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.371194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb85a4-707d-46db-ab00-598a7bb3e081 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.389482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.390089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.390370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.390646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.391312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:01.391615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.392999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.397939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:01.405527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 521/1033] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:01.406375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.409077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.410557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.410963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.411379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.412558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.416190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.440492 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 513/1034] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:13:01 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:01.441349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.528231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115ad63-c91d-41e6-9e40-3715b605a3df None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.558707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:01.561222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c28c0d-9684-476a-b1cd-911cdc0ec68e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.569508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.570205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.570494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.570771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.571427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.573037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.588943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 522/1035] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:13:01.602252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.602917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.603193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.603462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.616932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.618587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:01.635081 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:01.636138 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:01.637118 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:01.637118 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:01.637118 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:01.637118 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 514/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:01.643478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.762772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34dea3-b094-42e5-b865-ec113ba38c0d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.800283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.801302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.801808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.802278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.803102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:01.803581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.805132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.817837 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 523/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:01.823802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:01.862159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:01.933951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d3ec9-0928-4688-b87f-8af0cab3de2d None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:01.967798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:01.968430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:01.968715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:01.969020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:01.976886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:01.978383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:13:01.990192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:01.991163 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:13:01.992112 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:01.995996 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 515/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:01.997007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:02.049930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:02.103031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c347243-4682-4ae8-ad33-104e3b60dbbd None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:02.137855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:02.138461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:02.138740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:02.139019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:02.139742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:02.140049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:02.142062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:02.164221 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 524/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:13:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:02.165411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:02.262133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:02.269638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bde3-d558-4832-8f28-86165b365f00 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:02.304160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:02.304771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:02.305081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:02.305355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:02.373733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:02.375097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:02.470109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:02.483637 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 516/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:02.485139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:02.585984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1285c3-97c6-48f3-845d-33d22836a50f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:02.595110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:02.621082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:02.621709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:02.621988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:02.622263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:02.632054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:02.633476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:02.648527 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:02.657436 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:02.658384 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:02.658384 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:02.658384 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:02.658384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 525/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:02.658628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:02.761191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdbcdc-d80f-4956-ba26-b7a8bebfa873 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:02.795545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:02.796155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:02.796439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:02.796711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:02.797385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:02.797692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:02.799057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:02.813911 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 517/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:02.820180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:02.922556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756093-7ef2-40ea-8ca6-155bcd9885d3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:02.956340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:02.957056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:02.957344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:02.957623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:02.964185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:02.965648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:13:02.977678 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:02.978552 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:02.984590 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 526/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:02.986395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:03.043589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:03.088465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe2538-f2e7-4d97-9bf8-327fd26ce5a2 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:03.123577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:03.124179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:03.124455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:03.124725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:03.125432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:03.125734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:03.127153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ac3f1-d775-4164-9cda-c5427d0a392c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:03.139148 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 518/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:03.144951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:03.168895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:03.253076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d759-c153-4d40-9324-174b38c60a44 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:03.288473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66de573-e55a-4186-ac79-384200724510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:03.289120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de573-e55a-4186-ac79-384200724510 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:03.289408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de573-e55a-4186-ac79-384200724510 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:03.289689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66de573-e55a-4186-ac79-384200724510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:03.290496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de573-e55a-4186-ac79-384200724510 None admin] RBAC: Adding query filter params (role.id=5a7c9c56b8ad40a4b733984a132e0777, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=33ae6b3ef0964315be1bc1983fe65939) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:03.290812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de573-e55a-4186-ac79-384200724510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:03.292252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66de573-e55a-4186-ac79-384200724510 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:03.302965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 527/1045] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:03 2022] GET /identity/v3/role_assignments?user.id=33ae6b3ef0964315be1bc1983fe65939&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=5a7c9c56b8ad40a4b733984a132e0777 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:03.731231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a35c6-5507-44a7-a0ba-ef1c769c637c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:03.731753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a35c6-5507-44a7-a0ba-ef1c769c637c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:03.731832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a35c6-5507-44a7-a0ba-ef1c769c637c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:03.733190 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 519/1046] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:03.738450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:03.738872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:03.739057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:03.759445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:03.759445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:03.769137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9062ad-5d24-4578-89a4-caee305fc18b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:03.769425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9062ad-5d24-4578-89a4-caee305fc18b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:03.769704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9062ad-5d24-4578-89a4-caee305fc18b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:03.771607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 520/1047] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:13:03.776484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:03.776764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:03.777084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:03.795151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:03.796329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:03.833500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 528/1048] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:03.869861 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 521/1049] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:13:04.101922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.118367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.136860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.192735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.212788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f45ab-723d-478c-975b-6ae6aae95c8a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.248460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.249115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.249400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.249678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.256211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c8a6-dd19-4751-af95-6e641ae3c42b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.260828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:04.265610 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:04.266747 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:04.267597 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 529/1050] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:04.273197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.297131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.297763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.298046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.298323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] PATH_INFO: `/v3/services/image` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.298903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.300263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:04.309800 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:04.310826 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:04.311676 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 522/1051] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:04.316762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.354907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.381426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eff3b2-be0d-496d-8b3d-6946bd379e64 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.414873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.415484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.415767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.416041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.416710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:04.417047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.418420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.427065 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 530/1052] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:04.432101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac876ac-187e-4dab-ac57-25ee01654b6f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.432998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.444315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.472123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.472726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.473041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.473345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.474071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] RBAC: Adding query filter params (name=image) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:04.474271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.475625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.485318 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 523/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:04.486297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.543254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f72c4-6ee3-4d98-9082-484e932d6099 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.579217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.580092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.580379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.580649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] PATH_INFO: `/v3/users/47c695978bc244c5ab5cde8ab251e036` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.585054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.596293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=47c695978bc244c5ab5cde8ab251e036)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.596475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c65e-ca08-4943-8a1c-5a6fe1513d6c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.597773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.604283 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 531/1054] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/users/47c695978bc244c5ab5cde8ab251e036 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:04.605196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.641862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.642471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.642753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.643028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.643653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] RBAC: Adding query filter params (type=image) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:04.643959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.646947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.661925 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 524/1055] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:04.663563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:04.710476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.717102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35c3f-1475-4fee-ac75-535606998ee0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.759246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.759894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.760115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.760550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.784509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdcc90-4c08-4046-8628-9bb1a394e88e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:04.823232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:04.823838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:04.824117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:04.824387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:04.825084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.826463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.829715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:04.840306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:04.841949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:04.848550 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 525/1056] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:13:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:04.965925 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 532/1057] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:04.967392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:05.068774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:05.084970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafeaf3c-20bd-4411-955d-4693589f9e57 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:05.120866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d0964-fa7d-47fa-8658-26a0dd8e1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:05.121952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0964-fa7d-47fa-8658-26a0dd8e1a51 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:05.122427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0964-fa7d-47fa-8658-26a0dd8e1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:05.122890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d0964-fa7d-47fa-8658-26a0dd8e1a51 None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:05.124201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d0964-fa7d-47fa-8658-26a0dd8e1a51 None admin] RBAC: Authorizing `identity:get_project(project_id=166666a003b144aea11b8858b28cd7ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:05.125859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d0964-fa7d-47fa-8658-26a0dd8e1a51 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:05.128166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 526/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:04 2022] GET /identity/v3/projects/166666a003b144aea11b8858b28cd7ab => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:05.135065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:05.230370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:05.238956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e98d2-ed3d-4d2e-97d4-b7bf1c1d7111 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:05.275814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:05.276411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:05.276687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:05.276996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:05.277712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=166666a003b144aea11b8858b28cd7ab, user.id=47c695978bc244c5ab5cde8ab251e036) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:05.278017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:05.279497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff6c23-318b-499f-ad69-7d44984788b7 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:05.292929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 533/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:05 2022] GET /identity/v3/role_assignments?user.id=47c695978bc244c5ab5cde8ab251e036&scope.project.id=166666a003b144aea11b8858b28cd7ab&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:05.482544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311af6-8d68-43fd-a57a-0cefe60b5358 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:05.482848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311af6-8d68-43fd-a57a-0cefe60b5358 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:05.483035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311af6-8d68-43fd-a57a-0cefe60b5358 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:05.484536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 527/1060] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:05.490113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:05.490409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:05.490690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:05.509149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:05.510351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:05.579276 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 534/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:05.847685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311af6-8d68-43fd-a57a-0cefe60b5358 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:05.950700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311af6-8d68-43fd-a57a-0cefe60b5358 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:05.984598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:05.985261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:05.985545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:05.985822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:05.996685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:06.001520 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:06.002649 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:06.003645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 528/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 02:13:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:06.009380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:06.098948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:06.111989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825f79-bff6-464f-bfd9-7528169e2a5e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:06.147693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:06.148313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:06.148596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:06.148872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:06.149567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:06.149871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:06.151243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:06.160790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 535/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:13:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:06.166784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:06.187188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:06.271526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0039db-7b3a-4360-ad3a-f74261b9c2e0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:06.304446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:06.305096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:06.305381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:06.305656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:06.316847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:06.318401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:06.332522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:06.334119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:06.335035 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:06.335035 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:06.335035 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:06.335723 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 529/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:06.340098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:06.440078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccec9c-fb84-4fa7-8423-c09d11335aae None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:06.474892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:06.475505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:06.475791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:06.476069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:06.476713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:06.477050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:06.478416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:06.492944 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 536/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:06.496658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:06.566268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:06.600328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24513d2-ecec-467c-834e-0da01782b0ca None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:06.634118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:06.634744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:06.635028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:06.635304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:06.642817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:06.644245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:13:06.658333 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:06.659334 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:06.660302 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 530/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:06.665451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:06.678387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:06.768488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638c940-f201-4ec7-bd42-32de570ec4f8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:06.804449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:06.805091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:06.805370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:06.805637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:06.810078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:06.810078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:06.810078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:06.831430 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 537/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:06.833283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:06.934260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0833e7-fd4d-45b2-b959-06b9ae5006f9 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:06.965844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:06.974025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:06.974808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:06.975087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:06.975353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:06.986277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:06.987714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5e7dd38f-a9c9-4846-a9fe-2e7f2f7e7fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:07.002452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:07.003439 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:07.009218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:07.009218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:07.009218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:07.009218 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 531/1068] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:07.010762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:07.061937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87442372-ca6e-4b56-aa46-2231f4c35f11 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.062224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87442372-ca6e-4b56-aa46-2231f4c35f11 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.062502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87442372-ca6e-4b56-aa46-2231f4c35f11 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.063986 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 532/1069] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:07.068751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.069070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.069353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.084685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:07.088501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:07.089728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:07.121626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc2ad-28e9-41bd-a430-6efdd2b5a682 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:07.168935 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 533/1070] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:13:07.169138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:07.171525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.171812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.172088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.172741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:07.173134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:07.174509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.186692 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 538/1071] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:07.192726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:07.294617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4269c1-c8fc-48eb-8107-e635481c4b0e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:07.308311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:07.330179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:07.330738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.331016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.331284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.338541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:07.339972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:13:07.352560 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:07.353616 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:13:07.354534 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:07.357308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 534/1072] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:07.359821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:07.439266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:07.471689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b14f-6b75-4c5a-9d06-762bfb025c83 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:07.497649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:07.506598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:07.507207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.507490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.507768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.508453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:07.508757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:07.510219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162b02e-cfe7-4f36-b1b1-0f39c457a12d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.522832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 539/1073] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:07.524090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e09a-73df-4420-be76-33f260957621 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.524368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e09a-73df-4420-be76-33f260957621 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.524644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e09a-73df-4420-be76-33f260957621 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.526860 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 540/1074] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:07.528642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e09a-73df-4420-be76-33f260957621 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:07.552976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7692-c05a-4ffc-a139-eab23022f13c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:07.587710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:07.588274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.588554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.588853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.628106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e09a-73df-4420-be76-33f260957621 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:07.629272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:07.657459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:07.659565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.663163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6a54e-37ed-4339-a296-330aa217f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:07.663824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a54e-37ed-4339-a296-330aa217f11d None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.664098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a54e-37ed-4339-a296-330aa217f11d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.664369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a54e-37ed-4339-a296-330aa217f11d None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/33ae6b3ef0964315be1bc1983fe65939/roles/5a7c9c56b8ad40a4b733984a132e0777` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.666573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6a54e-37ed-4339-a296-330aa217f11d None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=33ae6b3ef0964315be1bc1983fe65939, role_id=5a7c9c56b8ad40a4b733984a132e0777)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:07.667991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6a54e-37ed-4339-a296-330aa217f11d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.684151 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 541/1075] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:13:07 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/33ae6b3ef0964315be1bc1983fe65939/roles/5a7c9c56b8ad40a4b733984a132e0777 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:13:07.685387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.685725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.686105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.712420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:07.713715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:07.769065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:07.770720 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 535/1076] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 05 02:13:07.777227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:07.800410 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 542/1077] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:07.861217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:07.893605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85ca5e-c058-4bdc-9374-9b753acd0926 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:07.928834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:07.929538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:07.929820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:07.930088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:07.940124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:07.941572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:07.957071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:07.958071 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:07.958988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:07.958988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:07.958988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:07.958988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 536/1078] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:07.964123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:08.064152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bb01b-3274-4f13-94a2-82dabb94e9fc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:08.078716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:08.104990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:08.105596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:08.105876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:08.106166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:08.106791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:08.107098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:08.108464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:08.120540 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 543/1079] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:08.187875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8af5d-8c94-43c3-9808-3512610a4d5b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:08.215155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:08.228203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:08.228855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:08.229236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:08.229511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:08.241710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:08.246722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:08.247855 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:08.248777 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 537/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:08.253957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:08.297709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:08.361842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f146b7-f646-46fc-ae67-619e6102a1ef None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:08.396840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:08.397483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:08.397772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:08.398052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:08.399967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:08.399967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:08.400429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:08.411327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 544/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:08.417568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:08.521981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346079ba-ec76-43aa-9650-110d4e1a2624 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:08.554437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:08.555056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:08.555335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:08.555608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] PATH_INFO: `/v3/users/47c695978bc244c5ab5cde8ab251e036` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:08.556722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] RBAC: Authorizing `identity:get_user(user_id=47c695978bc244c5ab5cde8ab251e036)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:08.558176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:08.559752 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 538/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:08 2022] GET /identity/v3/users/47c695978bc244c5ab5cde8ab251e036 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:08.565403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:08.665623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:08.668731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c240e-ef79-406c-8e29-e3e14e9e146d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:08.702027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06e631-869b-4361-814c-0ac022607d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:08.702652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06e631-869b-4361-814c-0ac022607d0f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:08.702935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06e631-869b-4361-814c-0ac022607d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:08.703210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06e631-869b-4361-814c-0ac022607d0f None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:08.704315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06e631-869b-4361-814c-0ac022607d0f None admin] RBAC: Authorizing `identity:get_project(project_id=166666a003b144aea11b8858b28cd7ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:08.706031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06e631-869b-4361-814c-0ac022607d0f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:08.708153 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 545/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:08 2022] GET /identity/v3/projects/166666a003b144aea11b8858b28cd7ab => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:08.714051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:08.764693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:08.811438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1d57b-3740-40b3-966f-ddeed7269232 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:08.844663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64977b42-9cb4-4449-8965-c28799debfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:08.845445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64977b42-9cb4-4449-8965-c28799debfa6 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:08.845636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64977b42-9cb4-4449-8965-c28799debfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:08.845913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64977b42-9cb4-4449-8965-c28799debfa6 None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab/users/47c695978bc244c5ab5cde8ab251e036/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:08.847812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64977b42-9cb4-4449-8965-c28799debfa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=166666a003b144aea11b8858b28cd7ab, user_id=47c695978bc244c5ab5cde8ab251e036, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:08.849900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64977b42-9cb4-4449-8965-c28799debfa6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:08.864392 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 539/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:13:08 2022] PUT /identity/v3/projects/166666a003b144aea11b8858b28cd7ab/users/47c695978bc244c5ab5cde8ab251e036/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:13:09.954541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b0bc-ccbd-4dea-85a6-aeda0df65aad None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:09.955293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b0bc-ccbd-4dea-85a6-aeda0df65aad None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:09.955293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b0bc-ccbd-4dea-85a6-aeda0df65aad None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:09.956666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 546/1085] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:09.962167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:09.962603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:09.962729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:09.981100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:09.982278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:10.046413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 540/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:10.332362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b0bc-ccbd-4dea-85a6-aeda0df65aad None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:10.431566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b0bc-ccbd-4dea-85a6-aeda0df65aad None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:10.465321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:10.465938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:10.466215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:10.466487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:10.476404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:10.481102 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:10.482098 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:10.482973 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 547/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Oct 5 02:13:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:10.488236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:10.537799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:10.594508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44a82f-8868-4a8d-a940-096a45a1d0f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:10.626722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:10.627326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:10.627604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:10.627873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:10.628527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:10.628824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:10.630766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:10.638820 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 541/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:10.644699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:10.679422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:10.750169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ec122-37d7-441c-bdfa-dd7a4df03bc3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:10.783069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:10.783692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:10.783973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:10.784248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:10.793898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:10.795330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:10.809833 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:10.810970 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:10.812229 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:10.812229 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:10.812229 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:10.812229 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 548/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:10.816667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:10.921228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ba88b-0a5b-4d17-bebc-c1ae5aef2484 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:10.923490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:10.956316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:10.956963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:10.957229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:10.957503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:10.958423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:10.958730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:10.960114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa0495-c558-4660-b0c2-80db864493eb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:10.971600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 542/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:10.977671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:10.996648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78eb4-fa42-4a62-a8b9-64230f906194 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:10.996966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78eb4-fa42-4a62-a8b9-64230f906194 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:10.997248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f78eb4-fa42-4a62-a8b9-64230f906194 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:10.998574 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 543/1091] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:13:11.003513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.003803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.004107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.022597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:11.023790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:11.059521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.079629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b158e-c1d0-40ac-9caf-6ac4354cd693 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.090515 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 544/1092] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:13:11.113363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.114529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.114804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.115073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.122341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.123762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:13:11.134561 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:11.135716 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:11.136924 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 549/1093] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Oct 5 02:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:11.141284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.232473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.240255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390f278-589a-4e17-8d8e-2a24849246ff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.273464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.274062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.274339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.274609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.275324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:11.275626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.277066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.294320 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 545/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:11.300006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.357655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.401502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434ed4-4abb-4231-b421-9715884a41e9 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.435699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.436304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.436584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.436859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.447147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.454885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8eade-d5c0-48f9-9bac-6cd4ce90afcd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.490636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.491179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.491457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.491727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.501437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:11.504399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.506054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:11.506316 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:11.507423 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:11.508364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 546/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:11.513298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.527912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.611299 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 550/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:11.615895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a305b-4d49-4b2f-a92d-6dc0f94e5182 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.616924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.648843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.649473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.649758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.650026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.650685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:11.650988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.652341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.657803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.660578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 547/1097] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:11.667517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.717845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c1da-e365-4769-985f-c0446f54d0f0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.741587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.751308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.751942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.752220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.752495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.762244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.763681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.766031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed413-7c56-4776-bda6-1bb3d37fb2d5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:11.778500 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:11.779587 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:13:11.780505 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:11.780505 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:13:11.780505 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:11.780505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 551/1098] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:11.785168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.800835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.801525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.801804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.802083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] PATH_INFO: `/v3/users/47c695978bc244c5ab5cde8ab251e036` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.803206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] RBAC: Authorizing `identity:get_user(user_id=47c695978bc244c5ab5cde8ab251e036)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.804631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.806228 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 548/1099] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/users/47c695978bc244c5ab5cde8ab251e036 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:11.811932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.877777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:11.888631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c11e6-cf63-497d-95e3-d642ca5d8a00 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.913571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606c84-8431-41b6-ae3c-337adf8fae44 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:11.921969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.922579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.922863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.923140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.923782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:11.924087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:11.925497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:11.937788 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 552/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:11.943783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:11.947763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:11.948367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:11.948648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:11.948943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:11.962631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:12.018654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:12.020086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:12.042009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cee0-96c5-4b2e-abdb-b2576407bd3d None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:12.076458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:12.077103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:12.077384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:12.077666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:12.084542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:12.086008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:13:12.096815 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:12.097786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:12.099231 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 553/1101] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:13:12.104189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:12.118272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:12.119997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 549/1102] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 05 02:13:12.125682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:12.167661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:12.206604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b1271-4b6d-49f7-adf1-6c604373af83 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:12.224277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98023a-57f8-42c4-b62b-45396a7c87a4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:12.239724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:12.240356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:12.240747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:12.241059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:12.241806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:12.242119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:12.243548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:12.255097 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 554/1103] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:12.260630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:12.260790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:12.261283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:12.261588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:12.261860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:12.262965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] RBAC: Authorizing `identity:get_project(project_id=166666a003b144aea11b8858b28cd7ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:12.264380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:12.271788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 550/1104] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:12 2022] GET /identity/v3/projects/166666a003b144aea11b8858b28cd7ab => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:12.272517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:12.332030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:12.361170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec06d5-55fb-4dc1-8c0d-39a71e44c085 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:12.370132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37615143-2790-4a45-8886-627e55cfba26 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:12.381947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:12.394543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:12.395178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:12.395542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:12.395811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:12.396522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] RBAC: Adding query filter params (role.id=5a7c9c56b8ad40a4b733984a132e0777, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=33ae6b3ef0964315be1bc1983fe65939) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:12.396828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:12.398268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf590-bbc3-434c-9314-1507ad5723d8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:12.403995 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 555/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:12 2022] GET /identity/v3/role_assignments?user.id=33ae6b3ef0964315be1bc1983fe65939&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=5a7c9c56b8ad40a4b733984a132e0777 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:12.404852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:12.405434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:12.405718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:12.405990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:12.406708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=166666a003b144aea11b8858b28cd7ab, user.id=47c695978bc244c5ab5cde8ab251e036) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:12.407018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:12.408444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef17329-f2fb-4411-9b60-8d643ed331f7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:12.415322 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 551/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:12 2022] GET /identity/v3/role_assignments?user.id=47c695978bc244c5ab5cde8ab251e036&scope.project.id=166666a003b144aea11b8858b28cd7ab&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:14.610176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58aa14-9b51-4a4f-b964-994f2b720b73 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:14.610706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58aa14-9b51-4a4f-b964-994f2b720b73 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:14.610706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58aa14-9b51-4a4f-b964-994f2b720b73 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:14.612037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 556/1107] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:14.617366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:14.617803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:14.617922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:14.635569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:14.636755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:14.701930 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 552/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:14.971999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58aa14-9b51-4a4f-b964-994f2b720b73 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:15.071518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58aa14-9b51-4a4f-b964-994f2b720b73 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:15.104279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428fae0-464f-4087-adae-f4f3e12fb34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:15.104893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fae0-464f-4087-adae-f4f3e12fb34d None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:15.105203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fae0-464f-4087-adae-f4f3e12fb34d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:15.105479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428fae0-464f-4087-adae-f4f3e12fb34d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:15.106579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428fae0-464f-4087-adae-f4f3e12fb34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:15.108004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428fae0-464f-4087-adae-f4f3e12fb34d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:15.109571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 557/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:15.115605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:15.211960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b108ed-49d2-4db0-98e5-f1788d485292 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:15.214217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:15.248275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea00c7-6835-454e-affc-86cc76ee9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:15.248877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea00c7-6835-454e-affc-86cc76ee9984 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:15.249229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea00c7-6835-454e-affc-86cc76ee9984 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:15.249499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea00c7-6835-454e-affc-86cc76ee9984 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:15.250216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea00c7-6835-454e-affc-86cc76ee9984 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:15.251811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea00c7-6835-454e-affc-86cc76ee9984 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:15.273524 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 553/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:13:15 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:17.424983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0f659-db82-4874-b665-8e03132dbecc None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:17.425523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0f659-db82-4874-b665-8e03132dbecc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:17.425523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0f659-db82-4874-b665-8e03132dbecc None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:17.427492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 558/1111] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:17.432620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:17.433065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:17.433198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:17.450889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:17.452058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:17.519413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 554/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:17.785244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0f659-db82-4874-b665-8e03132dbecc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:17.789627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:17.883908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0f659-db82-4874-b665-8e03132dbecc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:17.916095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:17.916707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:17.917009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:17.917283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] PATH_INFO: `/v3/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:17.918648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] RBAC: Authorizing `identity:get_role(role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:17.920002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:17.921322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 559/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:17 2022] GET /identity/v3/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:17.927161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:18.013976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:18.024796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944a888-8272-4921-8791-7c91b309edc7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:18.057300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:18.057921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:18.058204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:18.058482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] PATH_INFO: `/v3/users/016d087a6d6b4bc39fe0011bfe35b09c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:18.071762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] RBAC: Authorizing `identity:get_user(user_id=016d087a6d6b4bc39fe0011bfe35b09c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:18.073226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:18.074816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 555/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:17 2022] GET /identity/v3/users/016d087a6d6b4bc39fe0011bfe35b09c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:18.080758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:18.148468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:18.178292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df33152-6ddd-4772-8bae-05367426d946 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:18.212026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:18.212621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:18.212924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:18.213204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:18.280026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:18.281491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:18.346903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:18.376038 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 560/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:18.382728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:18.476689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce63833-8b52-4b84-ab9c-b742771d2373 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:18.509991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130870-0cb2-4277-b1c8-c85f3840825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:18.510601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130870-0cb2-4277-b1c8-c85f3840825a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:18.510879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130870-0cb2-4277-b1c8-c85f3840825a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:18.511147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130870-0cb2-4277-b1c8-c85f3840825a None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:18.512233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e130870-0cb2-4277-b1c8-c85f3840825a None admin] RBAC: Authorizing `identity:get_project(project_id=166666a003b144aea11b8858b28cd7ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:18.513667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e130870-0cb2-4277-b1c8-c85f3840825a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:18.515248 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 556/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:18 2022] GET /identity/v3/projects/166666a003b144aea11b8858b28cd7ab => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:18.521418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:18.617322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5a58f-fef3-43b5-9ebd-13f701f07e87 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:18.649516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:18.650109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:18.650389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:18.650665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:18.651415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] RBAC: Adding query filter params (role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=166666a003b144aea11b8858b28cd7ab, user.id=016d087a6d6b4bc39fe0011bfe35b09c) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:18.651691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:18.653269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df434c-4fe2-4722-9732-58cc561bd290 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:18.659001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 561/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:18 2022] GET /identity/v3/role_assignments?user.id=016d087a6d6b4bc39fe0011bfe35b09c&scope.project.id=166666a003b144aea11b8858b28cd7ab&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:20.820496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a377d1-0748-40be-ae35-098ad833a27b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:20.821089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a377d1-0748-40be-ae35-098ad833a27b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:20.821089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a377d1-0748-40be-ae35-098ad833a27b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:20.822439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 557/1118] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:20.827469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:20.827906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:20.828011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:20.846517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:20.847701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:20.875743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:20.914036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 562/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:21.180391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a377d1-0748-40be-ae35-098ad833a27b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:21.198414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:21.279989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a377d1-0748-40be-ae35-098ad833a27b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:21.312655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:21.313359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:21.313637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:21.313908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] PATH_INFO: `/v3/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:21.315284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] RBAC: Authorizing `identity:get_role(role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:21.316640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:21.318050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 558/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:21 2022] GET /identity/v3/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:21.323855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:21.419950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770138d0-1af7-4f69-8232-66d2ddca4a60 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:21.452061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:21.452613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:21.452894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:21.453198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] PATH_INFO: `/v3/users/016d087a6d6b4bc39fe0011bfe35b09c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:21.454302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] RBAC: Authorizing `identity:get_user(user_id=016d087a6d6b4bc39fe0011bfe35b09c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:21.455988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:21.458094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 563/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:21 2022] GET /identity/v3/users/016d087a6d6b4bc39fe0011bfe35b09c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:21.463703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:21.546007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:21.561461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6859c1-f116-4769-be53-cfb94faa8ffa None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:21.594494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb45648-a3da-412e-85a2-71e309ab330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:21.595111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45648-a3da-412e-85a2-71e309ab330b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:21.595390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45648-a3da-412e-85a2-71e309ab330b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:21.595666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb45648-a3da-412e-85a2-71e309ab330b None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:21.596789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45648-a3da-412e-85a2-71e309ab330b None admin] RBAC: Authorizing `identity:get_project(project_id=166666a003b144aea11b8858b28cd7ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:21.598884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb45648-a3da-412e-85a2-71e309ab330b None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:21.600524 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 559/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:21 2022] GET /identity/v3/projects/166666a003b144aea11b8858b28cd7ab => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:13:21.606390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:21.639376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:21.703996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875bc6b-3dc9-4d34-8e1e-5c166cb5507f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:21.737069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa294-9612-4d67-9f37-31d766742e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:21.737712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa294-9612-4d67-9f37-31d766742e2f None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:21.738000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa294-9612-4d67-9f37-31d766742e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:21.738266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa294-9612-4d67-9f37-31d766742e2f None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab/users/016d087a6d6b4bc39fe0011bfe35b09c/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:21.740577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa294-9612-4d67-9f37-31d766742e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=166666a003b144aea11b8858b28cd7ab, user_id=016d087a6d6b4bc39fe0011bfe35b09c, role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:21.742038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa294-9612-4d67-9f37-31d766742e2f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:21.754035 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 564/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:13:21 2022] PUT /identity/v3/projects/166666a003b144aea11b8858b28cd7ab/users/016d087a6d6b4bc39fe0011bfe35b09c/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:13:23.875647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac59a5-4ec5-4ac1-bef7-a0f7d24bb11d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:23.876199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac59a5-4ec5-4ac1-bef7-a0f7d24bb11d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:23.876199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac59a5-4ec5-4ac1-bef7-a0f7d24bb11d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:23.877571 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 560/1124] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:23.883363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:23.883775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:23.883918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:23.902197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:23.903379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:23.968034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:24.238405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac59a5-4ec5-4ac1-bef7-a0f7d24bb11d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:24.338210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac59a5-4ec5-4ac1-bef7-a0f7d24bb11d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:24.370518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:24.371127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:24.371405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:24.371674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] PATH_INFO: `/v3/roles/f2fddcf92c7d4e2dbfc8cbe29253b506` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:24.373065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] RBAC: Authorizing `identity:get_role(role_id=f2fddcf92c7d4e2dbfc8cbe29253b506)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:24.374413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:24.375702 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 561/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:24 2022] GET /identity/v3/roles/f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:24.381676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:24.405660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:24.479539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4fad-2acf-44ce-89f5-a71a635130dd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:24.511790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:24.512343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:24.512620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:24.512893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] PATH_INFO: `/v3/users/016d087a6d6b4bc39fe0011bfe35b09c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:24.514010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] RBAC: Authorizing `identity:get_user(user_id=016d087a6d6b4bc39fe0011bfe35b09c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:24.515434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:24.516994 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 566/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:24 2022] GET /identity/v3/users/016d087a6d6b4bc39fe0011bfe35b09c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:24.523375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:24.545005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:24.627845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f05da-5fac-44cd-abf4-8c237d401d74 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:24.663784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:24.664387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:24.664662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:24.664948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:24.729022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:24.730447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:24.749584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:24.824885 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:24.831157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:24.924204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:24.934015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eae174-039e-460f-ab02-487e5136f06f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:24.971147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c9923-10d1-441a-9e14-4200af20f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:24.971768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9923-10d1-441a-9e14-4200af20f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:24.972047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9923-10d1-441a-9e14-4200af20f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:24.972319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c9923-10d1-441a-9e14-4200af20f1e9 None admin] PATH_INFO: `/v3/projects/166666a003b144aea11b8858b28cd7ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:24.973627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9923-10d1-441a-9e14-4200af20f1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=166666a003b144aea11b8858b28cd7ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:24.975046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c9923-10d1-441a-9e14-4200af20f1e9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:24.976636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 567/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:24 2022] GET /identity/v3/projects/166666a003b144aea11b8858b28cd7ab => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:24.983008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:25.078052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5a5fe-0ab0-4e69-9bf5-9bd877004e54 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:25.097419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:25.111310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:25.111905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:25.112186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:25.112455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:25.113197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] RBAC: Adding query filter params (role.id=f2fddcf92c7d4e2dbfc8cbe29253b506, scope.project.id=166666a003b144aea11b8858b28cd7ab, user.id=016d087a6d6b4bc39fe0011bfe35b09c) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:25.114021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:25.115441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aedac-6bf0-4680-88ce-4fbe7f4172cb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:25.120970 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 563/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:24 2022] GET /identity/v3/role_assignments?user.id=016d087a6d6b4bc39fe0011bfe35b09c&scope.project.id=166666a003b144aea11b8858b28cd7ab&role.id=f2fddcf92c7d4e2dbfc8cbe29253b506 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:27.280952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7905091-ea80-406a-8ada-2f3275791f23 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:27.281528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7905091-ea80-406a-8ada-2f3275791f23 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:27.281528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7905091-ea80-406a-8ada-2f3275791f23 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:27.282883 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 568/1131] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:27.288128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:27.288535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:27.288678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:27.307290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:27.308458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:27.372338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 564/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:27.640958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7905091-ea80-406a-8ada-2f3275791f23 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:27.740281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7905091-ea80-406a-8ada-2f3275791f23 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:27.772254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09e021-8dae-4da0-9093-800fc34d7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:27.772871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09e021-8dae-4da0-9093-800fc34d7590 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:27.773177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09e021-8dae-4da0-9093-800fc34d7590 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:27.773450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09e021-8dae-4da0-9093-800fc34d7590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:27.774560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09e021-8dae-4da0-9093-800fc34d7590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:27.775987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09e021-8dae-4da0-9093-800fc34d7590 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:27.777551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 569/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:27.783336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:27.878538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ae367-072e-485c-bd90-8980c1a9083f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:27.891957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:27.912081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be607e6b-5eec-4d6d-a3f0-7ae301e1dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:27.912680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be607e6b-5eec-4d6d-a3f0-7ae301e1dd5d None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:27.912987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be607e6b-5eec-4d6d-a3f0-7ae301e1dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:27.913265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be607e6b-5eec-4d6d-a3f0-7ae301e1dd5d None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:27.913909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be607e6b-5eec-4d6d-a3f0-7ae301e1dd5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:27.915322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be607e6b-5eec-4d6d-a3f0-7ae301e1dd5d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:27.940498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 565/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:13:27 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:30.095325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75986f-f4cf-4f8d-a8d7-c0ed272e2f43 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:30.095849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75986f-f4cf-4f8d-a8d7-c0ed272e2f43 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:30.095966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75986f-f4cf-4f8d-a8d7-c0ed272e2f43 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:30.097255 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 570/1135] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:30.103134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:30.103553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:30.103693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:30.122241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:30.123419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:30.188032 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 566/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:30.459953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75986f-f4cf-4f8d-a8d7-c0ed272e2f43 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:30.487945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:30.559744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75986f-f4cf-4f8d-a8d7-c0ed272e2f43 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:30.593005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d519501-e498-41c6-b724-8d6151f16bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:30.593636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d519501-e498-41c6-b724-8d6151f16bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:30.593917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d519501-e498-41c6-b724-8d6151f16bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:30.594193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d519501-e498-41c6-b724-8d6151f16bc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:30.595310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d519501-e498-41c6-b724-8d6151f16bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:30.596747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d519501-e498-41c6-b724-8d6151f16bc3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:30.599285 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 571/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:30.605164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:30.697407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:30.704243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e472-b6e9-4b42-bfc8-08841dca3b12 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:30.737752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d6e1a-bf3a-4408-850b-9d21e62b083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:30.738288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d6e1a-bf3a-4408-850b-9d21e62b083e None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:30.738740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d6e1a-bf3a-4408-850b-9d21e62b083e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:30.739014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d6e1a-bf3a-4408-850b-9d21e62b083e None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:30.739669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d6e1a-bf3a-4408-850b-9d21e62b083e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:30.741098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d6e1a-bf3a-4408-850b-9d21e62b083e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:30.761699 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 567/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:13:30 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:32.950683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1a7d-0c62-48cf-bb9b-f7eff09b045b None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:32.951188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1a7d-0c62-48cf-bb9b-f7eff09b045b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:32.951188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1a7d-0c62-48cf-bb9b-f7eff09b045b None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:32.952472 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 572/1139] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:32.958468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:32.958891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:32.959000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:32.976666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:32.977858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:33.040719 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 568/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:13:33.308649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1a7d-0c62-48cf-bb9b-f7eff09b045b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:33.400397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:33.407705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1a7d-0c62-48cf-bb9b-f7eff09b045b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:33.439790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:33.440407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:33.440683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:33.441073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:33.451151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:33.456111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:33.457316 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:33.458172 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 573/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:33.463351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:33.541598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:33.560422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a0892-c1ac-4ae0-b93a-1d1972d1ef5f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:33.596103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:33.596702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:33.597019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:33.597298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:33.598567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:33.599042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:33.600408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:33.608140 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 569/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:33.614641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:33.712021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c9863-66a6-46d3-b0e3-1d4e33a0ea41 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:33.745473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:33.746121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:33.746406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:33.746685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] PATH_INFO: `/v3/users/66bb73131747423296a7c67eaf348a9c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:33.759134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=66bb73131747423296a7c67eaf348a9c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:33.760564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:33.762162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 574/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:33 2022] GET /identity/v3/users/66bb73131747423296a7c67eaf348a9c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:33.767839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:33.868110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd86d9-571c-497b-aec9-1415818ffa06 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:33.899631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:33.900220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:33.900502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:33.900772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:33.914819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:33.965956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:33.967387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:34.061340 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:34.067274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:34.083272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:34.164669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48495759-9c50-4412-b1be-ceb8a1b5a6a8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:34.196924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09f35-7dc3-449b-8adc-e0c2ec50bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:34.197558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09f35-7dc3-449b-8adc-e0c2ec50bd2a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:34.197839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09f35-7dc3-449b-8adc-e0c2ec50bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:34.198114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09f35-7dc3-449b-8adc-e0c2ec50bd2a None admin] PATH_INFO: `/v3/projects/e5832044751d4ed4812734c1dd49bb33` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:34.199215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09f35-7dc3-449b-8adc-e0c2ec50bd2a None admin] RBAC: Authorizing `identity:get_project(project_id=e5832044751d4ed4812734c1dd49bb33)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:34.200630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09f35-7dc3-449b-8adc-e0c2ec50bd2a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:34.202240 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 575/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:34 2022] GET /identity/v3/projects/e5832044751d4ed4812734c1dd49bb33 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:34.209135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:34.253586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:34.306170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221afa45-101e-41b7-ba5d-0054636f78cd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:34.339076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:34.339665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:34.339943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:34.340212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:34.340938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=e5832044751d4ed4812734c1dd49bb33, user.id=66bb73131747423296a7c67eaf348a9c) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:34.341249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:34.342650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b9da0-9760-4cf3-8c53-957b311e0012 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:34.348417 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 571/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:34 2022] GET /identity/v3/role_assignments?user.id=66bb73131747423296a7c67eaf348a9c&scope.project.id=e5832044751d4ed4812734c1dd49bb33&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:36.521108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06085934-6914-461c-8fef-0bef2757b9c3 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:36.521726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06085934-6914-461c-8fef-0bef2757b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:36.521849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06085934-6914-461c-8fef-0bef2757b9c3 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:36.523115 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 576/1147] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:36.528226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:36.528613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:36.528785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:36.547562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:36.548753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:36.613829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 572/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:36.887746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06085934-6914-461c-8fef-0bef2757b9c3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:36.971467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:36.991334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06085934-6914-461c-8fef-0bef2757b9c3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:37.024383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:37.025030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:37.025310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:37.025584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:37.035925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:37.040994 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:37.042063 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:37.043322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 577/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:37.048053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:37.086885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:37.145572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85250e83-c6ef-4259-8b44-4a224696fd81 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:37.178611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:37.179203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:37.179484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:37.179757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:37.180411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:37.180713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:37.182094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:37.189801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 573/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:37.195982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:37.295791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d421928-e96f-4fb7-8434-a5028c869fb0 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:37.328367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:37.329016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:37.329295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:37.329570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] PATH_INFO: `/v3/users/66bb73131747423296a7c67eaf348a9c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:37.330914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] RBAC: Authorizing `identity:get_user(user_id=66bb73131747423296a7c67eaf348a9c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:37.332867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:37.334434 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 578/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:37 2022] GET /identity/v3/users/66bb73131747423296a7c67eaf348a9c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:37.340282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:37.433010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:37.436098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01d4d6-4bbb-4ed1-aa73-85c38d3e22e6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:37.468950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566e940-5663-4f2d-81df-a548ed0ae1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:37.469561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e940-5663-4f2d-81df-a548ed0ae1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:37.469837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e940-5663-4f2d-81df-a548ed0ae1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:37.470109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566e940-5663-4f2d-81df-a548ed0ae1f9 None admin] PATH_INFO: `/v3/projects/e5832044751d4ed4812734c1dd49bb33` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:37.471199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e940-5663-4f2d-81df-a548ed0ae1f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e5832044751d4ed4812734c1dd49bb33)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:37.473153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566e940-5663-4f2d-81df-a548ed0ae1f9 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:37.474742 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 574/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:37 2022] GET /identity/v3/projects/e5832044751d4ed4812734c1dd49bb33 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:37.480579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:37.493444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:37.579509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c4470-45c3-4861-b55f-93f5b9a5e852 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:37.615413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70dbb-7594-4a7c-8c12-3c4871cf893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:37.616068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70dbb-7594-4a7c-8c12-3c4871cf893e None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:37.616350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70dbb-7594-4a7c-8c12-3c4871cf893e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:37.616626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70dbb-7594-4a7c-8c12-3c4871cf893e None admin] PATH_INFO: `/v3/projects/e5832044751d4ed4812734c1dd49bb33/users/66bb73131747423296a7c67eaf348a9c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:37.618530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe70dbb-7594-4a7c-8c12-3c4871cf893e None admin] RBAC: Authorizing `identity:create_grant(project_id=e5832044751d4ed4812734c1dd49bb33, user_id=66bb73131747423296a7c67eaf348a9c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:37.619967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe70dbb-7594-4a7c-8c12-3c4871cf893e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:37.633469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 579/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:13:37 2022] PUT /identity/v3/projects/e5832044751d4ed4812734c1dd49bb33/users/66bb73131747423296a7c67eaf348a9c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:13:39.757717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1cba-33a6-4e34-b963-f6f9f7a5e274 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:39.758297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1cba-33a6-4e34-b963-f6f9f7a5e274 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:39.758297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1cba-33a6-4e34-b963-f6f9f7a5e274 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:39.759604 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 575/1154] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:39.764816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:39.765253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:39.765402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:39.784538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:39.785761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:39.845140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:39.850613 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 580/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:40.120766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1cba-33a6-4e34-b963-f6f9f7a5e274 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:40.218003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1cba-33a6-4e34-b963-f6f9f7a5e274 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:40.251255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:40.251867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:40.252143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:40.252412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:40.263293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:40.267997 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:40.269213 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:40.270845 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 576/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:40.275714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:40.376112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e604f6-f067-4996-9e68-3d84e631aebc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:40.407811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:40.408410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:40.408687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:40.408983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:40.409638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:40.409935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:40.411923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:40.419481 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 581/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:40.425423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:40.453547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:40.523788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81d45e-7281-4b02-bbe8-58a4f7c2a015 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:40.556787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:40.557436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:40.557719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:40.557995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] PATH_INFO: `/v3/users/66bb73131747423296a7c67eaf348a9c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:40.559107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] RBAC: Authorizing `identity:get_user(user_id=66bb73131747423296a7c67eaf348a9c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:40.560521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:40.562097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 577/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:40 2022] GET /identity/v3/users/66bb73131747423296a7c67eaf348a9c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:40.567749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:40.643678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:40.692040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd640c-1a0b-43de-afff-a42f03721b4b None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:40.724306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:40.724933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:40.725214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:40.725487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:40.789992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:40.791419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:40.847342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:40.885442 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 582/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:40.891347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:40.985317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:40.991667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bceb314-0ead-48b5-9b9f-c85840d338c4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:41.023897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c096cb-7016-4d6a-b8b0-eb419697d82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:41.024505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c096cb-7016-4d6a-b8b0-eb419697d82e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:41.024780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c096cb-7016-4d6a-b8b0-eb419697d82e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:41.025076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c096cb-7016-4d6a-b8b0-eb419697d82e None admin] PATH_INFO: `/v3/projects/e5832044751d4ed4812734c1dd49bb33` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:41.026165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c096cb-7016-4d6a-b8b0-eb419697d82e None admin] RBAC: Authorizing `identity:get_project(project_id=e5832044751d4ed4812734c1dd49bb33)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:41.027577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c096cb-7016-4d6a-b8b0-eb419697d82e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:41.029214 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 578/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:40 2022] GET /identity/v3/projects/e5832044751d4ed4812734c1dd49bb33 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:41.036195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:41.130847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd41d8-ac41-43b1-906f-9c6ed1ad0d66 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:41.169727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:41.170335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:41.170619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:41.170895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:41.171626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=e5832044751d4ed4812734c1dd49bb33, user.id=66bb73131747423296a7c67eaf348a9c) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:41.171940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:41.173599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84123-12bc-4e01-8b36-7eff52b7989f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:41.182076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 583/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:41 2022] GET /identity/v3/role_assignments?user.id=66bb73131747423296a7c67eaf348a9c&scope.project.id=e5832044751d4ed4812734c1dd49bb33&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:43.341193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba5a5-fbbd-4c40-8b6a-874ced85c621 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:43.341742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba5a5-fbbd-4c40-8b6a-874ced85c621 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:43.341742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ba5a5-fbbd-4c40-8b6a-874ced85c621 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:43.343076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 579/1162] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:43.348761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:43.349184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:43.349338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:43.367649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:43.368834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:43.388246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:43.434516 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 584/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:43.698778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba5a5-fbbd-4c40-8b6a-874ced85c621 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:43.800042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ba5a5-fbbd-4c40-8b6a-874ced85c621 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:43.840706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:43.841403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:43.841681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:43.841950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:43.871560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:43.907668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:43.909180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:44.007700 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 580/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:44.013515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:44.122607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857b8b-316d-4465-9f73-bab4ba38d0d4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:44.156032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:44.156661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:44.156969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:44.157247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:44.164917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:44.166379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d374f26b-a0a1-4a54-9947-d173571cfea9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:44.178816 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:44.180056 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:13:44.181162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 585/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:13:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:44.186016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:44.247127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:44.283600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b2962-a4a4-40c3-9f5d-e3cf19d4373f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:44.317326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:44.317930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:44.318212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:44.318489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:44.319127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:44.319437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:44.320790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254819a1-aa76-49ed-9ff6-06d55218d7fc None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:44.327879 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 581/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Oct 5 02:13:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:46.462505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30837a-03eb-4697-a892-50f43a3ad9dc None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:46.463062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30837a-03eb-4697-a892-50f43a3ad9dc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:46.463062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30837a-03eb-4697-a892-50f43a3ad9dc None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:46.464370 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 586/1167] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:46.469531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff050-9417-4688-a6f8-cd4e8564b732 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:46.469936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff050-9417-4688-a6f8-cd4e8564b732 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:46.470083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff050-9417-4688-a6f8-cd4e8564b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:46.487793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-653ff050-9417-4688-a6f8-cd4e8564b732 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:46.489020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-653ff050-9417-4688-a6f8-cd4e8564b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:46.553217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 582/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:46.818280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30837a-03eb-4697-a892-50f43a3ad9dc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:46.837301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:46.927891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30837a-03eb-4697-a892-50f43a3ad9dc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:46.961239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c720695-a33e-42f8-be7b-d728016138d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:46.961838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c720695-a33e-42f8-be7b-d728016138d8 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:46.962116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c720695-a33e-42f8-be7b-d728016138d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:46.962387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c720695-a33e-42f8-be7b-d728016138d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:46.963056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c720695-a33e-42f8-be7b-d728016138d8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:46.964413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c720695-a33e-42f8-be7b-d728016138d8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:46.980254 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 587/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Oct 5 02:13:46 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:49.142365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e06e7-8a27-4542-a762-a26e2d0ce381 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:49.142921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e06e7-8a27-4542-a762-a26e2d0ce381 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:49.142921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e06e7-8a27-4542-a762-a26e2d0ce381 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:49.144769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 583/1170] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:49.150078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:49.150474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:49.150637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:49.168852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:49.170064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:49.234085 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 588/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:49.503224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e06e7-8a27-4542-a762-a26e2d0ce381 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:49.561230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:49.607009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e06e7-8a27-4542-a762-a26e2d0ce381 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:49.648839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30eadc-57d6-40a8-ba5c-2cb007ce23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:49.649497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30eadc-57d6-40a8-ba5c-2cb007ce23ad None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:49.649778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30eadc-57d6-40a8-ba5c-2cb007ce23ad None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:49.650048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30eadc-57d6-40a8-ba5c-2cb007ce23ad None admin] PATH_INFO: `/v3/domains/d6906107d9464c469ecaa11cc8643e88` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:49.660622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30eadc-57d6-40a8-ba5c-2cb007ce23ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=d6906107d9464c469ecaa11cc8643e88)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:49.662102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30eadc-57d6-40a8-ba5c-2cb007ce23ad None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:49.663714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 584/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 5 02:13:49 2022] GET /identity/v3/domains/d6906107d9464c469ecaa11cc8643e88 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:49.669503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:49.677623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:49.767406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75014d31-ad29-4c29-a787-a9f8ad54d9e4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:49.799598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123698ce-e519-406e-b232-c29de3d4697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:49.800195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123698ce-e519-406e-b232-c29de3d4697d None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:49.801001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123698ce-e519-406e-b232-c29de3d4697d None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:49.801276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123698ce-e519-406e-b232-c29de3d4697d None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:49.801925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123698ce-e519-406e-b232-c29de3d4697d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:49.803360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123698ce-e519-406e-b232-c29de3d4697d None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:49.829372 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 589/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:13:49 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:51.981710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592501b4-fe39-4b21-8afa-383bbaca4c3c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:51.982204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592501b4-fe39-4b21-8afa-383bbaca4c3c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:51.982204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592501b4-fe39-4b21-8afa-383bbaca4c3c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:51.983511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 585/1174] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:51.989469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:51.989859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:51.990039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:52.008768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:52.009991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:52.062437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:52.076830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:52.344325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592501b4-fe39-4b21-8afa-383bbaca4c3c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:52.442839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592501b4-fe39-4b21-8afa-383bbaca4c3c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:52.459009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:52.475958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acc50-9c1a-472c-a0c7-222ab01b3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:52.476574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acc50-9c1a-472c-a0c7-222ab01b3189 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:52.476854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acc50-9c1a-472c-a0c7-222ab01b3189 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:52.477155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acc50-9c1a-472c-a0c7-222ab01b3189 None admin] PATH_INFO: `/v3/domains/d6906107d9464c469ecaa11cc8643e88` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:52.478257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350acc50-9c1a-472c-a0c7-222ab01b3189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d6906107d9464c469ecaa11cc8643e88)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:52.479680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350acc50-9c1a-472c-a0c7-222ab01b3189 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:52.481326 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 586/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Oct 5 02:13:52 2022] GET /identity/v3/domains/d6906107d9464c469ecaa11cc8643e88 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:52.486967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:52.582701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690006e-57e6-4051-aab3-1d305929f0e6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:52.616333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2263bd6-57e6-493f-a5ec-3104399e88fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:52.616858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263bd6-57e6-493f-a5ec-3104399e88fc None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:52.617160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263bd6-57e6-493f-a5ec-3104399e88fc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:52.617431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2263bd6-57e6-493f-a5ec-3104399e88fc None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:52.618071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263bd6-57e6-493f-a5ec-3104399e88fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:52.619488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2263bd6-57e6-493f-a5ec-3104399e88fc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:52.639807 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 591/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:13:52 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:13:54.830066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14eb69-fd66-4da2-a075-8b151a093ec1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:54.830598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14eb69-fd66-4da2-a075-8b151a093ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:54.830598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14eb69-fd66-4da2-a075-8b151a093ec1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:54.832850 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 587/1178] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:54.838172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:54.838600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:54.838730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:54.856392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:54.857600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:54.896255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:54.923341 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 592/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:55.192178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14eb69-fd66-4da2-a075-8b151a093ec1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:55.292782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14eb69-fd66-4da2-a075-8b151a093ec1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:55.325710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:55.326331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:55.326612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:55.326886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:55.337322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:55.342008 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:55.343094 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:55.344273 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 588/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:55.350432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:55.451440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb6c7e-fdf5-4129-9f34-d95bcf3b2071 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:55.484096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:55.484703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:55.485019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:55.485297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:55.485959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:55.486264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:55.487631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:55.496215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 593/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:55.502121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:55.549026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:55.602773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86a9c8-8c73-42e8-8d84-1af9cb783d08 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:55.634684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:55.635295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:55.635573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:55.635843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] PATH_INFO: `/v3/users/7f802ea1a84f47279a45a75aa568e66b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:55.649786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] RBAC: Authorizing `identity:get_user(user_id=7f802ea1a84f47279a45a75aa568e66b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:55.651249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:55.652880 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 589/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:55 2022] GET /identity/v3/users/7f802ea1a84f47279a45a75aa568e66b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:55.658902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:55.695182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:55.774627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b8e0f-2b8a-4def-b2d0-b6df4be9f08e None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:55.806745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:55.807341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:55.807623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:55.807895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:55.871738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:55.873200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:55.904972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:55.967170 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 594/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:13:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:13:55.973713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:56.088137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad19d67-55e4-44a9-9161-60a0a2f8e443 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:56.090409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:56.121556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc95cb9-d57f-4acf-97aa-c83d692188c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:56.122167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc95cb9-d57f-4acf-97aa-c83d692188c6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:56.122444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc95cb9-d57f-4acf-97aa-c83d692188c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:56.122714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc95cb9-d57f-4acf-97aa-c83d692188c6 None admin] PATH_INFO: `/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:56.123810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc95cb9-d57f-4acf-97aa-c83d692188c6 None admin] RBAC: Authorizing `identity:get_project(project_id=7614799ca47b4c8fbc391e8c8dcbec40)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:56.125245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc95cb9-d57f-4acf-97aa-c83d692188c6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:56.126837 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 590/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:55 2022] GET /identity/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:56.133499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:56.229408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b6831-66ac-452c-bbd9-5b8203e50027 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:56.262046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:56.262636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:56.262915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:56.263190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:56.263906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=7614799ca47b4c8fbc391e8c8dcbec40, user.id=7f802ea1a84f47279a45a75aa568e66b) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:56.264220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:56.265662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c843aa-d9a5-4bad-826f-396e817b72b3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:56.268363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:56.272263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 595/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:13:56 2022] GET /identity/v3/role_assignments?user.id=7f802ea1a84f47279a45a75aa568e66b&scope.project.id=7614799ca47b4c8fbc391e8c8dcbec40&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:58.390876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc7c29-d089-4060-b550-2b510f104bf1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:58.391411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc7c29-d089-4060-b550-2b510f104bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:58.391411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc7c29-d089-4060-b550-2b510f104bf1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:58.392746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 591/1186] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:13:58.398456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:58.398871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:58.399003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:58.416586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:13:58.417784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:13:58.480888 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 596/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:13:58.749478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc7c29-d089-4060-b550-2b510f104bf1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:58.848741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc7c29-d089-4060-b550-2b510f104bf1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:58.881746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:58.882363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:58.882643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:58.882916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:58.892601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:13:58.897983 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:13:58.899115 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:13:58.900347 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 592/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:13:58.905098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:58.998798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babecc5-fce5-452b-b142-f6c0efc214e6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:59.026837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:59.033188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:59.033787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:59.034067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:59.034369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:59.035088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:13:59.035387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:59.036773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:59.044522 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 597/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:59.050340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:59.081130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:59.147162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60598fbe-752c-433a-9b96-79ed4761fb6b None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:59.179254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:59.179848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:59.180126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:59.180395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] PATH_INFO: `/v3/users/7f802ea1a84f47279a45a75aa568e66b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:59.181645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f802ea1a84f47279a45a75aa568e66b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:59.183033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:59.184550 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 593/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:13:59 2022] GET /identity/v3/users/7f802ea1a84f47279a45a75aa568e66b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:59.190191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:59.286016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3a94-82f4-4bcb-bad9-8048f2ec4d99 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:59.318336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd032af-896f-49c6-85b1-8dfe0b4b080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:59.318944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd032af-896f-49c6-85b1-8dfe0b4b080a None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:59.319221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd032af-896f-49c6-85b1-8dfe0b4b080a None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:59.319495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd032af-896f-49c6-85b1-8dfe0b4b080a None admin] PATH_INFO: `/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:59.320593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd032af-896f-49c6-85b1-8dfe0b4b080a None admin] RBAC: Authorizing `identity:get_project(project_id=7614799ca47b4c8fbc391e8c8dcbec40)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:59.322039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd032af-896f-49c6-85b1-8dfe0b4b080a None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:59.323616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 598/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:13:59 2022] GET /identity/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:13:59.329495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:13:59.423033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:13:59.426696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458d381-721d-4769-81eb-2d150d8029e1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:13:59.460176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c5d2d-411f-4427-a1ae-b5c45336ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:13:59.460842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5d2d-411f-4427-a1ae-b5c45336ea3d None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:13:59.461145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5d2d-411f-4427-a1ae-b5c45336ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:13:59.461419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5d2d-411f-4427-a1ae-b5c45336ea3d None admin] PATH_INFO: `/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40/users/7f802ea1a84f47279a45a75aa568e66b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:13:59.463272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c5d2d-411f-4427-a1ae-b5c45336ea3d None admin] RBAC: Authorizing `identity:create_grant(project_id=7614799ca47b4c8fbc391e8c8dcbec40, user_id=7f802ea1a84f47279a45a75aa568e66b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:13:59.464670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c5d2d-411f-4427-a1ae-b5c45336ea3d None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:13:59.476992 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 594/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:13:59 2022] PUT /identity/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40/users/7f802ea1a84f47279a45a75aa568e66b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:14:01.625141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339326d8-f7ad-4af1-8df0-d87f502e248a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:01.625684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339326d8-f7ad-4af1-8df0-d87f502e248a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:01.625684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339326d8-f7ad-4af1-8df0-d87f502e248a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:01.627027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 599/1193] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:14:01.632478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:01.632936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:01.633066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:01.651495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:14:01.652689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:14:01.718874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 595/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:14:01.993382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339326d8-f7ad-4af1-8df0-d87f502e248a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:02.053755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:02.094847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339326d8-f7ad-4af1-8df0-d87f502e248a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:02.127721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:02.129005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:02.129709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:02.129991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:02.140201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:14:02.146111 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:14:02.147211 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:14:02.148277 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 600/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:14:02.153284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:02.239589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:02.250137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddd18e-8744-45bb-bfce-eb20733ca35e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:02.283041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:02.283630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:02.283911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:02.284192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:02.285171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:14:02.285483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:02.286834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:02.294474 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 596/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:14:02.300784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:02.398267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c8148-9c44-4020-97da-b95aba702650 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:02.416820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:02.431239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:02.431859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:02.432141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:02.432416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] PATH_INFO: `/v3/users/7f802ea1a84f47279a45a75aa568e66b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:02.433535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f802ea1a84f47279a45a75aa568e66b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:02.434964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:02.436514 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 601/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Oct 5 02:14:02 2022] GET /identity/v3/users/7f802ea1a84f47279a45a75aa568e66b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:14:02.443213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:02.541533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0919e-aa45-4621-8127-648aadac1cfd None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:02.573863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:02.574449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:02.574725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:02.574990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:02.595475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:02.640584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:02.642042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:02.741599 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:14:02.747582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:02.843861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e962-f07b-484e-b7f1-03950841fdb2 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:02.876074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d0af5-24cc-40f9-adcf-82ade73640d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:02.876679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d0af5-24cc-40f9-adcf-82ade73640d4 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:02.876979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d0af5-24cc-40f9-adcf-82ade73640d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:02.877255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d0af5-24cc-40f9-adcf-82ade73640d4 None admin] PATH_INFO: `/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:02.878508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d0af5-24cc-40f9-adcf-82ade73640d4 None admin] RBAC: Authorizing `identity:get_project(project_id=7614799ca47b4c8fbc391e8c8dcbec40)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:02.880109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d0af5-24cc-40f9-adcf-82ade73640d4 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:02.881714 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 602/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Oct 5 02:14:02 2022] GET /identity/v3/projects/7614799ca47b4c8fbc391e8c8dcbec40 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:14:02.887676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:02.937543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:02.984880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb38ea-de46-45db-93a2-b6ce45bb0055 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:03.017857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:03.018453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:03.018730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:03.019691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:03.020407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=7614799ca47b4c8fbc391e8c8dcbec40, user.id=7f802ea1a84f47279a45a75aa568e66b) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:14:03.020715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:03.022165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502e6c46-36ef-4d65-8b1b-d96e6ebb3c26 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:03.027731 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 598/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:14:02 2022] GET /identity/v3/role_assignments?user.id=7f802ea1a84f47279a45a75aa568e66b&scope.project.id=7614799ca47b4c8fbc391e8c8dcbec40&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:14:12.872133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=72 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:13.025288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=42 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:59.018767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ce37-d97a-4d20-841b-6270fbb289c3 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:59.019418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ce37-d97a-4d20-841b-6270fbb289c3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:59.019418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56ce37-d97a-4d20-841b-6270fbb289c3 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:59.020718 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 603/1201] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:14:59.028545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:59.028545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:59.028545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:59.051003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:14:59.052392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:14:59.149621 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:14:59.454556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ce37-d97a-4d20-841b-6270fbb289c3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:59.582826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56ce37-d97a-4d20-841b-6270fbb289c3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:59.620042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:59.620636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:59.620992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:59.621218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:59.633288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:59.634764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:14:59.656172 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:14:59.661092 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:14:59.662220 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:14:59.662220 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:14:59.662220 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:14:59.662220 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 604/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:14:59.668633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:59.798030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55d606-aa78-4f20-84f0-07ca98bb2edf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:14:59.845316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:14:59.854091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:14:59.854839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:14:59.855170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:14:59.855458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:14:59.856263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:14:59.856595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:14:59.858081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241216-e883-48b6-af78-ef53433b1f6c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:14:59.872217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 600/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:14:59.883465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:14:59.964956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:00.042626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabda3c-0acc-49ea-9b02-7b34ae5ae0e1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:00.087264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8a231-64ae-45f1-b68a-1379835f08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:00.087955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a231-64ae-45f1-b68a-1379835f08c6 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:00.088268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a231-64ae-45f1-b68a-1379835f08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:00.088539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8a231-64ae-45f1-b68a-1379835f08c6 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:00.089342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8a231-64ae-45f1-b68a-1379835f08c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:00.090910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8a231-64ae-45f1-b68a-1379835f08c6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:00.122579 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 605/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Oct 5 02:14:59 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:15:02.798148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d842-0ee3-4ae8-9f09-ce494b452f42 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:02.799480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d842-0ee3-4ae8-9f09-ce494b452f42 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:02.800772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d842-0ee3-4ae8-9f09-ce494b452f42 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:02.803315 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 601/1206] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:02.808561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:02.809108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:02.811730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:02.857145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:02.858614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:02.944293 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:03.250798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d842-0ee3-4ae8-9f09-ce494b452f42 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:03.400804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d842-0ee3-4ae8-9f09-ce494b452f42 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:03.452283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:03.452875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:03.453196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:03.453476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:03.467306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:15:03.474749 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:03.476022 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:03.476938 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 602/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:15:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:03.481990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:03.529738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:03.608374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136847d-c9e8-4ff3-8b83-04d40fb89faf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:03.649165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:03.649933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:03.650321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:03.650702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:03.651899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:03.651899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:03.653382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:03.674315 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 607/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:15:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:03.676134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:03.735003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:03.795322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507691a1-01fe-40c1-ab30-e88d27b8d58a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:03.835924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:03.836709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:03.837170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:03.837457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:03.851212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:03.852645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:03.869203 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:03.870222 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:03.876025 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:03.876025 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:03.876025 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:03.876025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 603/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:03.878078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:03.995070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:03.998611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f09823-d546-4ce5-bba5-d15d44066ae3 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:04.039999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:04.040724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:04.041172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:04.041550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:04.042299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:04.042713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:04.044178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:04.062693 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 608/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:04.065222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:04.180577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961d63d-eeec-4949-afc9-53b8bf8fceab None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:04.182352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:04.219314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:04.219985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:04.220262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:04.220561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:04.229606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:04.231113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:15:04.244132 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:04.245394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:04.246415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 604/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:04.254038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:04.403267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4408c-ab4f-4d58-b217-d9d2adeda264 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:04.445373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:04.446015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:04.446298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:04.446575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:04.447312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:04.447620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:04.449127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:04.479446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 609/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 02:15:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:04.481511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:04.593654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eec012-fa93-4452-acb3-53bcb985d99f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:04.632599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:04.633290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:04.633579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:04.633847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:04.672344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:04.715658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:04.717236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:04.841935 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:15:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:15:04.849754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:04.868973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:04.953552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5abe88-a8c3-45fa-a4bf-86d528dee652 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:04.990725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:04.991412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:04.991776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:04.992114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:05.002886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:05.004395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:05.020250 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:05.021546 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:05.022648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:05.022648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:05.022648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:05.022648 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 610/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:05.027292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:05.090835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:05.131812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6ceaa-fd24-4723-9645-42e3cef99952 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:05.170981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:05.171665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:05.172091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:05.172364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:05.173141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:05.173487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:05.175623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:05.188472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 606/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:05.195229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:05.276469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:05.319558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbe2d0-83fe-4fb2-8daf-057ae433b332 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:05.357288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:05.358071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:05.358343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:05.358702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:05.367174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:05.368643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:15:05.380696 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:05.381831 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:05.382764 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 611/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:05.387839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:05.508837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a117-e5f4-4f91-b51b-92f2e44b1d0a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:05.535097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:05.548257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:05.549517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:05.550378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:05.550692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:05.551423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:05.551758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:05.553253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ede536-599a-43f8-bfbe-98d20fc4f949 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:05.566671 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 607/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:05.572982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:05.694875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba63480-b0ae-442f-b153-45d1ec1a9011 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:05.726679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:05.733215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:05.733819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:05.734155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:05.734369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:05.735185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=eea06fb6c97248549e3253c032e83a0f) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:05.735479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:05.737173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285ed16-a00c-458e-bd6e-0e3fe769c4a8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:05.743028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 612/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:15:05 2022] GET /identity/v3/role_assignments?user.id=eea06fb6c97248549e3253c032e83a0f&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:07.978782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb911-3e56-4a08-a741-faa312206114 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:07.979365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb911-3e56-4a08-a741-faa312206114 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:07.979365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbb911-3e56-4a08-a741-faa312206114 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:07.984716 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 608/1220] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:07.986427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:07.986863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:07.987178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:08.006726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:08.008189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:08.081445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:08.388035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb911-3e56-4a08-a741-faa312206114 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:08.497973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbb911-3e56-4a08-a741-faa312206114 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:08.535588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:08.536223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:08.536504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:08.536777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:08.547942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:15:08.553522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:08.555278 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:08.556143 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 609/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:15:08.560816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:08.680984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b86ea-f39b-4881-a510-2348f2179c07 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:08.709187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:08.721684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:08.722316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:08.722588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:08.722919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:08.723780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] RBAC: Adding query filter params (name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:08.724089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:08.725505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:08.738516 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 614/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:08.744225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:08.792270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:08.849531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc199724-9818-47a3-ac15-dfb89df2b2d0 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:08.885345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:08.886066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:08.886381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:08.886662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:08.897870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:08.899308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:08.915283 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:08.916413 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:08.917742 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:08.917742 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:08.917742 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:08.917742 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 610/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:15:08.922423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:09.032891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3859-ebd1-4744-9ff9-4f79e9858afc None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:09.071092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:09.071779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:09.072065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:09.072332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:09.073117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:09.073422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:09.075156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:09.090521 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 615/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:09.096923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:09.206221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:09.213495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047f07b-3905-4709-8ece-2a145b43328e None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:09.250731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:09.251279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:09.251554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:09.251826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:09.260400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:09.261860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:15:09.275767 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:09.277256 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:09.278361 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 611/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:09.283854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:09.336533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:09.397014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e29b4e-692c-45e3-9423-2a11beba1f64 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:09.435148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:09.435761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:09.436042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:09.436316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:09.437080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:09.437387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:09.438817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:09.463550 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 616/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 02:15:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:09.465220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:09.570124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53cdc7-6c2e-4600-8b8b-23b4b25f35c4 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:09.607559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a698-5594-4226-b676-8681f347b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:09.608347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a698-5594-4226-b676-8681f347b874 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:09.608649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a698-5594-4226-b676-8681f347b874 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:09.609002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785a698-5594-4226-b676-8681f347b874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:09.621398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785a698-5594-4226-b676-8681f347b874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:09.622988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785a698-5594-4226-b676-8681f347b874 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5785a698-5594-4226-b676-8681f347b874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:09.637817 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:09.639452 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:09.640650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:09.640650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:09.640650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:09.640650 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 612/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:09.645590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:09.763999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359ea6-e378-46c1-8738-acb95e6a7a36 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:09.766400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:09.803713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:09.804839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:09.804839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:09.805077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:09.805538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:09.805848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:09.807310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:09.821384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 617/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:09.827282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a698-5594-4226-b676-8681f347b874 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:09.838113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:09.942829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785a698-5594-4226-b676-8681f347b874 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:09.980888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:09.981948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:09.982452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:09.982890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:09.991397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:09.993680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:15:10.007561 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:10.008693 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:10.009770 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 613/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 05 02:15:10.014874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:10.141079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fdc77-ab98-43a5-83d0-e7a35c0f376c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:10.178096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:10.178802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:10.179075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:10.179391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:10.180125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:10.180511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:10.182155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2b8e2-5676-4513-ae3a-1e3ad0f4029c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:10.195830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 618/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:10.202387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:10.274278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:10.316637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bda0d0-32fe-48f9-9e43-e814a502e6d8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:10.353663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34c0f1-d791-4111-bec9-6059598b1523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:10.354360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34c0f1-d791-4111-bec9-6059598b1523 None admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:10.354695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34c0f1-d791-4111-bec9-6059598b1523 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:10.354972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34c0f1-d791-4111-bec9-6059598b1523 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/eea06fb6c97248549e3253c032e83a0f/roles/0653bb566f874dd6a4b9d609637255ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:10.370643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34c0f1-d791-4111-bec9-6059598b1523 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=eea06fb6c97248549e3253c032e83a0f, role_id=0653bb566f874dd6a4b9d609637255ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:10.372281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34c0f1-d791-4111-bec9-6059598b1523 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:10.385911 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:15:10 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/eea06fb6c97248549e3253c032e83a0f/roles/0653bb566f874dd6a4b9d609637255ee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:15:12.659216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fc5da-ad8c-4d67-b8e3-d53c9bb7d11c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:12.659810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fc5da-ad8c-4d67-b8e3-d53c9bb7d11c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:12.659810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fc5da-ad8c-4d67-b8e3-d53c9bb7d11c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:12.661136 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 619/1233] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:12.666892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:12.667375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:12.667483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:12.687244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:12.688513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:12.766713 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:13.056991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fc5da-ad8c-4d67-b8e3-d53c9bb7d11c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:13.086396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:13.175768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fc5da-ad8c-4d67-b8e3-d53c9bb7d11c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:13.211041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:13.211684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:13.211964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:13.212241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:13.223652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:15:13.228360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:13.229749 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:13.230666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 620/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Oct 5 02:15:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:13.235933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:13.294504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:13.357323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3693a-83fb-4aba-bdc0-bb8bbfd364e6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:13.392061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:13.393342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:13.393670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:13.393937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:13.394601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] RBAC: Adding query filter params (name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:13.394912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:13.396292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:13.405013 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 616/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Oct 5 02:15:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:13.411560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:13.509392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:13.528313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2293ea8-db37-47a6-835f-87a4ebb8973c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:13.567952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:13.568646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:13.569056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:13.569297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:13.581859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:13.583674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:13.598069 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:13.599261 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:13.600628 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:13.600628 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:13.600628 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:13.600628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 621/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:13.605019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:13.717623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd6024-f63d-4d0b-a359-558cc5510594 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:13.728026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:13.756212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:13.756892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:13.757201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:13.757516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:13.758258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:13.758684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:13.760153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:13.774572 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 617/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:13.780949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:13.894713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65243a0-2fef-4ed8-b334-bf7deb0ed7d8 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:13.933676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:13.934230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:13.934565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:13.934955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:13.937866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:13.945071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:13.946794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:15:13.958590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:13.959773 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:13.960940 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 622/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:13.965701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:14.078895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfab73-25af-4a45-af6c-22dc2a8bde0f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:14.117463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:14.118071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:14.118351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:14.118627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:14.119356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:14.119666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:14.121124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:14.139809 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 618/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 02:15:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:14.145743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:14.257056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510107-8ae9-4f66-96f3-69df4b773c2f None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:14.300007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:14.300459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:14.300828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:14.301058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:14.368488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:14.376490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:14.378175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:14.480189 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:15:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:15:14.487659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:14.523900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:14.608168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab721b27-a5fa-468d-bbd5-ffcbe0cb1ee8 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:14.644651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:14.645356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:14.645714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:14.645997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:14.661047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:14.662500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:14.678485 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:14.680156 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:14.681882 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:14.681882 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:14.681882 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:14.681882 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 619/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:14.685589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:14.791814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:14.797975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7981-a499-475c-b3c6-e8de400ba116 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:14.838510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:14.839084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:14.839368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:14.839646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:14.840295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:14.840604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:14.842010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:14.854294 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 624/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:14.860690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:14.947245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:14.971602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c218f-5672-4eb9-93f6-a65073edbd1f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:15.008262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:15.009027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:15.009303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:15.009577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:15.016779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:15.018338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:15:15.030192 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:15.031408 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:15.033015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 620/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:15:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:15.038019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:15.154762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba9682-4387-4367-aaac-0d4b855f4525 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:15.193570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:15.194148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:15.194430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:15.194708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:15.195402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:15.195707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:15.197204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe03a03-5a7e-475b-9848-7f18768d0d3e None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:15.209791 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 625/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:15.215959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:15.330462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70c33-5db5-4509-8983-27ea33fa2f7c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:15.366807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:15.367410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:15.367691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:15.367969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:15.368705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] RBAC: Adding query filter params (role.id=0653bb566f874dd6a4b9d609637255ee, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=eea06fb6c97248549e3253c032e83a0f) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:15.369037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:15.370706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257891-5738-419e-8292-22fe94350e1a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:15.376919 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 621/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:15:15 2022] GET /identity/v3/role_assignments?user.id=eea06fb6c97248549e3253c032e83a0f&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=0653bb566f874dd6a4b9d609637255ee => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:17.745663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078df3-0315-4804-87d3-fd7c7e4589cb None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:17.746238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078df3-0315-4804-87d3-fd7c7e4589cb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:17.746238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078df3-0315-4804-87d3-fd7c7e4589cb None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:17.747551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 626/1247] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:17.754532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:17.754977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:17.755069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:17.761452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:17.774658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:17.775854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:17.845709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:18.126720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078df3-0315-4804-87d3-fd7c7e4589cb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:18.144753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:18.235971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078df3-0315-4804-87d3-fd7c7e4589cb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:18.274220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:18.275003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:18.275283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:18.275566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:18.286690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:15:18.292445 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:18.293538 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:18.294608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 627/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:15:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:18.300547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:18.406713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed668b5-16c7-4ab6-8cc4-d4f8900c9cbe None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:18.438445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:18.443864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:18.444503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:18.444780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:18.445080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:18.445744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:18.446047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:18.447605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:18.458094 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 623/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:18.464104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:18.548492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:18.572347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8b63c-6e53-4f32-b3ff-9e07bfb43704 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:18.612918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:18.613811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:18.614107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:18.614403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:18.628444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:18.630316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:18.648719 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:18.649806 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:18.650755 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:18.650755 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:18.650755 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:18.650755 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 628/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:18.657639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:18.764708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdf712-6bc1-4c32-975b-301edc92f1cb None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:18.802611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:18.803244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:18.803525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:18.803793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:18.804452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:18.804756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:18.806191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:18.820413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 624/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:18.826474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:18.932675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9f817-a2c6-41e6-8567-bcf9f971582c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:18.961530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:18.970109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:18.970787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:18.971066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:18.971390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:18.979942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:18.981460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:15:18.993930 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:18.995182 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:18.996157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 629/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:19.001119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:19.061483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:19.109057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f1de-6c74-40ea-bd9f-9d0162930cd6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:19.145538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:19.146147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:19.146424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:19.146695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:19.147421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:19.147729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:19.149172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:19.168067 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 625/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 02:15:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:19.174013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:19.288027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6904b7-f87b-4cfa-88f4-a080bd04a1c6 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:19.325634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:19.326248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:19.326534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:19.326820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:19.384195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:19.398027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:19.399488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:19.507391 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:15:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:15:19.513239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:19.608035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23383fd-65c7-4370-83a6-05c6415f0a15 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:19.620582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:19.641735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:19.642433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:19.643219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:19.643493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:19.653223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:19.654663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:19.668843 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:19.670026 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:19.671119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:19.671119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:19.671119 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:19.671119 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 626/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:19.675759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:19.760266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:19.772748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5e17c-9e18-4c44-8498-d4f264793a9c None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:19.808739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:19.809369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:19.809651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:19.809925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:19.810564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:19.810869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:19.812233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:19.823855 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 631/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:19.829525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:19.925829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853853b-d0cd-4caf-b5bf-009b70c591e5 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:19.958322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:19.958930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:19.959207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:19.959477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:19.965758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:19.967170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:15:19.978055 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:19.979103 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:19.980374 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 627/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:19.984928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:20.089540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26843a-3df0-4c73-a464-42d2f8873f20 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:20.122566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:20.123163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:20.123442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:20.123715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:20.124400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:20.124706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:20.126154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca602-ab39-414f-9bbc-21f957f9d307 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:20.138234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 632/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:20.144563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:20.169664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:20.243273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d6de2-c636-4b50-8692-fb232b69681c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:20.282123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:20.282785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:20.283570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:20.283847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:20.284749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=eea06fb6c97248549e3253c032e83a0f) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:20.285152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:20.286822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc6ba2-b261-4296-a614-c6fda99c0b19 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:20.293236 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 628/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:15:20 2022] GET /identity/v3/role_assignments?user.id=eea06fb6c97248549e3253c032e83a0f&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=61064a68b37843f5b88e6641075320de => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:22.409095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b309072-b663-438b-b2ad-6b7247b269bd None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:22.409671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b309072-b663-438b-b2ad-6b7247b269bd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:22.409671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b309072-b663-438b-b2ad-6b7247b269bd None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:22.410891 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 633/1261] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:22.415849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:22.416220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:22.416400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:22.434198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:22.435364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:22.499329 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:22.763791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b309072-b663-438b-b2ad-6b7247b269bd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:22.774603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:22.865343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b309072-b663-438b-b2ad-6b7247b269bd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:22.898938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:22.899563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:22.899848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:22.900127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:22.910946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:15:22.915786 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:22.916890 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:22.917782 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 634/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:22.922842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:22.941115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:23.018925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18954d4-4721-4219-afe8-66f4b06cefd0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:23.051482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:23.052072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:23.052352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:23.052622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:23.053303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:23.053607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:23.054954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:23.062625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 630/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:23.068289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:23.133512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:23.166477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d800ed-c5b4-4d79-a331-864a4da258aa None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:23.198357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:23.198967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:23.199244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:23.199511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:23.209842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:23.211268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:23.225112 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:23.226231 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:23.227235 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:23.227235 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:23.227235 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:23.229047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 635/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:23.231776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:23.323730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:23.345086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b387fd-ef2e-45f1-8304-8a26648c98b6 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:23.377449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:23.378043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:23.378324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:23.378599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:23.379234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:23.379538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:23.380920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:23.392130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 631/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:23.398987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:23.500981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44112018-1db6-4b30-97e0-c52ffc3c8734 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:23.520467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:23.535205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:23.535824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:23.536106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:23.536381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:23.543608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:23.545078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:15:23.557038 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:23.558174 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:23.559348 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 636/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:23.563867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:23.660393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940100-cc7e-4395-a4e2-ab03c8235123 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:23.693100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:23.693695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:23.693975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:23.694248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:23.694965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:23.695272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:23.696681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:23.705457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:23.714405 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 632/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 02:15:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:23.720101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:23.815789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a6734-56f0-49ff-9960-1c9a1a35a3d9 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:23.848600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:23.849234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:23.849515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:23.849788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:23.859727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:23.861211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:23.874643 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:23.875572 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:23.876576 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:23.876576 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:23.876576 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:23.876576 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 637/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:23.881318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:23.978824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0a76-b58e-471a-9a42-608ad5133b74 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:24.011289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:24.011884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:24.012167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:24.012442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:24.013110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:24.013420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:24.014781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:24.025722 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 633/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:24.031247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:24.065743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:24.131520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1100aa-84fe-4a80-84a1-db2c72642405 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:24.169337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379585-4f60-410c-86b8-6905789204da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:24.169957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379585-4f60-410c-86b8-6905789204da None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:24.170233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379585-4f60-410c-86b8-6905789204da None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:24.170504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e379585-4f60-410c-86b8-6905789204da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:24.177481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379585-4f60-410c-86b8-6905789204da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:24.178914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e379585-4f60-410c-86b8-6905789204da None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-2e379585-4f60-410c-86b8-6905789204da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:15:24.189700 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:24.190760 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:24.192036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 638/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:24.196601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:24.255232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:24.300381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e70a4-6558-46fa-9607-e848f7cf786a None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:24.333086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:24.333673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:24.333950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:24.334221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:24.334902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:24.335205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:24.336613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3785386-7dc5-4e67-9140-aef5a5465627 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:24.348760 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 634/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:24.354756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379585-4f60-410c-86b8-6905789204da None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:24.443157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:24.452152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e379585-4f60-410c-86b8-6905789204da None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:24.486929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05386137-34dc-473f-9ec1-13556cde5a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:24.487572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05386137-34dc-473f-9ec1-13556cde5a31 None admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:24.487861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05386137-34dc-473f-9ec1-13556cde5a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:24.488129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05386137-34dc-473f-9ec1-13556cde5a31 None admin] PATH_INFO: `/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/eea06fb6c97248549e3253c032e83a0f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:24.489997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05386137-34dc-473f-9ec1-13556cde5a31 None admin] RBAC: Authorizing `identity:create_grant(project_id=5462d68b9a5a4b96b2588d076fce0fb4, user_id=eea06fb6c97248549e3253c032e83a0f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:24.491421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05386137-34dc-473f-9ec1-13556cde5a31 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:24.504160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Oct 5 02:15:24 2022] PUT /identity/v3/projects/5462d68b9a5a4b96b2588d076fce0fb4/users/eea06fb6c97248549e3253c032e83a0f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:15:26.619422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e49d-bcb7-40fc-a192-4a2544af023b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:26.619959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e49d-bcb7-40fc-a192-4a2544af023b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:26.620076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2e49d-bcb7-40fc-a192-4a2544af023b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:26.621377 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 635/1274] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:26.626438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:26.626902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:26.627171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:26.645561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:26.646748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:26.712159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 05 02:15:26.980761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2e49d-bcb7-40fc-a192-4a2544af023b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:27.078656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2e49d-bcb7-40fc-a192-4a2544af023b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:27.096144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:27.112420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:27.113058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:27.113337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:27.113605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:27.123204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 05 02:15:27.128412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:27.129552 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:27.130623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 636/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Oct 5 02:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:27.135628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:27.218574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:27.236509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55ec20-a282-43b9-b43d-a3b9c8921e14 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:27.272843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:27.273462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:27.273738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:27.274041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:27.274737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:27.274990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:27.276582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:27.285503 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 641/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Oct 5 02:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:27.292094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:27.395301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4711c8-d38f-47bc-ac6b-934e5d9c1600 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:27.427928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:27.428541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:27.428818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:27.429119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:27.438668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:27.440620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:27.454587 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:27.456184 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:27.457674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:27.457674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:27.457674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:27.457674 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 637/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:27.462314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:27.563296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2de3e5-c2c8-453b-af93-c2abb421b353 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:27.598035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:27.598638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:27.598922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:27.599199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:27.599837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:27.600141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:27.601526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:27.613014 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 642/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:27.618689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:27.648650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:27.717785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0d410-11d4-47b6-9c08-59eb849fda0f None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:27.749403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:27.750012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:27.750287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:27.750553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:27.758338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:27.759750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:15:27.770951 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:27.772091 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:27.773327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 638/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:27.778018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:27.781732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:27.878056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59861e82-d5f7-4900-9c1d-a65560691918 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:27.916170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:27.916775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:27.917092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:27.917368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:27.918089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:27.918401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:27.919835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:27.936221 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 643/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Oct 5 02:15:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:27.942776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:28.031146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:28.041585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dbf72-4bf9-4598-8d3a-320692ecda55 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:28.078529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:28.079129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:28.079415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:28.080189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:28.145295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:28.146671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:28.238536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:28.248950 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Oct 5 02:15:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 05 02:15:28.255696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:28.319735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:28.357680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acdf0-f2a1-4b75-bcc3-5a564af82594 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:28.389501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:28.390111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:28.390388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:28.390659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:28.401159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:28.402528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:15:28.417054 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:28.418178 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 05 02:15:28.419298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:15:28.419298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 05 02:15:28.419298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:28.419298 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 644/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:28.423933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:28.528725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac492cd5-ed8e-4035-a26b-4726ecec5a32 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:28.561349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:28.561945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:28.562226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:28.562501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:28.563136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:28.563439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:28.565437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:28.576153 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 640/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Oct 5 02:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:28.583072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:28.680455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e59ff-4495-447d-9fa7-dc8a82058915 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:28.694258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:28.714457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:28.715074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:28.715352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:28.715623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:28.722077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:28.723513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 05 02:15:28.734401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:28.735459 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:15:28.736440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 645/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Oct 5 02:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:28.741662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:28.790035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:28.842013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d62e6-1d49-4f14-a123-16827603fce1 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:28.874205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:28.874802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:28.875080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:28.875351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:28.876028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:28.876331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:28.877976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd832a-4bf6-4bb2-91d1-bc46b71a3799 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:28.889280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 641/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Oct 5 02:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:28.895871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:28.991152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb95429-81b4-419c-a434-0ff7985cca03 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:29.023368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:29.023955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:29.024233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:29.024503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:29.025246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] RBAC: Adding query filter params (role.id=61064a68b37843f5b88e6641075320de, scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4, user.id=eea06fb6c97248549e3253c032e83a0f) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:29.025549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:29.026960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6c56-923a-4d44-9e01-e81c8ababb5b None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:29.032400 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 646/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Oct 5 02:15:28 2022] GET /identity/v3/role_assignments?user.id=eea06fb6c97248549e3253c032e83a0f&scope.project.id=5462d68b9a5a4b96b2588d076fce0fb4&role.id=61064a68b37843f5b88e6641075320de => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:31.169429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e49fd-4b7d-4d12-94ec-2ab7d192bf18 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:31.169991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e49fd-4b7d-4d12-94ec-2ab7d192bf18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:31.169991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e49fd-4b7d-4d12-94ec-2ab7d192bf18 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:31.171314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 642/1288] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:31.176643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:31.177075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:31.177233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:31.195137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:31.196319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:31.231459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:31.270572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:31.543328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e49fd-4b7d-4d12-94ec-2ab7d192bf18 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:31.646243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e49fd-4b7d-4d12-94ec-2ab7d192bf18 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:31.656960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:31.680010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:31.680637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:31.680943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:31.681226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:31.681808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:31.683159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:31.692310 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:31.693593 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:31.694771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 643/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:15:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:31.699271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:31.794457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7903ba-7fdc-4383-b703-b93c6d128ba7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:31.827856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:31.828452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:31.828729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:31.829053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:31.829717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:31.830015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:31.831366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709167e0-f9e7-4725-8adf-b1f0f2df5803 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:31.836271 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 648/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 02:15:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:31.841879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:31.937988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c323dc-bd2d-4a34-98a3-f7f89d6ddad7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:31.970285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:31.971026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:31.971308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:31.971582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:31.972194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:31.972497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:31.973860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bfb1c-6fd2-4187-a7a6-c0f1a232a738 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:31.978068 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 644/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 02:15:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:34.122207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53903c60-c006-4af3-ae76-f9d9128cbc39 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:34.122776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53903c60-c006-4af3-ae76-f9d9128cbc39 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:34.122776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53903c60-c006-4af3-ae76-f9d9128cbc39 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:34.124059 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 649/1293] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:34.129542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd30e0b-7765-4b37-8950-cb67e98d45fd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:34.129926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd30e0b-7765-4b37-8950-cb67e98d45fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:34.130104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd30e0b-7765-4b37-8950-cb67e98d45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:34.148672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7bd30e0b-7765-4b37-8950-cb67e98d45fd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:34.149887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7bd30e0b-7765-4b37-8950-cb67e98d45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:34.178409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:34.214331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:34.496740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53903c60-c006-4af3-ae76-f9d9128cbc39 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:34.527911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:34.596709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53903c60-c006-4af3-ae76-f9d9128cbc39 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:34.629579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d89d8b-b6a1-447b-8820-a4323d9cc050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:34.630177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d89d8b-b6a1-447b-8820-a4323d9cc050 None admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:34.630461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d89d8b-b6a1-447b-8820-a4323d9cc050 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:34.630742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d89d8b-b6a1-447b-8820-a4323d9cc050 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:34.631389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d89d8b-b6a1-447b-8820-a4323d9cc050 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:34.632756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d89d8b-b6a1-447b-8820-a4323d9cc050 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:34.647020 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Oct 5 02:15:34 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:15:36.766362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5b7d3-0a6f-4b7e-82cc-350391fd5b7a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:36.767023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5b7d3-0a6f-4b7e-82cc-350391fd5b7a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:36.767023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5b7d3-0a6f-4b7e-82cc-350391fd5b7a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:36.768267 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 646/1296] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:36.773831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:36.774253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:36.774378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:36.792064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:36.793266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:36.864191 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:37.130879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5b7d3-0a6f-4b7e-82cc-350391fd5b7a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:37.231264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5b7d3-0a6f-4b7e-82cc-350391fd5b7a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:37.268483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:37.269313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:37.269467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:37.269764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:37.270454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:37.271973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:37.281687 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:37.282876 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:37.283857 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 647/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:15:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:37.289859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:37.310126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:37.393441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78867ce-c960-4a54-a403-0010a50bebf5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:37.426483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:37.427080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:37.427362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:37.427637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:37.428263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:37.428565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:37.429957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:37.434893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 652/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 02:15:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:15:37.440872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:37.472006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:37.537285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aab1a-a4af-4555-9df0-02cc043ecb9c None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:37.569195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:37.569782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:37.570060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:37.570330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:37.571016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] RBAC: Adding query filter params (interface=public, service_id=b9468adc9ad2473c979cf3db680539f6, region_id=RegionOne) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:37.571322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:37.572669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17111-7501-4027-bfe1-d208646f28a8 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:37.577531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 648/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Oct 5 02:15:37 2022] GET /identity/v3/endpoints?service_id=b9468adc9ad2473c979cf3db680539f6&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:37.583383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:37.661960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:37.680734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745225-cb8c-43e7-afa9-5d47f6c196b1 None admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:37.713172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0e6e1-2fad-41c4-b70d-793fe21fc333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:37.713764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0e6e1-2fad-41c4-b70d-793fe21fc333 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:37.714042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0e6e1-2fad-41c4-b70d-793fe21fc333 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:37.714312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0e6e1-2fad-41c4-b70d-793fe21fc333 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:37.714908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0e6e1-2fad-41c4-b70d-793fe21fc333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:37.716251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0e6e1-2fad-41c4-b70d-793fe21fc333 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:37.723314 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 653/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Oct 5 02:15:37 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:15:39.850791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27a171-2e18-41d3-88d3-c5357fd95752 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:39.851313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27a171-2e18-41d3-88d3-c5357fd95752 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:39.851431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27a171-2e18-41d3-88d3-c5357fd95752 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:39.852679 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 649/1302] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:15:39.857775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:39.858173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:39.858325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:39.875955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:15:39.877671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:15:39.942040 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 654/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:15:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 02:15:40.212679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27a171-2e18-41d3-88d3-c5357fd95752 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:40.307417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:40.314761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27a171-2e18-41d3-88d3-c5357fd95752 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:40.347681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:40.348293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:40.348572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:40.348845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:40.349443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:40.350787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:15:40.359158 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:15:40.360350 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:15:40.361546 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 650/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Oct 5 02:15:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:15:40.366402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:40.439999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:40.462840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3f457-42e2-4797-8261-0c8f6179f129 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:40.496103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:40.496694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:40.497006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:40.497282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:40.497905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:15:40.498207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:40.499561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727148-d5c7-4e0a-bd4e-9eff17d65c13 None admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:40.504681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 655/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Oct 5 02:15:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:15:40.510380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:15:40.606073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29725b4-37d1-4321-878f-82a7c4a4a3f7 None admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:15:40.638272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e01df-0289-4ca6-a1bd-ea21ca997534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:15:40.638852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e01df-0289-4ca6-a1bd-ea21ca997534 None admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:15:40.639131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e01df-0289-4ca6-a1bd-ea21ca997534 None admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:15:40.639399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e01df-0289-4ca6-a1bd-ea21ca997534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:15:40.640047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e01df-0289-4ca6-a1bd-ea21ca997534 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:15:40.641485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e01df-0289-4ca6-a1bd-ea21ca997534 None admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:15:40.661738 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 651/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:15:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:15:50.502429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=30 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:15:50.656837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:45.678710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20445a1-4755-4a9e-8099-7f422f704376 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:45.679168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20445a1-4755-4a9e-8099-7f422f704376 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:45.679251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20445a1-4755-4a9e-8099-7f422f704376 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:45.684539 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 656/1307] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:16:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:16:45.686093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6f4b-5f29-4779-ae81-7ca4e6b37e5b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:45.686894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6f4b-5f29-4779-ae81-7ca4e6b37e5b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:45.687175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6f4b-5f29-4779-ae81-7ca4e6b37e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:45.838775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1e2b6f4b-5f29-4779-ae81-7ca4e6b37e5b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:16:45.840047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e2b6f4b-5f29-4779-ae81-7ca4e6b37e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:45.957268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:16:46.271861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a70ca-76a5-4ff2-8c88-aeacdb14e990 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:46.272499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a70ca-76a5-4ff2-8c88-aeacdb14e990 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:46.273005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a70ca-76a5-4ff2-8c88-aeacdb14e990 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:46.274746 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 657/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 5 02:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:16:46.281465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e7b1-1e8c-4bb7-ae13-6e181247b5e2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:46.281987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e7b1-1e8c-4bb7-ae13-6e181247b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:46.282443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e7b1-1e8c-4bb7-ae13-6e181247b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:46.378215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ddc7e7b1-1e8c-4bb7-ae13-6e181247b5e2 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:16:46.379947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ddc7e7b1-1e8c-4bb7-ae13-6e181247b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:46.403667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:46.474380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 02:16:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:16:46.484957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a70ca-76a5-4ff2-8c88-aeacdb14e990 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:16:46.487694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-742a70ca-76a5-4ff2-8c88-aeacdb14e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:46.628972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a70ca-76a5-4ff2-8c88-aeacdb14e990 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:16:46.727219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:16:46.728656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:46.729176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:46.729678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:46.731631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:46.798614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:46.861697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:16:46.863145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae6b4-1fd2-4fd4-9ee6-db316d2aacb4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:16:46.885347 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 658/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:16:49.382896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d19d-4a52-4019-9523-fa294877709c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:49.383458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d19d-4a52-4019-9523-fa294877709c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:49.383458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85d19d-4a52-4019-9523-fa294877709c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:49.384784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 654/1312] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:16:49.390001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938efe3-18de-45e6-8a97-c239a3d59b9b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:49.390409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938efe3-18de-45e6-8a97-c239a3d59b9b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:49.390594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938efe3-18de-45e6-8a97-c239a3d59b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:49.466181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e938efe3-18de-45e6-8a97-c239a3d59b9b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:16:49.467393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e938efe3-18de-45e6-8a97-c239a3d59b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:49.561828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:16:49.844807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d19d-4a52-4019-9523-fa294877709c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:16:49.846449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb85d19d-4a52-4019-9523-fa294877709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:49.950039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85d19d-4a52-4019-9523-fa294877709c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:16:50.020039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:50.022864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:16:50.023696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:50.024164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:50.024651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:50.026310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:50.136411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:16:50.137792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744f8ce-bcdd-497a-80dc-0d3487d23e1a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:16:50.155053 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 655/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:16:52.599205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614b48-a495-46d7-b1a1-eaf2ffd4c368 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:52.599751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614b48-a495-46d7-b1a1-eaf2ffd4c368 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:52.599751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57614b48-a495-46d7-b1a1-eaf2ffd4c368 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:52.601112 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 660/1315] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:16:52.606463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae73a0-8ec5-42e2-ac5b-e37d9043c5b5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:52.606889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae73a0-8ec5-42e2-ac5b-e37d9043c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:52.607018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae73a0-8ec5-42e2-ac5b-e37d9043c5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:52.671400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-23ae73a0-8ec5-42e2-ac5b-e37d9043c5b5 None None] MFA Rules not processed for user `0d2eaab00594469bb62d452f4b394f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:16:52.672677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23ae73a0-8ec5-42e2-ac5b-e37d9043c5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:52.723419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:52.769768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:16:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:16:53.067804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e352-48b2-47b0-bfba-cc7bc86be96d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:53.068092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e352-48b2-47b0-bfba-cc7bc86be96d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:53.068368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e352-48b2-47b0-bfba-cc7bc86be96d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:53.069722 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 661/1317] 10.222.0.16 () {54 vars in 964 bytes} [Wed Oct 5 02:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:16:53.075242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041cf3-af5e-4996-a5b7-7fd11c8ec21e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:53.075531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041cf3-af5e-4996-a5b7-7fd11c8ec21e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:53.075806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041cf3-af5e-4996-a5b7-7fd11c8ec21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:53.150841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1e041cf3-af5e-4996-a5b7-7fd11c8ec21e None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:16:53.152028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e041cf3-af5e-4996-a5b7-7fd11c8ec21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:53.225347 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 657/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 02:16:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:16:53.234482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1e352-48b2-47b0-bfba-cc7bc86be96d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:16:53.236718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a4c1e352-48b2-47b0-bfba-cc7bc86be96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:53.246237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:53.338115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1e352-48b2-47b0-bfba-cc7bc86be96d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:16:53.410348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:16:53.410948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:53.411228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:53.411501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:53.413106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:53.475388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:53.522359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:16:53.523793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0534b0-f53b-4efa-8296-a879baa09c36 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:16:53.541857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 662/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:16:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:16:56.573783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547616-0c38-4683-93f8-461fe4dcf055 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:56.574329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547616-0c38-4683-93f8-461fe4dcf055 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:56.574329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547616-0c38-4683-93f8-461fe4dcf055 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:56.575669 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 658/1320] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:16:56.580815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12430b-75d0-45d6-9202-08c9102c09d7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:56.581261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12430b-75d0-45d6-9202-08c9102c09d7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:56.581406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12430b-75d0-45d6-9202-08c9102c09d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:56.645214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e12430b-75d0-45d6-9202-08c9102c09d7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:16:56.646392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e12430b-75d0-45d6-9202-08c9102c09d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:56.739820 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 663/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:16:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:16:57.022093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547616-0c38-4683-93f8-461fe4dcf055 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:16:57.023652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-76547616-0c38-4683-93f8-461fe4dcf055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:57.073155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:57.126560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547616-0c38-4683-93f8-461fe4dcf055 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:16:57.198100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:16:57.198704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:16:57.198983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:16:57.199254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:16:57.200827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:16:57.295706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:16:57.309112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:16:57.310545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b990dc8-60ea-40aa-8ea4-737109cdb43d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:16:57.328172 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 659/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:16:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:00.208121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ec99b-1f70-40ab-9cbf-1b442c7f12bc None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:00.208771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ec99b-1f70-40ab-9cbf-1b442c7f12bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:00.208771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ec99b-1f70-40ab-9cbf-1b442c7f12bc None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:00.210506 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 664/1323] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:00.218010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f436c01-609a-49e0-a284-d7d90b8cea42 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:00.218540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f436c01-609a-49e0-a284-d7d90b8cea42 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:00.218540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f436c01-609a-49e0-a284-d7d90b8cea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:00.292514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5f436c01-609a-49e0-a284-d7d90b8cea42 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:00.293878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f436c01-609a-49e0-a284-d7d90b8cea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:00.397287 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 660/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:00.680098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ec99b-1f70-40ab-9cbf-1b442c7f12bc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:00.681732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9f4ec99b-1f70-40ab-9cbf-1b442c7f12bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:00.701752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:00.787496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ec99b-1f70-40ab-9cbf-1b442c7f12bc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:00.862038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:00.862657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:00.862937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:00.863209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:00.864826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:00.937934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:00.976406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:00.977867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f490-2ae7-4526-b614-a0a9b7003c40 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:00.997141 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 665/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:03.199070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc468f89-9e6c-4729-b42c-51aeaa7b1a80 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:03.199665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc468f89-9e6c-4729-b42c-51aeaa7b1a80 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:03.199665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc468f89-9e6c-4729-b42c-51aeaa7b1a80 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:03.201111 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 661/1326] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:03.206635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21128f-e432-4bb5-89ec-c35e3d7efc02 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:03.207037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21128f-e432-4bb5-89ec-c35e3d7efc02 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:03.207193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21128f-e432-4bb5-89ec-c35e3d7efc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:03.276847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4f21128f-e432-4bb5-89ec-c35e3d7efc02 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:03.278088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f21128f-e432-4bb5-89ec-c35e3d7efc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:03.382072 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 666/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:03.664315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc468f89-9e6c-4729-b42c-51aeaa7b1a80 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:03.665960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bc468f89-9e6c-4729-b42c-51aeaa7b1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:03.726953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:03.771392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc468f89-9e6c-4729-b42c-51aeaa7b1a80 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:03.847761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:03.848368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:03.848647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:03.848941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:03.850528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:03.966742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:03.969286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:03.970828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da61b0c-844a-4612-a354-6c63931cb3f9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:03.989873 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 662/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:06.205844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d70cc-08f4-499c-8ddb-19f3a108cc73 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:06.206450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d70cc-08f4-499c-8ddb-19f3a108cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:06.206565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d70cc-08f4-499c-8ddb-19f3a108cc73 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:06.207826 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 667/1329] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:06.213476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7148-289c-4727-b257-a57ffe984069 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:06.213910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7148-289c-4727-b257-a57ffe984069 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:06.214007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7148-289c-4727-b257-a57ffe984069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:06.280383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4eef7148-289c-4727-b257-a57ffe984069 None None] MFA Rules not processed for user `0d2eaab00594469bb62d452f4b394f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:06.281533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4eef7148-289c-4727-b257-a57ffe984069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:06.377645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 663/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:06.670993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d70cc-08f4-499c-8ddb-19f3a108cc73 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:06.672981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b21d70cc-08f4-499c-8ddb-19f3a108cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:06.706964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:06.783333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d70cc-08f4-499c-8ddb-19f3a108cc73 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:06.861126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:06.861760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:06.862039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:06.862310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:06.863900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:06.943496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:06.976220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:06.977695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007e69f-70bb-4e6f-b9bc-03e977cfb5d4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:06.996073 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 668/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:09.382886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06060e76-fcd9-4dd6-8cfb-cb3d6d048194 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:09.383464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06060e76-fcd9-4dd6-8cfb-cb3d6d048194 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:09.383464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06060e76-fcd9-4dd6-8cfb-cb3d6d048194 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:09.384771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 664/1332] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:09.389967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dc2f-9327-4e51-86eb-313623e3cf57 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:09.390350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dc2f-9327-4e51-86eb-313623e3cf57 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:09.390542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dc2f-9327-4e51-86eb-313623e3cf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:09.456117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bce6dc2f-9327-4e51-86eb-313623e3cf57 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:09.457381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bce6dc2f-9327-4e51-86eb-313623e3cf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:09.556226 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 669/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:09.836790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06060e76-fcd9-4dd6-8cfb-cb3d6d048194 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:09.838411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06060e76-fcd9-4dd6-8cfb-cb3d6d048194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:09.907655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:09.942074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06060e76-fcd9-4dd6-8cfb-cb3d6d048194 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:10.013541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:10.014145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:10.014429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:10.014706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:10.016862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:10.126547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:10.127977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e752b-f863-43ed-b197-44cb97740780 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:10.139751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:10.148641 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 665/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:12.332377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd6a8-3446-4d1e-b005-3d066703e632 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:12.332964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd6a8-3446-4d1e-b005-3d066703e632 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:12.332964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cd6a8-3446-4d1e-b005-3d066703e632 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:12.334532 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 670/1335] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:12.339736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd615-96cf-4771-b583-657fe2972389 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:12.340159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd615-96cf-4771-b583-657fe2972389 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:12.340291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd615-96cf-4771-b583-657fe2972389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:12.405335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fa9cd615-96cf-4771-b583-657fe2972389 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:12.406443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fa9cd615-96cf-4771-b583-657fe2972389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:12.501469 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 666/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:17:12.785542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd6a8-3446-4d1e-b005-3d066703e632 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:12.787129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6a2cd6a8-3446-4d1e-b005-3d066703e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:12.826784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:12.890323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cd6a8-3446-4d1e-b005-3d066703e632 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:12.964763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:12.965314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:12.965599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:12.965880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:12.967483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:13.051181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:13.077088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:13.078578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21883b99-499c-4115-b21d-ebd2cf5fc224 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:13.097247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 671/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:15.682205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815d33-ea8e-4e65-a681-ba0b1c6d5037 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:15.682733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815d33-ea8e-4e65-a681-ba0b1c6d5037 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:15.682845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815d33-ea8e-4e65-a681-ba0b1c6d5037 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:15.684106 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 667/1338] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:15.689333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf7496-df1d-4115-a534-b2f3ce61e5a5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:15.689747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf7496-df1d-4115-a534-b2f3ce61e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:15.689921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf7496-df1d-4115-a534-b2f3ce61e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:15.756832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2fcf7496-df1d-4115-a534-b2f3ce61e5a5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:15.758074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2fcf7496-df1d-4115-a534-b2f3ce61e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:15.852283 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:16.132786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815d33-ea8e-4e65-a681-ba0b1c6d5037 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:16.134346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff815d33-ea8e-4e65-a681-ba0b1c6d5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:16.209918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:16.237830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815d33-ea8e-4e65-a681-ba0b1c6d5037 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:16.318711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:16.319317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:16.319597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:16.319868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:16.321476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:16.428535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:16.429914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3a87a-b26e-4e49-9326-910b21a6a533 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:16.447894 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 668/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:20.597451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed2df1-8c9e-47a9-b804-e27ffa7d5a36 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:20.598016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed2df1-8c9e-47a9-b804-e27ffa7d5a36 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:20.598434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed2df1-8c9e-47a9-b804-e27ffa7d5a36 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:20.600852 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 673/1341] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:20.607852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63830e33-4eef-4511-ba9e-77547fee743b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:20.608322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63830e33-4eef-4511-ba9e-77547fee743b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:20.608438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63830e33-4eef-4511-ba9e-77547fee743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:20.615926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:20.685084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-63830e33-4eef-4511-ba9e-77547fee743b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:20.686304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-63830e33-4eef-4511-ba9e-77547fee743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:20.785892 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 669/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:21.072287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed2df1-8c9e-47a9-b804-e27ffa7d5a36 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:21.073864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d1ed2df1-8c9e-47a9-b804-e27ffa7d5a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:21.123760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:21.180665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed2df1-8c9e-47a9-b804-e27ffa7d5a36 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:21.254460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:21.255069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:21.255353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:21.255630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:21.257262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:21.352604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:21.369271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:21.370713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227ea2d-7fcf-44df-b9bb-da33e7ba18c9 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:21.388765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 674/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:24.154049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786aac-d871-490e-9705-59d4cbc25a50 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:24.154579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786aac-d871-490e-9705-59d4cbc25a50 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:24.154579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786aac-d871-490e-9705-59d4cbc25a50 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:24.155916 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 670/1344] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:24.161453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076455-41e6-428d-87ca-93a83925e98f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:24.161886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076455-41e6-428d-87ca-93a83925e98f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:24.162012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076455-41e6-428d-87ca-93a83925e98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:24.229758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f5076455-41e6-428d-87ca-93a83925e98f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:24.230961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5076455-41e6-428d-87ca-93a83925e98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:24.332272 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:24.618849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786aac-d871-490e-9705-59d4cbc25a50 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:24.620388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a786aac-d871-490e-9705-59d4cbc25a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:24.715489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:24.734289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786aac-d871-490e-9705-59d4cbc25a50 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:24.816530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:24.817170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:24.817452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:24.817726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:24.819306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:24.928388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:24.929788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdea9a4-4362-46eb-8109-6fd7d5d71d74 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:24.947386 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:29.145707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94442f2-65b8-49ff-bc2b-bf5f298d8678 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:29.146278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94442f2-65b8-49ff-bc2b-bf5f298d8678 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:29.146278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94442f2-65b8-49ff-bc2b-bf5f298d8678 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:29.147588 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 676/1347] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:29.153095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fbf8-e780-49a1-add7-b79e1288eeb0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:29.153536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fbf8-e780-49a1-add7-b79e1288eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:29.153643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fbf8-e780-49a1-add7-b79e1288eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:29.170565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:29.223780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f067fbf8-e780-49a1-add7-b79e1288eeb0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:29.225031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f067fbf8-e780-49a1-add7-b79e1288eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:29.324728 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 672/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:29.608148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94442f2-65b8-49ff-bc2b-bf5f298d8678 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:29.609741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e94442f2-65b8-49ff-bc2b-bf5f298d8678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:29.670997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:29.718355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94442f2-65b8-49ff-bc2b-bf5f298d8678 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:29.789831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:29.790435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:29.790712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:29.790982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:29.792550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:29.896528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:29.900401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:29.901866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6f652-6915-443e-9a5a-078c3582c56f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:29.919816 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 677/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:34.877319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626e290-60b1-465c-be23-3e5c0e1a3b88 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:34.877797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626e290-60b1-465c-be23-3e5c0e1a3b88 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:34.877894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626e290-60b1-465c-be23-3e5c0e1a3b88 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:34.879690 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 673/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:34.884719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ac569-cf23-4d8c-b31f-de58894531e3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:34.885161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ac569-cf23-4d8c-b31f-de58894531e3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:34.885291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ac569-cf23-4d8c-b31f-de58894531e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:35.036781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8b6ac569-cf23-4d8c-b31f-de58894531e3 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:35.039586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b6ac569-cf23-4d8c-b31f-de58894531e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:35.192015 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 678/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:17:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:39.247326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dfbc9-e1dc-46b7-bec2-a9daf170d765 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:39.247911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dfbc9-e1dc-46b7-bec2-a9daf170d765 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:39.247911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dfbc9-e1dc-46b7-bec2-a9daf170d765 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:39.249538 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 674/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:39.255075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0cbe-9d15-46ac-9d8d-5b5d3195977a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:39.255947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0cbe-9d15-46ac-9d8d-5b5d3195977a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:39.256440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0cbe-9d15-46ac-9d8d-5b5d3195977a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:39.316330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:39.323162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=59 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:39.343808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e72c0cbe-9d15-46ac-9d8d-5b5d3195977a None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:39.345181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e72c0cbe-9d15-46ac-9d8d-5b5d3195977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:39.467096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 679/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:17:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:40.890225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979df86-fb02-49b0-84fd-09e7a2930542 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:40.891247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979df86-fb02-49b0-84fd-09e7a2930542 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:40.891409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979df86-fb02-49b0-84fd-09e7a2930542 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:40.892944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 675/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:40.897834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449613-dde7-46e4-946c-21181e718283 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:40.898245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449613-dde7-46e4-946c-21181e718283 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:40.898382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab449613-dde7-46e4-946c-21181e718283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:40.976796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ab449613-dde7-46e4-946c-21181e718283 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:40.977936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab449613-dde7-46e4-946c-21181e718283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:41.023064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:41.094485 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 680/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:17:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:44.751615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e00ff-ee76-4efe-8283-cbe643c98d56 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:44.752140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e00ff-ee76-4efe-8283-cbe643c98d56 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:44.752252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e00ff-ee76-4efe-8283-cbe643c98d56 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:44.753607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 676/1356] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:44.759013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dadac-833c-4481-8a69-7ffc1b3edd15 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:44.759410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dadac-833c-4481-8a69-7ffc1b3edd15 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:44.759566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dadac-833c-4481-8a69-7ffc1b3edd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:44.837726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6c2dadac-833c-4481-8a69-7ffc1b3edd15 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:44.838876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c2dadac-833c-4481-8a69-7ffc1b3edd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:44.944939 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 681/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:45.244934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa385f0-638e-49ef-b32d-5ab75271dce6 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:45.245338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa385f0-638e-49ef-b32d-5ab75271dce6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:45.245626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa385f0-638e-49ef-b32d-5ab75271dce6 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:45.248494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 677/1358] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 02:17:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:45.257940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7093-4a0b-40f0-9d18-a95349e37238 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:45.258286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7093-4a0b-40f0-9d18-a95349e37238 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:45.258515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7093-4a0b-40f0-9d18-a95349e37238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:45.281686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:45.346016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a73c7093-4a0b-40f0-9d18-a95349e37238 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:45.347369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a73c7093-4a0b-40f0-9d18-a95349e37238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:45.476545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 682/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 02:17:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:17:45.484862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa385f0-638e-49ef-b32d-5ab75271dce6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:45.486507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9aa385f0-638e-49ef-b32d-5ab75271dce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:45.638204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa385f0-638e-49ef-b32d-5ab75271dce6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:45.716549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:45.764123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:45.764914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:45.765398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:45.766218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:45.767777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:45.868140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:45.870179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959f091-99ec-4f69-943f-a441c78cc86a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:45.891502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 678/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:48.279521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e57ec-7ed2-457f-a21d-7b85c62cdd59 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:48.280080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e57ec-7ed2-457f-a21d-7b85c62cdd59 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:48.280080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e57ec-7ed2-457f-a21d-7b85c62cdd59 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:48.281701 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 683/1361] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:48.286732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbff23-3668-40b3-b805-20c3e5f680ce None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:48.287173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbff23-3668-40b3-b805-20c3e5f680ce None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:48.287285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbff23-3668-40b3-b805-20c3e5f680ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:48.356633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0dfbff23-3668-40b3-b805-20c3e5f680ce None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:48.357231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0dfbff23-3668-40b3-b805-20c3e5f680ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:48.398085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:48.460698 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 679/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:48.752073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e57ec-7ed2-457f-a21d-7b85c62cdd59 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:48.753678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-230e57ec-7ed2-457f-a21d-7b85c62cdd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:48.823620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:48.917857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e57ec-7ed2-457f-a21d-7b85c62cdd59 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:49.058480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:49.059170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:49.059457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:49.059733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:49.061343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:49.084711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:49.156178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:49.157817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97adb8a-61ce-4a7d-833d-27d2cc7f0f4d service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:49.177887 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 684/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:51.701924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66aa48-14c1-4de9-b8b7-2831b117c8f3 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:51.703119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66aa48-14c1-4de9-b8b7-2831b117c8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:51.703648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66aa48-14c1-4de9-b8b7-2831b117c8f3 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:51.705268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 680/1364] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:51.710811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fdc10-221e-45df-976b-f4292c859324 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:51.711262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fdc10-221e-45df-976b-f4292c859324 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:51.711359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fdc10-221e-45df-976b-f4292c859324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:51.783202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-454fdc10-221e-45df-976b-f4292c859324 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:51.784715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-454fdc10-221e-45df-976b-f4292c859324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:51.903789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:51.913383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 685/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:52.211963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823486d-5b39-4c32-97b2-adfe598a6ff1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:52.212252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823486d-5b39-4c32-97b2-adfe598a6ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:52.212531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823486d-5b39-4c32-97b2-adfe598a6ff1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:52.214159 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 681/1366] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 02:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:52.219688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03437563-8623-4271-8f09-6ffd6526beac None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:52.219980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03437563-8623-4271-8f09-6ffd6526beac None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:52.220315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03437563-8623-4271-8f09-6ffd6526beac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:52.307712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-03437563-8623-4271-8f09-6ffd6526beac None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:52.308998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-03437563-8623-4271-8f09-6ffd6526beac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:52.470220 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 686/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 02:17:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:52.479621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823486d-5b39-4c32-97b2-adfe598a6ff1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:52.481366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8823486d-5b39-4c32-97b2-adfe598a6ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:52.682451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823486d-5b39-4c32-97b2-adfe598a6ff1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:52.709891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:52.836496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:52.837142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:52.837425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:52.837702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:52.839711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:52.965101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:52.966962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20eec4d-d636-4a2c-802d-22e021ff0798 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:52.991828 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 682/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:55.550402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ce71-f4ba-4f0f-bf0b-926b98cff9c5 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:55.550939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ce71-f4ba-4f0f-bf0b-926b98cff9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:55.550939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ce71-f4ba-4f0f-bf0b-926b98cff9c5 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:55.552421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 687/1369] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:55.557804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba01b5-e94a-4995-bf47-37d87f75e01a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:55.558576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba01b5-e94a-4995-bf47-37d87f75e01a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:55.559038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba01b5-e94a-4995-bf47-37d87f75e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:55.629317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:55.632843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5fba01b5-e94a-4995-bf47-37d87f75e01a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:55.634432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5fba01b5-e94a-4995-bf47-37d87f75e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:55.786920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 683/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:56.132210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ce71-f4ba-4f0f-bf0b-926b98cff9c5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:56.134168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1b39ce71-f4ba-4f0f-bf0b-926b98cff9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:56.283410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:56.414089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ce71-f4ba-4f0f-bf0b-926b98cff9c5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:56.544126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:56.544959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:56.545350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:56.545732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:56.548496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:56.559059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:56.648048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:56.652258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8392927-607c-422f-8fa8-5930fd4489a2 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:56.673602 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 688/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:56.766572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1009103-6205-465d-9b1c-48fd3b074908 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:56.767131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1009103-6205-465d-9b1c-48fd3b074908 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:56.767131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1009103-6205-465d-9b1c-48fd3b074908 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:56.768550 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 684/1372] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:56.775010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740b446-a79a-45d3-9e22-6113d8331edd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:56.775548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740b446-a79a-45d3-9e22-6113d8331edd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:56.776138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740b446-a79a-45d3-9e22-6113d8331edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:56.859314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c740b446-a79a-45d3-9e22-6113d8331edd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:56.860553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c740b446-a79a-45d3-9e22-6113d8331edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:56.957558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:56.988476 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 689/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:57.324498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2b442-bc94-47bd-a7ae-4e615c3883d7 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:57.324498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2b442-bc94-47bd-a7ae-4e615c3883d7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:57.324498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2b442-bc94-47bd-a7ae-4e615c3883d7 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:57.327206 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 685/1374] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 5 02:17:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:57.331965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a324d-4759-43f2-8a6f-0fefdef520f9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:57.332361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a324d-4759-43f2-8a6f-0fefdef520f9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:57.332708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a324d-4759-43f2-8a6f-0fefdef520f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:57.415418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-619a324d-4759-43f2-8a6f-0fefdef520f9 None None] MFA Rules not processed for user `b074e2c621494cdfa6efc21e4a5c021b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:57.416539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-619a324d-4759-43f2-8a6f-0fefdef520f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:57.500958 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 690/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 5 02:17:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:57.508529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2b442-bc94-47bd-a7ae-4e615c3883d7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:57.510370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bdd2b442-bc94-47bd-a7ae-4e615c3883d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:57.622670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2b442-bc94-47bd-a7ae-4e615c3883d7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:57.627473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:57.710564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:57.711099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:57.711377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:57.711648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:57.713287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:57.831366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:57.832873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391a53e-0b49-4ec0-a5b1-bdd07f54347a service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:57.852371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 686/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:17:58.918246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2182-d879-447f-8c3d-225310c0e5b9 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:58.918805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2182-d879-447f-8c3d-225310c0e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:58.918805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c2182-d879-447f-8c3d-225310c0e5b9 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:58.922974 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 691/1377] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:17:58.925940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c5611-e2ae-44aa-b4cc-7c9e1b769b7a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:58.926523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c5611-e2ae-44aa-b4cc-7c9e1b769b7a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:58.926523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c5611-e2ae-44aa-b4cc-7c9e1b769b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:58.971497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:58.994113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-399c5611-e2ae-44aa-b4cc-7c9e1b769b7a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:17:58.995325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-399c5611-e2ae-44aa-b4cc-7c9e1b769b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:59.099096 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 687/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:17:59.389819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2182-d879-447f-8c3d-225310c0e5b9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:17:59.391629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c5c2182-d879-447f-8c3d-225310c0e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:59.493979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:59.569963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c2182-d879-447f-8c3d-225310c0e5b9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:17:59.696750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:17:59.697423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:17:59.697714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:17:59.697993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:17:59.699682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:17:59.750680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:17:59.812596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:17:59.814263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd8219-597e-4cf7-95e1-ae2deec8750f service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:17:59.835019 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 692/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:02.167414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5e27-2410-480b-980c-e7b05957a763 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:02.168298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5e27-2410-480b-980c-e7b05957a763 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:02.168735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5e27-2410-480b-980c-e7b05957a763 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:02.175877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178714d-fb7e-4ac1-9b87-92a20f254313 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:02.176712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178714d-fb7e-4ac1-9b87-92a20f254313 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:02.177185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178714d-fb7e-4ac1-9b87-92a20f254313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:02.181667 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 688/1380] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:02.252272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d178714d-fb7e-4ac1-9b87-92a20f254313 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:02.253508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d178714d-fb7e-4ac1-9b87-92a20f254313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:02.364712 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 693/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:02.668916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5e27-2410-480b-980c-e7b05957a763 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:02.670452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3bd5e27-2410-480b-980c-e7b05957a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:02.795119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:02.838128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5e27-2410-480b-980c-e7b05957a763 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:02.957650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:02.958266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:02.958552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:02.958827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:02.960667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:03.043172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:03.061986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:03.063728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e916b-33eb-4312-8c6b-841e2f9f838d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:03.082951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 689/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:05.382047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b284cd-463e-4d81-9b75-9a675f230557 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:05.382587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b284cd-463e-4d81-9b75-9a675f230557 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:05.382587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b284cd-463e-4d81-9b75-9a675f230557 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:05.384066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 694/1383] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:05.389201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6354e7-e1bd-46ee-b89a-45935d7bd405 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:05.389608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6354e7-e1bd-46ee-b89a-45935d7bd405 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:05.389808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6354e7-e1bd-46ee-b89a-45935d7bd405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:05.458809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5c6354e7-e1bd-46ee-b89a-45935d7bd405 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:05.460009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5c6354e7-e1bd-46ee-b89a-45935d7bd405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:05.564688 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 690/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:05.860311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b284cd-463e-4d81-9b75-9a675f230557 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:05.862018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62b284cd-463e-4d81-9b75-9a675f230557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:05.884469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:06.021325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b284cd-463e-4d81-9b75-9a675f230557 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:06.139866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:06.163729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:06.164351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:06.164651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:06.164945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:06.166593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:06.269611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:06.271824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fbec5-e6b7-483f-966c-dbef801eb9ea service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:06.294836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 695/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:08.932077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e8bf8-1786-4f13-8f5e-75b152152e35 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:08.932755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e8bf8-1786-4f13-8f5e-75b152152e35 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:08.932755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e8bf8-1786-4f13-8f5e-75b152152e35 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:08.933993 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 691/1386] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:08.939934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b755-1c49-4512-9166-41061bc17cee None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:08.940496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b755-1c49-4512-9166-41061bc17cee None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:08.940496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1b755-1c49-4512-9166-41061bc17cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:09.016717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98d1b755-1c49-4512-9166-41061bc17cee None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:09.018006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98d1b755-1c49-4512-9166-41061bc17cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:09.072104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:09.121098 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:09.429688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e8bf8-1786-4f13-8f5e-75b152152e35 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:09.431264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-374e8bf8-1786-4f13-8f5e-75b152152e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:09.505254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:09.605230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e8bf8-1786-4f13-8f5e-75b152152e35 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:09.733190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:09.734245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:09.734601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:09.735020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:09.737135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:09.755601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:09.842702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:09.844392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f917c3-28d3-49a2-a97d-4fd898f99197 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:09.862561 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 692/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:12.139225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609c589-af34-408d-899b-a162ad6ba5ef None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:12.140460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609c589-af34-408d-899b-a162ad6ba5ef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:12.140460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609c589-af34-408d-899b-a162ad6ba5ef None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:12.142572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 697/1389] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:12.148462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5c5f-a729-4ff6-a6ca-47971eb1b8cc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:12.148925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5c5f-a729-4ff6-a6ca-47971eb1b8cc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:12.149211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e5c5f-a729-4ff6-a6ca-47971eb1b8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:12.216209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cf5e5c5f-a729-4ff6-a6ca-47971eb1b8cc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:12.217473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf5e5c5f-a729-4ff6-a6ca-47971eb1b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:12.307939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:12.319930 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:12.610350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609c589-af34-408d-899b-a162ad6ba5ef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:12.611852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9609c589-af34-408d-899b-a162ad6ba5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:12.761109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609c589-af34-408d-899b-a162ad6ba5ef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:12.804252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:12.884845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:12.885729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:12.886006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:12.886277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:12.887874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:12.982817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:12.984570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa541c-aaf8-4e9a-bee4-b817c0e13491 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:13.003013 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 698/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:13.563065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6f04-8083-4fd0-b43c-12b1da3490c2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:13.563651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6f04-8083-4fd0-b43c-12b1da3490c2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:13.563651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6f04-8083-4fd0-b43c-12b1da3490c2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:13.565056 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 694/1392] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:13.570828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb85bb-fb09-4938-add8-9bdb49d7a564 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:13.570828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb85bb-fb09-4938-add8-9bdb49d7a564 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:13.571391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb85bb-fb09-4938-add8-9bdb49d7a564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:13.623567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:13.637422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4ccb85bb-fb09-4938-add8-9bdb49d7a564 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:13.638616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ccb85bb-fb09-4938-add8-9bdb49d7a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:13.739466 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 699/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:18:14.044570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5176-9f39-4c0d-bbba-67a887c32d92 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:14.044959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5176-9f39-4c0d-bbba-67a887c32d92 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:14.045305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5176-9f39-4c0d-bbba-67a887c32d92 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:14.047265 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 695/1394] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 5 02:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:14.052577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883e81-ed5f-4ce2-9e48-ff8b4e7b3cd3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:14.052870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883e81-ed5f-4ce2-9e48-ff8b4e7b3cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:14.053217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34883e81-ed5f-4ce2-9e48-ff8b4e7b3cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:14.130234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-34883e81-ed5f-4ce2-9e48-ff8b4e7b3cd3 None None] MFA Rules not processed for user `c7ebd0b9ab9a48f0a5505863a7d729e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:14.131422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-34883e81-ed5f-4ce2-9e48-ff8b4e7b3cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:14.195913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:14.208516 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 700/1395] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 5 02:18:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:18:14.217791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5176-9f39-4c0d-bbba-67a887c32d92 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:14.219863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f4f5176-9f39-4c0d-bbba-67a887c32d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:14.323437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5176-9f39-4c0d-bbba-67a887c32d92 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:14.396785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:14.397511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:14.397799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:14.398070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:14.399643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:14.445146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:14.516123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:14.517623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a8e52-2bff-43de-abd4-de3128bf390d service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:14.536406 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 696/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:15.215287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370914-8f3f-4f99-9a98-40f89d1897f7 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:15.215825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370914-8f3f-4f99-9a98-40f89d1897f7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:15.215825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370914-8f3f-4f99-9a98-40f89d1897f7 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:15.217104 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 701/1397] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:15.222339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb80e7-cfc7-4970-877a-fc327de5847f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:15.222786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb80e7-cfc7-4970-877a-fc327de5847f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:15.222890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb80e7-cfc7-4970-877a-fc327de5847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:15.292736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-84fb80e7-cfc7-4970-877a-fc327de5847f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:15.294008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84fb80e7-cfc7-4970-877a-fc327de5847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:15.309689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a9e2-fe6f-4324-8197-e8abae218d09 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:15.310119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a9e2-fe6f-4324-8197-e8abae218d09 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:15.310406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2a9e2-fe6f-4324-8197-e8abae218d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:15.381686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d4f2a9e2-fe6f-4324-8197-e8abae218d09 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:15.382908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4f2a9e2-fe6f-4324-8197-e8abae218d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:15.394687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:15.397366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 697/1398] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:15.520176 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 702/1399] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:18:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:18:15.563203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899703-cda8-4e44-920c-d43b4b65421b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:15.563493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899703-cda8-4e44-920c-d43b4b65421b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:15.563775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f899703-cda8-4e44-920c-d43b4b65421b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:15.565177 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 698/1400] 10.222.0.16 () {54 vars in 943 bytes} [Wed Oct 5 02:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:15.571399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:15.571758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:15.572122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:15.648639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] MFA Rules not processed for user `4c0d9417ce05468695abebca3b0abde3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:15.649871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:15.671664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:15.727378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f899703-cda8-4e44-920c-d43b4b65421b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:15.729009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f899703-cda8-4e44-920c-d43b4b65421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:15.761796 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 703/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Oct 5 02:18:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:15.772760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:15.782351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d0a6f-89fc-4341-aba1-9f85890310b8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:15.891869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:15.892110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f899703-cda8-4e44-920c-d43b4b65421b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:15.892475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:15.892757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:15.893080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:15.894722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:15.922920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:15.966631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:15.982524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:15.984117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56edf9f-6bba-4681-b9c6-4711e6fa022f service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:15.992111 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 704/1402] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:18:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:18:16.008563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:16.009085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:16.009361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:16.009632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:16.011226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:16.109956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:16.111709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033896e-dbdb-4058-a913-a296d873a24b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:16.132609 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 699/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:18:18.371290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8810f5-f290-4bfa-ace8-15839a62d1bc None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:18.371832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8810f5-f290-4bfa-ace8-15839a62d1bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:18.371832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8810f5-f290-4bfa-ace8-15839a62d1bc None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:18.373326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 705/1404] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:18.379049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d350-6e32-49f7-b7d5-8606ba8b4256 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:18.379488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d350-6e32-49f7-b7d5-8606ba8b4256 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:18.379583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d350-6e32-49f7-b7d5-8606ba8b4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:18.454161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9860d350-6e32-49f7-b7d5-8606ba8b4256 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:18.455454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9860d350-6e32-49f7-b7d5-8606ba8b4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:18.497853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:18.585939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 700/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:18.882392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8810f5-f290-4bfa-ace8-15839a62d1bc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:18.884277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b8810f5-f290-4bfa-ace8-15839a62d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:19.044935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8810f5-f290-4bfa-ace8-15839a62d1bc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:19.066929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:19.170700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:19.172411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:19.172699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:19.173004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:19.174665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:19.285100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:19.286820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72717250-9492-4ed5-b340-5f60e9090055 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:19.308068 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 706/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:18:21.538202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c867d2-9f20-4f34-ac15-a082da01bb06 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:21.539307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c867d2-9f20-4f34-ac15-a082da01bb06 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:21.539651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c867d2-9f20-4f34-ac15-a082da01bb06 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:21.541472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 701/1407] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:21.547090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1a499-4e1a-46f4-bbca-4af46bec3c67 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:21.547526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1a499-4e1a-46f4-bbca-4af46bec3c67 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:21.547630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1a499-4e1a-46f4-bbca-4af46bec3c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:21.584838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:21.627142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5ad1a499-4e1a-46f4-bbca-4af46bec3c67 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:21.628365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5ad1a499-4e1a-46f4-bbca-4af46bec3c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:21.738764 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 707/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:22.029142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c867d2-9f20-4f34-ac15-a082da01bb06 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:22.030826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74c867d2-9f20-4f34-ac15-a082da01bb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:22.195818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c867d2-9f20-4f34-ac15-a082da01bb06 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:22.219131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:22.325518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:22.326131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:22.326413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:22.326690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:22.328331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:22.431280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:22.433090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6e352-547f-42ee-94de-cbe1d69b1e26 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:22.453981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 702/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:31.737230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=54 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:32.450820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:39.648856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f245f6-d0e9-4adb-a7f6-386cfe5c30c4 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:39.649427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f245f6-d0e9-4adb-a7f6-386cfe5c30c4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:39.649521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f245f6-d0e9-4adb-a7f6-386cfe5c30c4 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:39.650796 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 708/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 5 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:39.656680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0476b9-6661-49f7-a019-d5d9e69966c4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:39.657172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0476b9-6661-49f7-a019-d5d9e69966c4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:39.657282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0476b9-6661-49f7-a019-d5d9e69966c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:39.731622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1c0476b9-6661-49f7-a019-d5d9e69966c4 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:39.732832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c0476b9-6661-49f7-a019-d5d9e69966c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:39.837756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 703/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 5 02:18:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:39.852480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac205d-55aa-434b-80cd-a29832bcd6ca None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:39.852766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac205d-55aa-434b-80cd-a29832bcd6ca None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:39.853067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac205d-55aa-434b-80cd-a29832bcd6ca None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:39.854371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 709/1412] 10.222.0.16 () {54 vars in 918 bytes} [Wed Oct 5 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:39.859748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe4dd-e863-4885-8ea3-a2d327d36f7f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:39.860040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe4dd-e863-4885-8ea3-a2d327d36f7f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:39.860315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe4dd-e863-4885-8ea3-a2d327d36f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:39.931766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:39.935031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ef7fe4dd-e863-4885-8ea3-a2d327d36f7f None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:39.937035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef7fe4dd-e863-4885-8ea3-a2d327d36f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:40.050994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 704/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Oct 5 02:18:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:18:42.636323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6764d1-f89b-4766-b2af-2b191f1c24e8 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:42.636895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6764d1-f89b-4766-b2af-2b191f1c24e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:42.636895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6764d1-f89b-4766-b2af-2b191f1c24e8 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:42.638253 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:42.644160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49fb27-950a-47c0-bbcf-4419ca1310e7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:42.644621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49fb27-950a-47c0-bbcf-4419ca1310e7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:42.644739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49fb27-950a-47c0-bbcf-4419ca1310e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:42.712513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5e49fb27-950a-47c0-bbcf-4419ca1310e7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:42.713756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e49fb27-950a-47c0-bbcf-4419ca1310e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:42.768311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:42.809202 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:43.095081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6764d1-f89b-4766-b2af-2b191f1c24e8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:43.096663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f6764d1-f89b-4766-b2af-2b191f1c24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:43.238856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6764d1-f89b-4766-b2af-2b191f1c24e8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:43.309611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:43.350431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:43.350972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:43.351252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:43.351528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:43.353164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:43.442431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:43.444019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b47d-8c2f-470a-9664-86b4be0ea3b9 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:43.462266 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 711/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:44.611347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120da2d1-ba77-4c1e-96e0-87bf057649bb None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:44.611923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120da2d1-ba77-4c1e-96e0-87bf057649bb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:44.611923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120da2d1-ba77-4c1e-96e0-87bf057649bb None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:44.613297 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:44.619353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655413a0-e664-4b2e-aa86-9dd0862fd613 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:44.619796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655413a0-e664-4b2e-aa86-9dd0862fd613 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:44.619908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655413a0-e664-4b2e-aa86-9dd0862fd613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:44.698904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-655413a0-e664-4b2e-aa86-9dd0862fd613 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:44.700315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-655413a0-e664-4b2e-aa86-9dd0862fd613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:44.729028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:44.800504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:44.967304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120da2d1-ba77-4c1e-96e0-87bf057649bb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:44.968962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-120da2d1-ba77-4c1e-96e0-87bf057649bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:45.115474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120da2d1-ba77-4c1e-96e0-87bf057649bb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:45.159087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:45.231443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:45.231971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:45.232252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:45.232526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:45.234183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:45.331312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:45.332930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398c982-0397-419f-88a1-7f0144aa9222 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:45.350645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 707/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:46.478557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b47b7-2bd1-4126-8f7b-df56f0f0f03a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:46.479140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b47b7-2bd1-4126-8f7b-df56f0f0f03a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:46.479140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b47b7-2bd1-4126-8f7b-df56f0f0f03a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:46.480436 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:46.486652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef0c3-76a1-4cfa-8c17-83b4edf1e362 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:46.487107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef0c3-76a1-4cfa-8c17-83b4edf1e362 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:46.487221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef0c3-76a1-4cfa-8c17-83b4edf1e362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:46.542143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:46.564414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bedef0c3-76a1-4cfa-8c17-83b4edf1e362 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:46.565638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bedef0c3-76a1-4cfa-8c17-83b4edf1e362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:46.660763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:46.809990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b47b7-2bd1-4126-8f7b-df56f0f0f03a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:46.812118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-284b47b7-2bd1-4126-8f7b-df56f0f0f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:46.953874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b47b7-2bd1-4126-8f7b-df56f0f0f03a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:46.966054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:47.066749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:47.067266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:47.067549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:47.067827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:47.069462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:47.157307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:47.158894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10aa2-6e87-46bf-9c9d-b1646299871c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:47.176792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 714/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:48.298609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4aedf-abb0-4d89-9efd-655deb6f4cc9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:48.299188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4aedf-abb0-4d89-9efd-655deb6f4cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:48.299188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4aedf-abb0-4d89-9efd-655deb6f4cc9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:48.300537 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:48.308175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb6bb-2310-40e0-b747-151b4075a8b3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:48.308709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb6bb-2310-40e0-b747-151b4075a8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:48.309260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fb6bb-2310-40e0-b747-151b4075a8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:48.330999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:48.388446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7c2fb6bb-2310-40e0-b747-151b4075a8b3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:48.389808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c2fb6bb-2310-40e0-b747-151b4075a8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:48.485077 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:48.635114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4aedf-abb0-4d89-9efd-655deb6f4cc9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:48.636518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-43a4aedf-abb0-4d89-9efd-655deb6f4cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:48.756000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:48.791105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4aedf-abb0-4d89-9efd-655deb6f4cc9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:48.901420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:48.901935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:48.902212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:48.902483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:48.904060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:48.988280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:49.003557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:49.005190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62c7ba-36b8-4f6c-adcf-2633608d3884 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:49.023965 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 710/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:50.142754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19153-7481-465f-8c18-d0c8a80288db None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:50.143325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19153-7481-465f-8c18-d0c8a80288db None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:50.143325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19153-7481-465f-8c18-d0c8a80288db None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:50.144674 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:50.150768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf237053-f6c1-4dc3-aa1e-cc0df91f2f94 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:50.151179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf237053-f6c1-4dc3-aa1e-cc0df91f2f94 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:50.151319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf237053-f6c1-4dc3-aa1e-cc0df91f2f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:50.226451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cf237053-f6c1-4dc3-aa1e-cc0df91f2f94 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:50.227658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf237053-f6c1-4dc3-aa1e-cc0df91f2f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:50.322327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:50.472404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19153-7481-465f-8c18-d0c8a80288db None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:50.473986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4cb19153-7481-465f-8c18-d0c8a80288db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:50.557471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:50.617348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19153-7481-465f-8c18-d0c8a80288db None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:50.730905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:50.731445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:50.731725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:50.731998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:50.733665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:50.783350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:50.825657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:50.827852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ea88-e96d-4de3-b81c-2f6c8bece086 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:50.846255 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 717/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:51.901443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551c30-6e82-4d33-adb6-08c820151dea None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:51.902019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551c30-6e82-4d33-adb6-08c820151dea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:51.902019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551c30-6e82-4d33-adb6-08c820151dea None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:51.903324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:51.910178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3672a-446e-4825-bd86-21c64767ddd9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:51.910648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3672a-446e-4825-bd86-21c64767ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:51.910802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3672a-446e-4825-bd86-21c64767ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:51.989698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-94b3672a-446e-4825-bd86-21c64767ddd9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:51.990915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-94b3672a-446e-4825-bd86-21c64767ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:52.086090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:52.235592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551c30-6e82-4d33-adb6-08c820151dea None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:52.237043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bf551c30-6e82-4d33-adb6-08c820151dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:52.284812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:52.383118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551c30-6e82-4d33-adb6-08c820151dea None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:52.494204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:52.494727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:52.495007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:52.495279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:52.496847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:52.503887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:52.586588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:52.588200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f184c-a54b-48ed-989b-bd23c678c7e0 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:52.606979 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 713/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:53.657054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d2237-d703-49aa-ae4c-dc341b982662 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:53.657610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d2237-d703-49aa-ae4c-dc341b982662 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:53.657610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d2237-d703-49aa-ae4c-dc341b982662 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:53.658983 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:53.665480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ce14-4dc0-40b7-bfd4-b25485fc4a74 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:53.665908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ce14-4dc0-40b7-bfd4-b25485fc4a74 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:53.666022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ce14-4dc0-40b7-bfd4-b25485fc4a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:53.741193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-37b3ce14-4dc0-40b7-bfd4-b25485fc4a74 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:53.742410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-37b3ce14-4dc0-40b7-bfd4-b25485fc4a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:53.809062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:53.839065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:53.988084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d2237-d703-49aa-ae4c-dc341b982662 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:53.989619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df9d2237-d703-49aa-ae4c-dc341b982662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:54.007145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:54.134360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d2237-d703-49aa-ae4c-dc341b982662 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:54.220174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:54.245365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:54.245997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:54.246277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:54.246549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:54.248154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:54.338013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:54.339614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6740e4-18a7-4d69-abcb-d7572dfa42da service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:54.356704 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 720/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:55.412437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee138b-a9a3-4432-9deb-b2e808b44090 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:55.413039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee138b-a9a3-4432-9deb-b2e808b44090 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:55.413039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee138b-a9a3-4432-9deb-b2e808b44090 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:55.414385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:55.420389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f576542-e435-420d-ac8b-a16eae812fa1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:55.421393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f576542-e435-420d-ac8b-a16eae812fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:55.421663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f576542-e435-420d-ac8b-a16eae812fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:55.495908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0f576542-e435-420d-ac8b-a16eae812fa1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:55.497124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f576542-e435-420d-ac8b-a16eae812fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:55.539292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:55.594149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:55.743252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee138b-a9a3-4432-9deb-b2e808b44090 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:55.744758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-27ee138b-a9a3-4432-9deb-b2e808b44090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:55.888969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee138b-a9a3-4432-9deb-b2e808b44090 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:55.944271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:56.005875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:56.006493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:56.006776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:56.007052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:56.008655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:56.098109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:56.099708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0521a8-d242-4b5c-a95c-45f270cfba0f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:56.118085 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 716/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:57.164033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f7fd-542f-469a-8c18-038c7cc368a5 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:57.164610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f7fd-542f-469a-8c18-038c7cc368a5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:57.164610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f7fd-542f-469a-8c18-038c7cc368a5 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:57.165997 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:57.173170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24ba77-6dab-43bf-a7b1-beb38b86f5e4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:57.173672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24ba77-6dab-43bf-a7b1-beb38b86f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:57.173770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24ba77-6dab-43bf-a7b1-beb38b86f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:57.248737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3f24ba77-6dab-43bf-a7b1-beb38b86f5e4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:18:57.249995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f24ba77-6dab-43bf-a7b1-beb38b86f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:57.252000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:57.348309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:18:57.497661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f7fd-542f-469a-8c18-038c7cc368a5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:18:57.499406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c6d3f7fd-542f-469a-8c18-038c7cc368a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:57.644079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f7fd-542f-469a-8c18-038c7cc368a5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:18:57.670895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:18:57.756395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:18:57.756937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:57.757218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:57.757495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:57.759109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:18:57.848342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:18:57.849977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d25125-1917-48e5-8155-ae11acf89053 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:18:57.868228 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 723/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:18:59.928271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed4cc-e0e5-4c24-8154-3f9f387ed7b7 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:59.928881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed4cc-e0e5-4c24-8154-3f9f387ed7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:59.928881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bed4cc-e0e5-4c24-8154-3f9f387ed7b7 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:59.930265 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:18:59.935417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebe77b-e158-4491-8cb0-549b3ae3f6c2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:18:59.935881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebe77b-e158-4491-8cb0-549b3ae3f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:18:59.935992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebe77b-e158-4491-8cb0-549b3ae3f6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:18:59.975791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:00.001674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e5ebe77b-e158-4491-8cb0-549b3ae3f6c2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:00.002886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e5ebe77b-e158-4491-8cb0-549b3ae3f6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:00.097392 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:00.385260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bed4cc-e0e5-4c24-8154-3f9f387ed7b7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:00.386801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e4bed4cc-e0e5-4c24-8154-3f9f387ed7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:00.489962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bed4cc-e0e5-4c24-8154-3f9f387ed7b7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:00.521972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:00.562899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:00.563508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:00.563791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:00.564064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:00.565717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:00.797564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:00.798996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f595c-e33a-4f2b-a52b-2e88ca5727d7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:00.817638 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 719/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:03.128070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52995fc-8d5d-453f-90ea-bb44837fb931 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:03.128650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52995fc-8d5d-453f-90ea-bb44837fb931 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:03.128650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52995fc-8d5d-453f-90ea-bb44837fb931 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:03.130003 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:03.135335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc46b0-9841-4f87-8a3f-2e1eac1b1181 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:03.135732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc46b0-9841-4f87-8a3f-2e1eac1b1181 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:03.135889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc46b0-9841-4f87-8a3f-2e1eac1b1181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:03.201528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-09fc46b0-9841-4f87-8a3f-2e1eac1b1181 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:03.203514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-09fc46b0-9841-4f87-8a3f-2e1eac1b1181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:03.216598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:03.309186 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:03.594024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52995fc-8d5d-453f-90ea-bb44837fb931 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:03.595583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a52995fc-8d5d-453f-90ea-bb44837fb931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:03.700305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52995fc-8d5d-453f-90ea-bb44837fb931 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:03.714263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:03.775093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:03.775628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:03.775942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:03.776242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:03.777889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:03.887297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:03.888719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eebef-994f-462e-9f8c-a77a281c531f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:03.907308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 726/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:06.385269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c787-0e6e-447d-adc9-a025e6aa9d67 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:06.386114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c787-0e6e-447d-adc9-a025e6aa9d67 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:06.386114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c787-0e6e-447d-adc9-a025e6aa9d67 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:06.387710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:06.395297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2ae4-91ea-4e69-b8e3-d8717863d1b7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:06.395804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2ae4-91ea-4e69-b8e3-d8717863d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:06.395919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a2ae4-91ea-4e69-b8e3-d8717863d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:06.448947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:06.470958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f78a2ae4-91ea-4e69-b8e3-d8717863d1b7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:06.472310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f78a2ae4-91ea-4e69-b8e3-d8717863d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:06.570824 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:06.863077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c787-0e6e-447d-adc9-a025e6aa9d67 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:06.864596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9087c787-0e6e-447d-adc9-a025e6aa9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:06.973208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087c787-0e6e-447d-adc9-a025e6aa9d67 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:07.015470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:07.050422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:07.051035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:07.051313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:07.051585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:07.053218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:07.162812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:07.164233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ee2e7-d1ba-422c-8162-1d290b996268 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:07.181908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 722/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:09.458915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9584b-2c0c-4ef8-9a38-e5217e0a791b None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:09.459489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9584b-2c0c-4ef8-9a38-e5217e0a791b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:09.459489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9584b-2c0c-4ef8-9a38-e5217e0a791b None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:09.460785 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:09.466250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edbfd8-6fc4-4217-bf71-e87e14243fa4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:09.466656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edbfd8-6fc4-4217-bf71-e87e14243fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:09.466807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edbfd8-6fc4-4217-bf71-e87e14243fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:09.532526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-53edbfd8-6fc4-4217-bf71-e87e14243fa4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:09.533744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53edbfd8-6fc4-4217-bf71-e87e14243fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:09.554331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:09.631576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:09.913828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9584b-2c0c-4ef8-9a38-e5217e0a791b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:09.915349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43b9584b-2c0c-4ef8-9a38-e5217e0a791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:10.025875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9584b-2c0c-4ef8-9a38-e5217e0a791b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:10.047159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:10.099634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:10.100231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:10.100511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:10.100784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:10.102388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:10.210236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:10.211866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d052d2a-4fac-4541-ae60-32533e1a2f5c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:10.229903 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 729/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:12.524189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141890-a3b0-4e08-b99b-1070c8ec4e22 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:12.524740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141890-a3b0-4e08-b99b-1070c8ec4e22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:12.524740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77141890-a3b0-4e08-b99b-1070c8ec4e22 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:12.526044 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:12.531817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0dbfe-4bc9-4c47-a9d6-f862977c86f3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:12.532277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0dbfe-4bc9-4c47-a9d6-f862977c86f3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:12.532398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0dbfe-4bc9-4c47-a9d6-f862977c86f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:12.595601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:12.598531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-07e0dbfe-4bc9-4c47-a9d6-f862977c86f3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:12.600351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-07e0dbfe-4bc9-4c47-a9d6-f862977c86f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:12.696027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:19:12.980822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141890-a3b0-4e08-b99b-1070c8ec4e22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:12.982401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77141890-a3b0-4e08-b99b-1070c8ec4e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:13.086465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77141890-a3b0-4e08-b99b-1070c8ec4e22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:13.135983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:13.161025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:13.161633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:13.161913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:13.162183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:13.163772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:13.273159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:13.274509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a250-ca12-4ae8-9c03-95f78385e469 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:13.292693 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 725/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:15.493165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844668c2-ec45-4a11-901b-62024e9ac569 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:15.493783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844668c2-ec45-4a11-901b-62024e9ac569 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:15.493783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844668c2-ec45-4a11-901b-62024e9ac569 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:15.495065 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:15.501354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42694-1c03-4b90-a30a-fe6192c7ca24 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:15.501793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42694-1c03-4b90-a30a-fe6192c7ca24 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:15.501893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42694-1c03-4b90-a30a-fe6192c7ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:15.566781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-64a42694-1c03-4b90-a30a-fe6192c7ca24 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:15.567987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64a42694-1c03-4b90-a30a-fe6192c7ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:15.596709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:15.664892 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:15.956074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844668c2-ec45-4a11-901b-62024e9ac569 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:15.957660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-844668c2-ec45-4a11-901b-62024e9ac569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:16.061952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844668c2-ec45-4a11-901b-62024e9ac569 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:16.095902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:16.141185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:16.141790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:16.142079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:16.142359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:16.143956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:16.251175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:16.252606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e644e-b846-4261-b7a4-bee143bbaf68 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:16.271232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 732/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:18.456459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46546-b9fa-4868-8ada-fa5910fb00cb None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:18.457028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46546-b9fa-4868-8ada-fa5910fb00cb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:18.457028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46546-b9fa-4868-8ada-fa5910fb00cb None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:18.458374 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:18.463805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426250f2-c7aa-4177-acfd-0af1c85bf2c9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:18.464212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426250f2-c7aa-4177-acfd-0af1c85bf2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:18.464360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426250f2-c7aa-4177-acfd-0af1c85bf2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:18.530660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-426250f2-c7aa-4177-acfd-0af1c85bf2c9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:18.531873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-426250f2-c7aa-4177-acfd-0af1c85bf2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:18.540178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:18.626741 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:18.915549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46546-b9fa-4868-8ada-fa5910fb00cb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:18.917112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64d46546-b9fa-4868-8ada-fa5910fb00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:19.023880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46546-b9fa-4868-8ada-fa5910fb00cb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:19.094025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:19.116987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:19.117965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:19.118425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:19.118876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:19.121453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:19.252591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:19.253968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a452-c7d3-4c53-9de1-b30ea77ecfeb service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:19.271829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 728/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:21.493691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e1c2-461b-4692-a898-b04963ac307d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:21.494301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e1c2-461b-4692-a898-b04963ac307d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:21.494301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3e1c2-461b-4692-a898-b04963ac307d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:21.495628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:21.501969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b4fb-d251-4676-b28f-2b3d47752b9b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:21.502430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b4fb-d251-4676-b28f-2b3d47752b9b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:21.502535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b4fb-d251-4676-b28f-2b3d47752b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:21.568760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4cf8b4fb-d251-4676-b28f-2b3d47752b9b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:21.569981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4cf8b4fb-d251-4676-b28f-2b3d47752b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:21.607061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:21.665380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:21.960960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3e1c2-461b-4692-a898-b04963ac307d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:21.962752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8b3e1c2-461b-4692-a898-b04963ac307d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:22.065807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3e1c2-461b-4692-a898-b04963ac307d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:22.101938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:22.138111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:22.138705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:22.139026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:22.139303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:22.140870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:22.254763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:22.256111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792ab8a-9a89-4ccb-9fb0-b7b604887042 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:22.273965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 735/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:24.500322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099d179-50cc-433d-b92d-fd72f1f9acb3 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:24.500943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099d179-50cc-433d-b92d-fd72f1f9acb3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:24.500943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099d179-50cc-433d-b92d-fd72f1f9acb3 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:24.502259 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:24.507549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462364a-2089-4a70-844b-9ed1bdd73d21 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:24.508011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462364a-2089-4a70-844b-9ed1bdd73d21 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:24.508131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462364a-2089-4a70-844b-9ed1bdd73d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:24.572785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7462364a-2089-4a70-844b-9ed1bdd73d21 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:24.574020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7462364a-2089-4a70-844b-9ed1bdd73d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:24.593900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:24.671930 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:24.959659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099d179-50cc-433d-b92d-fd72f1f9acb3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:24.961204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9099d179-50cc-433d-b92d-fd72f1f9acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:25.065802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099d179-50cc-433d-b92d-fd72f1f9acb3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:25.132448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:25.139765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:25.140462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:25.140743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:25.141039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:25.142626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:25.251289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:25.252725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9e6a-15b4-4b83-8ecb-490c33a5ab81 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:25.270269 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 731/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:27.441510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d721327-dda7-4471-8a19-e9a2feff8ead None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:27.442066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d721327-dda7-4471-8a19-e9a2feff8ead None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:27.442199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d721327-dda7-4471-8a19-e9a2feff8ead None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:27.444426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:27.449346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ea99-e3df-4807-b24e-951337fb7f35 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:27.449754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ea99-e3df-4807-b24e-951337fb7f35 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:27.449902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649ea99-e3df-4807-b24e-951337fb7f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:27.516886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b649ea99-e3df-4807-b24e-951337fb7f35 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:27.518108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b649ea99-e3df-4807-b24e-951337fb7f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:27.565506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:27.614201 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:27.895589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d721327-dda7-4471-8a19-e9a2feff8ead None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:27.897177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d721327-dda7-4471-8a19-e9a2feff8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:27.999757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d721327-dda7-4471-8a19-e9a2feff8ead None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:28.047172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:28.072982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:28.073584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:28.073862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:28.074133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:28.075713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:28.183210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:28.184587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc42dc-7454-4609-ad1b-c271d2296b51 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:28.203033 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 738/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:37.612697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=22 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:38.200804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=66 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:48.293342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901de94-bb26-4805-b0b9-4cc54e2c844b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:48.293873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901de94-bb26-4805-b0b9-4cc54e2c844b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:48.293873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901de94-bb26-4805-b0b9-4cc54e2c844b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:48.295784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 733/1471] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:48.301082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6fee-5c45-4d98-a7fb-26e1d8c56291 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:48.301522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6fee-5c45-4d98-a7fb-26e1d8c56291 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:48.301645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea6fee-5c45-4d98-a7fb-26e1d8c56291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:48.367671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c5ea6fee-5c45-4d98-a7fb-26e1d8c56291 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:48.368890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c5ea6fee-5c45-4d98-a7fb-26e1d8c56291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:48.465524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 739/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:48.769343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8d912-1dce-4ef3-a209-d88bd8c3a66b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:48.769631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8d912-1dce-4ef3-a209-d88bd8c3a66b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:48.769904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8d912-1dce-4ef3-a209-d88bd8c3a66b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:48.771285 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 734/1473] 10.222.0.16 () {54 vars in 962 bytes} [Wed Oct 5 02:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:48.776338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a34b-6824-4ed9-952c-62ec1b4e1768 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:48.776628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a34b-6824-4ed9-952c-62ec1b4e1768 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:48.776928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a34b-6824-4ed9-952c-62ec1b4e1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:48.852078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e141a34b-6824-4ed9-952c-62ec1b4e1768 None None] MFA Rules not processed for user `c7ebd0b9ab9a48f0a5505863a7d729e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:48.853317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e141a34b-6824-4ed9-952c-62ec1b4e1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:48.874357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:48.928729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 740/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 5 02:19:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:48.936521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8d912-1dce-4ef3-a209-d88bd8c3a66b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:48.938120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-efc8d912-1dce-4ef3-a209-d88bd8c3a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:49.040621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8d912-1dce-4ef3-a209-d88bd8c3a66b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:49.113199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:49.113809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:49.114090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:49.114365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:49.115950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:49.169479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:49.225411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:49.226816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68311-fd64-4421-a7a9-65c2be384cdd service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:49.244746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 735/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:19:51.502292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc2d5-a21b-4f0c-aff3-cdf5ca5477a0 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:51.502904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc2d5-a21b-4f0c-aff3-cdf5ca5477a0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:51.502904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc2d5-a21b-4f0c-aff3-cdf5ca5477a0 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:51.504238 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 741/1476] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:51.509490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d08a-15da-4f17-bba5-ed38ee120434 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:51.509922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d08a-15da-4f17-bba5-ed38ee120434 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:51.510025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d08a-15da-4f17-bba5-ed38ee120434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:51.578564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e231d08a-15da-4f17-bba5-ed38ee120434 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:51.579760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e231d08a-15da-4f17-bba5-ed38ee120434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:51.687792 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 736/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:51.957808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc2d5-a21b-4f0c-aff3-cdf5ca5477a0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:51.959356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d5cbc2d5-a21b-4f0c-aff3-cdf5ca5477a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:52.092883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc2d5-a21b-4f0c-aff3-cdf5ca5477a0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:52.141303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:52.184218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:52.184821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:52.185147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:52.185415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:52.186046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:52.187820 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:19:52.187820 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:19:52.187820 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:19:52.188987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a58e7f-6617-43ce-8e52-f7454d7017b9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:52.207803 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 742/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Oct 5 02:19:51 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:19:54.352332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf92358-e43f-4d3b-9fff-ed23806a32a2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:54.352942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf92358-e43f-4d3b-9fff-ed23806a32a2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:54.352942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf92358-e43f-4d3b-9fff-ed23806a32a2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:54.354295 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 737/1479] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:54.360017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf51b-9b2f-4cb2-a54b-ca85eed3b01c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:54.360484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf51b-9b2f-4cb2-a54b-ca85eed3b01c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:54.360591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edf51b-9b2f-4cb2-a54b-ca85eed3b01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:54.426989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-72edf51b-9b2f-4cb2-a54b-ca85eed3b01c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:54.428203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-72edf51b-9b2f-4cb2-a54b-ca85eed3b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:54.524404 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 743/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:54.823220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf92358-e43f-4d3b-9fff-ed23806a32a2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:54.824805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ccf92358-e43f-4d3b-9fff-ed23806a32a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:54.835178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:54.971708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf92358-e43f-4d3b-9fff-ed23806a32a2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:55.052916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:55.086759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:55.087616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:55.087898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:55.088171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:55.089804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:55.178788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:55.180375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b15f8-b772-4137-b8a5-741b7f6e9aa1 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:55.198080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 738/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:19:57.553504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9e4a-873b-4523-aafe-c8288c4594a8 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:57.553963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9e4a-873b-4523-aafe-c8288c4594a8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:57.554120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9e4a-873b-4523-aafe-c8288c4594a8 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:57.555457 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 744/1482] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:19:57.561469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec74e8e-9c74-42da-a8bc-ad8da9161044 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:57.561902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec74e8e-9c74-42da-a8bc-ad8da9161044 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:57.562006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec74e8e-9c74-42da-a8bc-ad8da9161044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:57.628554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ec74e8e-9c74-42da-a8bc-ad8da9161044 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:19:57.629791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ec74e8e-9c74-42da-a8bc-ad8da9161044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:57.676883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:57.727862 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 739/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:19:58.022069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9e4a-873b-4523-aafe-c8288c4594a8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:19:58.023618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7a8d9e4a-873b-4523-aafe-c8288c4594a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:58.050540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:58.130599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9e4a-873b-4523-aafe-c8288c4594a8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:19:58.202199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:19:58.202793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:19:58.203070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:19:58.203340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:19:58.204934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:19:58.278386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:19:58.318654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:19:58.320100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3be1c9-31b1-4e6c-ab47-955d66e7b13c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:19:58.338863 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 745/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:20:00.514624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117f9d-1b7b-4f69-aef6-9d089241dcdc None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:00.515209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117f9d-1b7b-4f69-aef6-9d089241dcdc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:00.515209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117f9d-1b7b-4f69-aef6-9d089241dcdc None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:00.516500 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 740/1485] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:20:00.521649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1f11-7524-443a-a2e7-1998d0202a2f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:00.522058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1f11-7524-443a-a2e7-1998d0202a2f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:00.522204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d1f11-7524-443a-a2e7-1998d0202a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:00.586334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4d9d1f11-7524-443a-a2e7-1998d0202a2f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:20:00.587808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d9d1f11-7524-443a-a2e7-1998d0202a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:00.683526 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 746/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:20:00.973977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117f9d-1b7b-4f69-aef6-9d089241dcdc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:20:00.975499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22117f9d-1b7b-4f69-aef6-9d089241dcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:01.075389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117f9d-1b7b-4f69-aef6-9d089241dcdc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:20:01.147032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:20:01.148520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:20:01.149165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:01.149517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:01.149992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:01.151949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:01.261230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:20:01.262610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc068d-bb47-4a0b-a44a-596afdabf9ea service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:20:01.282166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 741/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:20:03.572126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228901a9-a9c1-485e-881e-0d65bd7db55c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:03.572576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228901a9-a9c1-485e-881e-0d65bd7db55c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:03.572689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228901a9-a9c1-485e-881e-0d65bd7db55c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:03.574052 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 747/1488] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:20:03.579241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc5eb-ba78-46bd-b0be-632f9f13671a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:03.579682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc5eb-ba78-46bd-b0be-632f9f13671a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:03.579805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc5eb-ba78-46bd-b0be-632f9f13671a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:03.646158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bbebc5eb-ba78-46bd-b0be-632f9f13671a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:20:03.647367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bbebc5eb-ba78-46bd-b0be-632f9f13671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:03.699819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:20:03.744421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 742/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:20:04.034004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228901a9-a9c1-485e-881e-0d65bd7db55c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:20:04.035544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-228901a9-a9c1-485e-881e-0d65bd7db55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:04.070971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:20:04.139910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228901a9-a9c1-485e-881e-0d65bd7db55c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:20:04.211643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:20:04.212248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:04.212780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:04.213092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:04.214705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:04.415469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:20:04.444835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:20:04.446289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53785-c88b-4ad9-a219-a174735bfa51 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:20:04.465334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 748/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:20:06.902501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a955ac-afb5-4fcb-9a48-1b8b22be4cbf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:06.903159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a955ac-afb5-4fcb-9a48-1b8b22be4cbf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:06.903159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a955ac-afb5-4fcb-9a48-1b8b22be4cbf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:06.904986 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 743/1491] 10.222.0.16 () {54 vars in 927 bytes} [Wed Oct 5 02:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:20:06.911869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3df7-1dd2-4e85-be44-d15a7e5071b2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:06.912474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3df7-1dd2-4e85-be44-d15a7e5071b2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:06.912814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3df7-1dd2-4e85-be44-d15a7e5071b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:06.989144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f6ed3df7-1dd2-4e85-be44-d15a7e5071b2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:20:06.990349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f6ed3df7-1dd2-4e85-be44-d15a7e5071b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:07.096088 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Wed Oct 5 02:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:20:07.387983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a955ac-afb5-4fcb-9a48-1b8b22be4cbf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:20:07.390166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d7a955ac-afb5-4fcb-9a48-1b8b22be4cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:07.492365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a955ac-afb5-4fcb-9a48-1b8b22be4cbf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:20:07.565411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:20:07.566015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:20:07.566295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:20:07.566566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:20:07.568145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:20:07.577218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:20:07.677443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:20:07.678891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec63c44-4ad1-450d-aa96-712335d271a8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:20:07.697375 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 744/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:20:17.094597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=82 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:20:17.695090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=50 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:26.948242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:26.948840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:26.948840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:27.023720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:21:27.024988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:27.118204 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:21:27.126727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:27.127240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:27.127347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:27.204262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:21:27.205427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:27.301503 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:21:27.306175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:27.307375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:27.319132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538824a-bbc2-473e-8241-31a3e16f11e2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:27.382247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:27.415846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:27.416642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:27.417025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:27.417367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:27.418077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:21:27.418983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:27.420065 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:27.420065 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:21:27.420065 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:21:27.421068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:27.435351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 751/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:21:27.443635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:27.453664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd6e19-965a-4dac-a996-789f89143a1b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:27.520123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:27.559916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:27.560513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:27.560792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:27.561094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:27.561743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:27.563670 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:27.563670 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:21:27.563670 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:21:27.564712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:27.622819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 746/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:21:27 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:21:27.627072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:27.628604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:27.662660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51a74e-a524-4448-85a7-81516bb0c624 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:27.755288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:27.755894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:27.756177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:27.756455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:27.757119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:27.758140 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:27.758140 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:21:27.758140 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:21:27.759354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:27.803152 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 752/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:21:27 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:21:27.807277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:27.808818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:27.874477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766dce-55c4-42b9-b538-6bd30d3d63c8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:27.956968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:27.969284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:27.969902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:27.970186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:27.970488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:27.971133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:27.972167 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:27.972167 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:21:27.972167 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:21:27.973116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:27.986492 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 747/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:21:27.990555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:27.992132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:28.004555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b37e76-3771-4cff-89c4-18bb9a8074bb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:28.030277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:28.103591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:28.104162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.104415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.104687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.105359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:28.106452 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:28.106452 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:21:28.106452 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:21:28.107330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0f00e-b2a0-4eee-964e-c551aa2fd363 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:28.119434 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 753/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:21:28.124676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:28.126228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:28.159788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97c41c-9c2b-4c60-95db-e105af192b06 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:28.251261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:28.251907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.252184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.252455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] PATH_INFO: `/v3/projects/9a6a9499c761404b9dc6fc4b9234e8cf/users/99ae30bb050443f3bfa2e39699b8f4e4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.274983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6a9499c761404b9dc6fc4b9234e8cf, user_id=99ae30bb050443f3bfa2e39699b8f4e4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:28.276002 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:28.276002 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:21:28.276002 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:21:28.278640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954163c6-e41e-4662-be26-3a13f33f30ec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:28.302324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 748/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:21:28 2022] PUT /identity/v3/projects/9a6a9499c761404b9dc6fc4b9234e8cf/users/99ae30bb050443f3bfa2e39699b8f4e4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:21:28.314402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641145d-2209-4c48-9726-3e7b9a4b41ae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.314692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641145d-2209-4c48-9726-3e7b9a4b41ae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.314967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641145d-2209-4c48-9726-3e7b9a4b41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.371019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2641145d-2209-4c48-9726-3e7b9a4b41ae None None] MFA Rules not processed for user `99ae30bb050443f3bfa2e39699b8f4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:21:28.372854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2641145d-2209-4c48-9726-3e7b9a4b41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:28.451783 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 754/1502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:21:28.465202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549539-04ce-4372-9a39-859c7e3da784 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.465613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549539-04ce-4372-9a39-859c7e3da784 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.465892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f549539-04ce-4372-9a39-859c7e3da784 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.467233 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 749/1503] 10.222.0.16 () {54 vars in 963 bytes} [Wed Oct 5 02:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:21:28.472083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8aa6a-48c8-4381-b3a4-00fe7dbf618b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.472373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8aa6a-48c8-4381-b3a4-00fe7dbf618b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.472653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8aa6a-48c8-4381-b3a4-00fe7dbf618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.505567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:28.550177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-90d8aa6a-48c8-4381-b3a4-00fe7dbf618b None None] MFA Rules not processed for user `b074e2c621494cdfa6efc21e4a5c021b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:21:28.551401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-90d8aa6a-48c8-4381-b3a4-00fe7dbf618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:28.625453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 755/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 5 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:21:28.632967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549539-04ce-4372-9a39-859c7e3da784 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:28.634539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f549539-04ce-4372-9a39-859c7e3da784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:28.685424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:28.741361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f549539-04ce-4372-9a39-859c7e3da784 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:28.815495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:28.816092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.816370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.816642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.818244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:28.913684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:28.915022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:28.919132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:28.933851 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 750/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:21:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:21:28.978880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3ca7-ef93-432a-9eac-a7b909e71f81 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:28.979173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3ca7-ef93-432a-9eac-a7b909e71f81 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:28.979450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc3ca7-ef93-432a-9eac-a7b909e71f81 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:28.980680 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 756/1506] 10.222.0.16 () {52 vars in 830 bytes} [Wed Oct 5 02:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:21:28.984869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:28.986108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:29.084213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c10f5-40ab-4131-bfc7-4ef9d267d553 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:29.178899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:29.179554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:29.179703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:29.179974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] PATH_INFO: `/v3/users/99ae30bb050443f3bfa2e39699b8f4e4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:29.192124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99ae30bb050443f3bfa2e39699b8f4e4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:29.193169 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:29.193169 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:21:29.193169 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:21:29.194374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:29.204511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:29.261728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99ae30bb050443f3bfa2e39699b8f4e4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:29.285959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99ae30bb050443f3bfa2e39699b8f4e4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:29.286571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99ae30bb050443f3bfa2e39699b8f4e4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:29.297167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99ae30bb050443f3bfa2e39699b8f4e4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:29.297673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99ae30bb050443f3bfa2e39699b8f4e4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:29.316645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 751/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:21:28 2022] DELETE /identity/v3/users/99ae30bb050443f3bfa2e39699b8f4e4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:21:29.321188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:29.321687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:29.321788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:29.378570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:21:29.379772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:29.455369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:29.469434 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 757/1508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:21:29.478949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:29.480177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:29.585434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbeb77-2558-428d-b0d8-cde97beca11a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:29.641731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:29.663875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:29.664804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:29.664804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:29.665131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:29.666614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:29.776655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:29.778656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b0c89-5c65-4f9b-9739-30f4196c7362 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:29.796472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 752/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:21:30.120012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:21:30.121283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:21:30.133291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f364c23-9a49-485e-b5d9-dfa957a3082c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:21:30.235122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:21:30.235760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:21:30.236041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:21:30.236318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] PATH_INFO: `/v3/projects/9a6a9499c761404b9dc6fc4b9234e8cf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:21:30.246037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6a9499c761404b9dc6fc4b9234e8cf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:21:30.247573 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:21:30.247573 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:21:30.247573 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:21:30.248781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:21:30.308688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6a9499c761404b9dc6fc4b9234e8cf', 'request_id': 'req-85ee8ec2-d886-46b7-ac6c-980cce10b67d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:30.314663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6a9499c761404b9dc6fc4b9234e8cf', 'request_id': 'req-85ee8ec2-d886-46b7-ac6c-980cce10b67d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:30.328120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6a9499c761404b9dc6fc4b9234e8cf', 'request_id': 'req-85ee8ec2-d886-46b7-ac6c-980cce10b67d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:30.354499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] The token cache is being invalidate because project 9a6a9499c761404b9dc6fc4b9234e8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:21:30.354765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:30.355192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85ee8ec2-d886-46b7-ac6c-980cce10b67d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:21:30.356689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 758/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:21:30 2022] DELETE /identity/v3/projects/9a6a9499c761404b9dc6fc4b9234e8cf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:21:39.794207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=62 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:21:40.352538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:24:51.312010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1794f-e55c-4700-80bd-6d16fd8f1c89 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:24:51.312633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1794f-e55c-4700-80bd-6d16fd8f1c89 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:24:51.312633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1794f-e55c-4700-80bd-6d16fd8f1c89 None None] PATH_INFO: `/v3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:24:51.313908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 753/1511] 10.222.0.25 () {54 vars in 925 bytes} [Wed Oct 5 02:24:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:24:51.320403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7d36-0bca-463c-9628-be1edf481611 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:24:51.320839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7d36-0bca-463c-9628-be1edf481611 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:24:51.320978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7d36-0bca-463c-9628-be1edf481611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:24:51.405804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-15dd7d36-0bca-463c-9628-be1edf481611 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:24:51.407010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-15dd7d36-0bca-463c-9628-be1edf481611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:24:51.518546 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 759/1512] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 5 02:24:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:24:51.523769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927474-bfa9-499d-912b-e9d41fb6cd6c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:24:51.523980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927474-bfa9-499d-912b-e9d41fb6cd6c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:24:51.524255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927474-bfa9-499d-912b-e9d41fb6cd6c None None] PATH_INFO: `/v3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:24:51.525889 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 754/1513] 10.222.0.17 () {54 vars in 925 bytes} [Wed Oct 5 02:24:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:24:51.531261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692806-1594-47f2-9c54-0373a5e0a672 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:24:51.531557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692806-1594-47f2-9c54-0373a5e0a672 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:24:51.531843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692806-1594-47f2-9c54-0373a5e0a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:24:51.550944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-27692806-1594-47f2-9c54-0373a5e0a672 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:24:51.552156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-27692806-1594-47f2-9c54-0373a5e0a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:24:51.560815 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 760/1514] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Oct 5 02:24:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:25:00.024576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d961c3-8ef0-4191-8803-a96b7f94899b None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:00.025083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d961c3-8ef0-4191-8803-a96b7f94899b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:00.025183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d961c3-8ef0-4191-8803-a96b7f94899b None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:00.026473 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 755/1515] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 02:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:25:00.028763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4f22a-4d80-4d70-8621-1acb7416ea9c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:00.029225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4f22a-4d80-4d70-8621-1acb7416ea9c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:00.029342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4f22a-4d80-4d70-8621-1acb7416ea9c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:00.030700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 761/1516] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 02:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:25:00.032090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:00.032382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:00.032657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:00.035450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:00.035918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:00.036324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:00.052547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:25:00.054525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:00.056006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:25:00.057919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:00.063541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 756/1517] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 02:25:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:25:00.066606 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 762/1518] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 02:25:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:25:00.071655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:25:00.074972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:25:00.081093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9aba3e-1d5c-4529-82c1-2b22dd91a000 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:25:00.084601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c19192-117a-4c70-9191-fe4f2ecc7f6d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:25:00.086472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483a937-3d86-4a4a-aa03-4a8c2a0e3873 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:25:00.087059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483a937-3d86-4a4a-aa03-4a8c2a0e3873 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:00.087337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483a937-3d86-4a4a-aa03-4a8c2a0e3873 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:00.087611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483a937-3d86-4a4a-aa03-4a8c2a0e3873 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:00.089731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bb854-80d0-4d3c-b443-a36f35cec7cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:25:00.090319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bb854-80d0-4d3c-b443-a36f35cec7cc service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:00.090604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bb854-80d0-4d3c-b443-a36f35cec7cc service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:00.090882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bb854-80d0-4d3c-b443-a36f35cec7cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:00.096090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483a937-3d86-4a4a-aa03-4a8c2a0e3873 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:25:00.097686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483a937-3d86-4a4a-aa03-4a8c2a0e3873 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:25:00.099532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bb854-80d0-4d3c-b443-a36f35cec7cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:25:00.101139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bb854-80d0-4d3c-b443-a36f35cec7cc service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:25:00.107821 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 757/1519] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:25:00.110920 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 763/1520] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:25:10.103517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:25:10.106728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:25:10.243579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155582fb-7f9b-46e4-825a-e4781214aeaf None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:10.243945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155582fb-7f9b-46e4-825a-e4781214aeaf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:10.244191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155582fb-7f9b-46e4-825a-e4781214aeaf None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:10.246800 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 758/1521] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:25:10.251114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430de01-2a79-4fa4-a035-a7e7a70021d6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:10.251399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430de01-2a79-4fa4-a035-a7e7a70021d6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:10.251673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430de01-2a79-4fa4-a035-a7e7a70021d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:10.311032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b430de01-2a79-4fa4-a035-a7e7a70021d6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:25:10.312223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b430de01-2a79-4fa4-a035-a7e7a70021d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:10.388368 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 764/1522] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:25:10.541828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155582fb-7f9b-46e4-825a-e4781214aeaf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:25:10.543662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-155582fb-7f9b-46e4-825a-e4781214aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:10.648022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155582fb-7f9b-46e4-825a-e4781214aeaf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:25:10.653879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784191f0-559f-497e-8ccd-8f1c14320ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:25:10.654491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784191f0-559f-497e-8ccd-8f1c14320ac6 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:10.654769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784191f0-559f-497e-8ccd-8f1c14320ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:10.655041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784191f0-559f-497e-8ccd-8f1c14320ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:10.664365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784191f0-559f-497e-8ccd-8f1c14320ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:25:10.665976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784191f0-559f-497e-8ccd-8f1c14320ac6 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:25:10.675346 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 759/1523] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:25:11.762255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53269-303b-490f-949e-1e00468a1378 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:11.762784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53269-303b-490f-949e-1e00468a1378 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:11.762784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a53269-303b-490f-949e-1e00468a1378 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:11.764159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 765/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 5 02:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:25:11.770333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf478-1022-4b45-b0ce-a25000199f3f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:11.770775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf478-1022-4b45-b0ce-a25000199f3f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:11.770881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf478-1022-4b45-b0ce-a25000199f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:11.790899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8dadf478-1022-4b45-b0ce-a25000199f3f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:25:11.792091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8dadf478-1022-4b45-b0ce-a25000199f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:11.799785 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 760/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 5 02:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:25:11.951426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a53269-303b-490f-949e-1e00468a1378 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:25:11.966762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a53269-303b-490f-949e-1e00468a1378 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:25:11.972448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf0ffb-3926-41a6-96d8-44df2553ad75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:25:11.973070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0ffb-3926-41a6-96d8-44df2553ad75 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:11.973357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0ffb-3926-41a6-96d8-44df2553ad75 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:11.973635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0ffb-3926-41a6-96d8-44df2553ad75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:11.982169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf0ffb-3926-41a6-96d8-44df2553ad75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:25:11.983752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf0ffb-3926-41a6-96d8-44df2553ad75 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:25:11.994076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 766/1526] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:25:15.895019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9648-83cb-41fd-be6c-dd0910dd95d9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:15.895542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9648-83cb-41fd-be6c-dd0910dd95d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:15.895542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9648-83cb-41fd-be6c-dd0910dd95d9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:15.897019 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 761/1527] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:25:15.902351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997953-bc84-456f-8158-a09d00f66f49 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:15.902759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997953-bc84-456f-8158-a09d00f66f49 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:15.902912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b997953-bc84-456f-8158-a09d00f66f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:15.922525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3b997953-bc84-456f-8158-a09d00f66f49 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:25:15.923725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b997953-bc84-456f-8158-a09d00f66f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:15.932430 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 767/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:25:16.232509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9648-83cb-41fd-be6c-dd0910dd95d9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:25:16.234255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-deed9648-83cb-41fd-be6c-dd0910dd95d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:16.311839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9648-83cb-41fd-be6c-dd0910dd95d9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:25:16.315358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83073874-a3a7-4252-8f40-bbeb1ce7b298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:25:16.315956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83073874-a3a7-4252-8f40-bbeb1ce7b298 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:16.316234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83073874-a3a7-4252-8f40-bbeb1ce7b298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:16.316503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83073874-a3a7-4252-8f40-bbeb1ce7b298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:16.325417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83073874-a3a7-4252-8f40-bbeb1ce7b298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:25:16.326873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83073874-a3a7-4252-8f40-bbeb1ce7b298 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:25:16.336324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 762/1529] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:25:18.484452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc93643-1ca4-404d-9277-ce0e01b08679 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:18.485025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc93643-1ca4-404d-9277-ce0e01b08679 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:18.485025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc93643-1ca4-404d-9277-ce0e01b08679 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:18.486738 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 768/1530] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 5 02:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:25:18.492417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71601c75-3b50-4db6-af57-0835471ab92d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:18.492849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71601c75-3b50-4db6-af57-0835471ab92d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:18.493006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71601c75-3b50-4db6-af57-0835471ab92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:18.512349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-71601c75-3b50-4db6-af57-0835471ab92d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:25:18.513570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-71601c75-3b50-4db6-af57-0835471ab92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:25:18.521330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 763/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 5 02:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:25:18.812127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc93643-1ca4-404d-9277-ce0e01b08679 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:25:18.823285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc93643-1ca4-404d-9277-ce0e01b08679 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:25:18.826724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f622-0014-455b-8906-c29486660362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:25:18.827307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f622-0014-455b-8906-c29486660362 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:25:18.827584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f622-0014-455b-8906-c29486660362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:25:18.827854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f622-0014-455b-8906-c29486660362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:25:18.836646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f622-0014-455b-8906-c29486660362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:25:18.838132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4f622-0014-455b-8906-c29486660362 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:25:18.847660 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 769/1532] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:25:28.507479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:25:28.843354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=65 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:07.281567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e629-2add-407f-8e8d-06f05076598a None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:07.282427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e629-2add-407f-8e8d-06f05076598a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:07.282709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e629-2add-407f-8e8d-06f05076598a None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:07.284397 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 764/1533] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:07.290216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508f96-d45e-43ff-9f6f-3f93e05b5f44 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:07.290691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508f96-d45e-43ff-9f6f-3f93e05b5f44 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:07.290762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff508f96-d45e-43ff-9f6f-3f93e05b5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:07.311426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ff508f96-d45e-43ff-9f6f-3f93e05b5f44 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:07.312791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff508f96-d45e-43ff-9f6f-3f93e05b5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:07.322096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 770/1534] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:26:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:17.305917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:39.121573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.122148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.122148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.146278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.147624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.159633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 765/1535] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.169332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.169867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.169867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.202585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.203855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.217968 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 771/1536] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.222602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.238521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f45c80-ca5e-4d7f-b88b-ea2e0c195a4d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.245055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.245954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.246381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.246808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.247596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.248156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.249328 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:26:39.249328 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:26:39.249328 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:26:39.250515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfab610-d402-4d0f-8269-0458ecc9403e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.267908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 766/1537] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.279054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.293463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b2e8-9ae1-44f5-b0e2-08fd8aa363ab None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.302403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.303067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.303351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.303628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.304277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.305335 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:26:39.305335 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:26:39.305335 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:26:39.306534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.330591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699f29-403e-432c-bc46-db277f87eca5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.331098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699f29-403e-432c-bc46-db277f87eca5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.331545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d699f29-403e-432c-bc46-db277f87eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.367270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4d699f29-403e-432c-bc46-db277f87eca5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.368556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d699f29-403e-432c-bc46-db277f87eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.374981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 772/1538] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:39.379866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.471747 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 767/1539] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.474744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd81e-724f-434f-a573-5557d730d400 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.475036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd81e-724f-434f-a573-5557d730d400 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.475312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcd81e-724f-434f-a573-5557d730d400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.482216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe429f-6d1d-4ec5-aa0f-bc4e8945f18c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.493983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bebbaa-9c4d-44ad-9c16-0a43b8b7b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.494606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebbaa-9c4d-44ad-9c16-0a43b8b7b4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.494889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebbaa-9c4d-44ad-9c16-0a43b8b7b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.495166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bebbaa-9c4d-44ad-9c16-0a43b8b7b4dc admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.495807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bebbaa-9c4d-44ad-9c16-0a43b8b7b4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.497776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bebbaa-9c4d-44ad-9c16-0a43b8b7b4dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.513396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3dcd81e-724f-434f-a573-5557d730d400 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.514744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3dcd81e-724f-434f-a573-5557d730d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.525231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 768/1540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.529049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175533-df60-4585-8b53-9bff73f1d08f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.529049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175533-df60-4585-8b53-9bff73f1d08f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.529049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175533-df60-4585-8b53-9bff73f1d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.529667 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 773/1541] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:39.531288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b2511-6e66-46a7-947e-73f9bff77f73 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.531756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b2511-6e66-46a7-947e-73f9bff77f73 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.532312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b2511-6e66-46a7-947e-73f9bff77f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.548292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1a175533-df60-4585-8b53-9bff73f1d08f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.549544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a175533-df60-4585-8b53-9bff73f1d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.554114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-666b2511-6e66-46a7-947e-73f9bff77f73 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.555617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-666b2511-6e66-46a7-947e-73f9bff77f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.559136 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 769/1542] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.560393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4c79f-d6dc-480d-87bb-581fc29c7002 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.560686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4c79f-d6dc-480d-87bb-581fc29c7002 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.561037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4c79f-d6dc-480d-87bb-581fc29c7002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.564972 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 774/1543] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.566632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e464c3-b22c-46d4-b488-0721fe4dd6a0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.568672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e464c3-b22c-46d4-b488-0721fe4dd6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.568985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e464c3-b22c-46d4-b488-0721fe4dd6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.584694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ecf4c79f-d6dc-480d-87bb-581fc29c7002 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.586592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ecf4c79f-d6dc-480d-87bb-581fc29c7002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.589802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d2e464c3-b22c-46d4-b488-0721fe4dd6a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.590949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d2e464c3-b22c-46d4-b488-0721fe4dd6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.595441 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 770/1544] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.596466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.596754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.597067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.600089 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 775/1545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.601321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91374a04-2abb-42f3-ba22-14c5dde61cda None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.601610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91374a04-2abb-42f3-ba22-14c5dde61cda None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.601893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91374a04-2abb-42f3-ba22-14c5dde61cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.624084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.624282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-91374a04-2abb-42f3-ba22-14c5dde61cda None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.625395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.625538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-91374a04-2abb-42f3-ba22-14c5dde61cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.634264 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 771/1546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.634774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 776/1547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.635111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.636388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d675-ae4e-4cca-8c04-2241f54913b3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.636885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d675-ae4e-4cca-8c04-2241f54913b3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.637263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d675-ae4e-4cca-8c04-2241f54913b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.650397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ee6c0-f0f2-46b0-b5df-84565121995c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.658227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.659010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2712d675-ae4e-4cca-8c04-2241f54913b3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.659475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.659899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.660224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2712d675-ae4e-4cca-8c04-2241f54913b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.660484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.661791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.663551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.670886 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 777/1548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.672251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73952578-d2fd-48d5-9980-f9c52ba2e0d2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.672537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73952578-d2fd-48d5-9980-f9c52ba2e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.672814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73952578-d2fd-48d5-9980-f9c52ba2e0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.676917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 772/1549] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:39.677894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.688130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886ad00-615a-47d2-849a-880f3f8ada60 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.693618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.694217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.694328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-73952578-d2fd-48d5-9980-f9c52ba2e0d2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.694601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.694771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.695416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.695528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-73952578-d2fd-48d5-9980-f9c52ba2e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.695743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.697616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e372ed-a6c9-4a9f-b25f-ea13581e0fb9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.707172 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 778/1550] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.707172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e38264-4863-469a-9399-2cb433391384 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.707172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e38264-4863-469a-9399-2cb433391384 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.707172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e38264-4863-469a-9399-2cb433391384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.712942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 773/1551] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.712942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113cd2-5229-4c2b-b679-c309561d9e6f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.712942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113cd2-5229-4c2b-b679-c309561d9e6f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.712942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113cd2-5229-4c2b-b679-c309561d9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.733332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1c113cd2-5229-4c2b-b679-c309561d9e6f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.734525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c113cd2-5229-4c2b-b679-c309561d9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.735538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-91e38264-4863-469a-9399-2cb433391384 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.736735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-91e38264-4863-469a-9399-2cb433391384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.744039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 774/1552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.747652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.747652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.747652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.756761 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 779/1553] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.758127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.758507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.758882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.767339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.768562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.780970 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 775/1554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.781129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:39.781226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.781308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:39.790688 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 780/1555] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:39.791432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c09ae-dae9-4b6a-8e31-315b8dddcf6d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.792326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.798405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.798866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.799147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.799426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.800069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.800372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.802395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.803159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3a35b-0b25-4913-9f95-0de201e37a78 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.807709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.808296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.808583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.808855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.809530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.811109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.820196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 776/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.820196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.824894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 781/1557] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:39.825599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.825972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3355b-9889-4c3e-9cc4-99679a7ae66c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.830502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.831101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.831866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.831866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.832845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.833507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.835091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.835751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bead4e2-9e59-4b89-86fc-8b6c0a1e9541 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.840454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.841084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.841368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.841644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.842270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.844307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.847331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 777/1558] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.848855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.862513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150e29d-7e6a-4e9a-8ab0-1d2c46746699 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.867784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.868383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.868669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.868990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.869633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.869938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.871509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.873327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 782/1559] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:39.874371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.889541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 778/1560] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.889541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.894381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24160-3de1-4579-ad32-923690ccfb67 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.915916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:39.929299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:39.945042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd9cc0-e3fa-40ff-8448-19a326827590 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.949792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.950396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.950673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.950946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.951590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.951892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.953289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.953520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.953962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.954249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.954528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.955176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.955487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.957158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.965727 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 783/1561] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.966574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.976912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439271a-4f0b-4dba-a3c7-c301927cb51c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.985245 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 779/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.985245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:39.985448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.985448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.985448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.985448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.985737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:39.985737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.985737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.989004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512c3b4-8f1e-4678-963f-b541c0223024 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:39.993782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:39.994372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:39.994657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:39.994927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:39.995556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:39.997478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:39.997597 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 784/1563] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:39.998282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.007597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d03e-e61d-4f2a-b28c-82530f207411 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.012290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.012965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.013250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.013645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] PATH_INFO: `/v3/projects/385cb9af38684f89a84b6b38145be97f/users/d838517b0409403fa28d9e0f4d9d4e81/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.028709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 780/1564] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:39 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.029734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.033042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385cb9af38684f89a84b6b38145be97f, user_id=d838517b0409403fa28d9e0f4d9d4e81, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.034090 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:26:40.034090 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:26:40.034090 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:26:40.036588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.050401 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 785/1565] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:39 2022] PUT /identity/v3/projects/385cb9af38684f89a84b6b38145be97f/users/d838517b0409403fa28d9e0f4d9d4e81/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:40.050966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.093579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25585856-001c-4b37-b68f-485461ad3201 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.112536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea6a1-2c06-4fd7-9903-12a7e53ca6a4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.117845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.118448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.118725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.118996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.119622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.121601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.142902 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 786/1566] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.143617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.151651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.152265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.152567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.152845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.153433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430a0a-b414-4bc4-8660-ee585a2f6ac8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.153543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.155399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.158070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.158690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.159069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.159346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.159966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.162368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.184634 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 781/1567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.185516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.200402 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 787/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.201285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.236065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:40.254669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a95c9-92dc-4bda-b4a7-2762bb06c989 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.263630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:40.267530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8d8b-93d5-4d6a-9bb6-2cdf286fb53b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.278299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.278917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.279201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.279478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.280178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.282142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.310011 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 788/1569] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.310820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.314440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.315325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.315611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.315891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.316533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.319458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.349307 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 782/1570] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.350194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.377222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d926561-403a-4803-b972-44953cc21323 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.409905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2da51-183b-4fdb-8db4-87a505cfea31 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.416121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.416726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.417037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.417313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.417949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.418955 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:26:40.418955 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:26:40.418955 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:26:40.420173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c2a57-5014-4823-a579-6b12b0f1d93b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.434922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.435665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.436084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.436316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.437013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.438938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.442525 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 783/1571] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.443758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.444052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.444330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.469478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 789/1572] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.469478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.472537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] MFA Rules not processed for user `d838517b0409403fa28d9e0f4d9d4e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:40.473866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:40.529025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5011-37a6-4825-b62a-8e82d6d7d352 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.529668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:40.534125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.534886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.535173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.535471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.536165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.537816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.545146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 784/1573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:40.546231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.555821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 790/1574] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.556929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.558224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f42e9f-2ac7-4bb9-bd27-c4ac46725cc5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.562955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.563563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.563872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.564147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.564781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.566832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.568503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdf749-203d-4439-85f1-a349aadd16e2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.573100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.573688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.573996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.574267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.574883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.576771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.586832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:40.589695 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 785/1575] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.590483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.600750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8f746-d4e8-45ca-9b27-b85db56cf14e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.601803 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 791/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 299 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.602615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.608448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.609083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.609365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.609639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.610268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.612154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef260362-0612-45ed-89b8-15b77d18f864 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.612268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.617627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.618219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.618503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.618783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.619405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.621427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.638057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 786/1577] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.638057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.645873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97057f-d31a-4aa2-8c8a-2d5c6bf32a8d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.647263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 792/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.647937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.655541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.656152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.656452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.656734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.657406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.662587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.662706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56820b-361c-47e9-b73c-9b22777c81b4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.667013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.667552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.667829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.668099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.669221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.670358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 787/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.671016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.671113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.681658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709bdd2-8a81-48c9-9da1-6748001e1730 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.687411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.687981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.688245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.688556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.689233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.691207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.696206 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 793/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 291 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.696855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.706085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06b6df-f933-4288-8daa-bfd84f86ee80 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.710737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.711322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.711606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.711895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.712523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.714155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.722995 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 788/1581] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.723790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.728662 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 794/1582] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.729769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.739752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9117c8-264e-48eb-87fa-4eb8a5e49b36 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.789955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c7f7-2937-4f44-9e39-48088c282d0d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.794678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.795298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.795583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.795856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.796497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.798171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.802463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.803068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.803348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.803621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.804266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.805866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.808552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 789/1583] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.811759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.817672 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 795/1584] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.818458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.822242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956db07-7474-4cbd-b70c-424a32a21f5a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.826772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.827358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.827638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.827750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc291a06-d1f9-484f-9dad-03622e552fae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.827909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.828541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.830135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.832343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.832990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.833274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.833550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.834186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.835741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.842080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 790/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.842988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.850635 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 796/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.851951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.853353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f450-3cee-49f4-926d-d927e6dc831f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.858118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.858790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.859072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.859346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.860003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.861654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.862139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636080-c9d6-4227-89c9-a888fc1d925f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.867817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.868403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.868682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.868979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.869612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.871196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.872318 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 791/1587] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.873134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.883222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f580e8-20a9-4bbc-923a-e8dac256a9af admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.888232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 797/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.888232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.890985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.891746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.892029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.892303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.892956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.894979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.896020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67860e-6c77-4d57-8b0c-1bad6e947e6a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.900519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.901177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.901482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.901756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] PATH_INFO: `/v3/projects/e469f1829d7b4adab5e4863ba837259b/users/4ccf8cee1cd241b7a61db479282453c4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.917872 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 792/1589] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:40 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:40.918458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.922752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e469f1829d7b4adab5e4863ba837259b, user_id=4ccf8cee1cd241b7a61db479282453c4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.925645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.930272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15b712-0eef-4e05-8bbd-36dd65024939 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.935340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:40.935870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:40.936155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:40.936429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:40.937112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:40.938848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:40.941502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 798/1590] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:40 2022] PUT /identity/v3/projects/e469f1829d7b4adab5e4863ba837259b/users/4ccf8cee1cd241b7a61db479282453c4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:40.942570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.950631 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 793/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:40.951351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:40.963160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b12039-840d-44b9-8739-be7f46eb69d2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:40.994250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:41.016290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:41.020560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a54068-d257-4d6d-b540-39f08cb9f590 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.022323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.023036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.023406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.023741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.024452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.026200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.027927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.029291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.029630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.029972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.030697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.033153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.037600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 794/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:41.038302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.050481 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 799/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:41.050481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.050740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b780d5b-c7b7-46ae-bc0e-45613e4897bb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.055770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.056480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.056827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.057220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.058183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.059592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.061862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab5216-40fe-4729-b413-9b74627bbb79 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.066633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6f9d1-2eb6-4979-b335-bb89bb4a35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.067698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6f9d1-2eb6-4979-b335-bb89bb4a35c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.068157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6f9d1-2eb6-4979-b335-bb89bb4a35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.068459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6f9d1-2eb6-4979-b335-bb89bb4a35c1 admin admin] PATH_INFO: `/v3/projects/c559be1425fc4ffdbf91dcf07b9046b6/users/93536c51174c404b9fe239b677745297/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.071427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 795/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:41.072081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.084174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f27b7-1e05-4c7a-8e91-fb471cc14c01 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.087742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6f9d1-2eb6-4979-b335-bb89bb4a35c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c559be1425fc4ffdbf91dcf07b9046b6, user_id=93536c51174c404b9fe239b677745297, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.089308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.089963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.090248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.090570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.090872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6f9d1-2eb6-4979-b335-bb89bb4a35c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.091210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.092890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.106759 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 796/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:41.107440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 800/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/c559be1425fc4ffdbf91dcf07b9046b6/users/93536c51174c404b9fe239b677745297/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.108971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.109397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.109866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.114189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.137978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f463b-109b-4fca-9d3d-25b022302af3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.144448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] MFA Rules not processed for user `4ccf8cee1cd241b7a61db479282453c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.146299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.204502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.205099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.205351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.205618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.206267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.207953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.218055 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 797/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:41.222314 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 801/1598] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.222832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.223130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.232526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac42d-0100-4221-8b35-160a4015db28 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.233832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e258d4a-e15a-4256-a4ae-43a10fd855b9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.237273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.237928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.238214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.238492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] PATH_INFO: `/v3/projects/71b7bb601bea47d88c9ad68be2651451/users/f4aebce7113c4e8980490aa0b0fbb296/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.239195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.239850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.240229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.240602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] PATH_INFO: `/v3/projects/16c4f78462ca401e9ab6a1c4672fd0fc/users/681c3a53569444e1814ae30fa55bc2d6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.257712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b7bb601bea47d88c9ad68be2651451, user_id=f4aebce7113c4e8980490aa0b0fbb296, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.258511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c4f78462ca401e9ab6a1c4672fd0fc, user_id=681c3a53569444e1814ae30fa55bc2d6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.261235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.261966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.275887 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 802/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/16c4f78462ca401e9ab6a1c4672fd0fc/users/681c3a53569444e1814ae30fa55bc2d6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.276690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.278818 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 798/1600] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/71b7bb601bea47d88c9ad68be2651451/users/f4aebce7113c4e8980490aa0b0fbb296/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.280071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.359684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fac32-1c96-4337-a48a-9a3da452d77d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.361965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455220b-b219-4ad7-8305-da88022dbc67 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.365294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66dc44-3a97-4f45-b96c-ce8ecb08753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.365952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66dc44-3a97-4f45-b96c-ce8ecb08753f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.366235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66dc44-3a97-4f45-b96c-ce8ecb08753f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.366509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66dc44-3a97-4f45-b96c-ce8ecb08753f admin admin] PATH_INFO: `/v3/projects/94e607d0847d4561b2c989abb99ed936/users/e233b00296d24acd8bc66ea3a4cf8b5e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.368036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.368930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.369445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.369803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] PATH_INFO: `/v3/projects/b59141ab746f4d1f9f9ddf9f5a2d3d60/users/b9f07b094c2b47638554b9271e74d053/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.382974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66dc44-3a97-4f45-b96c-ce8ecb08753f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e607d0847d4561b2c989abb99ed936, user_id=e233b00296d24acd8bc66ea3a4cf8b5e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.385683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66dc44-3a97-4f45-b96c-ce8ecb08753f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.386489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59141ab746f4d1f9f9ddf9f5a2d3d60, user_id=b9f07b094c2b47638554b9271e74d053, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.389340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.396721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:41.409015 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 803/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/b59141ab746f4d1f9f9ddf9f5a2d3d60/users/b9f07b094c2b47638554b9271e74d053/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.409015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.409439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 799/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/94e607d0847d4561b2c989abb99ed936/users/e233b00296d24acd8bc66ea3a4cf8b5e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.411085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.411505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.411876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.435992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:41.446677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] MFA Rules not processed for user `93536c51174c404b9fe239b677745297`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.447914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.480385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1f686-d22c-4806-8663-039614b088db admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.485026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.485687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.485964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.486235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] PATH_INFO: `/v3/projects/c4eced6c0ef2472cb3feabfb2a1febaf/users/edea67ff0e0848d88cf239caaa671923/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.501733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4eced6c0ef2472cb3feabfb2a1febaf, user_id=edea67ff0e0848d88cf239caaa671923, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.504554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.513637 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 800/1603] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.517416 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 804/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/c4eced6c0ef2472cb3feabfb2a1febaf/users/edea67ff0e0848d88cf239caaa671923/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.517810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.518491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.535461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319788-17ce-4b24-8f1b-85f07b6d1a2a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.604470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8545-7540-4386-8047-d0a41172822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.604620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab259b96-da14-48b3-807d-e347f113f75a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.605448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8545-7540-4386-8047-d0a41172822b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.605888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8545-7540-4386-8047-d0a41172822b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.606313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8545-7540-4386-8047-d0a41172822b admin admin] PATH_INFO: `/v3/projects/5f5a0abd49264f7c809fdee011e66737/users/cb315a035f9a41808badcddf0fc015d1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.610142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0b52-dfef-49c3-8758-2f1d33a0469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.610799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0b52-dfef-49c3-8758-2f1d33a0469e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.611079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0b52-dfef-49c3-8758-2f1d33a0469e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.611401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0b52-dfef-49c3-8758-2f1d33a0469e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.612052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac0b52-dfef-49c3-8758-2f1d33a0469e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.614682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac0b52-dfef-49c3-8758-2f1d33a0469e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.623348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8545-7540-4386-8047-d0a41172822b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a0abd49264f7c809fdee011e66737, user_id=cb315a035f9a41808badcddf0fc015d1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.626074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8545-7540-4386-8047-d0a41172822b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.640346 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 801/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:41 2022] PUT /identity/v3/projects/5f5a0abd49264f7c809fdee011e66737/users/cb315a035f9a41808badcddf0fc015d1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:41.647141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24ea7-d802-4bbb-af8f-d0af19ab5ede None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.647291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 805/1606] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:41.647368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24ea7-d802-4bbb-af8f-d0af19ab5ede None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.647368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24ea7-d802-4bbb-af8f-d0af19ab5ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.647514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be490a8-29dd-4ac9-a7ea-c3512883be8b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.647514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be490a8-29dd-4ac9-a7ea-c3512883be8b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.647514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be490a8-29dd-4ac9-a7ea-c3512883be8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.680590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6be490a8-29dd-4ac9-a7ea-c3512883be8b None None] MFA Rules not processed for user `681c3a53569444e1814ae30fa55bc2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.681870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6be490a8-29dd-4ac9-a7ea-c3512883be8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.684395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-28e24ea7-d802-4bbb-af8f-d0af19ab5ede None None] MFA Rules not processed for user `f4aebce7113c4e8980490aa0b0fbb296`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.685679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28e24ea7-d802-4bbb-af8f-d0af19ab5ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.752613 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 806/1607] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.752613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.752613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.752960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.766980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 802/1608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.768259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d748b10-11fe-471b-86f2-5d6945607ed9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.768555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d748b10-11fe-471b-86f2-5d6945607ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.768833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d748b10-11fe-471b-86f2-5d6945607ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.776547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:41.791392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] MFA Rules not processed for user `e233b00296d24acd8bc66ea3a4cf8b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.793645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.798687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:41.800407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5d748b10-11fe-471b-86f2-5d6945607ed9 None None] MFA Rules not processed for user `b9f07b094c2b47638554b9271e74d053`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.802059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d748b10-11fe-471b-86f2-5d6945607ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.865967 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 807/1609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.867023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.876367 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 803/1610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.881205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.881205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.881205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.909731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] MFA Rules not processed for user `edea67ff0e0848d88cf239caaa671923`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:41.911223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:41.944740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00079c01-7d2c-4c92-9d65-78b87c4eb86f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:41.950571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:41.951193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:41.951477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:41.951751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:41.952391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:41.954407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:41.985536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 804/1611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:41.985536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.990913 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 808/1612] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:41.990913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:41.997737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917c1a7-6fd9-45a4-90cb-75d044efce31 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.056887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.057676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.057959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.058234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.058893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.059298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157ccf-1127-484e-b012-a9a4c8e26621 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.060505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.064317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.065043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.065387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.065738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.066437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.068610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.074959 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 805/1613] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:42.075742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.087322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780f454-39a2-470c-90ee-cb1165a19679 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.091682 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 809/1614] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:41 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.092061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.092595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.092733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.093077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.093328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.093951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.096620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.102642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0654157-8d41-4ab0-b1b6-ef4f8e321e59 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.107294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.107987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.108708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.108708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.109280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.111173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.112747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.126831 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 806/1615] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.127816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.134749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.145200 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 810/1616] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.146223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.200858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369b1d4-74bd-43f0-8baf-f9d3c278cdb2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.225875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51088-d7c3-4528-8d2c-edf505fe8f7f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.229887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.230510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.230807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.231067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.268954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.269668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.270014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.270487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.271123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.273056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.291248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.293113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.301659 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 807/1617] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/projects => generated 397 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.302469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.303188 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 811/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:42.304053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.314620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32720b0e-7da2-45e5-86c2-d10ed55ad16c service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.374026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feca77b-0f28-42a6-887c-a2495187ba5d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.379439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.380321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.380704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.381026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.381798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.383773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.384935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.385059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.385059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.386096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.386096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.388204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.413464 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 812/1619] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.414565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.418576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 808/1620] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.419645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.427237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ec92-d153-483e-ad8e-8c9a41ea4b8b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.437611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.471732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.495681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8b81-55be-42d6-9997-94c65786a931 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.495998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.496672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.497001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.497257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] PATH_INFO: `/v3/projects/5f5a0abd49264f7c809fdee011e66737/users/cb315a035f9a41808badcddf0fc015d1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.499397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5a0abd49264f7c809fdee011e66737, user_id=cb315a035f9a41808badcddf0fc015d1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.501680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.501680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.502095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.502200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.502527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.503276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.505564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.515402 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 813/1621] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:42 2022] PUT /identity/v3/projects/5f5a0abd49264f7c809fdee011e66737/users/cb315a035f9a41808badcddf0fc015d1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:42.519331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 809/1622] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:42.519331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.521869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.530609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de947c14-cae7-4cd6-9985-fc4edbfe6e70 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.592217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab6ab1-02b9-4f3e-8e80-3f752960b4ab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.597004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.597623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.597951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.598234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.598378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.599064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.599443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.599923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.600332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.601014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.601324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.603489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.626137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 810/1623] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.626137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.631784 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 814/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.631784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.637913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aca8-dd48-4a82-b25d-edddcb706ce8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.642143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed266cb-6614-463d-8e4d-e22f1a83d154 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.643439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.644190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.644548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.645644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.646462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.647827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.651793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.651793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.651793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.652057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.652143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.652143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.667909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 815/1625] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:42.668422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.680150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280831f8-4fb2-4b22-8c77-6b2a9856adc7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.681217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 811/1626] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/users => generated 305 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.682027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.685134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7da53-6436-45f5-8ebe-93247593ec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.685732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7da53-6436-45f5-8ebe-93247593ec25 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.686038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7da53-6436-45f5-8ebe-93247593ec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.686302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7da53-6436-45f5-8ebe-93247593ec25 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.686916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7da53-6436-45f5-8ebe-93247593ec25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.688822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7da53-6436-45f5-8ebe-93247593ec25 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.691416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71206a64-9b37-488c-9cfd-deb82b3f5551 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.696125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.696803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.697138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.697398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] PATH_INFO: `/v3/projects/c43666c1c52a454ca1a0a749957487d0/users/36422091243549928cff514b1ea71c72/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.710935 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 816/1627] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/users => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:42.712386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.712685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.713043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.713851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43666c1c52a454ca1a0a749957487d0, user_id=36422091243549928cff514b1ea71c72, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.716420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.731384 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 812/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:42 2022] PUT /identity/v3/projects/c43666c1c52a454ca1a0a749957487d0/users/36422091243549928cff514b1ea71c72/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:42.732375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.744719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] MFA Rules not processed for user `cb315a035f9a41808badcddf0fc015d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:42.746026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:42.795361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.799270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e300737-9d8c-4bdd-8977-c94ae8a41ac1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.805687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.806293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.806571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.806843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.807485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.809085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.819555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 813/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:42.820315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.825109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 817/1630] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:42.825814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.835742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63f18e-9944-4084-8437-b8c6074214ff None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.836788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3376c-75d7-4031-964f-5dedf8097727 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.840569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.841859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.841859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.842019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.842229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] PATH_INFO: `/v3/users/e233b00296d24acd8bc66ea3a4cf8b5e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.842343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.842566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.843124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.843797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.843980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e233b00296d24acd8bc66ea3a4cf8b5e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.845407 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:26:42.845407 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:26:42.845407 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:26:42.845874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.847019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.857425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 814/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:42.858335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.869594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f56af-70a7-483d-9867-cad4297366de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:42.874222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:42.874801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:42.874939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:42.875180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:42.875463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] PATH_INFO: `/v3/projects/0551f527b2d14e2cb33514d236058575/users/3d2ef588a5864ddf944d31a1b63d18ce/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:42.892728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0551f527b2d14e2cb33514d236058575, user_id=3d2ef588a5864ddf944d31a1b63d18ce, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:42.895738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:42.909198 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 815/1632] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:42 2022] PUT /identity/v3/projects/0551f527b2d14e2cb33514d236058575/users/3d2ef588a5864ddf944d31a1b63d18ce/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:42.913185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.915198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e233b00296d24acd8bc66ea3a4cf8b5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:42.936884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e233b00296d24acd8bc66ea3a4cf8b5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:42.937776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e233b00296d24acd8bc66ea3a4cf8b5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:42.945950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e233b00296d24acd8bc66ea3a4cf8b5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:42.946848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e233b00296d24acd8bc66ea3a4cf8b5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:42.962787 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 818/1633] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:42 2022] DELETE /identity/v3/users/e233b00296d24acd8bc66ea3a4cf8b5e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:42.965788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:42.965788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:42.978267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687d19f-43fa-4835-8e55-cfd6c79d0fe2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.029342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f90165-34d3-4d7c-b654-520e8a8fefd7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.034347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.034946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.035223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.035645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.035878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.036415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.036514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.036691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.036992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.037633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.038080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.039770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.048078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 819/1634] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.048978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.053667 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 816/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.053816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.053924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.055504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.063777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae9a41-b2f8-4467-9a95-79a338d49910 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.067750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb7260-91e5-4503-820e-6ee9b49f46e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.068501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ffe2-e64e-49cb-9ce2-e6541f68dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.069141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ffe2-e64e-49cb-9ce2-e6541f68dcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.069427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ffe2-e64e-49cb-9ce2-e6541f68dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.069694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ffe2-e64e-49cb-9ce2-e6541f68dcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.070323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ffe2-e64e-49cb-9ce2-e6541f68dcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.071881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ffe2-e64e-49cb-9ce2-e6541f68dcdb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.072356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.073047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.073324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.073596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] PATH_INFO: `/v3/projects/9dfcd8da86654d8985bf3ce1d8bbca81/users/32299f2021c340b5b27d2dc4919299cf/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.082016 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 820/1636] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.085295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca68a-d2a2-4046-936b-2d922ed7f038 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.085295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca68a-d2a2-4046-936b-2d922ed7f038 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.085295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bca68a-d2a2-4046-936b-2d922ed7f038 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.085551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 821/1637] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 02:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:43.086124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca68a-d2a2-4046-936b-2d922ed7f038 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.087825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-24bca68a-d2a2-4046-936b-2d922ed7f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.092457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfcd8da86654d8985bf3ce1d8bbca81, user_id=32299f2021c340b5b27d2dc4919299cf, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.095395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.104090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bca68a-d2a2-4046-936b-2d922ed7f038 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.109775 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 817/1638] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/9dfcd8da86654d8985bf3ce1d8bbca81/users/32299f2021c340b5b27d2dc4919299cf/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.110585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.112142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.153820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.162850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e957b-a072-4de0-bf45-9a7f57135a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.163506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e957b-a072-4de0-bf45-9a7f57135a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.163783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e957b-a072-4de0-bf45-9a7f57135a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.164058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e957b-a072-4de0-bf45-9a7f57135a83 admin admin] PATH_INFO: `/v3/projects/9f200daffdb045f1890a5d81d8f096ac/users/a03f6143e81548208120fe6e818d87ba/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.178370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e957b-a072-4de0-bf45-9a7f57135a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200daffdb045f1890a5d81d8f096ac, user_id=a03f6143e81548208120fe6e818d87ba, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.179497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793029-f6e3-4c49-b95e-c4ac09c3ef12 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.181103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e957b-a072-4de0-bf45-9a7f57135a83 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.184416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.185157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.185471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.185814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.186610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.188407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.194714 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 822/1639] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/9f200daffdb045f1890a5d81d8f096ac/users/a03f6143e81548208120fe6e818d87ba/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.195968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.196375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.196655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.199858 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 818/1640] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.200886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.206661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.212657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4c4cc-e00f-47fe-b77b-227b362476d3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.220920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:43.222417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.272203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.272856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.273171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.273451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] PATH_INFO: `/v3/projects/e9e75c589989477a807ffd7322a4d738/users/a307c101e0f4467ca7113009fced4181/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.283390 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 823/1641] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:43.284407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.287114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.288426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e75c589989477a807ffd7322a4d738, user_id=a307c101e0f4467ca7113009fced4181, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.291134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.299016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30e24-b65c-4374-856d-ff9f21282186 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.306465 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 819/1642] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/e9e75c589989477a807ffd7322a4d738/users/a307c101e0f4467ca7113009fced4181/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.307738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.358063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a3d02-419f-486a-964a-62054ebc6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.358728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3d02-419f-486a-964a-62054ebc6b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.359010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3d02-419f-486a-964a-62054ebc6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.359290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3d02-419f-486a-964a-62054ebc6b03 admin admin] PATH_INFO: `/v3/projects/58b7759803984da1ae71aa71f3ca3380/users/e1ec0ed07d184f4dabc88050c82423f2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.369636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3e68-2eb8-4d9c-aa7b-2c3905e1a911 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.373620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3d02-419f-486a-964a-62054ebc6b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b7759803984da1ae71aa71f3ca3380, user_id=e1ec0ed07d184f4dabc88050c82423f2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.374310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.374965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.375243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.375514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] PATH_INFO: `/v3/projects/c43666c1c52a454ca1a0a749957487d0/users/36422091243549928cff514b1ea71c72/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.376288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3d02-419f-486a-964a-62054ebc6b03 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.377416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43666c1c52a454ca1a0a749957487d0, user_id=36422091243549928cff514b1ea71c72, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.380849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.391306 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 824/1643] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/58b7759803984da1ae71aa71f3ca3380/users/e1ec0ed07d184f4dabc88050c82423f2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.400492 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 820/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/c43666c1c52a454ca1a0a749957487d0/users/36422091243549928cff514b1ea71c72/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.400783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.400783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.400946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.401033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.433132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:43.434392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.453483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.468089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e533f-85a0-44ae-a695-dbc199cd2560 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.473051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.473720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.473935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.474209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.474854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.476487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.486498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 821/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.487290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.496994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6166f-6dce-4e38-a120-b95fbfab6bca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.501459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.502031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.502364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.502588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.503207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.504948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.509551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 825/1646] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 02:26:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:43.510483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.517809 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 822/1647] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.517809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.519611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.521431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.522881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743f9f8-2fd8-4ddf-9ffb-7c4e0330f287 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.528616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.529486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.530027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.530657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] PATH_INFO: `/v3/projects/0551f527b2d14e2cb33514d236058575/users/3d2ef588a5864ddf944d31a1b63d18ce/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.532803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0551f527b2d14e2cb33514d236058575, user_id=3d2ef588a5864ddf944d31a1b63d18ce, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.536226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.547037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 826/1648] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/0551f527b2d14e2cb33514d236058575/users/3d2ef588a5864ddf944d31a1b63d18ce/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.547605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.578040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f54f6-2b77-414b-8705-16e766e4ba09 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.618988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448d6ce-63a9-403d-bb67-158eec2ad3f1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.623841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.624445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.624725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.625037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.625705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.627378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.627485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910756e-9ae3-4992-84d9-5a86090e4e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.628082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910756e-9ae3-4992-84d9-5a86090e4e46 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.628422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910756e-9ae3-4992-84d9-5a86090e4e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.628857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910756e-9ae3-4992-84d9-5a86090e4e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.637291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 827/1649] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.638117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.641694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910756e-9ae3-4992-84d9-5a86090e4e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.643130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910756e-9ae3-4992-84d9-5a86090e4e46 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.648438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99f4a-3d6a-4260-add2-c392a9e2c7c4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.653811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.654425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.654532 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 823/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:43.654759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.655117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.655793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.655912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.656152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.656432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.657454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.675465 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 828/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:43.675465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.686982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1c985-97b3-48ec-b19d-e49d4a3db1c4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.688752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] MFA Rules not processed for user `36422091243549928cff514b1ea71c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:43.690309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.692171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.693014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.693397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.693793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] PATH_INFO: `/v3/projects/9dfcd8da86654d8985bf3ce1d8bbca81/users/32299f2021c340b5b27d2dc4919299cf/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.695802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfcd8da86654d8985bf3ce1d8bbca81, user_id=32299f2021c340b5b27d2dc4919299cf, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.698575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.711850 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 829/1652] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/9dfcd8da86654d8985bf3ce1d8bbca81/users/32299f2021c340b5b27d2dc4919299cf/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.721695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.788196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 824/1653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:43.788996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.800058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a17f67-d4e1-4f73-9f8a-922343abdc2c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.815747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61cbb2-5a7f-4e46-8418-8c69320fa4f4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:43.822485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.831091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.832124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.832124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.832355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.834902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.883739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd153c-567a-4d99-9386-c888833d1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:43.884066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd153c-567a-4d99-9386-c888833d1350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.884464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd153c-567a-4d99-9386-c888833d1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.884608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd153c-567a-4d99-9386-c888833d1350 admin admin] PATH_INFO: `/v3/projects/9f200daffdb045f1890a5d81d8f096ac/users/a03f6143e81548208120fe6e818d87ba/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.886948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd153c-567a-4d99-9386-c888833d1350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f200daffdb045f1890a5d81d8f096ac, user_id=a03f6143e81548208120fe6e818d87ba, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.889616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd153c-567a-4d99-9386-c888833d1350 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.902398 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 825/1654] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/9f200daffdb045f1890a5d81d8f096ac/users/a03f6143e81548208120fe6e818d87ba/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:43.903508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:43.903794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:43.904066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:43.923517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:43.927170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:43.929565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:43.941633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] MFA Rules not processed for user `3d2ef588a5864ddf944d31a1b63d18ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:43.943353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:43.944953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 830/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:43.946478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:43.959754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056baf-ddac-4228-b99c-4e2e3aef52ad service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.047610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 826/1656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.048246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.049619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4fa02-756e-4d00-84ba-acf95a5ee6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.050524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fa02-756e-4d00-84ba-acf95a5ee6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.051074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fa02-756e-4d00-84ba-acf95a5ee6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.052409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4fa02-756e-4d00-84ba-acf95a5ee6fe admin admin] PATH_INFO: `/v3/projects/e9e75c589989477a807ffd7322a4d738/users/a307c101e0f4467ca7113009fced4181/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.054640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fa02-756e-4d00-84ba-acf95a5ee6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e75c589989477a807ffd7322a4d738, user_id=a307c101e0f4467ca7113009fced4181, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.057522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4fa02-756e-4d00-84ba-acf95a5ee6fe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.062636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db5ffc-8130-4fd8-b161-39adb1ae7a96 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.067794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bd594-bf8d-43cd-b252-fb2e95c916ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.068554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd594-bf8d-43cd-b252-fb2e95c916ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.068930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd594-bf8d-43cd-b252-fb2e95c916ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.069302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bd594-bf8d-43cd-b252-fb2e95c916ee admin admin] PATH_INFO: `/v3/projects/58b7759803984da1ae71aa71f3ca3380/users/e1ec0ed07d184f4dabc88050c82423f2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.070126 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 831/1657] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:43 2022] PUT /identity/v3/projects/e9e75c589989477a807ffd7322a4d738/users/a307c101e0f4467ca7113009fced4181/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:44.071332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.071621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.071893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.078602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bd594-bf8d-43cd-b252-fb2e95c916ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b7759803984da1ae71aa71f3ca3380, user_id=e1ec0ed07d184f4dabc88050c82423f2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.081914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bd594-bf8d-43cd-b252-fb2e95c916ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.097057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 827/1658] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:44 2022] PUT /identity/v3/projects/58b7759803984da1ae71aa71f3ca3380/users/e1ec0ed07d184f4dabc88050c82423f2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:44.099851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ff72-5e33-45d5-833b-3c1ef2580b67 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.100331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ff72-5e33-45d5-833b-3c1ef2580b67 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.101051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ff72-5e33-45d5-833b-3c1ef2580b67 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.102156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] MFA Rules not processed for user `32299f2021c340b5b27d2dc4919299cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.103082 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 828/1659] 10.222.0.16 () {54 vars in 961 bytes} [Wed Oct 5 02:26:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:44.103428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.104679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb485d7-c00b-4c1d-ac58-9c0dd5af24e1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.105161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb485d7-c00b-4c1d-ac58-9c0dd5af24e1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.105840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb485d7-c00b-4c1d-ac58-9c0dd5af24e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.136117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ccb485d7-c00b-4c1d-ac58-9c0dd5af24e1 None None] MFA Rules not processed for user `a03f6143e81548208120fe6e818d87ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.137616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ccb485d7-c00b-4c1d-ac58-9c0dd5af24e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.185724 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 832/1660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.186566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.187864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.221484 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 829/1661] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.224538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836669b-6819-4c24-81ea-9c59f529b4fe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.224828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836669b-6819-4c24-81ea-9c59f529b4fe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.225130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836669b-6819-4c24-81ea-9c59f529b4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.245169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.254450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7836669b-6819-4c24-81ea-9c59f529b4fe None None] MFA Rules not processed for user `a307c101e0f4467ca7113009fced4181`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.255657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7836669b-6819-4c24-81ea-9c59f529b4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.266561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b06cb-ca03-432a-a2e4-4794a5a9038e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.271658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.272289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.272569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.272847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] PATH_INFO: `/v3/projects/94e607d0847d4561b2c989abb99ed936` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.273975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e607d0847d4561b2c989abb99ed936)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.275870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.293731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.324623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 830/1662] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.325175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e607d0847d4561b2c989abb99ed936', 'request_id': 'req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.325809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.326102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.326385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.331507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e607d0847d4561b2c989abb99ed936', 'request_id': 'req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.338656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e607d0847d4561b2c989abb99ed936', 'request_id': 'req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.352682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] The token cache is being invalidate because project 94e607d0847d4561b2c989abb99ed936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:44.353024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.353850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ed4f316-a1c8-4c76-ba61-19e6a51cf8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.355569 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 833/1663] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:44 2022] DELETE /identity/v3/projects/94e607d0847d4561b2c989abb99ed936 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:44.356627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19931c7b-bb79-44ac-bb73-5efa91c03816 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.356945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19931c7b-bb79-44ac-bb73-5efa91c03816 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.357230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19931c7b-bb79-44ac-bb73-5efa91c03816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.359956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] MFA Rules not processed for user `e1ec0ed07d184f4dabc88050c82423f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.361306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.377549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-19931c7b-bb79-44ac-bb73-5efa91c03816 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.378755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19931c7b-bb79-44ac-bb73-5efa91c03816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.430523 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 831/1664] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.431614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.432954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.447668 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 834/1665] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.449021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.449322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.449601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.471212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.472566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.506472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172828b-018f-49d2-b762-a85d4d28d8cb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.511870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.512480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.512759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.513059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.514796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.531426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 835/1666] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.532270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.534299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.550555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45002256-67e7-4889-a735-d42b8367d9f7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.556274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.557073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.557352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.557629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.560129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.576861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.578478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a5903-1f18-471b-a538-7a33078bc401 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.588504 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 832/1667] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:44.589811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.590061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.590340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.597540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.615669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.617061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.625548 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 833/1668] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.626520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.627798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.632501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.634263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.640534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bb44-f32e-4ccd-95f1-b47467721f83 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.644142 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 836/1669] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:44.645593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.645857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.646528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.646811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.647078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] PATH_INFO: `/v3/users/93536c51174c404b9fe239b677745297` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.648202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93536c51174c404b9fe239b677745297)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.650134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.663108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228289-9f77-4652-8703-247bb01e90db service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.670843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.671557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.671899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.672239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.674106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.709610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93536c51174c404b9fe239b677745297'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.726787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93536c51174c404b9fe239b677745297'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.727624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93536c51174c404b9fe239b677745297'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.736155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93536c51174c404b9fe239b677745297'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.737165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93536c51174c404b9fe239b677745297'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:44.751844 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 834/1670] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:44 2022] DELETE /identity/v3/users/93536c51174c404b9fe239b677745297 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:44.752742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.755640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.757737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.758468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3972b9-cf9c-4dcd-854f-935be92d400b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.773641 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 837/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:44.775823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.776391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.777139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.812795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:44.815125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.853918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1144d2-0624-42ad-be28-68763b0e1763 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.858700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.859311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.859826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.859931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.860498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:44.860808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.862437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.875634 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 835/1672] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:44.880137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.890861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff98e72-7ce4-46bf-81d0-63b29225778c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:44.906172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:44.907078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:44.907599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:44.907880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:44.908527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:44.910072 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 838/1673] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:44.917307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:44.917514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.917514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.931679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.952748 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 836/1674] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:44 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:44.953916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:44.956123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:44.994798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:44.999523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150552bc-b71f-491d-a299-087fbbfaaded None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.014156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c95b7-8306-48ed-91d7-c9a99e13b0a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.017953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.018535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.018814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.019085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.063305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.063903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.064292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.064393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.066419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.089582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.091012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.103955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 837/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:45.104827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.117028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fc87a-ad2c-4549-9eb7-05052f0091ed service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.123502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.124187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.124659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.125034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.125738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.127849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.134170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.136064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10b09-9e60-472a-bc85-c35ec2046d3a service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.147113 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 839/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:45.148240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.148529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.148826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.150454 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 840/1677] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:45.155155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:26:45.157629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.158371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 838/1678] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:45 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:45.162142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.174497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7828d4f-823e-4079-aaa5-16df92ae8d65 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.181242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.181979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.182404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.182783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.183538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.185448 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 05 02:26:45.185448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.186142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.187295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.199024 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 839/1679] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:26:45.203187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.222280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e5a0e-6f8f-401d-a6ba-0c12fe564c64 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.233000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.233740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.234141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.234479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.235380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.237145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.249327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 840/1680] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:45.250338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.263505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb79c-2dbb-4874-9872-94d629535bcf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.269039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.270387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.271240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.271240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.272963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.281801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ade0f-287c-4525-8253-5cbce4c7c47c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.287933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb315a035f9a41808badcddf0fc015d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f5a0abd49264f7c809fdee011e66737', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.289263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.290338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.291250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] PATH_INFO: `/v3/projects/385cb9af38684f89a84b6b38145be97f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.293209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] RBAC: Authorizing `identity:get_project(project_id=385cb9af38684f89a84b6b38145be97f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.295708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.298263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 841/1681] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:26:45 2022] GET /identity/v3/projects/385cb9af38684f89a84b6b38145be97f => generated 379 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:26:45.299513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.313332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e77681-c070-4e9c-b6af-a92f6c5a2ade tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.320312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee79cf-001d-4440-ac86-cfa7079569b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.321338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee79cf-001d-4440-ac86-cfa7079569b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.321788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee79cf-001d-4440-ac86-cfa7079569b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.322509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee79cf-001d-4440-ac86-cfa7079569b7 admin admin] PATH_INFO: `/v3/projects/d96631fc5adf4139b9fa9426d1ffacd6/users/03248810e8424e6db93e74efb8062173/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.347521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee79cf-001d-4440-ac86-cfa7079569b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96631fc5adf4139b9fa9426d1ffacd6, user_id=03248810e8424e6db93e74efb8062173, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.351475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee79cf-001d-4440-ac86-cfa7079569b7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.355261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.357003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.370431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:45.376702 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 841/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:45.378027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.381193 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 842/1683] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:45 2022] PUT /identity/v3/projects/d96631fc5adf4139b9fa9426d1ffacd6/users/03248810e8424e6db93e74efb8062173/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:45.391542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89857b0c-8615-4cd3-bd97-1700b67f20cb service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.393235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.393529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.393804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.451014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:45.463899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] MFA Rules not processed for user `03248810e8424e6db93e74efb8062173`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:45.465609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.480200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.480924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.481278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.481621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.484436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.549564 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 843/1684] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:26:45.551311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.578431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.580606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.605518 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 842/1685] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:45 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:45.617644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.619121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.670098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3303-47b8-42d4-b681-c5b4bc497bd1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.674980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.675756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.676626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.677427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.678150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.680136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.735813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5a0c-603d-4d58-97af-d10f0daf9e1e service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.740441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.741130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.741382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.741754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] PATH_INFO: `/v3/projects/c559be1425fc4ffdbf91dcf07b9046b6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.743058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c559be1425fc4ffdbf91dcf07b9046b6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.744400 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:26:45.744400 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:26:45.744400 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:26:45.745265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 844/1686] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:45 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:45.746184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.747957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.750475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.802921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:45.823761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c559be1425fc4ffdbf91dcf07b9046b6', 'request_id': 'req-ee71e6ec-16da-448f-befc-a3d827be3044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.834762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c559be1425fc4ffdbf91dcf07b9046b6', 'request_id': 'req-ee71e6ec-16da-448f-befc-a3d827be3044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.843856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c559be1425fc4ffdbf91dcf07b9046b6', 'request_id': 'req-ee71e6ec-16da-448f-befc-a3d827be3044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.844977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502348be-a32b-495c-9eec-e23c824666dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.865781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] The token cache is being invalidate because project c559be1425fc4ffdbf91dcf07b9046b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:45.866044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.866657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.868170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 843/1687] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:45 2022] DELETE /identity/v3/projects/c559be1425fc4ffdbf91dcf07b9046b6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:26:45.868977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.872224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.877745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:45.906751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.907381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.907665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.908069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] PATH_INFO: `/v3/users/4ccf8cee1cd241b7a61db479282453c4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.909215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccf8cee1cd241b7a61db479282453c4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:45.911167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:45.951233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71e6ec-16da-448f-befc-a3d827be3044 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:45.957554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:45.958054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:45.958465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:45.958586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:45.959963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccf8cee1cd241b7a61db479282453c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.960354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:45.972370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccf8cee1cd241b7a61db479282453c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.973184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccf8cee1cd241b7a61db479282453c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.981737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccf8cee1cd241b7a61db479282453c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.982399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccf8cee1cd241b7a61db479282453c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:45.995879 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 845/1688] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:45 2022] DELETE /identity/v3/users/4ccf8cee1cd241b7a61db479282453c4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:45.996847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:45.998461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.025107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.026703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.036536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 844/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:46.037182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.038894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.052371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c2f1d-b5bf-4af5-b529-4e003756a814 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.071798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756c3e0-57aa-454d-9853-c41fd106a3ad admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.076773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.077120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.077406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.077687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] PATH_INFO: `/v3/users/edea67ff0e0848d88cf239caaa671923` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.078889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edea67ff0e0848d88cf239caaa671923)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.081063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.122463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.123110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.123456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.123828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.124529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.126490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.134302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edea67ff0e0848d88cf239caaa671923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.135252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:46.140558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:46.150566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edea67ff0e0848d88cf239caaa671923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.151506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edea67ff0e0848d88cf239caaa671923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.152016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 845/1690] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:46 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:46.156081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.157884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.159252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edea67ff0e0848d88cf239caaa671923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.159942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a70ac5ba-6ce9-4100-a33f-f2b00c9828d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edea67ff0e0848d88cf239caaa671923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.169602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31aeff8-b58f-434c-8ba7-9f516c21b014 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.172730 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 846/1691] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:45 2022] DELETE /identity/v3/users/edea67ff0e0848d88cf239caaa671923 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:46.174053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e53ea-2f72-45f8-ab4c-b54f3326514d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.174340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e53ea-2f72-45f8-ab4c-b54f3326514d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.174613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e53ea-2f72-45f8-ab4c-b54f3326514d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.176956 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 847/1692] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:46.177182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.177822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.178089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a280c-a431-41a3-9717-0bfbc45275da None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.178199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.178361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] PATH_INFO: `/v3/users/3d2ef588a5864ddf944d31a1b63d18ce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.178452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a280c-a431-41a3-9717-0bfbc45275da None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.178650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a280c-a431-41a3-9717-0bfbc45275da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.179484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2ef588a5864ddf944d31a1b63d18ce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.181422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.198657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-047a280c-a431-41a3-9717-0bfbc45275da None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:46.200402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-047a280c-a431-41a3-9717-0bfbc45275da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.234832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2ef588a5864ddf944d31a1b63d18ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.247652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2ef588a5864ddf944d31a1b63d18ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.248368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2ef588a5864ddf944d31a1b63d18ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.256332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2ef588a5864ddf944d31a1b63d18ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.257085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be164a1c-3e54-472f-89da-6e7371a65d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2ef588a5864ddf944d31a1b63d18ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:46.263170 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 848/1693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:46.264421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3d31-7ded-4970-ae14-68eaaa4fe2bf None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.264716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3d31-7ded-4970-ae14-68eaaa4fe2bf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.265022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3d31-7ded-4970-ae14-68eaaa4fe2bf None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.266440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 849/1694] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:46.271779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3d31-7ded-4970-ae14-68eaaa4fe2bf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.273498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f72a3d31-7ded-4970-ae14-68eaaa4fe2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.274141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 846/1695] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:46 2022] DELETE /identity/v3/users/3d2ef588a5864ddf944d31a1b63d18ce => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:46.275412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.275703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.275986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.299117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:46.300335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.351294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3d31-7ded-4970-ae14-68eaaa4fe2bf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.356459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5e3a1-010f-4a50-82e9-7570febf6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.357244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e3a1-010f-4a50-82e9-7570febf6052 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.357530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e3a1-010f-4a50-82e9-7570febf6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.357876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5e3a1-010f-4a50-82e9-7570febf6052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.358606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5e3a1-010f-4a50-82e9-7570febf6052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.360265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5e3a1-010f-4a50-82e9-7570febf6052 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.371775 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 850/1696] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:46.372348 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 847/1697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:46.373920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.374134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.376005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.376120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:26:46.376468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.400578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:46.401861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.443742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:46.470379 n-d-858272-3 devstack@keystone.service[81827]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 05 02:26:46.470827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.472144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.487984 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 851/1698] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:26:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:46.489719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.491535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.498548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:46.565796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d877f-f728-4951-9cb9-c4ee6288d5a2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.572128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb315a035f9a41808badcddf0fc015d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f5a0abd49264f7c809fdee011e66737', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.572940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.573294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.573642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] PATH_INFO: `/v3/projects/385cb9af38684f89a84b6b38145be97f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.575298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] RBAC: Authorizing `identity:get_project(project_id=385cb9af38684f89a84b6b38145be97f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.578495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.586763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a4c58-5a9d-4fae-a5fa-11d55b6ab2d2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.590377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.590558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 848/1699] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:26:46 2022] GET /identity/v3/projects/385cb9af38684f89a84b6b38145be97f => generated 379 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:46.590986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.591263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.591532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.591888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.604096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.605846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.609721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d5df8-2ddd-403e-a00e-fee2d94131f7 tempest-FlavorsAccessTestJSON-1623173671 tempest-FlavorsAccessTestJSON-1623173671-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.617002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.617942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.618371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.619101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] PATH_INFO: `/v3/projects/7f31cc43afe644798a4fa51cf6710ea0/users/5054d03a1bc6467fad701a74e144e270/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.626543 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 852/1700] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:46.628942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.635229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.644149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f31cc43afe644798a4fa51cf6710ea0, user_id=5054d03a1bc6467fad701a74e144e270, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.648492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.682074 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 849/1701] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:46 2022] PUT /identity/v3/projects/7f31cc43afe644798a4fa51cf6710ea0/users/5054d03a1bc6467fad701a74e144e270/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:46.682074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.682307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb7b7-6e1a-4b29-8dec-03275a42b1d5 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.691116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.749784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.750501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.750855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.751200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.786054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75ed09-8f9f-4145-82f1-61c286343334 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.794063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.794753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.794995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.795297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.813415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.816047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.831534 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 850/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:46.832794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.835349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:46.858334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.860072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.873365 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 853/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:46.874232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.884734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f1c5-ba3d-45b6-a5c7-71e3c0ca8080 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.890100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.891054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.891745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.892271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.893101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.895118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.907263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 854/1704] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:46.909658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac554-d3d4-4c8b-bc94-edc232206e1c service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.913284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:46.925173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d706139-bd16-49c5-a07c-486965f2d886 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:46.926810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.927844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.928424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.929045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] PATH_INFO: `/v3/projects/0551f527b2d14e2cb33514d236058575` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.931333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cc732-c4b9-4b0e-b785-816f183ad291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:46.931679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0551f527b2d14e2cb33514d236058575)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.932382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cc732-c4b9-4b0e-b785-816f183ad291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.933080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cc732-c4b9-4b0e-b785-816f183ad291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.933505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cc732-c4b9-4b0e-b785-816f183ad291 admin admin] PATH_INFO: `/v3/projects/7f31cc43afe644798a4fa51cf6710ea0/users/5054d03a1bc6467fad701a74e144e270/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:46.935895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cc732-c4b9-4b0e-b785-816f183ad291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f31cc43afe644798a4fa51cf6710ea0, user_id=5054d03a1bc6467fad701a74e144e270, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:46.936541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.941989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cc732-c4b9-4b0e-b785-816f183ad291 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:46.958630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 855/1705] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:46 2022] PUT /identity/v3/projects/7f31cc43afe644798a4fa51cf6710ea0/users/5054d03a1bc6467fad701a74e144e270/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:26:46.971102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e090c9-7acf-43a5-ae0c-dd48e0cd4b85 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:46.971350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e090c9-7acf-43a5-ae0c-dd48e0cd4b85 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:46.971633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e090c9-7acf-43a5-ae0c-dd48e0cd4b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.021086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b8e090c9-7acf-43a5-ae0c-dd48e0cd4b85 None None] MFA Rules not processed for user `5054d03a1bc6467fad701a74e144e270`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:47.022573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8e090c9-7acf-43a5-ae0c-dd48e0cd4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.045763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0551f527b2d14e2cb33514d236058575', 'request_id': 'req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.056666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:47.058095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0551f527b2d14e2cb33514d236058575', 'request_id': 'req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.065412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:47.069709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0551f527b2d14e2cb33514d236058575', 'request_id': 'req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.087315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] The token cache is being invalidate because project 0551f527b2d14e2cb33514d236058575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:47.088001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.089613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.091694 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 851/1706] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:46 2022] DELETE /identity/v3/projects/0551f527b2d14e2cb33514d236058575 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:47.096089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.099138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.126396 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 856/1707] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:47.130930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.146468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.149660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.173505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] MFA Rules not processed for user `f4aebce7113c4e8980490aa0b0fbb296`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:47.174906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.201479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9a1da-1ca9-4c08-b790-5b721d264cd1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.208686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.209693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.209828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.210260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] PATH_INFO: `/v3/users/d838517b0409403fa28d9e0f4d9d4e81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.211417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d838517b0409403fa28d9e0f4d9d4e81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.213996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.238159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 857/1708] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:47.239801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.241263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.258673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b1ac7-9962-4193-b531-2c1a6f772067 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.268271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.268992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.269278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.269575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] PATH_INFO: `/v3/projects/e469f1829d7b4adab5e4863ba837259b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.272092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e469f1829d7b4adab5e4863ba837259b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.272774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.278894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd838517b0409403fa28d9e0f4d9d4e81'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.293213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd838517b0409403fa28d9e0f4d9d4e81'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.294150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd838517b0409403fa28d9e0f4d9d4e81'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.305633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd838517b0409403fa28d9e0f4d9d4e81'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.306584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76eadfb3-b81c-42b8-9884-8a0a7907d509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd838517b0409403fa28d9e0f4d9d4e81'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.324745 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 852/1709] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:47 2022] DELETE /identity/v3/users/d838517b0409403fa28d9e0f4d9d4e81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:47.326398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.326631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.326915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.341646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e469f1829d7b4adab5e4863ba837259b', 'request_id': 'req-0f3aa463-518a-46a2-9546-3739122b71ea'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.348454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e469f1829d7b4adab5e4863ba837259b', 'request_id': 'req-0f3aa463-518a-46a2-9546-3739122b71ea'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.351910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:47.353952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.354788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e469f1829d7b4adab5e4863ba837259b', 'request_id': 'req-0f3aa463-518a-46a2-9546-3739122b71ea'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.367486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] The token cache is being invalidate because project e469f1829d7b4adab5e4863ba837259b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:47.367868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.368513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.370062 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 858/1710] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:47 2022] DELETE /identity/v3/projects/e469f1829d7b4adab5e4863ba837259b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:47.372970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.372970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.416444 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 853/1711] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:47.417312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.418617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.427952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:47.430673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:47.455393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aa463-518a-46a2-9546-3739122b71ea admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.498765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93269af-52f3-4393-bfcd-51afe6eff1aa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.504244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.504848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.505149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.505428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.507139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.519586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.520710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.521024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.521299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.523022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.565709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.568098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.577825 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 854/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:47.578614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.579884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.586108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.587699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b013a-cf17-426f-9d60-b823b72dd07f service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.594176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85433dd5-ff87-4a53-bf22-9d2fce8dbe3b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.598376 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 859/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:47.599086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.599722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.599970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.600069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.600264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.600376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.600460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] PATH_INFO: `/v3/projects/c4eced6c0ef2472cb3feabfb2a1febaf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.601608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4eced6c0ef2472cb3feabfb2a1febaf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.603491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.620209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:47.621600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.637439 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 860/1714] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:47.640115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.642233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.659553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5fc4a-95fb-4343-8155-022a67cc025b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.686106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4eced6c0ef2472cb3feabfb2a1febaf', 'request_id': 'req-bf175a3f-86ab-4aa9-8128-c7fc2045532e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.700664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4eced6c0ef2472cb3feabfb2a1febaf', 'request_id': 'req-bf175a3f-86ab-4aa9-8128-c7fc2045532e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.710116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4eced6c0ef2472cb3feabfb2a1febaf', 'request_id': 'req-bf175a3f-86ab-4aa9-8128-c7fc2045532e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.724435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] The token cache is being invalidate because project c4eced6c0ef2472cb3feabfb2a1febaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:47.725040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.725827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bf175a3f-86ab-4aa9-8128-c7fc2045532e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.727737 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 855/1715] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:47 2022] DELETE /identity/v3/projects/c4eced6c0ef2472cb3feabfb2a1febaf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:47.729147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.729557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.729927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.747684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.748651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.749226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.749539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] PATH_INFO: `/v3/users/36422091243549928cff514b1ea71c72` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.750986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36422091243549928cff514b1ea71c72)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.752847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.756048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:47.757447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.768946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 856/1716] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:47.774656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.776637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.779400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:47.803564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:47.819711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36422091243549928cff514b1ea71c72'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.832289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36422091243549928cff514b1ea71c72'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.833741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36422091243549928cff514b1ea71c72'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.842184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36422091243549928cff514b1ea71c72'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.842898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d7cbe1c-2adb-4044-a4ec-0b71426d37b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36422091243549928cff514b1ea71c72'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:47.844425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b8a69-104e-41a7-85da-a65be2de1681 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.848403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.849044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.849325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.849597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.851335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.855789 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 861/1717] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:47 2022] DELETE /identity/v3/users/36422091243549928cff514b1ea71c72 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:47.857052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46bb11-f0e9-4ced-a601-4b0d38a5223f None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.857334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46bb11-f0e9-4ced-a601-4b0d38a5223f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.857610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46bb11-f0e9-4ced-a601-4b0d38a5223f None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.859303 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 862/1718] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:47.859895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46bb11-f0e9-4ced-a601-4b0d38a5223f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.862477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2a46bb11-f0e9-4ced-a601-4b0d38a5223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.864471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.866096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.877003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 857/1719] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:47.877709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:47.882650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:47.901873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d089c-6632-4666-8711-341a5bf52056 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.946463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46bb11-f0e9-4ced-a601-4b0d38a5223f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:47.952531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.953292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.953581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.954022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] PATH_INFO: `/v3/users/a307c101e0f4467ca7113009fced4181` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.955646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a307c101e0f4467ca7113009fced4181)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.958388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.973461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:47.974243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.974534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.974812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:47.975475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:47.975778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:47.977559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084436b-a3cd-489a-bd99-09021f2aa6ba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:47.994030 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 858/1720] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:47.995347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:47.995654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:47.995915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.020397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:48.021810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.029999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a307c101e0f4467ca7113009fced4181'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.045753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a307c101e0f4467ca7113009fced4181'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.047001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a307c101e0f4467ca7113009fced4181'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.057794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a307c101e0f4467ca7113009fced4181'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.058652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a307c101e0f4467ca7113009fced4181'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.076138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 863/1721] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:47 2022] DELETE /identity/v3/users/a307c101e0f4467ca7113009fced4181 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:48.077145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.078575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.092946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:48.117120 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 859/1722] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:26:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:48.135157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.136989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.189996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612875-e884-4247-b128-ef6def6ddd97 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.197218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.197833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.198123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.198398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.199419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.201568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.218809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:48.247477 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 864/1723] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:48 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:48.249288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.251387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f809e-f498-4c4f-b26d-3d35b8d89112 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.336072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.337180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.339513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b044f-7146-487f-9647-4ddbb521c038 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.340122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.340380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.346585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.347211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.348487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.348487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.348990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.351716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.383607 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 865/1724] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:48 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:48.384825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.386884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.409544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf4bb1-be39-48b4-ac9d-85bab38ad3f0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.416777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.417783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.418070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.418804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] PATH_INFO: `/v3/projects/c43666c1c52a454ca1a0a749957487d0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.422869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43666c1c52a454ca1a0a749957487d0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.425978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.446071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.448288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.465931 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 860/1725] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:26:48.466790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.482174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adf029-0599-45cc-a39d-878693078465 service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.483377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43666c1c52a454ca1a0a749957487d0', 'request_id': 'req-3ba39e7b-5e35-4f16-b617-0f6e358fc102'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.491315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43666c1c52a454ca1a0a749957487d0', 'request_id': 'req-3ba39e7b-5e35-4f16-b617-0f6e358fc102'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.515248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43666c1c52a454ca1a0a749957487d0', 'request_id': 'req-3ba39e7b-5e35-4f16-b617-0f6e358fc102'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.538167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] The token cache is being invalidate because project c43666c1c52a454ca1a0a749957487d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:48.538457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.539188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.541605 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 866/1726] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:48 2022] DELETE /identity/v3/projects/c43666c1c52a454ca1a0a749957487d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:48.542782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.545546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.561058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a8fd-7af3-49c5-b359-8425608bf86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.561713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a8fd-7af3-49c5-b359-8425608bf86c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.562037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a8fd-7af3-49c5-b359-8425608bf86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.562280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a8fd-7af3-49c5-b359-8425608bf86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.562711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:48.564048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a8fd-7af3-49c5-b359-8425608bf86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.566086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a8fd-7af3-49c5-b359-8425608bf86c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.581265 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 861/1727] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:48.586091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.586592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.586844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.628783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:48.630364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.639899 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 862/1728] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:48.640957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.645985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39e7b-5e35-4f16-b617-0f6e358fc102 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.648592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.652239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.653102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.653400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.653679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] PATH_INFO: `/v3/projects/385cb9af38684f89a84b6b38145be97f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.654873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=385cb9af38684f89a84b6b38145be97f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.656890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.664106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e94b8e-2add-4707-83e0-23e721cb414a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.669298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.670077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.670373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.670646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.671301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.673006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.684893 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 863/1729] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:48.685970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.689439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.700135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:48.704604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1406e2-1909-44aa-a724-815c21812b7c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.717255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385cb9af38684f89a84b6b38145be97f', 'request_id': 'req-8abbac01-a70e-4c9c-ad72-12e78431a7de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.724334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385cb9af38684f89a84b6b38145be97f', 'request_id': 'req-8abbac01-a70e-4c9c-ad72-12e78431a7de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.731949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385cb9af38684f89a84b6b38145be97f', 'request_id': 'req-8abbac01-a70e-4c9c-ad72-12e78431a7de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.749471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] The token cache is being invalidate because project 385cb9af38684f89a84b6b38145be97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:48.749887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.750639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8abbac01-a70e-4c9c-ad72-12e78431a7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.752718 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 867/1730] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:48 2022] DELETE /identity/v3/projects/385cb9af38684f89a84b6b38145be97f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:48.755733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.756329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.756839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.773314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.774083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.774371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.774651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] PATH_INFO: `/v3/projects/e9e75c589989477a807ffd7322a4d738` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.776828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e75c589989477a807ffd7322a4d738)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.778789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.781004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:48.782971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.792536 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 868/1731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:48.793259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.794558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.807649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcb49c-1e7b-4294-82d2-0463682fb0bf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.812843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.813600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.813938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.814211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] PATH_INFO: `/v3/projects/205b2ecb09f94f48a682a22555b084e6/users/1a6e771a42484ae09e43df3007b5e3c6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.838797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205b2ecb09f94f48a682a22555b084e6, user_id=1a6e771a42484ae09e43df3007b5e3c6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.839069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e75c589989477a807ffd7322a4d738', 'request_id': 'req-80ca85db-9fa5-4619-bd09-83caea1be445'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.842975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.849367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e75c589989477a807ffd7322a4d738', 'request_id': 'req-80ca85db-9fa5-4619-bd09-83caea1be445'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.856249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e75c589989477a807ffd7322a4d738', 'request_id': 'req-80ca85db-9fa5-4619-bd09-83caea1be445'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.860809 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 869/1732] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:48 2022] PUT /identity/v3/projects/205b2ecb09f94f48a682a22555b084e6/users/1a6e771a42484ae09e43df3007b5e3c6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:48.862241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.871298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.873308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] The token cache is being invalidate because project e9e75c589989477a807ffd7322a4d738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:48.873607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.874294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:48.875980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 864/1733] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:48 2022] DELETE /identity/v3/projects/e9e75c589989477a807ffd7322a4d738 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:48.881390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:48.883485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:48.948001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0755-b3dd-40e5-ba15-f9178730d880 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.954082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.954818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.955325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.955663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] PATH_INFO: `/v3/users/cb315a035f9a41808badcddf0fc015d1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.956978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb315a035f9a41808badcddf0fc015d1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.959265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.966406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:48.970562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca85db-9fa5-4619-bd09-83caea1be445 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:48.977553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:48.978268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.978603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.978921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:48.980252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:48.980252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:48.981614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63bffc-8eda-47f9-bccb-7be7ec0d7b38 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:48.996953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 865/1734] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:48.998913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:48.999388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:48.999666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.016582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb315a035f9a41808badcddf0fc015d1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.030948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb315a035f9a41808badcddf0fc015d1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.031753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb315a035f9a41808badcddf0fc015d1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.033070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] MFA Rules not processed for user `1a6e771a42484ae09e43df3007b5e3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:49.034381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.048188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb315a035f9a41808badcddf0fc015d1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.049026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46005050-3dfb-4144-ba63-57c599a9bc5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb315a035f9a41808badcddf0fc015d1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.056660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:49.067397 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 870/1735] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:48 2022] DELETE /identity/v3/users/cb315a035f9a41808badcddf0fc015d1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:49.069979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c429-8740-49b2-809e-550cf09a3472 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.077163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c429-8740-49b2-809e-550cf09a3472 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.077767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341c429-8740-49b2-809e-550cf09a3472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.151392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c341c429-8740-49b2-809e-550cf09a3472 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:49.152744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c341c429-8740-49b2-809e-550cf09a3472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.157653 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 866/1736] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:49.158866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.161969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.178749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb723b2-0489-4886-abd6-5fc5dc13ea58 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.229867 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 871/1737] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:49.231291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c71d56-b4b3-42b4-a75b-78edb4a6c046 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.231845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c71d56-b4b3-42b4-a75b-78edb4a6c046 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.236980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c71d56-b4b3-42b4-a75b-78edb4a6c046 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.237138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 872/1738] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:26:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:49.238030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c71d56-b4b3-42b4-a75b-78edb4a6c046 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.246432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a2c71d56-b4b3-42b4-a75b-78edb4a6c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.259217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.260065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.260137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.260433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.261366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.263487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.296104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 867/1739] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:49.297286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.299275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.329266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c71d56-b4b3-42b4-a75b-78edb4a6c046 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.361145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:49.370338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1ba0-65b3-4715-bca5-a861174a6119 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.375102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b03d6-d6af-47aa-9e4c-f0c7fcdfd25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.375739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b03d6-d6af-47aa-9e4c-f0c7fcdfd25b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.375993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b03d6-d6af-47aa-9e4c-f0c7fcdfd25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.376266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b03d6-d6af-47aa-9e4c-f0c7fcdfd25b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.376923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b03d6-d6af-47aa-9e4c-f0c7fcdfd25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.379695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b03d6-d6af-47aa-9e4c-f0c7fcdfd25b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.408948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.409673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.409965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.410227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.412074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.415983 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 868/1740] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:49.417567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.417852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.418122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.423871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.425746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4ff46-7f56-46fc-8d33-c8b131cdde09 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.439290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 873/1741] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:49.440538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.441039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.441329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.448797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:49.450440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.462530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:49.463730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.482448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:49.529937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 869/1742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:49.531554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.542102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258c6b-f3ac-4c3f-bcec-25c02564e31e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.544258 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 874/1743] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:49.545346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.546679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.558104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.558801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.559190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.559359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.560003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.560774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92af6a-5cc5-405a-bdb4-f205589ef897 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.561963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.565334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.565968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.566246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.566833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] PATH_INFO: `/v3/projects/5f5a0abd49264f7c809fdee011e66737` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.568275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5a0abd49264f7c809fdee011e66737)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.570208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.596981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 870/1744] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/users => generated 295 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:49.596981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.609914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fea753-48d7-42b4-86a3-7eb08e36064f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.615536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.616149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.616424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.616695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.617573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.619716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.627330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5a0abd49264f7c809fdee011e66737', 'request_id': 'req-a161687f-d94f-4adb-a932-08a72181e7a7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.636670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5a0abd49264f7c809fdee011e66737', 'request_id': 'req-a161687f-d94f-4adb-a932-08a72181e7a7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.645696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5a0abd49264f7c809fdee011e66737', 'request_id': 'req-a161687f-d94f-4adb-a932-08a72181e7a7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.653743 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 871/1745] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/users => generated 295 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:49.653743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.665246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5597e-43b6-4662-8654-e279f6747b7c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.671390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] The token cache is being invalidate because project 5f5a0abd49264f7c809fdee011e66737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:49.671766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.672957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:49.675078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 875/1746] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:49 2022] DELETE /identity/v3/projects/5f5a0abd49264f7c809fdee011e66737 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:49.676210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.677565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.715755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:49.731301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.732008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.732555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.732846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.734144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:49.734456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.736079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.744409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161687f-d94f-4adb-a932-08a72181e7a7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.750604 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 872/1747] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:49.751505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.753205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.755214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.755842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.756127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.756407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.758243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.766810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349645fe-21ab-409e-b54d-72cd10fb8c43 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.774358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.774987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.775265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.775933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.776654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.779051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.793846 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 873/1748] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:49.797370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.799207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.818501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bdc7-9004-4573-9735-364a1cf7299a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.823260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9641369-3b55-42ef-a3de-261536649cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.824012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641369-3b55-42ef-a3de-261536649cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.824306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641369-3b55-42ef-a3de-261536649cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.824667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641369-3b55-42ef-a3de-261536649cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.825272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9641369-3b55-42ef-a3de-261536649cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.827226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9641369-3b55-42ef-a3de-261536649cf0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.837198 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 874/1749] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:49.841558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.841850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.842133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.857058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.858524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.866148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:49.867372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.872028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 876/1750] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:49.872709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.874096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:49.887830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 875/1751] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:49.888804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.897201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5836dbe-873a-4542-aff9-eeb791ca0304 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.901894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1a915-a25b-4d02-9114-d8ebfc7a84a0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.902451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae8df4-508e-4275-beb9-cb812f3852bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.903098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8df4-508e-4275-beb9-cb812f3852bd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.903321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8df4-508e-4275-beb9-cb812f3852bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.903600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae8df4-508e-4275-beb9-cb812f3852bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.904258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae8df4-508e-4275-beb9-cb812f3852bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.906391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae8df4-508e-4275-beb9-cb812f3852bd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.907639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:49.908348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.908728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.909152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.910025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:49.913610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:49.932831 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 876/1752] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:49.932831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:49.953343 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 877/1753] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:49.954838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:49.955130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:49.955408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:49.957561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ad0bf-c0c9-41fe-b934-6d25f0e7ca35 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:49.977376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:49.978582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:50.015109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:50.032333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.033128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.033410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.033683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] PATH_INFO: `/v3/projects/03853789f6f5480483a0f083e41936f7/users/6e871184736242e88d8d1fa63b0bd08a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.050243 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 878/1754] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:50.050243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.053829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03853789f6f5480483a0f083e41936f7, user_id=6e871184736242e88d8d1fa63b0bd08a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.056564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.060679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d9ee1-c09e-46a0-9323-30cfba3d4509 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.067604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.068355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.068638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.068923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] PATH_INFO: `/v3/projects/a0a161064bfc4b608dabcd8fd2b26037/users/fa65581361534943b2cda9381e3f7a8c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.079338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 877/1755] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:49 2022] PUT /identity/v3/projects/03853789f6f5480483a0f083e41936f7/users/6e871184736242e88d8d1fa63b0bd08a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:50.079338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.086712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a161064bfc4b608dabcd8fd2b26037, user_id=fa65581361534943b2cda9381e3f7a8c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.089791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.106655 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 879/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:50 2022] PUT /identity/v3/projects/a0a161064bfc4b608dabcd8fd2b26037/users/fa65581361534943b2cda9381e3f7a8c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:50.107399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.146676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:50.159644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303fd4-2d29-42fd-b155-228e8eadbc1f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.188514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8380d-85c9-42dc-b767-31d1a3ffaf30 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.194451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.195130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.195579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.195862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.196511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:50.196835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.198433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.210602 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 880/1757] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:26:50.211483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.221402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e85841-6be7-4879-8a05-f2dbb3f60290 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.225244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.225851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.226034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de949d-9f21-44e5-85af-34a2d1aa8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.226182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.226388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.226604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de949d-9f21-44e5-85af-34a2d1aa8109 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.226883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de949d-9f21-44e5-85af-34a2d1aa8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.227015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.227157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de949d-9f21-44e5-85af-34a2d1aa8109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.227786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de949d-9f21-44e5-85af-34a2d1aa8109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.228921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.229362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de949d-9f21-44e5-85af-34a2d1aa8109 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.243845 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 881/1758] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:50.243845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.243845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.243845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.260108 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 878/1759] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:50.260962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.271002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54ee53-e89f-4078-a656-3385750c3d87 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.272840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] MFA Rules not processed for user `fa65581361534943b2cda9381e3f7a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:50.274081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:50.276875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.277826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.277826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.278093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.278733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.280693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.312574 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 879/1760] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:50.313444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.346156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 882/1761] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:50.349880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.361294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d697e-3953-41ba-8a1d-e483884c24f4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.369332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:50.387155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ec0e9-29ef-445b-944b-0fd7b4d05e4e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.392077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.392757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.393073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.393349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] PATH_INFO: `/v3/projects/03853789f6f5480483a0f083e41936f7/users/6e871184736242e88d8d1fa63b0bd08a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.395526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03853789f6f5480483a0f083e41936f7, user_id=6e871184736242e88d8d1fa63b0bd08a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.398303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.410887 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 880/1762] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:50 2022] PUT /identity/v3/projects/03853789f6f5480483a0f083e41936f7/users/6e871184736242e88d8d1fa63b0bd08a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:50.414993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.426629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.427927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.428217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.428497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.429187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.430798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.445657 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 883/1763] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:50.446589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.458216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a039d-37a4-4d7b-88bb-94fade436b81 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.490310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fce3-93af-4ee7-bd51-fe6d6f7ce4c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.495480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc2eee-1108-47f2-8563-0a08c2011d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.495817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc2eee-1108-47f2-8563-0a08c2011d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.496103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc2eee-1108-47f2-8563-0a08c2011d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.496381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc2eee-1108-47f2-8563-0a08c2011d54 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.497049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc2eee-1108-47f2-8563-0a08c2011d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.499543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc2eee-1108-47f2-8563-0a08c2011d54 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.500029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:50.523053 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 881/1764] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/users => generated 301 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:50.533154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.533154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.533154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.538122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.538756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.539036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.539313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.539959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.542163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.562848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] MFA Rules not processed for user `6e871184736242e88d8d1fa63b0bd08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:50.564173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:50.580437 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 884/1765] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:50.581747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.653500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e834b-fb0a-4d87-978e-3569d20693ac admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.656269 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 882/1766] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:50.657254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.661982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.661982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.661982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.661982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.662711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.664477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.674651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501462-4df9-4939-bfbe-df6231c0af12 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.677820 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 885/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:50.678773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.684073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.685017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.685530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.686655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.687767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.689957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.691208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947852cd-bee5-4100-8497-8ac312f43df1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.697357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.697965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.698254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.698529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.699166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.701142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.701660 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 883/1768] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:50.703180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.706022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:50.733460 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 886/1769] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/users => generated 301 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:50.734425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.754037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d59a0-27f6-4036-9034-b3d09eecb77c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.759186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.759847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.760127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.760402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] PATH_INFO: `/v3/projects/50c1341f60af459d888d88cc25c6f24b/users/9cff207fb15f41e585fcd2398f6e8849/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.764558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:50.777591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c1341f60af459d888d88cc25c6f24b, user_id=9cff207fb15f41e585fcd2398f6e8849, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.780287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.793501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc068f-d195-401a-b51c-5679b322f44a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.795328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 887/1770] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:50 2022] PUT /identity/v3/projects/50c1341f60af459d888d88cc25c6f24b/users/9cff207fb15f41e585fcd2398f6e8849/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:50.796155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.860080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca78514-3999-4e59-b427-fd72dadff59f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.864173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.864790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.865108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.865403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.865581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.866216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.866527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.866804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.867448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.869235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.880056 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 888/1771] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:50.880858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.892029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fee219-f0c1-4862-baf0-2b51deac91b3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.897073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963e629-73c4-4bcd-b4db-04480e5f1a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.897662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963e629-73c4-4bcd-b4db-04480e5f1a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.897942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963e629-73c4-4bcd-b4db-04480e5f1a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.898219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963e629-73c4-4bcd-b4db-04480e5f1a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.898855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963e629-73c4-4bcd-b4db-04480e5f1a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.900427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963e629-73c4-4bcd-b4db-04480e5f1a87 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.911707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 889/1772] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:50.912980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299095-2763-4f81-a0a5-7d25d682c327 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.913264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299095-2763-4f81-a0a5-7d25d682c327 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.913545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00299095-2763-4f81-a0a5-7d25d682c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.921579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:50.928940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.930549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:50.942546 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 884/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:50.943286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:50.944495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-00299095-2763-4f81-a0a5-7d25d682c327 None None] MFA Rules not processed for user `9cff207fb15f41e585fcd2398f6e8849`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:50.945868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00299095-2763-4f81-a0a5-7d25d682c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:50.953090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8f764-bac2-43ec-a79a-9326c5f863ad service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:50.959169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:50.959169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:50.959479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:50.959805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] PATH_INFO: `/v3/projects/f5ee302729b94af88faeeab91f24ca23/users/2937cb376ab94fceb8ba49bab0878e68/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:50.979147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ee302729b94af88faeeab91f24ca23, user_id=2937cb376ab94fceb8ba49bab0878e68, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:50.988141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.004521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 885/1774] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:50 2022] PUT /identity/v3/projects/f5ee302729b94af88faeeab91f24ca23/users/2937cb376ab94fceb8ba49bab0878e68/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:51.005824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.040161 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 890/1775] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:51.041494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.041767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.042042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.083460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] MFA Rules not processed for user `2937cb376ab94fceb8ba49bab0878e68`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:51.085010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:51.115038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:51.130415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603620fa-8ff2-4039-960b-2f717d4509a7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.149605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.150670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.150961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.151534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] PATH_INFO: `/v3/projects/e220527c548d42c99907296edb416065/users/2da3d21b1bdc4e5a854e4afea42eab84/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.181718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e220527c548d42c99907296edb416065, user_id=2da3d21b1bdc4e5a854e4afea42eab84, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.187370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.188763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 891/1776] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:51.190223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.204811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebb377-ec0e-4ffa-b9c3-557afd12d072 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.212527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.214507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.214877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.215749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.215967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.218471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.219462 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 886/1777] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:51 2022] PUT /identity/v3/projects/e220527c548d42c99907296edb416065/users/2da3d21b1bdc4e5a854e4afea42eab84/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:51.220771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.275511 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 892/1778] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:51.276688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.324451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f499a-c5ba-4c62-9e94-998403e37497 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.350760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105974-4fbd-4eb8-a981-e8afa794c0c9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.355628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.356334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.356698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.357068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.357796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.359471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.361036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:51.376765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 893/1779] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:51.377826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.388779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d72a5-bddf-48a3-b933-266556335108 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.395069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.395702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.395987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.396265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.396924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.398870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.430659 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 894/1780] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/users => generated 301 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:51.430659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.433857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb284fb4-5db5-4b10-87e0-b0afbdaaa970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.434721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284fb4-5db5-4b10-87e0-b0afbdaaa970 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.435131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284fb4-5db5-4b10-87e0-b0afbdaaa970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.435486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb284fb4-5db5-4b10-87e0-b0afbdaaa970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.436450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb284fb4-5db5-4b10-87e0-b0afbdaaa970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.438816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb284fb4-5db5-4b10-87e0-b0afbdaaa970 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.447957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81f27-95a2-433c-936f-0c31c3d07cf5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.455110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.455983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.456246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.456524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] PATH_INFO: `/v3/projects/e220527c548d42c99907296edb416065/users/2da3d21b1bdc4e5a854e4afea42eab84/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.460768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e220527c548d42c99907296edb416065, user_id=2da3d21b1bdc4e5a854e4afea42eab84, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.463609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.480992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 895/1781] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:51 2022] PUT /identity/v3/projects/e220527c548d42c99907296edb416065/users/2da3d21b1bdc4e5a854e4afea42eab84/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:51.482099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.489575 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 887/1782] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/projects => generated 403 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:51.493781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.494417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.494906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.528019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] MFA Rules not processed for user `2da3d21b1bdc4e5a854e4afea42eab84`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:51.529523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:51.568996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaaff6-aee2-4ab0-b1f4-fe1ad579837b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.600326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:51.629592 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 888/1783] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:51.630538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.646176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e2baa-5834-432c-ad0f-ef065d77c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.646870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e2baa-5834-432c-ad0f-ef065d77c8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.647309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e2baa-5834-432c-ad0f-ef065d77c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.647588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e2baa-5834-432c-ad0f-ef065d77c8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.648250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e2baa-5834-432c-ad0f-ef065d77c8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.654775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e2baa-5834-432c-ad0f-ef065d77c8e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.681251 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 896/1784] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:51.681251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6fea1-a996-4aa3-a144-eabdf0d59de0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.681251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6fea1-a996-4aa3-a144-eabdf0d59de0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.681251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6fea1-a996-4aa3-a144-eabdf0d59de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.719471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-12a6fea1-a996-4aa3-a144-eabdf0d59de0 None None] MFA Rules not processed for user `fa65581361534943b2cda9381e3f7a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:51.721243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12a6fea1-a996-4aa3-a144-eabdf0d59de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:51.751758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df9e2-0be0-45f5-9d05-875be2a6bab8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.758401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.759362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.759650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.759927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.760597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.763231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.787097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 889/1785] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/users => generated 308 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:51.787832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.802163 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 897/1786] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:51.802382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a7ad5-4ba4-4fe4-b7cb-b09899a8043c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.808262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.808628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.809074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.810882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.812951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.813409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.813689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] PATH_INFO: `/v3/projects/366a7363294442dda95298f5839a9975/users/e432e296cbf640d8a112c99a0bd0e9d0/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.833101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366a7363294442dda95298f5839a9975, user_id=e432e296cbf640d8a112c99a0bd0e9d0, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:51.835764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:51.839491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:51.852321 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 890/1787] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:51 2022] PUT /identity/v3/projects/366a7363294442dda95298f5839a9975/users/e432e296cbf640d8a112c99a0bd0e9d0/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:51.852559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:51.854246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:51.877730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:51.879061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:51.947689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f0c88-e6cc-417f-852d-050887520ea5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:51.956013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:51.956633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:51.957019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:51.958424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:51.960276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:51.966790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 898/1788] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:51.969891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.063075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:52.066318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.069490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.082928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b00684-4c61-4f79-b1f0-2b73d14bd35e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.088235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.089503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.089793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.090065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.090580 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 891/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:52.090740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.091811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.092299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.104953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 899/1790] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:52.109253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.120082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10710b3-2a88-4168-8590-fc897788c6df service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.125929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f3741-888a-44f3-ba51-1cb11c23d2a5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.132010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.132119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.132608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.132761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.132914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.133190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.133289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.133588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.133835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.135416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.147733 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 900/1791] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:52.152114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.165897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6d33d-1e4b-4676-a36f-ba2b25ab712d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.171387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.172507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.172791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.173250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] PATH_INFO: `/v3/projects/3a31cc939acb4e2a941ba27d4d9f0e81/users/6a67f5e085d4483b8679afa50fd878b5/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.197332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a31cc939acb4e2a941ba27d4d9f0e81, user_id=6a67f5e085d4483b8679afa50fd878b5, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.200010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.217132 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 901/1792] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:52 2022] PUT /identity/v3/projects/3a31cc939acb4e2a941ba27d4d9f0e81/users/6a67f5e085d4483b8679afa50fd878b5/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:52.218030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.242760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.244712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.256231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 892/1793] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:52.257339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.259081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:52.284101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:52.314893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2bd9-8e62-4f28-8971-11a59025014f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.331569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.333149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.342486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.342847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] PATH_INFO: `/v3/projects/366a7363294442dda95298f5839a9975/users/e432e296cbf640d8a112c99a0bd0e9d0/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.345011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366a7363294442dda95298f5839a9975, user_id=e432e296cbf640d8a112c99a0bd0e9d0, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.348152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.392323 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 902/1794] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:52 2022] PUT /identity/v3/projects/366a7363294442dda95298f5839a9975/users/e432e296cbf640d8a112c99a0bd0e9d0/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:52.393475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.491883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7ddc5-3454-460d-b951-a22a4b8a5ffd service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.497818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4af37-5725-4df4-8fe2-f147a4a1b239 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.503861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3192816-c7fa-4ae0-a065-1eda10dc9223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.506060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3192816-c7fa-4ae0-a065-1eda10dc9223 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.506356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3192816-c7fa-4ae0-a065-1eda10dc9223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.506635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3192816-c7fa-4ae0-a065-1eda10dc9223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.507586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3192816-c7fa-4ae0-a065-1eda10dc9223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.509468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3192816-c7fa-4ae0-a065-1eda10dc9223 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.549329 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 903/1795] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:26:52.550708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.551734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.551829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.606214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] MFA Rules not processed for user `e432e296cbf640d8a112c99a0bd0e9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:52.606214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:52.629817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.630584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.631135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.631457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.664847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:52.741264 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 904/1796] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:52.742325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.756494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f000e7-2b62-4b66-a27f-45880288b25d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:52.762389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145cc1c-2de6-4958-be1b-051ef2d3e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:52.763236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145cc1c-2de6-4958-be1b-051ef2d3e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.774041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145cc1c-2de6-4958-be1b-051ef2d3e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.774475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145cc1c-2de6-4958-be1b-051ef2d3e315 admin admin] PATH_INFO: `/v3/projects/3a31cc939acb4e2a941ba27d4d9f0e81/users/6a67f5e085d4483b8679afa50fd878b5/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.775916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.777433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145cc1c-2de6-4958-be1b-051ef2d3e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a31cc939acb4e2a941ba27d4d9f0e81, user_id=6a67f5e085d4483b8679afa50fd878b5, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:52.778162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.781133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145cc1c-2de6-4958-be1b-051ef2d3e315 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:52.791109 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 893/1797] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:52.792201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:52.818480 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 905/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:26:52 2022] PUT /identity/v3/projects/3a31cc939acb4e2a941ba27d4d9f0e81/users/6a67f5e085d4483b8679afa50fd878b5/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:52.844612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96022cf4-fd65-4aa6-93ae-9350f898aa7b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:52.844927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96022cf4-fd65-4aa6-93ae-9350f898aa7b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:52.846999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96022cf4-fd65-4aa6-93ae-9350f898aa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:52.917940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-96022cf4-fd65-4aa6-93ae-9350f898aa7b None None] MFA Rules not processed for user `6a67f5e085d4483b8679afa50fd878b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:52.919826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-96022cf4-fd65-4aa6-93ae-9350f898aa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:52.934678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4d43f-f4b6-43fb-9bda-0d32e0c845b2 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:53.050859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:53.139375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 906/1799] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:53.141753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:53.142766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:53.143647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:53.170149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:53.170785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:53.171083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:53.171342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:53.230787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:53.232133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:53.322739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 907/1800] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 5 02:26:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:53.324037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:53.344575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:53.346830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fedb4e-eebc-4c49-906f-97a869a2daea None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:53.362301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:53.362940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:53.363232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:53.364037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:53.371941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:53.376287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:53.380513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:53.383745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:53.413204 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 908/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:53.413204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:53.419286 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 894/1802] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:53.421927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:53.442149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade355d-7483-40b6-9410-f46d81fbac25 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:53.447671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:53.448103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:53.448422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:53.449350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:53.467469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:53.469460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:53.491141 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 909/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:53.537706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:53.563533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c899134-7dee-4d9f-9888-18247745eba0 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:53.587109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:53.587984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:53.588624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:53.589132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:53.777184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:53.779013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:53.799296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 895/1804] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:26:54.329740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:54.549968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be71bd5-6bf0-410d-8fdc-193c32e816dd service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:54.570635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:54.572558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:54.573143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:54.573699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] PATH_INFO: `/v3/users/9cff207fb15f41e585fcd2398f6e8849` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:54.575095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cff207fb15f41e585fcd2398f6e8849)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:54.577348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:54.690876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:54.701674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cff207fb15f41e585fcd2398f6e8849'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.764871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:54.777775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cff207fb15f41e585fcd2398f6e8849'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.779420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cff207fb15f41e585fcd2398f6e8849'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.780701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428cef-8d10-4f1f-b680-27d6bd00a632 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:54.800199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cff207fb15f41e585fcd2398f6e8849'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.802045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:54.802597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a4e4da89-d1d0-4b27-8368-20f06a7b2d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cff207fb15f41e585fcd2398f6e8849'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.804510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:54.805114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:54.806023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] PATH_INFO: `/v3/users/2937cb376ab94fceb8ba49bab0878e68` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:54.807764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2937cb376ab94fceb8ba49bab0878e68)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:54.811066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:54.839156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 910/1805] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:54 2022] DELETE /identity/v3/users/9cff207fb15f41e585fcd2398f6e8849 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:54.844272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:54.846107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:54.846494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:54.883681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:54.885138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:54.941203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2937cb376ab94fceb8ba49bab0878e68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.960497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2937cb376ab94fceb8ba49bab0878e68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.961894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2937cb376ab94fceb8ba49bab0878e68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.983069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2937cb376ab94fceb8ba49bab0878e68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:54.984161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9006558c-9acb-4927-91c7-2bcad64145c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2937cb376ab94fceb8ba49bab0878e68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:55.010724 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 896/1806] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:54 2022] DELETE /identity/v3/users/2937cb376ab94fceb8ba49bab0878e68 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:55.025810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:55.025810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:55.025810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:55.055863 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 911/1807] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:55.080472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:55.085594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:55.086099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:55.089232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:55.219055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf4cf6-a694-49be-a484-fe1f78f8bb07 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:55.249537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:55.304165 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 897/1808] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:55.311658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:55.360440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3e9b-c641-48c5-9352-0422c35497a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:55.368890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3e9b-c641-48c5-9352-0422c35497a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:55.369332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3e9b-c641-48c5-9352-0422c35497a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:55.369656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3e9b-c641-48c5-9352-0422c35497a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:55.397515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be3e9b-c641-48c5-9352-0422c35497a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:55.398890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be3e9b-c641-48c5-9352-0422c35497a9 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:55.415485 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 912/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:55.463117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6194df-e419-4f28-939c-33cb4fb8e02f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:55.476027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03e48c-7159-4632-8253-75941a199f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:55.477160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e48c-7159-4632-8253-75941a199f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:55.477650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e48c-7159-4632-8253-75941a199f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:55.479076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03e48c-7159-4632-8253-75941a199f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:55.522484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e48c-7159-4632-8253-75941a199f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:55.529621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03e48c-7159-4632-8253-75941a199f67 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:55.576485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 898/1810] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:55.737929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458f47-527f-4073-8648-8e009180c80b None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:55.738213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458f47-527f-4073-8648-8e009180c80b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:55.738736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01458f47-527f-4073-8648-8e009180c80b None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:55.740309 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 913/1811] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:26:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:26:55.770383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:55.770383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:55.770383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:55.810338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:55.811653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:55.890478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458f47-527f-4073-8648-8e009180c80b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:55.892337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-01458f47-527f-4073-8648-8e009180c80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:55.921784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01458f47-527f-4073-8648-8e009180c80b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:55.935710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:55.937781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:55.938133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:55.938349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] PATH_INFO: `/v3/users/1a6e771a42484ae09e43df3007b5e3c6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:55.941466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6e771a42484ae09e43df3007b5e3c6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:55.946206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:56.001227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:56.021962 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 899/1812] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:26:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:26:56.053182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:56.055366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:56.083357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41ea4f-6af7-43ab-938e-99b4013ead5d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:56.091368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6e771a42484ae09e43df3007b5e3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:56.100105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5db37-a72a-45dc-9614-cedc6a6b2dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:56.100976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5db37-a72a-45dc-9614-cedc6a6b2dd9 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:56.101269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5db37-a72a-45dc-9614-cedc6a6b2dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:56.101553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5db37-a72a-45dc-9614-cedc6a6b2dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:56.114861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5db37-a72a-45dc-9614-cedc6a6b2dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:56.116497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5db37-a72a-45dc-9614-cedc6a6b2dd9 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:56.123568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6e771a42484ae09e43df3007b5e3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:56.124673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6e771a42484ae09e43df3007b5e3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:56.137792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6e771a42484ae09e43df3007b5e3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:56.138669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-522e690a-34da-4b8d-9d47-da005abbb10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6e771a42484ae09e43df3007b5e3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:56.171999 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 914/1813] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:55 2022] DELETE /identity/v3/users/1a6e771a42484ae09e43df3007b5e3c6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:26:56.172193 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 900/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:56.174949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:56.175707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:56.177642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:56.205826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:56.206089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:56.206374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:56.231328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:56.233258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:56.233970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:56.235597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:56.337045 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 915/1815] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:56.346050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 901/1816] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:26:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:56.363283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:56.366280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:56.367527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:56.369295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:56.453005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:56.538004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e289a-5834-40a5-8cb4-c961aca95465 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:56.548046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:56.549605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:56.549894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:56.550225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350045-9f3b-4728-8dfa-627584c0ec86 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:56.552954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:56.574031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:56.575696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:56.578230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:56.579679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:56.580079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:56.580533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:56.604853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 916/1817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:26:56.606059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:56.607867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:56.625424 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 902/1818] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:26:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:26:56.743658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:56.745984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:56.795122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e38b3-b1ab-47fa-ba90-6a8be45fd164 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:56.823149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:56.826400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:56.829417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:56.830368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] PATH_INFO: `/v3/projects/50c1341f60af459d888d88cc25c6f24b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:56.835218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c1341f60af459d888d88cc25c6f24b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:56.845684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:56.988096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:57.028031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c1341f60af459d888d88cc25c6f24b', 'request_id': 'req-5cc53926-f2b5-4baf-9275-89442156a23b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.040723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c1341f60af459d888d88cc25c6f24b', 'request_id': 'req-5cc53926-f2b5-4baf-9275-89442156a23b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.061715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c1341f60af459d888d88cc25c6f24b', 'request_id': 'req-5cc53926-f2b5-4baf-9275-89442156a23b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.105830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] The token cache is being invalidate because project 50c1341f60af459d888d88cc25c6f24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:57.106127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.111171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.117541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 917/1819] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:56 2022] DELETE /identity/v3/projects/50c1341f60af459d888d88cc25c6f24b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:57.121403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:57.136166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34ae12-9393-4991-8dcb-0efc0838b16c service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:57.262948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:57.268132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:57.268418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:57.268698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] PATH_INFO: `/v3/users/e432e296cbf640d8a112c99a0bd0e9d0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:57.271095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e432e296cbf640d8a112c99a0bd0e9d0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:57.274159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:57.395612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e432e296cbf640d8a112c99a0bd0e9d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.444654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e432e296cbf640d8a112c99a0bd0e9d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.446165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e432e296cbf640d8a112c99a0bd0e9d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.456414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e432e296cbf640d8a112c99a0bd0e9d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.457752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e432e296cbf640d8a112c99a0bd0e9d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:57.481921 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 903/1820] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:57 2022] DELETE /identity/v3/users/e432e296cbf640d8a112c99a0bd0e9d0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:57.714567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:57.717205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:57.753468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:57.757633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:57.766595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53926-f2b5-4baf-9275-89442156a23b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:57.941746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:57.945473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:57.946506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:57.947497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] PATH_INFO: `/v3/projects/f5ee302729b94af88faeeab91f24ca23` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:57.956622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ee302729b94af88faeeab91f24ca23)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:57.961535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:57.969676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:58.084844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ee302729b94af88faeeab91f24ca23', 'request_id': 'req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.099645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ee302729b94af88faeeab91f24ca23', 'request_id': 'req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.112778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ee302729b94af88faeeab91f24ca23', 'request_id': 'req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.134933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3f05e-68a3-4bc5-b2fd-4542d14023a5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:58.140989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] The token cache is being invalidate because project f5ee302729b94af88faeeab91f24ca23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:58.141335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.142991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.148119 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 918/1821] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:57 2022] DELETE /identity/v3/projects/f5ee302729b94af88faeeab91f24ca23 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:58.152040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:58.154617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:58.283505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:58.286187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:58.286543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:58.287955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] PATH_INFO: `/v3/projects/205b2ecb09f94f48a682a22555b084e6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:58.291395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205b2ecb09f94f48a682a22555b084e6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:58.294500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:58.299331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:58.325448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6af7-e04c-4c6c-bd54-bb763d03ac5e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:58.339247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:58.344151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:58.344503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:58.344859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] PATH_INFO: `/v3/users/6a67f5e085d4483b8679afa50fd878b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:58.347547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a67f5e085d4483b8679afa50fd878b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:58.350483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:58.431821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205b2ecb09f94f48a682a22555b084e6', 'request_id': 'req-433c1a26-ff46-4eb1-958c-effe04021282'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.450335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205b2ecb09f94f48a682a22555b084e6', 'request_id': 'req-433c1a26-ff46-4eb1-958c-effe04021282'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.466853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205b2ecb09f94f48a682a22555b084e6', 'request_id': 'req-433c1a26-ff46-4eb1-958c-effe04021282'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.502671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a67f5e085d4483b8679afa50fd878b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.522113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a67f5e085d4483b8679afa50fd878b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.523493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a67f5e085d4483b8679afa50fd878b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.525027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] The token cache is being invalidate because project 205b2ecb09f94f48a682a22555b084e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:58.536072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a67f5e085d4483b8679afa50fd878b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.537256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a67f5e085d4483b8679afa50fd878b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.541168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.544188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:58.554831 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 904/1823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:57 2022] DELETE /identity/v3/projects/205b2ecb09f94f48a682a22555b084e6 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:58.558173 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 919/1823] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:58 2022] DELETE /identity/v3/users/6a67f5e085d4483b8679afa50fd878b5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:58.559552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:58.563220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:58.765308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c1a26-ff46-4eb1-958c-effe04021282 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:58.798518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:58.801727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:58.813075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:58.938824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:58.939423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:58.939687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:58.939964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] PATH_INFO: `/v3/users/6e871184736242e88d8d1fa63b0bd08a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:58.952332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e871184736242e88d8d1fa63b0bd08a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:58.956756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:58.984784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6a04-fcbc-4627-91d5-c5d2ec9d3cb3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:58.995173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:58.995969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:58.996353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:58.996734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] PATH_INFO: `/v3/projects/366a7363294442dda95298f5839a9975` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:58.998727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366a7363294442dda95298f5839a9975)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:59.001934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:59.109894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e871184736242e88d8d1fa63b0bd08a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.116680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366a7363294442dda95298f5839a9975', 'request_id': 'req-987ebe15-3945-4cf0-b606-f21e1be8fe49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.124049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366a7363294442dda95298f5839a9975', 'request_id': 'req-987ebe15-3945-4cf0-b606-f21e1be8fe49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.139194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366a7363294442dda95298f5839a9975', 'request_id': 'req-987ebe15-3945-4cf0-b606-f21e1be8fe49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.146704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e871184736242e88d8d1fa63b0bd08a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.148399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e871184736242e88d8d1fa63b0bd08a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.164432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:59.170426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e871184736242e88d8d1fa63b0bd08a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.185059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d58c1012-e444-43e9-9734-f87af0f69267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e871184736242e88d8d1fa63b0bd08a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.190433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] The token cache is being invalidate because project 366a7363294442dda95298f5839a9975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:59.192077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.192696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-987ebe15-3945-4cf0-b606-f21e1be8fe49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.201244 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 920/1824] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:58 2022] DELETE /identity/v3/projects/366a7363294442dda95298f5839a9975 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:26:59.203540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.203540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.203540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.216951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 905/1825] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:26:58 2022] DELETE /identity/v3/users/6e871184736242e88d8d1fa63b0bd08a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:59.250654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:59.251923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:59.439254 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 921/1826] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:26:59.439957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9539f8-a672-494c-816e-36af6064728b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.440294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9539f8-a672-494c-816e-36af6064728b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.440667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9539f8-a672-494c-816e-36af6064728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.483022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ff9539f8-a672-494c-816e-36af6064728b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:26:59.484550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff9539f8-a672-494c-816e-36af6064728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:59.501090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:59.511808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 906/1827] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:26:59.518432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c98808-e268-4756-8c42-55d21de09e8a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:59.525685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:59.527018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.527472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.527855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.528746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:26:59.529309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:59.531414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:59.571785 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 922/1828] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:26:59.576257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9539f8-a672-494c-816e-36af6064728b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:59.590739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9539f8-a672-494c-816e-36af6064728b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:59.618166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:59.618815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.619326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.620638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.622320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:59.624459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:59.631727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:59.633650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:26:59.653759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a503-023e-43b8-89dd-c195cabb85f8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:59.664799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:59.664799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.664799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.664799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] PATH_INFO: `/v3/projects/3a31cc939acb4e2a941ba27d4d9f0e81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.665271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a31cc939acb4e2a941ba27d4d9f0e81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:59.669355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:26:59.696859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 907/1829] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:26:59 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:26:59.700285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:26:59.811981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a31cc939acb4e2a941ba27d4d9f0e81', 'request_id': 'req-92f7ee70-2110-48f2-9a67-f433e8aef733'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.828750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c604e2-7a2f-4500-842c-f0900ce0c449 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:26:59.834202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a31cc939acb4e2a941ba27d4d9f0e81', 'request_id': 'req-92f7ee70-2110-48f2-9a67-f433e8aef733'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.857717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a31cc939acb4e2a941ba27d4d9f0e81', 'request_id': 'req-92f7ee70-2110-48f2-9a67-f433e8aef733'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.869554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:26:59.927498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] The token cache is being invalidate because project 3a31cc939acb4e2a941ba27d4d9f0e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:26:59.928170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.929163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92f7ee70-2110-48f2-9a67-f433e8aef733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:26:59.935496 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 923/1830] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:26:59 2022] DELETE /identity/v3/projects/3a31cc939acb4e2a941ba27d4d9f0e81 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:26:59.949972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.951174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.952336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.986423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:26:59.987166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:26:59.987453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:26:59.987731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:26:59.989071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:26:59.993725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.029125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:00.030973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.049729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 908/1831] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:26:59 2022] POST /identity/v3/users => generated 302 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:00.051818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.056966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.073991 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 924/1832] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:00.075962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.079005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.085441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac438ed-c7f9-4cb9-a2a4-6d56804812a3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:00.095771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:00.096423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.096711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.097026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] PATH_INFO: `/v3/projects/03853789f6f5480483a0f083e41936f7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.098854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03853789f6f5480483a0f083e41936f7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:00.100934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.132197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2b7e8-c5aa-4cb7-a1b8-5a14eeecd1e5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:00.146502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47c897-8f00-4073-a223-b1600cbef7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:00.147423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c897-8f00-4073-a223-b1600cbef7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.147805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c897-8f00-4073-a223-b1600cbef7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.148252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47c897-8f00-4073-a223-b1600cbef7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.149128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c897-8f00-4073-a223-b1600cbef7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:00.151253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47c897-8f00-4073-a223-b1600cbef7e1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.169419 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 925/1833] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:00.173926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8b82-8452-4695-8dd3-16c03361c2ba None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.174741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8b82-8452-4695-8dd3-16c03361c2ba None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.176788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8b82-8452-4695-8dd3-16c03361c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.213485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03853789f6f5480483a0f083e41936f7', 'request_id': 'req-cb3c1685-a7b6-414c-8878-3632e476fa32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:00.231041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03853789f6f5480483a0f083e41936f7', 'request_id': 'req-cb3c1685-a7b6-414c-8878-3632e476fa32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:00.240220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03853789f6f5480483a0f083e41936f7', 'request_id': 'req-cb3c1685-a7b6-414c-8878-3632e476fa32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:00.244335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b0fb8b82-8452-4695-8dd3-16c03361c2ba None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:00.244335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0fb8b82-8452-4695-8dd3-16c03361c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.267300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] The token cache is being invalidate because project 03853789f6f5480483a0f083e41936f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:00.267632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:00.268575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:00.274200 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 909/1834] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:00 2022] DELETE /identity/v3/projects/03853789f6f5480483a0f083e41936f7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:00.274200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.274200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.385773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:00.422934 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 926/1835] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:00.428021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.428308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.432133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.446010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c1685-a7b6-414c-8878-3632e476fa32 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:00.461791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:00.462543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.463014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.463384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.464355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:00.466031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.476765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:00.478021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.493577 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 910/1836] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:00.494649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 927/1837] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:00.494938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.496196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.506996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e665c1-2670-4cd6-b939-500727f6ef85 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:00.512856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:00.513906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.514254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.514623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.515563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:00.515886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:00.517606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713003d9-bd6a-48ca-96ae-5dec6d154112 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.524106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf183-e238-419d-b9ea-1d9e215286a2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:00.531007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:00.531687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.531965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.532241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] PATH_INFO: `/v3/projects/67a2902527c84ebe81a9012bc05c0571/users/1bb1d85f596c495c84a3834e62fd91e8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.535388 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 911/1838] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:00.540372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221459c8-f20b-4970-99f2-1bf56bcf8ecb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.540679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221459c8-f20b-4970-99f2-1bf56bcf8ecb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.542034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221459c8-f20b-4970-99f2-1bf56bcf8ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.565460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-221459c8-f20b-4970-99f2-1bf56bcf8ecb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:00.567278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-221459c8-f20b-4970-99f2-1bf56bcf8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.573823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a2902527c84ebe81a9012bc05c0571, user_id=1bb1d85f596c495c84a3834e62fd91e8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:00.575959 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 912/1839] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:00.576593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.577716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.578161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.578584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.591305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:00.599681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 928/1840] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:00 2022] PUT /identity/v3/projects/67a2902527c84ebe81a9012bc05c0571/users/1bb1d85f596c495c84a3834e62fd91e8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:00.600750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.610208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:00.612278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.687080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 913/1841] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Oct 5 02:27:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:00.688193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:00.712311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ee6ac-9729-43a2-8555-ebbd2728e758 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:00.718313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6f5d8-0703-432d-b08c-584e02fe09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:00.719262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6f5d8-0703-432d-b08c-584e02fe09f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.719736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6f5d8-0703-432d-b08c-584e02fe09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.720207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6f5d8-0703-432d-b08c-584e02fe09f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.721516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6f5d8-0703-432d-b08c-584e02fe09f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:00.723810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6f5d8-0703-432d-b08c-584e02fe09f1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:00.789347 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 929/1842] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:00 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:00.791351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:00.793436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:00.793992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:00.831530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:00.831530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:00.856759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476329d-251c-4dbf-9d03-8c3910298ad5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.002205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.002726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.003081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.003365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.004773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:01.005144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.008351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 930/1843] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:01.008351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.008570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.012478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:01.024540 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 914/1844] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:01.025753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.040428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849845d-97f6-49ad-bc6e-d4061bd7f4fd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.048281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.048922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.049205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.049478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.050120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.052592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.081779 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 915/1845] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:01 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:01.081779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.083916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:01.089334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:01.093870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fd2e1-80a6-4b03-bca0-e4ce5941644e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.099712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.100480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.101750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.102153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.107322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3d59-d4d4-4750-b5f7-ae2ff58d18f8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.110890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.112659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.118824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.120252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.121588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.121899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.136074 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 931/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:01.136730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.136818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.138456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.158998 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 916/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:01.159882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.172574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a00eab-52c0-4e4e-ae74-a59220210b92 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.175185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d972b-3e50-4e7e-9ef6-fca125495442 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.178658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.179286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.179568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.179845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.180502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.182784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.195213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.195831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.196108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.196950 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 917/1848] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:01.197184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.197434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.201983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.202600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.226850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c469217-0162-47af-8520-cbe70fa94941 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.232221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.233176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.233176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.233451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.234267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.240196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.253201 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 918/1849] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:01.258144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.266184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:01.273962 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 932/1850] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:01 2022] POST /identity/v3/projects => generated 399 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:01.278139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.279620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e37ff-5169-424a-91e7-8f06512c8b62 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.413090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee7c01-a884-468a-9a4b-db8b10a4a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.414251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7c01-a884-468a-9a4b-db8b10a4a383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.414602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7c01-a884-468a-9a4b-db8b10a4a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.415022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7c01-a884-468a-9a4b-db8b10a4a383 admin admin] PATH_INFO: `/v3/projects/357f4a6b48b5443f94722e2d6090771f/users/60a118397f3a4b25a5915203a7f9ac83/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.442587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6882c6-4434-4175-a523-6453185bec1b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.444354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee7c01-a884-468a-9a4b-db8b10a4a383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357f4a6b48b5443f94722e2d6090771f, user_id=60a118397f3a4b25a5915203a7f9ac83, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.452520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee7c01-a884-468a-9a4b-db8b10a4a383 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.454837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.455471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.465244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.465558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.466628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.470988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.484702 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 919/1851] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:01 2022] PUT /identity/v3/projects/357f4a6b48b5443f94722e2d6090771f/users/60a118397f3a4b25a5915203a7f9ac83/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:01.496214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.496508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.496777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.525487 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 933/1852] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:01 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:01.529493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.549844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca2f1-f7cf-4928-a5ac-467113cc5205 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.569721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] MFA Rules not processed for user `60a118397f3a4b25a5915203a7f9ac83`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:01.572549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:01.721637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.722382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.722584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.722931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.723618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.725431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.760203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 934/1853] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:01.761795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.774969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 920/1854] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:01.778379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.793567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048f046-4a1f-4149-a037-75e55b18ad49 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.802853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717624c-60d8-408e-9e93-df5d42213e2c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.807186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.807817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.808221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.808421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.809886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.812700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.817604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.818311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.818561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.818834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.820048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.825071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:01.850379 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 935/1855] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:01.853186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.880582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d76892-f708-4283-b024-6239442c00b5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:01.910553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea07fd-c3a5-42a9-977b-f4b170d8a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:01.913302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea07fd-c3a5-42a9-977b-f4b170d8a8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:01.914049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea07fd-c3a5-42a9-977b-f4b170d8a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:01.915116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea07fd-c3a5-42a9-977b-f4b170d8a8c7 admin admin] PATH_INFO: `/v3/projects/c63d834f24524b87874d34caeacaea89/users/e65f598908804f8d89a086f7b3ca87a2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:01.922093 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 921/1856] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:01 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:01.928737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:01.956929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea07fd-c3a5-42a9-977b-f4b170d8a8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63d834f24524b87874d34caeacaea89, user_id=e65f598908804f8d89a086f7b3ca87a2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:01.964926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea07fd-c3a5-42a9-977b-f4b170d8a8c7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:02.013528 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 936/1857] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:01 2022] PUT /identity/v3/projects/c63d834f24524b87874d34caeacaea89/users/e65f598908804f8d89a086f7b3ca87a2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:02.024879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.025590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.026010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.074468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:02.091749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4418-f2a6-4a6f-ba64-c4261703c323 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.154830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] MFA Rules not processed for user `e65f598908804f8d89a086f7b3ca87a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:02.155315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:02.207763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:02.277785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:02.278477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.279562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.279962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.280690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:02.286099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:02.313003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 922/1858] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:01 2022] POST /identity/v3/users => generated 293 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:27:02.317323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:02.331075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286f783-948f-4a4e-9ae4-c269f137e92c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.346601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 937/1859] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:02.348159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:02.374854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eedb2a-be01-4d66-b361-85a49258e396 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.380484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:02.381804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.382095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.382371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.382760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:02.383386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.383677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.384049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.386146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:02.386431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:02.388344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:02.392078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:02.447829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 923/1860] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:02.448250 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 938/1861] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:02 2022] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:02.449549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:02.451833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:02.475196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13332af-fa3e-4a99-8326-bf53c0c89dc5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.617674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf916c-ae7f-4967-bc5d-cfa7ee097c6d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.634288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:02.634991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.635274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.635552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] PATH_INFO: `/v3/projects/6ee0c3c741a845f7b586e7095e797797/users/39227c3587144b0ebfcbf1aaaa7e79ed/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.674109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee0c3c741a845f7b586e7095e797797, user_id=39227c3587144b0ebfcbf1aaaa7e79ed, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:02.677086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:02.705304 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 939/1862] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:02 2022] PUT /identity/v3/projects/6ee0c3c741a845f7b586e7095e797797/users/39227c3587144b0ebfcbf1aaaa7e79ed/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:02.708575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:02.721890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:02.723954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.724240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.724523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.726403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:02.733279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:02.815737 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 924/1863] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:02 2022] POST /identity/v3/users => generated 306 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:02.817492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:02.857788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b29ada-b4f9-496b-a571-fd76d6ecd45d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.909599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8302a9-9baa-4b6a-aba6-4fadc94a21d4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:02.929397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:02.932674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:02.933284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:02.933910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:02.936530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:02.951636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:03.009090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 940/1864] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:03.010333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:03.024917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:03.028851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.029654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.030098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.030936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:03.037933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:03.057606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dd9f0-a233-474b-b198-e7f4fd75511d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:03.078166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 925/1865] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:03.079565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cb11f-fbc9-498d-b858-36de06bc937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:03.079734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:03.080783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb11f-fbc9-498d-b858-36de06bc937c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.081299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb11f-fbc9-498d-b858-36de06bc937c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.082455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cb11f-fbc9-498d-b858-36de06bc937c admin admin] PATH_INFO: `/v3/projects/6ee0c3c741a845f7b586e7095e797797/users/39227c3587144b0ebfcbf1aaaa7e79ed/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.086461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cb11f-fbc9-498d-b858-36de06bc937c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee0c3c741a845f7b586e7095e797797, user_id=39227c3587144b0ebfcbf1aaaa7e79ed, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:03.092270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cb11f-fbc9-498d-b858-36de06bc937c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:03.097031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:03.098461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:03.103996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b04fa-6e3f-432a-be98-c08edfc5448e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:03.121884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:03.122747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.123040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.123318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] PATH_INFO: `/v3/projects/cb63164f86ee41468eaa519d5e7ba856/users/c6d67334217342f59b05759dc85f8b46/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.125931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 941/1866] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:03 2022] PUT /identity/v3/projects/6ee0c3c741a845f7b586e7095e797797/users/39227c3587144b0ebfcbf1aaaa7e79ed/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:03.146598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.147257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.147683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.166560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb63164f86ee41468eaa519d5e7ba856, user_id=c6d67334217342f59b05759dc85f8b46, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:03.170025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:03.222848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] MFA Rules not processed for user `39227c3587144b0ebfcbf1aaaa7e79ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:03.227744 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 926/1867] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:03 2022] PUT /identity/v3/projects/cb63164f86ee41468eaa519d5e7ba856/users/c6d67334217342f59b05759dc85f8b46/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:03.229404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:03.232144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:03.430551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 942/1868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:03.437694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:03.448125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:03.486206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da894ab0-266d-4499-9be7-ea3b4b47051f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:03.500743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:03.502706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.503583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.506378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.507707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:03.509902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:03.558866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 927/1869] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:03.561152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:03.591454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1922-fc0f-4cc3-abe5-bde7869e19ba admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:03.604329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05c67-e979-4956-9837-6425330d2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:03.606840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05c67-e979-4956-9837-6425330d2190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.608678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05c67-e979-4956-9837-6425330d2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.609201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05c67-e979-4956-9837-6425330d2190 admin admin] PATH_INFO: `/v3/projects/cb63164f86ee41468eaa519d5e7ba856/users/c6d67334217342f59b05759dc85f8b46/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.614276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a05c67-e979-4956-9837-6425330d2190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb63164f86ee41468eaa519d5e7ba856, user_id=c6d67334217342f59b05759dc85f8b46, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:03.623179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a05c67-e979-4956-9837-6425330d2190 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:03.663508 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 928/1870] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:03 2022] PUT /identity/v3/projects/cb63164f86ee41468eaa519d5e7ba856/users/c6d67334217342f59b05759dc85f8b46/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:03.666016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.668511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.668978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.669970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15e206-ee6c-4a4f-9c3f-61b943747a0b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:03.774001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] MFA Rules not processed for user `c6d67334217342f59b05759dc85f8b46`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:03.781193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:03.885923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510f1e5-d6d0-4fb2-9827-bd56f647ed22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:03.888075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510f1e5-d6d0-4fb2-9827-bd56f647ed22 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:03.888802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510f1e5-d6d0-4fb2-9827-bd56f647ed22 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:03.891107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510f1e5-d6d0-4fb2-9827-bd56f647ed22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:03.920820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:03.980002 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 929/1871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:04.065236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510f1e5-d6d0-4fb2-9827-bd56f647ed22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:04.068081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510f1e5-d6d0-4fb2-9827-bd56f647ed22 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:04.081048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 943/1872] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:27:04.177106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:04.219539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c92e7-60fa-49ec-bd26-666e516ffe88 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:04.242271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057a71-c864-4a21-8095-fc97dac36c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:04.243245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057a71-c864-4a21-8095-fc97dac36c4c service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:04.243600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057a71-c864-4a21-8095-fc97dac36c4c service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:04.243985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057a71-c864-4a21-8095-fc97dac36c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:04.249368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da217dd-9c48-41db-b3cb-ccac8ce6ed40 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:04.249672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da217dd-9c48-41db-b3cb-ccac8ce6ed40 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:04.250159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da217dd-9c48-41db-b3cb-ccac8ce6ed40 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:04.252380 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 944/1873] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:27:04.339380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:04.354921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057a71-c864-4a21-8095-fc97dac36c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:04.357001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057a71-c864-4a21-8095-fc97dac36c4c service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:04.372228 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 930/1874] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:04.409768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da217dd-9c48-41db-b3cb-ccac8ce6ed40 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:04.446895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da217dd-9c48-41db-b3cb-ccac8ce6ed40 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:04.461578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:04.462556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:04.462980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:04.463483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:04.525887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:04.527032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:04.527644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:04.666584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:04.673560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:04.709442 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 931/1875] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:27:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:04.728856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:04.731903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:04.763192 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 945/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:04.981231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:04.995995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267def9f-9c0a-4980-b8fd-9db11d255d45 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:05.007333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:05.008436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:05.008890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:05.009310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:05.024218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:05.026633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:05.058795 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 932/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:05.153573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:05.155678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:05.201181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b4703-4ef3-434a-a48d-025f89f6e675 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:05.226053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:05.226053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:05.226053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:05.226053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:05.282759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:05.284715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:05.328726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 946/1878] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:05.567827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:05.604975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:05.742483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ea02d-c20d-4113-9a92-d1bbc2bf4494 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:05.751430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:05.751779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:05.752291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:05.753557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] PATH_INFO: `/v3/users/e65f598908804f8d89a086f7b3ca87a2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:05.755038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65f598908804f8d89a086f7b3ca87a2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:05.757959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:05.764918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954c0ae-43d6-487b-ae3b-c2d3c35391b6 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:05.775342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:05.776018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:05.776344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:05.776633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] PATH_INFO: `/v3/users/60a118397f3a4b25a5915203a7f9ac83` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:05.779741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a118397f3a4b25a5915203a7f9ac83)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:05.782097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:05.828866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65f598908804f8d89a086f7b3ca87a2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.856055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65f598908804f8d89a086f7b3ca87a2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.857274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65f598908804f8d89a086f7b3ca87a2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.864966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:05.879163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65f598908804f8d89a086f7b3ca87a2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.880116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a88c59bd-4caf-4915-9657-5e6a177e0833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65f598908804f8d89a086f7b3ca87a2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.888880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a118397f3a4b25a5915203a7f9ac83'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.919920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 933/1879] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:05 2022] DELETE /identity/v3/users/e65f598908804f8d89a086f7b3ca87a2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:05.920028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a118397f3a4b25a5915203a7f9ac83'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.920028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a118397f3a4b25a5915203a7f9ac83'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.922745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:05.923015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:05.923298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:05.943758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a118397f3a4b25a5915203a7f9ac83'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.945689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73663e40-5146-41aa-9a3b-e2f684c6ef3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a118397f3a4b25a5915203a7f9ac83'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:05.980756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 947/1880] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:05 2022] DELETE /identity/v3/users/60a118397f3a4b25a5915203a7f9ac83 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:05.980962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:05.981672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:05.983649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:05.983937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:05.984231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:06.046974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:06.055075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:06.126516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:06.180129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 934/1881] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:06.191014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:06.195630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:06.266303 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 948/1882] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:06.357847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:06.359991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:06.369476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216272f-2c68-407b-b467-84085564f5b4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:06.374633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:06.375729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:06.375729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:06.376083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:06.378423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbb2b7-4322-433b-bc35-2b24efd9365c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:06.388380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:06.390123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:06.392038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:06.392754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:06.393136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:06.393413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:06.402958 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 935/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:27:06.421901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:06.423666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:06.446893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 949/1884] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:07.967156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:07.969368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:07.994574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c83c4-7787-441f-b8ec-f06750c45233 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:08.006281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:08.007148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:08.010274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:08.010938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] PATH_INFO: `/v3/projects/357f4a6b48b5443f94722e2d6090771f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:08.015108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357f4a6b48b5443f94722e2d6090771f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:08.018739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:08.151549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357f4a6b48b5443f94722e2d6090771f', 'request_id': 'req-1bc9d2b4-62b2-4305-8534-413699359986'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.183191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357f4a6b48b5443f94722e2d6090771f', 'request_id': 'req-1bc9d2b4-62b2-4305-8534-413699359986'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.203537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357f4a6b48b5443f94722e2d6090771f', 'request_id': 'req-1bc9d2b4-62b2-4305-8534-413699359986'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.231964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] The token cache is being invalidate because project 357f4a6b48b5443f94722e2d6090771f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:08.232270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.235849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.241889 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 936/1885] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:07 2022] DELETE /identity/v3/projects/357f4a6b48b5443f94722e2d6090771f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:08.245989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:08.276157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2174-a2bb-4b74-9970-b938750f116c service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:08.301115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:08.303036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:08.473732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:08.474308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:08.474593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:08.474866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] PATH_INFO: `/v3/users/39227c3587144b0ebfcbf1aaaa7e79ed` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:08.480753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39227c3587144b0ebfcbf1aaaa7e79ed)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:08.486333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:08.586994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9d2b4-62b2-4305-8534-413699359986 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:08.596334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:08.598018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:08.598316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:08.598762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] PATH_INFO: `/v3/projects/c63d834f24524b87874d34caeacaea89` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:08.603382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63d834f24524b87874d34caeacaea89)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:08.604837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:08.606355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:08.609405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39227c3587144b0ebfcbf1aaaa7e79ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.636744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39227c3587144b0ebfcbf1aaaa7e79ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.638003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:08.639487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39227c3587144b0ebfcbf1aaaa7e79ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.661432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39227c3587144b0ebfcbf1aaaa7e79ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.663135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39227c3587144b0ebfcbf1aaaa7e79ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.699796 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 950/1886] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:08 2022] DELETE /identity/v3/users/39227c3587144b0ebfcbf1aaaa7e79ed => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:08.751399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63d834f24524b87874d34caeacaea89', 'request_id': 'req-03d5f9ee-e284-4470-aed2-e4956423daf7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.773938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63d834f24524b87874d34caeacaea89', 'request_id': 'req-03d5f9ee-e284-4470-aed2-e4956423daf7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.794080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63d834f24524b87874d34caeacaea89', 'request_id': 'req-03d5f9ee-e284-4470-aed2-e4956423daf7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.830939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] The token cache is being invalidate because project c63d834f24524b87874d34caeacaea89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:08.833147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.834100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:08.838674 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 937/1887] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:08 2022] DELETE /identity/v3/projects/c63d834f24524b87874d34caeacaea89 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:08.842840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:08.844690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:09.123498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574898-e281-47a0-a5a1-3548a3ccb048 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:09.265452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:09.266417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:09.266417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:09.266943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] PATH_INFO: `/v3/users/c6d67334217342f59b05759dc85f8b46` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:09.268472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d67334217342f59b05759dc85f8b46)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:09.271182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:09.278066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:09.279880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:09.305639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f9ee-e284-4470-aed2-e4956423daf7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:09.329420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:09.330381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:09.331344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:09.331869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] PATH_INFO: `/v3/projects/6ee0c3c741a845f7b586e7095e797797` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:09.336417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee0c3c741a845f7b586e7095e797797)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:09.338943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:09.442994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d67334217342f59b05759dc85f8b46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.471969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d67334217342f59b05759dc85f8b46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.474137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d67334217342f59b05759dc85f8b46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.490220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:09.495051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d67334217342f59b05759dc85f8b46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.496714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1fe2ee2b-03d0-4570-9dc6-dfee83a29dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d67334217342f59b05759dc85f8b46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.519590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee0c3c741a845f7b586e7095e797797', 'request_id': 'req-069c13e8-866e-429d-8498-ebbe547c3dd9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.524023 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 951/1888] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:08 2022] DELETE /identity/v3/users/c6d67334217342f59b05759dc85f8b46 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:09.540827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee0c3c741a845f7b586e7095e797797', 'request_id': 'req-069c13e8-866e-429d-8498-ebbe547c3dd9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.557211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee0c3c741a845f7b586e7095e797797', 'request_id': 'req-069c13e8-866e-429d-8498-ebbe547c3dd9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.579565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] The token cache is being invalidate because project 6ee0c3c741a845f7b586e7095e797797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:09.579867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.582764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-069c13e8-866e-429d-8498-ebbe547c3dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:09.587225 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 938/1889] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:09 2022] DELETE /identity/v3/projects/6ee0c3c741a845f7b586e7095e797797 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:09.598620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:09.599230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:09.599721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:09.639559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:09.643237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:09.917608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 952/1890] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:09.925597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:09.926409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:09.926901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:09.976245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:09.979088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:10.010474 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 939/1891] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:10.016613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.038551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aa48a-b911-4022-be44-9492e88b13b1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.055646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.058065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.058453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.060101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.061244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:10.063958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.071332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:10.111570 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 953/1892] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:10.112737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.134881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd17b2-ae65-44cb-8945-b85f629cdcbc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.159003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.159003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.159003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.159003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.159436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.164590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:10.248658 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 940/1893] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:10 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:27:10.250812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.278445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7acf5-5644-44d3-a9bc-a2f48b0e9726 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.417853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.418409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.418715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.419024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.420806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.424738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:10.478078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 954/1894] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:10 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:27:10.480716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.528437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462b168-04b7-44a6-bf2d-e960805f4546 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.540325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.542662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.543010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.543328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.543995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.545598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:10.601529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 941/1895] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:10.602732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.623651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e55ba-d80d-41a5-8f2e-cbfcd9093576 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.628896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa951ed5-5db1-4fca-81fc-14ab06c8be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.629566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa951ed5-5db1-4fca-81fc-14ab06c8be27 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.629887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa951ed5-5db1-4fca-81fc-14ab06c8be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.630118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa951ed5-5db1-4fca-81fc-14ab06c8be27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.630774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa951ed5-5db1-4fca-81fc-14ab06c8be27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.632795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa951ed5-5db1-4fca-81fc-14ab06c8be27 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:10.680500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 955/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:10.685032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.700828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea5b6-59f4-4eef-af08-cce2e3401f12 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.709764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.710541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.710888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.711231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] PATH_INFO: `/v3/projects/bbd25b0a68f749029eeed701c77462ce/users/39671ba0b86847f995c96013947fee65/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.747129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd25b0a68f749029eeed701c77462ce, user_id=39671ba0b86847f995c96013947fee65, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.750447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:10.779057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 942/1897] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:10 2022] PUT /identity/v3/projects/bbd25b0a68f749029eeed701c77462ce/users/39671ba0b86847f995c96013947fee65/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:10.786505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.787005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.787684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.823046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:10.824273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:10.884239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:10.904943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 956/1898] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:10.916035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.920801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:10.930378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:10.932592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:10.959965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04296c7-669d-4927-a68a-b5078fb5d137 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:10.965798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:10.967118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:10.967568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:10.968009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] PATH_INFO: `/v3/projects/cb63164f86ee41468eaa519d5e7ba856` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:10.968446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:10.970372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb63164f86ee41468eaa519d5e7ba856)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:10.973687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.010569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f8402-6d94-4780-9135-c56ed2e8a1e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.014419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736eae4-fa1b-40e7-8675-617366f65b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.015031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736eae4-fa1b-40e7-8675-617366f65b6e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.015317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736eae4-fa1b-40e7-8675-617366f65b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.015595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736eae4-fa1b-40e7-8675-617366f65b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.025602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736eae4-fa1b-40e7-8675-617366f65b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.027054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736eae4-fa1b-40e7-8675-617366f65b6e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.036198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb63164f86ee41468eaa519d5e7ba856', 'request_id': 'req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:11.037449 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 943/1899] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:11.038666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.038954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.039228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.042274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb63164f86ee41468eaa519d5e7ba856', 'request_id': 'req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:11.048978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb63164f86ee41468eaa519d5e7ba856', 'request_id': 'req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:11.063181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] The token cache is being invalidate because project cb63164f86ee41468eaa519d5e7ba856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:11.063482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:11.064474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-62f2f4c3-de27-433c-8a56-d4a4170a8b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:11.066349 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 957/1900] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:10 2022] DELETE /identity/v3/projects/cb63164f86ee41468eaa519d5e7ba856 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:11.071509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fffb84-211a-4fa7-b92c-5229553b18c3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.071937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fffb84-211a-4fa7-b92c-5229553b18c3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.072290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fffb84-211a-4fa7-b92c-5229553b18c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.073131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] MFA Rules not processed for user `1bb1d85f596c495c84a3834e62fd91e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:11.074354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:11.093471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-00fffb84-211a-4fa7-b92c-5229553b18c3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:11.094770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00fffb84-211a-4fa7-b92c-5229553b18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:11.152697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 944/1901] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:11.157433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.159298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:11.169343 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 958/1902] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:11.174379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.174669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.174946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.176274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa37d64-c026-485c-97d6-8c37c17be378 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.181420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.182260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.182631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.183105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.183826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.186151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.197918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:11.199635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:11.209359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 959/1903] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:11.216062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.223576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 945/1904] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:27:11.224880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.227314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8b30e-3a25-40d1-9c87-d27e1822bf09 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.304704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.305498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.306004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.307686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.309282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:11.309662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.312671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.319966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71599e-d27d-4c72-b79c-161f84b64f40 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.325374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.326014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.326267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.326546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.327327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.329409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.332943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 960/1905] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:11.335623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.346510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:11.351670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b903b-b506-421a-80c6-6def5456e2f2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.356652 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 946/1906] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/users => generated 309 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:11.358435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.360351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.360793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.360938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.361270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.361986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.364883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.374246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3080a9-3f1c-4dfa-a9aa-1d487a81bf3f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.388279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.389257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.389372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.390516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.391838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.393207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.411149 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 947/1907] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:11.411364 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 961/1908] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:27:11.413996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.414938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.426589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7618-9945-4c01-b920-588c231735be admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.438026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:11.511922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.512608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.512847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.513842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.514906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.519300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.526992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0f65-6ccb-4c1c-8ebb-046b7cc06d09 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.533591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.534543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.534896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.535181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] PATH_INFO: `/v3/projects/abcdf94654ef4e5695a274b93f2b3eb1/users/ce61148363124cc7a15d27fb2790fc46/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.554281 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 948/1909] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:11.558474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.558630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcdf94654ef4e5695a274b93f2b3eb1, user_id=ce61148363124cc7a15d27fb2790fc46, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.565748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.581245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bb556-364b-4148-b29b-20708428df02 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.590411 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 962/1910] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:11 2022] PUT /identity/v3/projects/abcdf94654ef4e5695a274b93f2b3eb1/users/ce61148363124cc7a15d27fb2790fc46/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:11.594789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.690427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.691756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.692040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.692313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.693163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.695244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.703130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27010bd-8e23-44b9-a37d-7bc3987a8da2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.711572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.712574 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 949/1911] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:11.713770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.715689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.716168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.716465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.717708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.719504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.730737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadb913-1afa-40bd-988d-588fee916dc6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.737912 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 963/1912] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:11.745701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.754997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0294-9bbd-4afd-b8c1-c8fda8bba3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.755720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0294-9bbd-4afd-b8c1-c8fda8bba3eb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.756242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0294-9bbd-4afd-b8c1-c8fda8bba3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.756590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0294-9bbd-4afd-b8c1-c8fda8bba3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.757356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c0294-9bbd-4afd-b8c1-c8fda8bba3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.760711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c0294-9bbd-4afd-b8c1-c8fda8bba3eb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.763206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4eb800-7bf8-487f-96b5-77cff12d17e5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.771939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.772619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.772926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.773202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] PATH_INFO: `/v3/projects/abcdf94654ef4e5695a274b93f2b3eb1/users/ce61148363124cc7a15d27fb2790fc46/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.776126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcdf94654ef4e5695a274b93f2b3eb1, user_id=ce61148363124cc7a15d27fb2790fc46, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.780204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.801342 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 964/1913] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:11 2022] PUT /identity/v3/projects/abcdf94654ef4e5695a274b93f2b3eb1/users/ce61148363124cc7a15d27fb2790fc46/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:11.808690 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 950/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:11.813633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:11.888382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:11.907524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4855f-b299-4838-a975-0575d5dbf5a9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:11.913472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:11.914276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.914433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.914690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] PATH_INFO: `/v3/projects/d270dec30a614780870c2bfd0b7bf5be/users/d035bf27daca4238b4eb2df2afba48a0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:11.933358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d270dec30a614780870c2bfd0b7bf5be, user_id=d035bf27daca4238b4eb2df2afba48a0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:11.936756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:11.955931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 965/1915] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:11 2022] PUT /identity/v3/projects/d270dec30a614780870c2bfd0b7bf5be/users/d035bf27daca4238b4eb2df2afba48a0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:11.971128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:11.971483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:11.971937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.010976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] MFA Rules not processed for user `d035bf27daca4238b4eb2df2afba48a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:12.012482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:12.108008 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 951/1916] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:12.109610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:12.234747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a150f0-21a5-429f-93d1-7c974ae86bb3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:12.240865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:12.241785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.242235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.242732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.243531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:12.246334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:12.303189 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 966/1917] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:12 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:12.304237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:12.322970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e967d-37d1-4d7c-8fa7-d8584d4245ba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:12.340831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:12.411034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:12.411843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.412125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.412397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.413163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:12.415853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:12.450820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:12.461102 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 952/1918] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:12 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:12.480826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85e79-033e-44e5-a65a-66c83d7392a3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:12.487242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:12.489074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.489523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.490032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.492493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:12.495933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:12.514789 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 967/1919] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:12.515622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:12.528112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc61e5-1042-4383-8204-5b9b6226e950 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:12.535141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:12.535960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.536748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.536748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] PATH_INFO: `/v3/projects/75bbaafc814e496392561b19c5e1a0f3/users/67ac8a89f2d440dea83eeb0713e1dcd9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.559513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bbaafc814e496392561b19c5e1a0f3, user_id=67ac8a89f2d440dea83eeb0713e1dcd9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:12.563257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:12.591783 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 953/1920] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:12 2022] PUT /identity/v3/projects/75bbaafc814e496392561b19c5e1a0f3/users/67ac8a89f2d440dea83eeb0713e1dcd9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:12.598596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:12.610799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102a23c-7012-4b27-a7cc-489b0b7a91e5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:12.734738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c79e-a0d7-4f41-8552-2a546eefd154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:12.736926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c79e-a0d7-4f41-8552-2a546eefd154 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.737242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c79e-a0d7-4f41-8552-2a546eefd154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.737521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c79e-a0d7-4f41-8552-2a546eefd154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.739197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c79e-a0d7-4f41-8552-2a546eefd154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:12.741140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c79e-a0d7-4f41-8552-2a546eefd154 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:12.764959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:12.782494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 968/1921] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:12.784029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ea348-3dbc-4e50-ba0a-cd200b3c0d18 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:12.792480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:12.793791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.793791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.794055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] PATH_INFO: `/v3/projects/75bbaafc814e496392561b19c5e1a0f3/users/67ac8a89f2d440dea83eeb0713e1dcd9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.796479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bbaafc814e496392561b19c5e1a0f3, user_id=67ac8a89f2d440dea83eeb0713e1dcd9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:12.801521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:12.829356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:12.829644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:12.829924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:12.833360 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 954/1922] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:12 2022] PUT /identity/v3/projects/75bbaafc814e496392561b19c5e1a0f3/users/67ac8a89f2d440dea83eeb0713e1dcd9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:12.863769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] MFA Rules not processed for user `67ac8a89f2d440dea83eeb0713e1dcd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:12.865111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:12.910657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:12.977437 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 969/1923] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:13.117049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:13.119370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:13.218198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158359d-4014-4588-8c2c-973a1b6c42fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:13.227756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ca2c-abd8-4d31-a553-437bdb8bcdc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:13.228487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ca2c-abd8-4d31-a553-437bdb8bcdc7 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:13.228813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ca2c-abd8-4d31-a553-437bdb8bcdc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:13.229158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ca2c-abd8-4d31-a553-437bdb8bcdc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:13.239026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ca2c-abd8-4d31-a553-437bdb8bcdc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:13.240755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ca2c-abd8-4d31-a553-437bdb8bcdc7 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:13.251876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 955/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:13.490085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:13.572733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5160d1b-5165-4b1a-b06f-d69173b7a79b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:13.577695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:13.578359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:13.578640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:13.578916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] PATH_INFO: `/v3/users/d035bf27daca4238b4eb2df2afba48a0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:13.580304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d035bf27daca4238b4eb2df2afba48a0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:13.583014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:13.651273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd035bf27daca4238b4eb2df2afba48a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:13.673287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd035bf27daca4238b4eb2df2afba48a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:13.674660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd035bf27daca4238b4eb2df2afba48a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:13.690455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd035bf27daca4238b4eb2df2afba48a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:13.691302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd035bf27daca4238b4eb2df2afba48a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:13.716879 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 970/1925] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:13 2022] DELETE /identity/v3/users/d035bf27daca4238b4eb2df2afba48a0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:13.718358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:13.718836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:13.718913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:13.754651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:13.756272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:13.836525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:13.868175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 956/1926] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:13.895129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:13.896732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:13.976522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:13.994407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2837a96-25a5-426f-b34d-d58213397b08 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:14.009878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:14.012845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:14.013498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:14.013986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:14.028603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:14.030656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:14.051215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 971/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:14.693825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:14.696224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:14.720181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa44c4-c7ed-4ec9-96b0-e3831dc16823 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:14.728814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:14.729766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:14.730118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:14.730945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] PATH_INFO: `/v3/projects/d270dec30a614780870c2bfd0b7bf5be` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:14.733022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d270dec30a614780870c2bfd0b7bf5be)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:14.737030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:14.829688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd270dec30a614780870c2bfd0b7bf5be', 'request_id': 'req-19e0891a-38e1-4588-b41e-16832542a9ca'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:14.843519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd270dec30a614780870c2bfd0b7bf5be', 'request_id': 'req-19e0891a-38e1-4588-b41e-16832542a9ca'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:14.856572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd270dec30a614780870c2bfd0b7bf5be', 'request_id': 'req-19e0891a-38e1-4588-b41e-16832542a9ca'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:14.877986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] The token cache is being invalidate because project d270dec30a614780870c2bfd0b7bf5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:14.878839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:14.880641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:14.884289 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 957/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:14 2022] DELETE /identity/v3/projects/d270dec30a614780870c2bfd0b7bf5be => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:14.888998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:14.908915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656c535-55f9-4578-8267-70d8ec0801f2 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:15.050245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:15.052654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:15.053564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:15.054442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] PATH_INFO: `/v3/users/67ac8a89f2d440dea83eeb0713e1dcd9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:15.057609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ac8a89f2d440dea83eeb0713e1dcd9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:15.061480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:15.200251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ac8a89f2d440dea83eeb0713e1dcd9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:15.222217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ac8a89f2d440dea83eeb0713e1dcd9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:15.223950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ac8a89f2d440dea83eeb0713e1dcd9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:15.237709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ac8a89f2d440dea83eeb0713e1dcd9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:15.239373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6a0f65c7-99da-4191-ae66-5db781feac81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ac8a89f2d440dea83eeb0713e1dcd9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:15.262849 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 972/1929] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:14 2022] DELETE /identity/v3/users/67ac8a89f2d440dea83eeb0713e1dcd9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:16.197227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:16.200245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:16.224155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0891a-38e1-4588-b41e-16832542a9ca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:16.327200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:16.329179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:16.329677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:16.330103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] PATH_INFO: `/v3/projects/75bbaafc814e496392561b19c5e1a0f3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:16.332765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bbaafc814e496392561b19c5e1a0f3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:16.335630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:16.458372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bbaafc814e496392561b19c5e1a0f3', 'request_id': 'req-6846e990-bb5a-4ae2-9b20-fc7560034caa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:16.477821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bbaafc814e496392561b19c5e1a0f3', 'request_id': 'req-6846e990-bb5a-4ae2-9b20-fc7560034caa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:16.491577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bbaafc814e496392561b19c5e1a0f3', 'request_id': 'req-6846e990-bb5a-4ae2-9b20-fc7560034caa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:16.516443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] The token cache is being invalidate because project 75bbaafc814e496392561b19c5e1a0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:16.529654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:16.531193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6846e990-bb5a-4ae2-9b20-fc7560034caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:16.549655 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 958/1930] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:16 2022] DELETE /identity/v3/projects/75bbaafc814e496392561b19c5e1a0f3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:16.555432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:16.556321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:16.556623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:16.585811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:16.588449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:16.674279 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 973/1931] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:16.682758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:16.683407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:16.683788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:16.707105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:16.713512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:16.714741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:16.733363 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 959/1932] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:16.734570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:16.746262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d5bea-43c8-47b0-8be0-c1dcccc05be2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:16.751330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:16.751955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:16.752491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:16.752491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:16.753191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:16.753542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:16.755304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:16.758259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:16.774010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 974/1933] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:27:16.775788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:16.790600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e99f1-7b41-423c-bb0f-e59ba601fe4c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:16.801981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:16.802802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:16.803218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:16.803743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:16.804503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:16.806591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:16.855472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 960/1934] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:16 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:16.857035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:16.871398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2000f-5992-4a0f-94d5-8150f449e62f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:16.984826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:16.987744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:16.989063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:16.989923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:16.990768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:16.992847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:17.059018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 975/1935] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:16 2022] POST /identity/v3/users => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:17.061796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:17.086397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5819e1e-bd47-4251-9ae3-5ceff32c9091 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:17.091384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:17.092153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:17.092536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:17.092937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:17.093715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:17.095450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:17.121733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 961/1936] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:17.122623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:17.142825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755b04-7607-4048-9f6e-5ba7613604eb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:17.158339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68950c3-1d75-45a8-b44e-21b335b9a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:17.159128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68950c3-1d75-45a8-b44e-21b335b9a085 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:17.159476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68950c3-1d75-45a8-b44e-21b335b9a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:17.160356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68950c3-1d75-45a8-b44e-21b335b9a085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:17.162042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68950c3-1d75-45a8-b44e-21b335b9a085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:17.163797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68950c3-1d75-45a8-b44e-21b335b9a085 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:17.197524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 976/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:17.202414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:17.219946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a53a-6f39-4dc6-b5b1-5a115ba5e6f3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:17.239243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:17.244690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:17.245752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:17.246893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] PATH_INFO: `/v3/projects/5a93c3456d1044bdb8051a602034f222/users/b08ae6abe63f453b892ddfc294e00044/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:17.274995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a93c3456d1044bdb8051a602034f222, user_id=b08ae6abe63f453b892ddfc294e00044, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:17.279228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:17.319383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 962/1938] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:17 2022] PUT /identity/v3/projects/5a93c3456d1044bdb8051a602034f222/users/b08ae6abe63f453b892ddfc294e00044/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:17.319946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:17.320404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:17.320713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:17.387594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] MFA Rules not processed for user `b08ae6abe63f453b892ddfc294e00044`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:17.389186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:17.523777 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 977/1939] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:17.528942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:17.677441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13cb3e-c491-4531-b06b-1ff2c4b8b40b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:17.684134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:17.684626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:17.685055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:17.685424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:17.686209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:17.689445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:17.763185 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 963/1940] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:17 2022] POST /identity/v3/projects => generated 403 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:17.764012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:17.795888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077770d-aad6-4393-add5-d74400418ff4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:17.957838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:17.958473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:17.958750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:17.959021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:17.959666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:17.961688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:17.987285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:18.013757 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 978/1941] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:17 2022] POST /identity/v3/users => generated 308 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:18.018377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:18.037386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef2e7-178a-46e7-a5b9-647aa0479abf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:18.046281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:18.047157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:18.047499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:18.047766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:18.049595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:18.059731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:18.094540 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 964/1942] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:18.101620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:18.121519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a1f7-4250-466c-ac53-4fb5c6cdfa5d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:18.142434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:18.143182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:18.143468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:18.143751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] PATH_INFO: `/v3/projects/3c48ec22ea5343f09d2e834aa1fefc4e/users/091eb9f59fd1404cb3376b71607a9a6b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:18.184840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c48ec22ea5343f09d2e834aa1fefc4e, user_id=091eb9f59fd1404cb3376b71607a9a6b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:18.189503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:18.219072 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 979/1943] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:18 2022] PUT /identity/v3/projects/3c48ec22ea5343f09d2e834aa1fefc4e/users/091eb9f59fd1404cb3376b71607a9a6b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:18.223469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:18.240535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4201-9edc-4153-b92b-d1f72e9dd16e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:18.429344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289464fc-bde5-4614-a812-f62e4e310e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:18.429986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289464fc-bde5-4614-a812-f62e4e310e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:18.430263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289464fc-bde5-4614-a812-f62e4e310e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:18.430532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289464fc-bde5-4614-a812-f62e4e310e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:18.434676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289464fc-bde5-4614-a812-f62e4e310e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:18.434676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289464fc-bde5-4614-a812-f62e4e310e18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:18.463380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 965/1944] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:18.467409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:18.489115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9305a-0c3b-47bc-9d21-04003b5a6867 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:18.510783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:18.511462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:18.511927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:18.512349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] PATH_INFO: `/v3/projects/3c48ec22ea5343f09d2e834aa1fefc4e/users/091eb9f59fd1404cb3376b71607a9a6b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:18.519989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c48ec22ea5343f09d2e834aa1fefc4e, user_id=091eb9f59fd1404cb3376b71607a9a6b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:18.522610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:18.549460 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 980/1945] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:18 2022] PUT /identity/v3/projects/3c48ec22ea5343f09d2e834aa1fefc4e/users/091eb9f59fd1404cb3376b71607a9a6b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:18.560138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:18.560422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:18.560696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:18.616717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:18.625660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] MFA Rules not processed for user `091eb9f59fd1404cb3376b71607a9a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:18.627821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:18.788410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 966/1946] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:18.890642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:18.892605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:19.063961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d8d25-5480-4ad8-b79f-79def1f164f7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:19.082436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fca59-66fe-432d-945a-4ddb61f74394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:19.083053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fca59-66fe-432d-945a-4ddb61f74394 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:19.083328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fca59-66fe-432d-945a-4ddb61f74394 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:19.083767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fca59-66fe-432d-945a-4ddb61f74394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:19.107316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fca59-66fe-432d-945a-4ddb61f74394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:19.109819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1fca59-66fe-432d-945a-4ddb61f74394 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:19.135054 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 981/1947] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:18 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:19.689081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:19.691211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:19.718897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fef1d-f82d-4944-8ee0-4f3d18a2e2fd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:19.735288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:19.736118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:19.736673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:19.737139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:19.767873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:19.767873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:19.768161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:19.810769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] MFA Rules not processed for user `39671ba0b86847f995c96013947fee65`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:19.812180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:19.881751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:19.883760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:19.903710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 967/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:19 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:19.937311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:19.975203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 982/1949] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:19.989000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:19.992509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:20.060384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:20.086266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558925-ccb4-421f-883e-ded0bc15ff12 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.099352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.100974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.102007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.102569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] PATH_INFO: `/v3/users/b08ae6abe63f453b892ddfc294e00044` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.105502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08ae6abe63f453b892ddfc294e00044)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.109456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.124174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11c4c-351a-4d2d-be00-4c702092d07c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.140177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfd9c9-7804-4ecb-b01c-bbed3f5b48b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.140949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd9c9-7804-4ecb-b01c-bbed3f5b48b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.141484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd9c9-7804-4ecb-b01c-bbed3f5b48b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.141966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfd9c9-7804-4ecb-b01c-bbed3f5b48b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.142813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfd9c9-7804-4ecb-b01c-bbed3f5b48b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.145851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfd9c9-7804-4ecb-b01c-bbed3f5b48b0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.192431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:20.208495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08ae6abe63f453b892ddfc294e00044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:20.215319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 983/1950] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:19 2022] POST /identity/v3/projects => generated 395 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:27:20.217808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40ff04-b8df-4324-9dbb-7b85df3f8320 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.219832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40ff04-b8df-4324-9dbb-7b85df3f8320 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.220311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40ff04-b8df-4324-9dbb-7b85df3f8320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.242651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08ae6abe63f453b892ddfc294e00044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:20.245080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08ae6abe63f453b892ddfc294e00044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:20.272305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08ae6abe63f453b892ddfc294e00044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:20.273327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08ae6abe63f453b892ddfc294e00044'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:20.290935 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 968/1951] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:19 2022] DELETE /identity/v3/users/b08ae6abe63f453b892ddfc294e00044 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:20.292342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:20.294047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:20.308728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7c40ff04-b8df-4324-9dbb-7b85df3f8320 None None] MFA Rules not processed for user `ce61148363124cc7a15d27fb2790fc46`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:20.312828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c40ff04-b8df-4324-9dbb-7b85df3f8320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:20.474042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef555c-4418-4f07-8642-7bbe64839931 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.479464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.480847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.481357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.481731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.482489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.484772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.492875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 984/1952] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:20 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:20.495135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.495564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.495987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.518732 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 969/1953] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:20 2022] POST /identity/v3/users => generated 304 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:20.525299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:20.540614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50342-aefd-460f-b8f0-091ee916c40b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.546305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.547223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.547714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.548750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.549751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.552315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.558150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:20.559536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:20.570734 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 985/1954] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:20.576804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 970/1955] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:20.583259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:20.585085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:20.588623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:20.597761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed80e3b-9d0b-4c11-a0c7-c9169a61c82d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.603562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.604412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.604844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.605304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] PATH_INFO: `/v3/projects/73917320d66041dab18fbbb7afe26d6e/users/6dfa347c77704102857f5fea97bc130b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.622673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73917320d66041dab18fbbb7afe26d6e, user_id=6dfa347c77704102857f5fea97bc130b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.625945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.661449 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 986/1956] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:20 2022] PUT /identity/v3/projects/73917320d66041dab18fbbb7afe26d6e/users/6dfa347c77704102857f5fea97bc130b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:20.664992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:20.695163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c40cd-26bd-485b-bb07-27867c8c8940 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.811616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc88d9-afd0-4515-8aea-0381d69d92f4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.813872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535ddc4-b89b-45dc-b26e-c059c3594b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.814934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535ddc4-b89b-45dc-b26e-c059c3594b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.815699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535ddc4-b89b-45dc-b26e-c059c3594b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.816369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535ddc4-b89b-45dc-b26e-c059c3594b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.821942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.823111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.826394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.826755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.827534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:20.827672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.829308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.839161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535ddc4-b89b-45dc-b26e-c059c3594b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.840946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535ddc4-b89b-45dc-b26e-c059c3594b7b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.853960 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 987/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:20.856926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:20.859324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 971/1958] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:20.870759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca069a-23c4-444e-acdf-6b05ab231ae9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:20.877761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845460ec-10c8-4679-8989-8ad79cf4711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:20.878666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845460ec-10c8-4679-8989-8ad79cf4711c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:20.879165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845460ec-10c8-4679-8989-8ad79cf4711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:20.879500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845460ec-10c8-4679-8989-8ad79cf4711c admin admin] PATH_INFO: `/v3/projects/73917320d66041dab18fbbb7afe26d6e/users/6dfa347c77704102857f5fea97bc130b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:20.881611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845460ec-10c8-4679-8989-8ad79cf4711c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73917320d66041dab18fbbb7afe26d6e, user_id=6dfa347c77704102857f5fea97bc130b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:20.885323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845460ec-10c8-4679-8989-8ad79cf4711c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:20.887915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:20.898677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 988/1959] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:20 2022] PUT /identity/v3/projects/73917320d66041dab18fbbb7afe26d6e/users/6dfa347c77704102857f5fea97bc130b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:21.195801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d046-6ecd-4ce3-b2ba-24b0bfdbdd9d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:21.196222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d046-6ecd-4ce3-b2ba-24b0bfdbdd9d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:21.196601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55d046-6ecd-4ce3-b2ba-24b0bfdbdd9d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:21.198483 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 972/1960] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:21.276374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:21.277421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:21.277904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:21.333267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:21.343201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:21.512375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 989/1961] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:27:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:21.706663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d046-6ecd-4ce3-b2ba-24b0bfdbdd9d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:21.708641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-af55d046-6ecd-4ce3-b2ba-24b0bfdbdd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:21.905416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55d046-6ecd-4ce3-b2ba-24b0bfdbdd9d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:21.929180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:21.930003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:21.930298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:21.930582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] PATH_INFO: `/v3/projects/5a93c3456d1044bdb8051a602034f222` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:21.940768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a93c3456d1044bdb8051a602034f222)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:21.948085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:22.032056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:22.035722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:22.064765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ce912-aace-4496-9a39-17d1e7564c0c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:22.085293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a93c3456d1044bdb8051a602034f222', 'request_id': 'req-9238993f-53a9-48f0-8357-79c775c8e272'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.104763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a93c3456d1044bdb8051a602034f222', 'request_id': 'req-9238993f-53a9-48f0-8357-79c775c8e272'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.120032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a93c3456d1044bdb8051a602034f222', 'request_id': 'req-9238993f-53a9-48f0-8357-79c775c8e272'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.154493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] The token cache is being invalidate because project 5a93c3456d1044bdb8051a602034f222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:22.154867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.156345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.161730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 973/1962] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:21 2022] DELETE /identity/v3/projects/5a93c3456d1044bdb8051a602034f222 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:22.165606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:22.167421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:22.254447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:22.255449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:22.255933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:22.256405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:22.266524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:22.288857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:22.292540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:22.323559 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 990/1963] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:27:22.338608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238993f-53a9-48f0-8357-79c775c8e272 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:22.354720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:22.391495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:22.393228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:22.393532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] PATH_INFO: `/v3/users/091eb9f59fd1404cb3376b71607a9a6b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:22.403301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091eb9f59fd1404cb3376b71607a9a6b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:22.406058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:22.498827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:22.568327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091eb9f59fd1404cb3376b71607a9a6b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.597860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091eb9f59fd1404cb3376b71607a9a6b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.598913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091eb9f59fd1404cb3376b71607a9a6b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.630685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091eb9f59fd1404cb3376b71607a9a6b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.631340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f4544974-033a-4597-b047-ba9f5bad1b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091eb9f59fd1404cb3376b71607a9a6b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:22.663097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 974/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:22 2022] DELETE /identity/v3/users/091eb9f59fd1404cb3376b71607a9a6b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:23.745143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:23.760264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcb209-2b69-4d7e-983b-7ba643bba60d service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:23.854122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:23.855370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:23.855753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:23.856130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] PATH_INFO: `/v3/projects/3c48ec22ea5343f09d2e834aa1fefc4e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:23.858058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c48ec22ea5343f09d2e834aa1fefc4e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:23.861049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:23.879147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:23.935039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c48ec22ea5343f09d2e834aa1fefc4e', 'request_id': 'req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:23.943639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c48ec22ea5343f09d2e834aa1fefc4e', 'request_id': 'req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:23.952656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c48ec22ea5343f09d2e834aa1fefc4e', 'request_id': 'req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:23.973443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] The token cache is being invalidate because project 3c48ec22ea5343f09d2e834aa1fefc4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:23.973949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:23.974567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d2e66f47-c6f0-46ba-8ecb-6164a5d5bb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:23.981531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 991/1965] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:23 2022] DELETE /identity/v3/projects/3c48ec22ea5343f09d2e834aa1fefc4e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:23.982647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:23.983129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:23.983253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.025734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:24.027589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:24.157094 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 975/1966] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:24.162792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.163080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.163365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.198867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:24.200643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:24.219717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:24.233203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e29fb-693a-442a-9673-264ba1d2e085 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:24.234497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 992/1967] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:24.242633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:24.243503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.243958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.244542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.245414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:24.245892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:24.247739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:24.267126 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 976/1968] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:24.272329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:24.290148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8a54f-3f28-45c0-a65c-a6d66c755d09 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:24.308752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:24.310033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.310727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.311452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.313012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:24.319069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:24.393685 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 993/1969] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:24 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:24.398359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:24.414103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e903b-025e-4e86-8079-dcc97346d4a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:24.529792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:24.530664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.531241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.532385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.533779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:24.537693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:24.597852 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 977/1970] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:24 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:24.602582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:24.625091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4571350-e52a-49ec-bd3f-c3b387b15eda admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:24.636256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:24.637302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.637736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.638161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.639032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:24.642851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:24.673281 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 994/1971] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:24.674840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:24.691170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115df20b-f686-4f95-b5c5-14fed4f164a8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:24.708047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c65e72-cfe5-4a81-ad90-2c21e5252d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:24.708676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c65e72-cfe5-4a81-ad90-2c21e5252d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.708982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c65e72-cfe5-4a81-ad90-2c21e5252d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.709263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c65e72-cfe5-4a81-ad90-2c21e5252d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.709922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c65e72-cfe5-4a81-ad90-2c21e5252d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:24.712156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c65e72-cfe5-4a81-ad90-2c21e5252d6b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:24.741643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 978/1972] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:24.745890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:24.760861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7453b-0695-4696-bd13-70c7fb977c1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:24.777517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:24.778270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.778556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.778834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] PATH_INFO: `/v3/projects/042cb224217e4a1b8a62612369b54f36/users/e42df06198d44552aa7934a5f3169fd1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.818653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=042cb224217e4a1b8a62612369b54f36, user_id=e42df06198d44552aa7934a5f3169fd1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:24.822313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:24.863771 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 995/1973] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:24 2022] PUT /identity/v3/projects/042cb224217e4a1b8a62612369b54f36/users/e42df06198d44552aa7934a5f3169fd1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:24.865911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:24.866727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:24.867230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:24.892614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:24.908332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] MFA Rules not processed for user `e42df06198d44552aa7934a5f3169fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:24.911401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:25.000788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 979/1974] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:25.055344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:25.057242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:25.180654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881cc66-80dd-41e1-9dda-a7e04ab83d9c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:25.190357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:25.192279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:25.192833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:25.193297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:25.204619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:25.206799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:25.217545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 996/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:26.638339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:26.646107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:26.658848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e831a-31ab-4854-bfac-fce70c6cfcb1 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:26.676593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:26.679431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:26.680390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:26.681890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:26.688742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:26.742055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:26.796718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f436d-4021-443f-9276-31bdfbe0f7df None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:26.804248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:26.805192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:26.805860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:26.806334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] PATH_INFO: `/v3/users/e42df06198d44552aa7934a5f3169fd1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:26.807990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e42df06198d44552aa7934a5f3169fd1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:26.810253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:26.837357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:26.840061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66acd8e-0e7b-43c1-83ec-9b5312897b95 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:26.870316 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 997/1976] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:27.020362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42df06198d44552aa7934a5f3169fd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:27.039939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42df06198d44552aa7934a5f3169fd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:27.041359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42df06198d44552aa7934a5f3169fd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:27.058665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42df06198d44552aa7934a5f3169fd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:27.059679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42df06198d44552aa7934a5f3169fd1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:27.085936 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 980/1977] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:26 2022] DELETE /identity/v3/users/e42df06198d44552aa7934a5f3169fd1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:27.091810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:27.092440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:27.092751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:27.138399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:27.142468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:27.303708 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 998/1978] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:27.304270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:27.306121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:27.369398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:27.434244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3675-b8cd-4c85-a194-8ebab3d785b6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:27.446283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e03dd-22bc-4cb0-8ec3-0df8b6a81e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:27.448837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e03dd-22bc-4cb0-8ec3-0df8b6a81e76 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:27.450966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e03dd-22bc-4cb0-8ec3-0df8b6a81e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:27.451607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e03dd-22bc-4cb0-8ec3-0df8b6a81e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:27.464063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e03dd-22bc-4cb0-8ec3-0df8b6a81e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:27.465937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e03dd-22bc-4cb0-8ec3-0df8b6a81e76 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:27.489310 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 981/1979] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:27:28.267409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:28.270701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:28.286281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd3bda-34a4-429f-a7af-e187c3caef55 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:28.291732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:28.292751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.293270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.293759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] PATH_INFO: `/v3/projects/042cb224217e4a1b8a62612369b54f36` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.295177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042cb224217e4a1b8a62612369b54f36)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:28.298279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:28.383485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042cb224217e4a1b8a62612369b54f36', 'request_id': 'req-67af93c1-15c1-45a0-ab65-48343b9fac03'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:28.392453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042cb224217e4a1b8a62612369b54f36', 'request_id': 'req-67af93c1-15c1-45a0-ab65-48343b9fac03'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:28.403409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042cb224217e4a1b8a62612369b54f36', 'request_id': 'req-67af93c1-15c1-45a0-ab65-48343b9fac03'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:28.424407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] The token cache is being invalidate because project 042cb224217e4a1b8a62612369b54f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:28.425065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:28.426563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-67af93c1-15c1-45a0-ab65-48343b9fac03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:28.435974 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 999/1980] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:28 2022] DELETE /identity/v3/projects/042cb224217e4a1b8a62612369b54f36 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:28.438080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.439050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.441463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.477648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:28.481394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:28.633191 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 982/1981] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:28.641233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.641522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.641800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.693171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:28.694417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:28.705239 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1000/1982] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:28.707793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:28.718699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9b918-4c95-4bb1-8574-9aa0dfbd57bc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:28.725228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:28.726035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.726412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.726806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.727568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:28.727977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:28.730520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ad14a-5917-4bda-8ea5-7c1eae05db41 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:28.754499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:28.760511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 983/1983] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:28.773216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690085a1-89d5-4ece-88bc-91c1b5dca3a9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:28.790754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30f02e-8657-4e85-9560-ae61f4d5316e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.791064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30f02e-8657-4e85-9560-ae61f4d5316e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.791505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30f02e-8657-4e85-9560-ae61f4d5316e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.793078 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 984/1984] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:27:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:28.813876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:28.814499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.814839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.815514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.815796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:28.821544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:28.870108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:28.870438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:28.870679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:28.908330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1001/1985] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:28 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:28.912196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:28.930177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:28.934960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:28.935198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:29.055872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47272486-6964-4fb9-a30f-d4ace816257d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:29.071342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:29.072216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.073201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.073881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.075598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:29.078306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:29.103111 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 985/1986] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:27:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:29.154803 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1002/1987] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:28 2022] POST /identity/v3/users => generated 296 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:29.156717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:29.161974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:29.166953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:29.179646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8098d3-e72c-4285-adc4-b564cc6a4c2d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:29.196722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:29.197389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.197672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.197959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.198620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:29.200228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:29.229112 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 986/1988] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:29.230142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:29.247920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ced5-1ca0-47f0-9f36-04b5fe1d368f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:29.254934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a1dd3-adf3-440d-945c-4f0d6ceccf79 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:29.263268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:29.277433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.279304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.279608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.284159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:29.286159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:29.303499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4d161-d991-455f-8030-51e41a8ffcac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:29.304922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4d161-d991-455f-8030-51e41a8ffcac service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.305432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4d161-d991-455f-8030-51e41a8ffcac service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.305975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4d161-d991-455f-8030-51e41a8ffcac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.328255 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 987/1989] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:29.331964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4d161-d991-455f-8030-51e41a8ffcac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:29.334116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:29.344641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4d161-d991-455f-8030-51e41a8ffcac service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:29.370920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86592a6-7e43-4af7-a619-c2d0510dc73c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:29.376315 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1003/1990] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:29.388351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:29.389582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.389921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.390208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] PATH_INFO: `/v3/projects/0b4365a5fbc549aaa81cf1c786b52591/users/d477f91de9224b76b40880623a8c4a18/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.443516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4365a5fbc549aaa81cf1c786b52591, user_id=d477f91de9224b76b40880623a8c4a18, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:29.445951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:29.467298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:29.474582 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 988/1991] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:29 2022] PUT /identity/v3/projects/0b4365a5fbc549aaa81cf1c786b52591/users/d477f91de9224b76b40880623a8c4a18/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:29.479392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455ecb-5e60-41d4-af5e-2a52d5fed2d0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.480044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455ecb-5e60-41d4-af5e-2a52d5fed2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.480504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455ecb-5e60-41d4-af5e-2a52d5fed2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.525356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-89455ecb-5e60-41d4-af5e-2a52d5fed2d0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:29.526612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-89455ecb-5e60-41d4-af5e-2a52d5fed2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:29.666493 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1004/1992] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:29.695296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:29.698187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:29.820726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4588f0-1c38-40d2-9b5d-71eb6190365c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:29.826628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f58b33-2f67-4e2b-8fa2-6ee9347efc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:29.827585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58b33-2f67-4e2b-8fa2-6ee9347efc56 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:29.828504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58b33-2f67-4e2b-8fa2-6ee9347efc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:29.829096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f58b33-2f67-4e2b-8fa2-6ee9347efc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:29.841943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f58b33-2f67-4e2b-8fa2-6ee9347efc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:29.844218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f58b33-2f67-4e2b-8fa2-6ee9347efc56 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:29.868146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 989/1993] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:31.895349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f513062-6900-49a8-9c39-893a019da018 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:31.896498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f513062-6900-49a8-9c39-893a019da018 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:31.898333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f513062-6900-49a8-9c39-893a019da018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:31.945394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1f513062-6900-49a8-9c39-893a019da018 None None] MFA Rules not processed for user `6dfa347c77704102857f5fea97bc130b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:31.947725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f513062-6900-49a8-9c39-893a019da018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:32.058997 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1005/1994] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:32.072176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:32.072754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:32.072754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:32.109987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] MFA Rules not processed for user `39671ba0b86847f995c96013947fee65`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:32.111254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:32.168372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab88a38-b28e-434e-8293-f2a99f568520 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:32.168686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab88a38-b28e-434e-8293-f2a99f568520 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:32.168991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab88a38-b28e-434e-8293-f2a99f568520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:32.213193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bab88a38-b28e-434e-8293-f2a99f568520 None None] MFA Rules not processed for user `fa65581361534943b2cda9381e3f7a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:32.217149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bab88a38-b28e-434e-8293-f2a99f568520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:32.247493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:32.303851 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 990/1995] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:32.315711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:32.319535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:32.374866 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1006/1996] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:32.501318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f9cf-098f-4db2-be20-d6b6434e59c4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:32.524248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:32.524942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:32.525228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:32.525503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:32.529370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:32.560057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:32.561773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:32.598409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 991/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:33.572117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9a7b-9002-46af-a413-2166b10d8fc6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:33.572615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9a7b-9002-46af-a413-2166b10d8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:33.572720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9a7b-9002-46af-a413-2166b10d8fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:33.624766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ca3a9a7b-9002-46af-a413-2166b10d8fc6 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:33.626241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ca3a9a7b-9002-46af-a413-2166b10d8fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:33.648576 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1007/1998] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:27:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:33.672113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:33.673654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:33.724790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b72bed-9587-4236-8976-e055141138a1 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:33.734814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e980-0ab6-4be2-ad67-fa4562ddb5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:33.735450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e980-0ab6-4be2-ad67-fa4562ddb5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:33.738548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e980-0ab6-4be2-ad67-fa4562ddb5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:33.738852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e980-0ab6-4be2-ad67-fa4562ddb5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:33.770899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4e980-0ab6-4be2-ad67-fa4562ddb5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:33.772371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4e980-0ab6-4be2-ad67-fa4562ddb5ba service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:33.822094 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 992/1999] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:35.914700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc033a-5238-4b6c-8c3d-c0f6b645e865 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:35.915216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc033a-5238-4b6c-8c3d-c0f6b645e865 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:35.915332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc033a-5238-4b6c-8c3d-c0f6b645e865 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:35.916614 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1008/2000] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:35.926918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:35.927447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:35.927533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:35.978835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:35.980406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:36.044565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:36.127983 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 993/2001] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:36.173883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc033a-5238-4b6c-8c3d-c0f6b645e865 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:36.176361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-02dc033a-5238-4b6c-8c3d-c0f6b645e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:36.203488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc033a-5238-4b6c-8c3d-c0f6b645e865 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:36.210506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18f574-7323-405e-8869-1fedb023ee7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:36.211048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f574-7323-405e-8869-1fedb023ee7b service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:36.211336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f574-7323-405e-8869-1fedb023ee7b service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:36.211600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18f574-7323-405e-8869-1fedb023ee7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:36.225438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18f574-7323-405e-8869-1fedb023ee7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:36.227315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18f574-7323-405e-8869-1fedb023ee7b service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:36.239187 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1009/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:36.732581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:36.734231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:36.757767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31331-d0c9-4078-846c-1d7b85c5bfb1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:36.779057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:36.779723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:36.780647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:36.780974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] PATH_INFO: `/v3/users/681c3a53569444e1814ae30fa55bc2d6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:36.782972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681c3a53569444e1814ae30fa55bc2d6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:36.787483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:36.954712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681c3a53569444e1814ae30fa55bc2d6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:36.993295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681c3a53569444e1814ae30fa55bc2d6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:36.994388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681c3a53569444e1814ae30fa55bc2d6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.015952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681c3a53569444e1814ae30fa55bc2d6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.016877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681c3a53569444e1814ae30fa55bc2d6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.059628 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 994/2003] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:36 2022] DELETE /identity/v3/users/681c3a53569444e1814ae30fa55bc2d6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:37.064069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:37.064513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:37.064711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:37.105259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:37.106988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:37.217638 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1010/2004] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:37.256280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:37.259144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:37.324081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:37.326085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:37.343803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588d913-b2e0-4219-a903-82c86926d9bd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:37.364347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:37.365294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:37.365688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:37.366075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] PATH_INFO: `/v3/users/03248810e8424e6db93e74efb8062173` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:37.380730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03248810e8424e6db93e74efb8062173)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:37.386979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:37.402506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadfcfe-0004-4b0c-8768-9d53e4c25270 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:37.408973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45785f7-3403-46af-aea4-631e2f97011d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:37.410421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45785f7-3403-46af-aea4-631e2f97011d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:37.410877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45785f7-3403-46af-aea4-631e2f97011d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:37.411329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45785f7-3403-46af-aea4-631e2f97011d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:37.423511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45785f7-3403-46af-aea4-631e2f97011d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:37.426825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45785f7-3403-46af-aea4-631e2f97011d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:37.440972 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 995/2005] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:37.516754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03248810e8424e6db93e74efb8062173'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.557339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03248810e8424e6db93e74efb8062173'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.561528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03248810e8424e6db93e74efb8062173'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.584430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03248810e8424e6db93e74efb8062173'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.585256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03248810e8424e6db93e74efb8062173'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:37.624736 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1011/2006] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:37 2022] DELETE /identity/v3/users/03248810e8424e6db93e74efb8062173 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:37.630173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:37.630397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:37.630543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:37.678265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:37.680306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:37.731166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:37.877526 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 996/2007] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:37.899365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:37.900838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:37.955398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:38.117900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c92-effe-45c8-9104-a789be14cc94 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:38.127175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:38.128320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:38.128802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:38.129334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:38.152551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:38.155394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:38.193458 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1012/2008] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:38.311141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:38.313753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:38.334526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c74d4-f881-4aba-b44b-db8fa4c0f8d0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:38.344945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:38.346000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:38.346000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:38.346409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] PATH_INFO: `/v3/projects/16c4f78462ca401e9ab6a1c4672fd0fc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:38.348731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c4f78462ca401e9ab6a1c4672fd0fc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:38.350710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:38.517770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c4f78462ca401e9ab6a1c4672fd0fc', 'request_id': 'req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:38.538297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c4f78462ca401e9ab6a1c4672fd0fc', 'request_id': 'req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:38.555196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c4f78462ca401e9ab6a1c4672fd0fc', 'request_id': 'req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:38.601965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] The token cache is being invalidate because project 16c4f78462ca401e9ab6a1c4672fd0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:38.602277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:38.603262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:38.612289 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 997/2009] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:38 2022] DELETE /identity/v3/projects/16c4f78462ca401e9ab6a1c4672fd0fc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:38.614055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:38.627228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dcd9c-ba39-4374-8daa-5e9df1bfd910 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:38.837831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:38.838657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:38.839251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:38.839643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] PATH_INFO: `/v3/users/a03f6143e81548208120fe6e818d87ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:38.841436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03f6143e81548208120fe6e818d87ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:38.844563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:38.978139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03f6143e81548208120fe6e818d87ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:39.017633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03f6143e81548208120fe6e818d87ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:39.020840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03f6143e81548208120fe6e818d87ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:39.042441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03f6143e81548208120fe6e818d87ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:39.043448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03f6143e81548208120fe6e818d87ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:39.077177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1013/2010] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:38 2022] DELETE /identity/v3/users/a03f6143e81548208120fe6e818d87ba => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:39.749884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:39.751578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:39.823497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e013e-1c1e-41cc-860c-a18fe5644d0d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:39.977932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:39.978596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:39.978886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:39.980865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] PATH_INFO: `/v3/projects/d96631fc5adf4139b9fa9426d1ffacd6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:39.987172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96631fc5adf4139b9fa9426d1ffacd6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:39.995045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:40.122849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96631fc5adf4139b9fa9426d1ffacd6', 'request_id': 'req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.128598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:40.147814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96631fc5adf4139b9fa9426d1ffacd6', 'request_id': 'req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.166925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96631fc5adf4139b9fa9426d1ffacd6', 'request_id': 'req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.219316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] The token cache is being invalidate because project d96631fc5adf4139b9fa9426d1ffacd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:40.219607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.221106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.226935 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 998/2011] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:39 2022] DELETE /identity/v3/projects/d96631fc5adf4139b9fa9426d1ffacd6 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:40.228568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:40.230581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:40.251560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9f2ff-ccb3-4d8f-8b85-d03bb4b4b7e3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:40.415724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:40.509640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:40.511316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:40.511851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:40.512224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] PATH_INFO: `/v3/users/5054d03a1bc6467fad701a74e144e270` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:40.514170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5054d03a1bc6467fad701a74e144e270)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:40.516613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:40.641464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5054d03a1bc6467fad701a74e144e270'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.675626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5054d03a1bc6467fad701a74e144e270'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.682782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5054d03a1bc6467fad701a74e144e270'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.710122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5054d03a1bc6467fad701a74e144e270'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.711087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5054d03a1bc6467fad701a74e144e270'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:40.742158 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1014/2012] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:40 2022] DELETE /identity/v3/users/5054d03a1bc6467fad701a74e144e270 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:41.072101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:41.074079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:41.101186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:41.103608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:41.124806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1a1d5-1a75-4fea-a098-a7a9a2b01399 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:41.255439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:41.256574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:41.257252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:41.258754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] PATH_INFO: `/v3/projects/9f200daffdb045f1890a5d81d8f096ac` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:41.264381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f200daffdb045f1890a5d81d8f096ac)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:41.270320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:41.276722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f7b56-122a-48bc-ace1-fede5ff02b45 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:41.288477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:41.289143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:41.289427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:41.289704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:41.292036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:41.423524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f200daffdb045f1890a5d81d8f096ac', 'request_id': 'req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:41.426674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:41.450760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f200daffdb045f1890a5d81d8f096ac', 'request_id': 'req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:41.456774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:41.464995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681bee9-369c-4cca-9ea4-1c7ea6d789e8 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:41.484794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f200daffdb045f1890a5d81d8f096ac', 'request_id': 'req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:41.497679 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1015/2013] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:27:41.537076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] The token cache is being invalidate because project 9f200daffdb045f1890a5d81d8f096ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:41.537395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:41.539445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1e44fe-a0da-4324-8bc3-22d25c3f98c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:41.543431 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 999/2014] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:41 2022] DELETE /identity/v3/projects/9f200daffdb045f1890a5d81d8f096ac => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:41.549618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:41.551102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:41.551394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:41.599948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:41.602856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:41.807770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1016/2015] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:41.817967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:41.818254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:41.818531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:41.862499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:41.863968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:41.895134 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1000/2016] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:41.899363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:41.916805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dd80a-b3ab-4477-9586-bba3efee7f36 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:41.922669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:41.923394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:41.923754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:41.924086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:41.924987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:41.925663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:41.929622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:41.955207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1017/2017] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:41.960238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:41.980094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48531a4e-5c6f-4b81-b1c3-c0ecfe330a29 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:41.992488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:41.993354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:41.993827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:41.994291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:41.995113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:41.997250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:42.076704 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1001/2018] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:41 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:42.080957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.104556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28889d96-3375-4656-a58e-925ece240686 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:42.174145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.181676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:42.288940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:42.289608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:42.289885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:42.290153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:42.290959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:42.296504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:42.303276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:42.352279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df97eb2-ebbe-497f-a746-a990a6b50a08 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:42.370646 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1018/2019] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:42 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:42.374299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.380098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:42.381074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:42.381504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:42.381964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] PATH_INFO: `/v3/users/1bb1d85f596c495c84a3834e62fd91e8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:42.383650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb1d85f596c495c84a3834e62fd91e8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:42.385867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:42.395121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56def8b-94bd-4e3a-bc60-18ef031063db admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:42.405389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:42.406864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:42.406864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:42.407145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:42.410002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:42.415902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:42.479732 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1019/2020] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:27:42.481680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.537520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907c7a-546b-44b8-891a-d91206d6717e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:42.537727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb1d85f596c495c84a3834e62fd91e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.553524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:42.558457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:42.559155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:42.560335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:42.563665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:42.568169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:42.590990 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1020/2021] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:42.592181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.597770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:42.598526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb1d85f596c495c84a3834e62fd91e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.600353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb1d85f596c495c84a3834e62fd91e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.619887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb1d85f596c495c84a3834e62fd91e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.620663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb1d85f596c495c84a3834e62fd91e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.623438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5081b-058d-4be3-bde0-7c7c43cbbd38 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:42.630869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:42.631836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:42.632179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:42.632726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] PATH_INFO: `/v3/users/f4aebce7113c4e8980490aa0b0fbb296` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:42.634393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4aebce7113c4e8980490aa0b0fbb296)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:42.637200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:42.647961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1002/2022] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:42 2022] DELETE /identity/v3/users/1bb1d85f596c495c84a3834e62fd91e8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:42.684445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.692217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:42.761706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:42.783455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4aebce7113c4e8980490aa0b0fbb296'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.820473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4aebce7113c4e8980490aa0b0fbb296'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.821435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4aebce7113c4e8980490aa0b0fbb296'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.849527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4aebce7113c4e8980490aa0b0fbb296'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.850355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4aebce7113c4e8980490aa0b0fbb296'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:42.890306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d410-e540-45fd-a8ce-4da29b121db0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:42.895337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1021/2023] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:42 2022] DELETE /identity/v3/users/f4aebce7113c4e8980490aa0b0fbb296 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:42.896019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:42.904713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.062660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee0830-b077-4716-aeb4-25896956b9a6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:43.088173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53469849-e5f4-4a1b-b47d-587ba1b13fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.088921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53469849-e5f4-4a1b-b47d-587ba1b13fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.089195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53469849-e5f4-4a1b-b47d-587ba1b13fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.089566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.090161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.090436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.090707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] PATH_INFO: `/v3/projects/7f31cc43afe644798a4fa51cf6710ea0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.093165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53469849-e5f4-4a1b-b47d-587ba1b13fb6 admin admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb/users/5abef17f2c2e4ce980b10ec4a3de8ea4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.097322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f31cc43afe644798a4fa51cf6710ea0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.103296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:43.152958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53469849-e5f4-4a1b-b47d-587ba1b13fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65073d0fb914f13b382c660b200bbfb, user_id=5abef17f2c2e4ce980b10ec4a3de8ea4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.158881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53469849-e5f4-4a1b-b47d-587ba1b13fb6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:43.166401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:43.203372 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1003/2024] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:42 2022] PUT /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb/users/5abef17f2c2e4ce980b10ec4a3de8ea4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:43.215647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff687a-e8b1-45de-a772-4e150ea492e8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.216470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff687a-e8b1-45de-a772-4e150ea492e8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.216997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff687a-e8b1-45de-a772-4e150ea492e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.238816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f31cc43afe644798a4fa51cf6710ea0', 'request_id': 'req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:43.254799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e3ff687a-e8b1-45de-a772-4e150ea492e8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:43.256302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e3ff687a-e8b1-45de-a772-4e150ea492e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.256523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f31cc43afe644798a4fa51cf6710ea0', 'request_id': 'req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:43.270729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f31cc43afe644798a4fa51cf6710ea0', 'request_id': 'req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:43.303915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] The token cache is being invalidate because project 7f31cc43afe644798a4fa51cf6710ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:43.304584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:43.307675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-916bb7d4-bb85-4996-a5c0-1ca9efe2a1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:43.309568 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1022/2025] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:42 2022] DELETE /identity/v3/projects/7f31cc43afe644798a4fa51cf6710ea0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:43.310709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab75d8-1fd2-43f1-a1fd-c690b29bd20b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.310911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab75d8-1fd2-43f1-a1fd-c690b29bd20b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.311180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab75d8-1fd2-43f1-a1fd-c690b29bd20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.374607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-21ab75d8-1fd2-43f1-a1fd-c690b29bd20b None None] MFA Rules not processed for user `5abef17f2c2e4ce980b10ec4a3de8ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:43.377915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21ab75d8-1fd2-43f1-a1fd-c690b29bd20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.436334 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1004/2026] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:43.436334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.436334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.436334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.455780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:43.493425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:43.495268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.507815 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1005/2027] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:43.508945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:43.511046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.549292 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1023/2028] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:43.551036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.551329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.551610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.596885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:43.598175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.616763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1024/2029] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:43.619955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:43.624134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.624341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642bd04-730b-428f-afb0-1c7018ff640d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:43.631966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.632619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.632915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.633237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.645590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b4e7-45fd-4ee4-a327-e92e12d38ecc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:43.653659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.655361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:43.671325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1006/2030] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:43.672153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.672309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:43.673101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.673538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.675770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.677460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.682823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:43.713969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1e37-23c9-4ca5-a622-57cc4670aadf service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:43.723581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.724276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.727391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.727710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.729318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:43.730485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.732643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:43.751406 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1007/2031] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:43.752385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:43.755681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:43.791835 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1025/2032] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:43 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:43.791835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:43.807114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0dd56-d9d5-41d8-8689-3d3e48aa744e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:43.913635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.914553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.916386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.917156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] PATH_INFO: `/v3/projects/67a2902527c84ebe81a9012bc05c0571` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.920915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a2902527c84ebe81a9012bc05c0571)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.926452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:43.933125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a25ed-3c75-4c34-9a24-575980e856e2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:43.949150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:43.949471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:43.951416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:43.951416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:43.951416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:43.952600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.010084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1026/2033] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:43 2022] POST /identity/v3/projects => generated 393 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:44.010914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.016660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:44.103658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895e0a8-05c4-4b12-b858-73dfdee504cf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.104846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a2902527c84ebe81a9012bc05c0571', 'request_id': 'req-3ee9bd80-fda6-42ff-abf9-f5535139b846'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.116202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a2902527c84ebe81a9012bc05c0571', 'request_id': 'req-3ee9bd80-fda6-42ff-abf9-f5535139b846'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.128944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a2902527c84ebe81a9012bc05c0571', 'request_id': 'req-3ee9bd80-fda6-42ff-abf9-f5535139b846'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.167062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] The token cache is being invalidate because project 67a2902527c84ebe81a9012bc05c0571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:44.167378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.168019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.169794 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1008/2034] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:43 2022] DELETE /identity/v3/projects/67a2902527c84ebe81a9012bc05c0571 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:44.170901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.173684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.186647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:44.218515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.219187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.219926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.219926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.220572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.224303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.259213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1027/2035] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:44 2022] POST /identity/v3/users => generated 303 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:44.260481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.264058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.283850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedac38b-1dcb-4576-8b6f-b085a7607515 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.311477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.313271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.313271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.313684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9bd80-fda6-42ff-abf9-f5535139b846 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.314146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] PATH_INFO: `/v3/users/ce61148363124cc7a15d27fb2790fc46` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.317813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce61148363124cc7a15d27fb2790fc46)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.319876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.324754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.325284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.325838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.326510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.327270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.330083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.361517 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1009/2036] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:44 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:44.361517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.361879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.376388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1deec9-b623-432f-97f8-d97b7d2ddbe2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.382367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.383056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.383413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.384277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.385120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.387332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.399113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce61148363124cc7a15d27fb2790fc46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.404815 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1010/2037] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:44.406132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.419463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3b288-0e58-4b4c-93cc-67aa872f1753 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.422004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce61148363124cc7a15d27fb2790fc46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.423160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce61148363124cc7a15d27fb2790fc46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.427709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.428660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.429404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.430098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.431944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.433636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.437931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce61148363124cc7a15d27fb2790fc46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.438939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce61148363124cc7a15d27fb2790fc46'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.450611 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1011/2038] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:44.450611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.451470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.463579 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1028/2039] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:44 2022] DELETE /identity/v3/users/ce61148363124cc7a15d27fb2790fc46 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:44.464801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.466667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.486377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0238912-48e4-4e3c-adee-72eb62dac19d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.590522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b74ac2-3f19-48c2-8e1e-f5883283c53c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.598509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.599138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.599689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.600654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] PATH_INFO: `/v3/projects/71b7bb601bea47d88c9ad68be2651451` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.602605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b7bb601bea47d88c9ad68be2651451)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.623984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.656451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.657357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.657480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.657710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] PATH_INFO: `/v3/projects/7225ec592cee45a9842e24c94626072c/users/fcb4fff49dcf46dc953f2cff8f2f25f0/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.702443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7225ec592cee45a9842e24c94626072c, user_id=fcb4fff49dcf46dc953f2cff8f2f25f0, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.706566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.718552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:44.725026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:44.733292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b7bb601bea47d88c9ad68be2651451', 'request_id': 'req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.745902 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1012/2040] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:44 2022] PUT /identity/v3/projects/7225ec592cee45a9842e24c94626072c/users/fcb4fff49dcf46dc953f2cff8f2f25f0/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:44.747507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.748022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b7bb601bea47d88c9ad68be2651451', 'request_id': 'req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.755455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.769848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b7bb601bea47d88c9ad68be2651451', 'request_id': 'req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.813457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] The token cache is being invalidate because project 71b7bb601bea47d88c9ad68be2651451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:44.813808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.816454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:44.818871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1029/2041] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:44 2022] DELETE /identity/v3/projects/71b7bb601bea47d88c9ad68be2651451 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:44.819693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.821727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.933185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53759d30-bcdd-47fc-9c7a-8a9c380c0a65 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.943059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.943694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.943980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.944255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.944940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.946589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.948423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87a3c4-b2d3-4c46-aaf4-e702f18899e6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.954072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.954968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.955432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.956014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.957272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.959351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.965726 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1013/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:44.966709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.969732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.971853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1030/2043] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:44.973014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:44.974887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:44.988769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82739b1a-5aa3-4463-a335-01e502618606 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.991121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d67c35-e501-4d08-a581-ef4b9a94d706 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:44.993971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:44.994676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:44.994961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:44.995237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] PATH_INFO: `/v3/users/b9f07b094c2b47638554b9271e74d053` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:44.996418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f07b094c2b47638554b9271e74d053)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:44.998402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:44.999906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.001215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.001568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.001960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] PATH_INFO: `/v3/users/32299f2021c340b5b27d2dc4919299cf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.004521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32299f2021c340b5b27d2dc4919299cf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.007323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.074041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f07b094c2b47638554b9271e74d053'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.103141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f07b094c2b47638554b9271e74d053'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.104147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f07b094c2b47638554b9271e74d053'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.116933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f07b094c2b47638554b9271e74d053'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.118287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f07b094c2b47638554b9271e74d053'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.123151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32299f2021c340b5b27d2dc4919299cf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.141587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32299f2021c340b5b27d2dc4919299cf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.141818 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1031/2044] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:44 2022] DELETE /identity/v3/users/b9f07b094c2b47638554b9271e74d053 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:45.141920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.142638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32299f2021c340b5b27d2dc4919299cf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.143333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.152514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32299f2021c340b5b27d2dc4919299cf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.153939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32299f2021c340b5b27d2dc4919299cf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.199268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1014/2045] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:44 2022] DELETE /identity/v3/users/32299f2021c340b5b27d2dc4919299cf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:45.203352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.204753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:45.205713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.250083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11990d-90b3-4d6a-844c-cc5ab3a3e749 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:45.310798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7933e-510d-4c65-9274-62924802fd01 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:45.323339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453b78-f33d-43c1-93a7-d1f228f6428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.324479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453b78-f33d-43c1-93a7-d1f228f6428e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.324893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453b78-f33d-43c1-93a7-d1f228f6428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.325329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453b78-f33d-43c1-93a7-d1f228f6428e admin admin] PATH_INFO: `/v3/projects/4b2e29038dc64f93b5eebe843cca7172/users/bd160ef90aa54054a7844811a2dbc39d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.338702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ec747-b40c-4e78-89d0-5785e74fb3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.339586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ec747-b40c-4e78-89d0-5785e74fb3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.339945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ec747-b40c-4e78-89d0-5785e74fb3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.341083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ec747-b40c-4e78-89d0-5785e74fb3ed admin admin] PATH_INFO: `/v3/projects/7225ec592cee45a9842e24c94626072c/users/fcb4fff49dcf46dc953f2cff8f2f25f0/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.345483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ec747-b40c-4e78-89d0-5785e74fb3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7225ec592cee45a9842e24c94626072c, user_id=fcb4fff49dcf46dc953f2cff8f2f25f0, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.350257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ec747-b40c-4e78-89d0-5785e74fb3ed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.369755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453b78-f33d-43c1-93a7-d1f228f6428e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2e29038dc64f93b5eebe843cca7172, user_id=bd160ef90aa54054a7844811a2dbc39d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.369755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453b78-f33d-43c1-93a7-d1f228f6428e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.370049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1015/2046] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:45 2022] PUT /identity/v3/projects/7225ec592cee45a9842e24c94626072c/users/fcb4fff49dcf46dc953f2cff8f2f25f0/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:45.370049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448728b7-1e14-458c-829a-ca8bd449007a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.370333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448728b7-1e14-458c-829a-ca8bd449007a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.373243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448728b7-1e14-458c-829a-ca8bd449007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.380462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:45.394151 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1032/2047] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:45 2022] PUT /identity/v3/projects/4b2e29038dc64f93b5eebe843cca7172/users/bd160ef90aa54054a7844811a2dbc39d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:45.396071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-448728b7-1e14-458c-829a-ca8bd449007a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:45.397370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c665e25-e572-4476-976f-d33be084371c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.397866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c665e25-e572-4476-976f-d33be084371c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.398339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c665e25-e572-4476-976f-d33be084371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.406258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-448728b7-1e14-458c-829a-ca8bd449007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.447249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9c665e25-e572-4476-976f-d33be084371c None None] MFA Rules not processed for user `fcb4fff49dcf46dc953f2cff8f2f25f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:45.449198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9c665e25-e572-4476-976f-d33be084371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.498866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1016/2048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:45.506002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.506002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.506002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.536154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] MFA Rules not processed for user `bd160ef90aa54054a7844811a2dbc39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:45.537494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.584646 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1033/2049] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:45.585475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c665e25-e572-4476-976f-d33be084371c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.586917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9c665e25-e572-4476-976f-d33be084371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.613893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c665e25-e572-4476-976f-d33be084371c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:45.627665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.628961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.629366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.629649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] PATH_INFO: `/v3/projects/abcdf94654ef4e5695a274b93f2b3eb1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.630790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abcdf94654ef4e5695a274b93f2b3eb1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.632746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.646886 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1017/2050] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:45.647795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.654051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.669667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8455-46a4-4547-829a-9e84a1a84581 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:45.676576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.677506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.677621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.677850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] PATH_INFO: `/v3/projects/9dfcd8da86654d8985bf3ce1d8bbca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.679083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfcd8da86654d8985bf3ce1d8bbca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.681061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.695498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abcdf94654ef4e5695a274b93f2b3eb1', 'request_id': 'req-719939eb-06ae-4782-892a-9528190a6e18'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.698785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:45.706689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abcdf94654ef4e5695a274b93f2b3eb1', 'request_id': 'req-719939eb-06ae-4782-892a-9528190a6e18'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.715334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abcdf94654ef4e5695a274b93f2b3eb1', 'request_id': 'req-719939eb-06ae-4782-892a-9528190a6e18'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.731616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] The token cache is being invalidate because project abcdf94654ef4e5695a274b93f2b3eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:45.731921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.732588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.735271 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1034/2051] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:45 2022] DELETE /identity/v3/projects/abcdf94654ef4e5695a274b93f2b3eb1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:45.738578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.740147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.742168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfcd8da86654d8985bf3ce1d8bbca81', 'request_id': 'req-743a6343-1811-4749-ad77-55fbc1ed79d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.753408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfcd8da86654d8985bf3ce1d8bbca81', 'request_id': 'req-743a6343-1811-4749-ad77-55fbc1ed79d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.761225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfcd8da86654d8985bf3ce1d8bbca81', 'request_id': 'req-743a6343-1811-4749-ad77-55fbc1ed79d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.775447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] The token cache is being invalidate because project 9dfcd8da86654d8985bf3ce1d8bbca81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:45.775762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.776437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-743a6343-1811-4749-ad77-55fbc1ed79d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:45.778097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1018/2052] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:45 2022] DELETE /identity/v3/projects/9dfcd8da86654d8985bf3ce1d8bbca81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:45.779302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.779585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.779864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.809758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:45.813068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] MFA Rules not processed for user `d477f91de9224b76b40880623a8c4a18`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:45.814296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.819785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719939eb-06ae-4782-892a-9528190a6e18 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:45.883812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.884429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.884719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.885048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.887735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.892270 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1019/2053] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:45.893218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.896437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.970225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.973273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.983948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1035/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:45.984820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:45.986258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:45.987028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8443f8-866c-4aa8-9627-d9fb6f04c6ac None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:45.992841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb6b3b-21f7-4c0c-9382-4cdc1ec75127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:45.993637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb6b3b-21f7-4c0c-9382-4cdc1ec75127 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:45.994022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb6b3b-21f7-4c0c-9382-4cdc1ec75127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:45.994397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb6b3b-21f7-4c0c-9382-4cdc1ec75127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:45.995153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb6b3b-21f7-4c0c-9382-4cdc1ec75127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:45.997423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb6b3b-21f7-4c0c-9382-4cdc1ec75127 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:45.999184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f041c2-38b5-4484-9188-d4f25fc18eb2 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.004784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19cdeb-acc1-494b-bbf9-0cb0398e2acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.005593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19cdeb-acc1-494b-bbf9-0cb0398e2acb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.005875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19cdeb-acc1-494b-bbf9-0cb0398e2acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.006150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19cdeb-acc1-494b-bbf9-0cb0398e2acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.006783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19cdeb-acc1-494b-bbf9-0cb0398e2acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.008717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19cdeb-acc1-494b-bbf9-0cb0398e2acb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.037601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1020/2055] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:45 2022] POST /identity/v3/projects => generated 395 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:46.039090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.039388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.042250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.051931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1036/2056] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:45 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:46.055951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.056351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.056712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.076190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:46.077648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:46.081135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:46.083571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:46.112333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:46.182353 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1021/2057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:46.182353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.182353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:46.192953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1037/2058] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:46.192953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.201241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df89c-04c2-4780-b3b5-d7f11b6e2add None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.207386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.208080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.208739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.209068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.209713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.212345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.225388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:46.245284 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1038/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/users => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:46.246476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.267103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8223e-ec6c-4a2a-9cf0-ca5b60a3af9e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.279676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801ae91-9f58-4a1d-9cf3-e9520b6dbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.282180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ae91-9f58-4a1d-9cf3-e9520b6dbfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.283714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ae91-9f58-4a1d-9cf3-e9520b6dbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.284938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801ae91-9f58-4a1d-9cf3-e9520b6dbfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.287863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801ae91-9f58-4a1d-9cf3-e9520b6dbfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.289879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f801ae91-9f58-4a1d-9cf3-e9520b6dbfc9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.317642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a7fef-9f59-45af-a9b1-8bcac766850d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.327658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.328354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.328697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.329330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1039/2060] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/users => generated 302 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:46.332997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a205e-153d-4050-80b7-ff34a8a19966 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.333295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a205e-153d-4050-80b7-ff34a8a19966 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.333604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a205e-153d-4050-80b7-ff34a8a19966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.334551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.378493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-664a205e-153d-4050-80b7-ff34a8a19966 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:46.383070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-664a205e-153d-4050-80b7-ff34a8a19966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:46.401958 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1040/2061] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:46.403242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.403526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.403802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.416732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.418552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.443548 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1022/2062] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:46.444467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.451132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:46.454919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:46.461321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65965b-44f6-49ff-9971-d7d601a8589b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.472338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.473251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.473548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.473825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.474483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.476152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.480752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1041/2063] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:46.481706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.497123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1023/2064] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:46.497123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.505266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6cd2f-7b10-48e9-a9f0-d2f8470fc7a5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.513915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b66e-858e-4141-bcb2-5d0958e3cee8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.517579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.518212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.519046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.519373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.520340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.521879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.523256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.523256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.523256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.523865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:46.524236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.526987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.527133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.547828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1042/2065] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:46.548722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.569262 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1024/2066] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:46.570259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.570778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4bfba-cf37-4ce0-8de5-22ef04736f57 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.593029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.593671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.593921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.594199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.594860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:46.595416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.597925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.611962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2273-4892-49b4-addb-b4767f38ada7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.616623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.617274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.617556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.618269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.618467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.620322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.629894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1043/2067] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:46.629894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.652840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4badf-519a-4e9d-8252-afa31b2ef504 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.653207 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1025/2068] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:46.653207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.671170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.672668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.672846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceab00c-d271-4fd2-9898-81bc871ac6f4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.672966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.673553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] PATH_INFO: `/v3/projects/36833897a3a14bbaad6c935c7421611f/users/a43637f5a40e489a996acf6fb8f0a58d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.687004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.687764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.688057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.688331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.690444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.695269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.713300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36833897a3a14bbaad6c935c7421611f, user_id=a43637f5a40e489a996acf6fb8f0a58d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.716299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.738950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1044/2069] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:46 2022] PUT /identity/v3/projects/36833897a3a14bbaad6c935c7421611f/users/a43637f5a40e489a996acf6fb8f0a58d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:46.743586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.763080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1026/2070] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:46.766160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.865125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970c318-e427-4322-b17a-3f60bc0a189b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.869285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ec174-0106-4b86-9ab9-13a943f2167c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:46.870732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.871567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.871936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.872262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] PATH_INFO: `/v3/projects/3eb0d0a55478414c83dd8345b60903aa/users/1e5bed911b4b4536b942a82109310b05/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.876601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:46.877464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:46.878687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:46.879196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:46.880282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.882966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.897491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:46.904632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0d0a55478414c83dd8345b60903aa, user_id=1e5bed911b4b4536b942a82109310b05, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:46.908387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:46.928975 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1045/2071] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:46 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:46.930156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.934993 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1027/2072] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:46 2022] PUT /identity/v3/projects/3eb0d0a55478414c83dd8345b60903aa/users/1e5bed911b4b4536b942a82109310b05/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:46.936413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:46.944776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:46.959540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:47.038249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d887ae2-836c-43af-8878-79112c3c138e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.042335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a0a2-e3e2-4a68-b384-5e4884f7e3b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.043797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.044940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.045237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.045535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.046172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.047934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.049061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.050334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.050866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.051356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] PATH_INFO: `/v3/projects/b59141ab746f4d1f9f9ddf9f5a2d3d60` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.052724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59141ab746f4d1f9f9ddf9f5a2d3d60)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.054887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.061015 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1046/2073] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:47.061927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.078445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c43e4-5303-4632-8b2c-c3fbd9d08cec admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.091333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.092040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.092323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.092649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.093595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.096751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.117812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'request_id': 'req-17c8ddf4-f911-44d4-968c-7be454d6198f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.127652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'request_id': 'req-17c8ddf4-f911-44d4-968c-7be454d6198f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.131467 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1047/2074] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:47 2022] POST /identity/v3/users => generated 280 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:47.132320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.137089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59141ab746f4d1f9f9ddf9f5a2d3d60', 'request_id': 'req-17c8ddf4-f911-44d4-968c-7be454d6198f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.143517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a33fd9-2515-4540-a9d1-284ad969142c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.152509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] The token cache is being invalidate because project b59141ab746f4d1f9f9ddf9f5a2d3d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:47.153410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.154746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c8ddf4-f911-44d4-968c-7be454d6198f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.161302 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1028/2075] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:46 2022] DELETE /identity/v3/projects/b59141ab746f4d1f9f9ddf9f5a2d3d60 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:47.163104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.163817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.164283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.211868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] MFA Rules not processed for user `1e5bed911b4b4536b942a82109310b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:47.215129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.218394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.219125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.219663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.219922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.221215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.224544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.255462 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1048/2076] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:47 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:47.259503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.261909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.277417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b580a76-b395-441d-8ad6-db97a8f5b6a2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.289729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.290707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.291167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.292514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] PATH_INFO: `/v3/projects/36833897a3a14bbaad6c935c7421611f/users/a43637f5a40e489a996acf6fb8f0a58d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.296035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36833897a3a14bbaad6c935c7421611f, user_id=a43637f5a40e489a996acf6fb8f0a58d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.299220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.314586 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1029/2077] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:47.324982 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1049/2078] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:47 2022] PUT /identity/v3/projects/36833897a3a14bbaad6c935c7421611f/users/a43637f5a40e489a996acf6fb8f0a58d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:47.324982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.324982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.326927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.328859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.350615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09b3f5-f804-4dcd-ab6a-d2c858788bb4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.365483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:47.422289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16989b-ee8b-4b91-abbe-e8be960f7d98 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.430237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.430776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.431919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.431919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.433225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.434592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.435388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.437670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.438365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.438656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] PATH_INFO: `/v3/users/e1ec0ed07d184f4dabc88050c82423f2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.439879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ec0ed07d184f4dabc88050c82423f2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.445060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.448453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1050/2079] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:47.449755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.451716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.465779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:47.478383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c514cc-56c4-4e74-915b-844b36c5f5f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.500211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954bc17-7328-43bc-b4f3-f76a663a6324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.501647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954bc17-7328-43bc-b4f3-f76a663a6324 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.501979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954bc17-7328-43bc-b4f3-f76a663a6324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.502216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954bc17-7328-43bc-b4f3-f76a663a6324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.502890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954bc17-7328-43bc-b4f3-f76a663a6324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.504740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954bc17-7328-43bc-b4f3-f76a663a6324 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.512705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ec0ed07d184f4dabc88050c82423f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.516740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1051/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:47.517798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.518085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.520019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.543941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ec0ed07d184f4dabc88050c82423f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.544700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ec0ed07d184f4dabc88050c82423f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.554663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ec0ed07d184f4dabc88050c82423f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.555501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ec0ed07d184f4dabc88050c82423f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:47.571694 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1030/2081] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:47 2022] DELETE /identity/v3/users/e1ec0ed07d184f4dabc88050c82423f2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:47.572649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.575269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.578389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] MFA Rules not processed for user `a43637f5a40e489a996acf6fb8f0a58d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:47.580232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.751363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38293f-f0f4-44a4-b55c-040c4ffe5037 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.759007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.759799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.760224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.760519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.763032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.773943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1052/2082] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:47.773943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.779322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.808606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:47.877603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.879988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.894546 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1031/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:47.895437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:47.898605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:47.964752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7445af9-e713-416a-bffa-b2b838165216 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:47.972810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:47.973540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:47.973831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:47.974256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:47.975056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:47.977864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:47.997031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1053/2084] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:48.001615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.004034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:48.024870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f86d0-2fb3-473a-a49b-15057b113015 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.033658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.034430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.035046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.035439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.036267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:48.038446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:48.052235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1ec8f-3663-415f-bc3f-b47b4742839e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.058344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.059196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.059655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.060165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.060272 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1032/2085] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:48.061124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.073961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9af19a-a159-4774-896a-4381e7cf201f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.081667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:48.083699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda81051-efab-44b8-a749-dedcb8129806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.084338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:48.084448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda81051-efab-44b8-a749-dedcb8129806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.084842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda81051-efab-44b8-a749-dedcb8129806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.085064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda81051-efab-44b8-a749-dedcb8129806 admin admin] PATH_INFO: `/v3/projects/541365221b2045afbc2f99e613fc9eb0/users/1af05e175fd2437295a8cea9134cada3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.112933 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1054/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:48.113543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.123783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda81051-efab-44b8-a749-dedcb8129806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=541365221b2045afbc2f99e613fc9eb0, user_id=1af05e175fd2437295a8cea9134cada3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:48.133433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda81051-efab-44b8-a749-dedcb8129806 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:48.136402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5123572-8bdf-46fd-bf34-832d2a81eaf9 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.151995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403886f5-8de7-4a30-8b78-dd5151751a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.152915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403886f5-8de7-4a30-8b78-dd5151751a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.153210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403886f5-8de7-4a30-8b78-dd5151751a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.153967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403886f5-8de7-4a30-8b78-dd5151751a96 admin admin] PATH_INFO: `/v3/projects/e93b46cfdb944ea5a90c7c7ce92eb749/users/478ebb4efbc64c71baf3af5245e59c19/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.170010 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1033/2087] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:48 2022] PUT /identity/v3/projects/541365221b2045afbc2f99e613fc9eb0/users/1af05e175fd2437295a8cea9134cada3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:48.171918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1d9c-7ccc-4399-a42b-92f98f820925 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.172221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1d9c-7ccc-4399-a42b-92f98f820925 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.172561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a1d9c-7ccc-4399-a42b-92f98f820925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.182837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403886f5-8de7-4a30-8b78-dd5151751a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93b46cfdb944ea5a90c7c7ce92eb749, user_id=478ebb4efbc64c71baf3af5245e59c19, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:48.187610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403886f5-8de7-4a30-8b78-dd5151751a96 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:48.215822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1055/2088] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:48 2022] PUT /identity/v3/projects/e93b46cfdb944ea5a90c7c7ce92eb749/users/478ebb4efbc64c71baf3af5245e59c19/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:48.229970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.231303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.231303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.249670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3e2a1d9c-7ccc-4399-a42b-92f98f820925 None None] MFA Rules not processed for user `1af05e175fd2437295a8cea9134cada3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:48.250900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e2a1d9c-7ccc-4399-a42b-92f98f820925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:48.287965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] MFA Rules not processed for user `478ebb4efbc64c71baf3af5245e59c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:48.289731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:48.324158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:48.394496 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1034/2089] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:48.395916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061935ee-9152-4503-be06-ba266bf999e0 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.396221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061935ee-9152-4503-be06-ba266bf999e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.396486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061935ee-9152-4503-be06-ba266bf999e0 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.397925 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1035/2090] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:48.398544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061935ee-9152-4503-be06-ba266bf999e0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.439980 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1056/2091] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:48.440996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:27:48.475383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:48.541914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061935ee-9152-4503-be06-ba266bf999e0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.550366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.551074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.551423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.551762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.552524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:48.554727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:48.618594 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1036/2092] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:48 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:48.624804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.631171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:48.670251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.732066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a416-2ffc-413e-b55f-b13da526cb77 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.737739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.739380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.739767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.740209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] PATH_INFO: `/v3/projects/58b7759803984da1ae71aa71f3ca3380` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.741688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b7759803984da1ae71aa71f3ca3380)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:48.744097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:48.848330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a16693-974c-4b8b-8bf3-5e3bf8b3537c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:48.915957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b7759803984da1ae71aa71f3ca3380', 'request_id': 'req-01701bff-2c87-4b0f-8a6d-a2992b268f2e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:48.941097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b7759803984da1ae71aa71f3ca3380', 'request_id': 'req-01701bff-2c87-4b0f-8a6d-a2992b268f2e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:48.949333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b7759803984da1ae71aa71f3ca3380', 'request_id': 'req-01701bff-2c87-4b0f-8a6d-a2992b268f2e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:48.981607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] The token cache is being invalidate because project 58b7759803984da1ae71aa71f3ca3380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:48.982158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:48.983429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:48.985895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcb4fff49dcf46dc953f2cff8f2f25f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7225ec592cee45a9842e24c94626072c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:48.987896 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1037/2093] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:48 2022] DELETE /identity/v3/projects/58b7759803984da1ae71aa71f3ca3380 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:48.988859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:48.989651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:48.990214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:48.991691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:48.994885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:48.995843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorizing `identity:get_project(project_id=c65073d0fb914f13b382c660b200bbfb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.001296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.009926 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1057/2094] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:27:48 2022] GET /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb => generated 393 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:49.011155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.016400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.052118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5035e-a12f-4dd2-a422-2cf8bdd5a792 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.071287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:49.093548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:49.132121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701bff-2c87-4b0f-8a6d-a2992b268f2e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.138871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e1dd3-489b-4418-b1b8-b077bcd5000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.140100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e1dd3-489b-4418-b1b8-b077bcd5000d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.140226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e1dd3-489b-4418-b1b8-b077bcd5000d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.140439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e1dd3-489b-4418-b1b8-b077bcd5000d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.141475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e1dd3-489b-4418-b1b8-b077bcd5000d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.144599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e1dd3-489b-4418-b1b8-b077bcd5000d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.190049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1038/2095] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:48 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:49.193340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0328-1c7a-48ee-9f65-2ab3fc6efaaf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.193633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0328-1c7a-48ee-9f65-2ab3fc6efaaf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.193914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d0328-1c7a-48ee-9f65-2ab3fc6efaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.204378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.207375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.208392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.208873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.210101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.214628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.240887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aa3d0328-1c7a-48ee-9f65-2ab3fc6efaaf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:49.242585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa3d0328-1c7a-48ee-9f65-2ab3fc6efaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.254337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1058/2096] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:49 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:49.255211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.257228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.273499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58dd1-68bc-4495-bdb6-011ad34d4853 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.342784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1039/2097] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:49.344696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201a14-7a9a-4c08-8647-be932171eb32 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.345396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201a14-7a9a-4c08-8647-be932171eb32 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.345846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201a14-7a9a-4c08-8647-be932171eb32 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.351967 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1040/2098] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:49.353112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201a14-7a9a-4c08-8647-be932171eb32 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.371266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.372178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.372541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.372875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] PATH_INFO: `/v3/users/bd160ef90aa54054a7844811a2dbc39d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.381067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd160ef90aa54054a7844811a2dbc39d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.383117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.385528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201a14-7a9a-4c08-8647-be932171eb32 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.398361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.400532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.401065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.402639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.404780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.406934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.473561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd160ef90aa54054a7844811a2dbc39d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:49.474206 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1041/2099] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:49 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:49.475279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.497590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2567de-8652-4a79-9cd0-0f7fc93f26de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.505967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6c60b-14ae-42b7-b701-e560062c0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.506308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd160ef90aa54054a7844811a2dbc39d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:49.506700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c60b-14ae-42b7-b701-e560062c0e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.506958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd160ef90aa54054a7844811a2dbc39d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:49.507063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c60b-14ae-42b7-b701-e560062c0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.507246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6c60b-14ae-42b7-b701-e560062c0e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.507892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c60b-14ae-42b7-b701-e560062c0e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.509646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6c60b-14ae-42b7-b701-e560062c0e9c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.521010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd160ef90aa54054a7844811a2dbc39d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:49.522357 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1042/2100] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:49.524002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.524224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.524772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.530355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd160ef90aa54054a7844811a2dbc39d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:49.553731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:49.555614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.555851 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1059/2101] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:49 2022] DELETE /identity/v3/users/bd160ef90aa54054a7844811a2dbc39d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:49.557285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:27:49.559216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.617498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:49.695382 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1043/2102] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:49.696563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.699266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.735884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5696b12-789f-4628-8558-7fe108b4ba77 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.741504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.742898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.750482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.751105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.751386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.751658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.752311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.756155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.783144 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1044/2103] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:49.783144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.786016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:49.802388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c244a-fa85-4352-82cd-c27356efd2e0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.809679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82affad-5126-4052-8d62-fe5e5f816bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.810689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82affad-5126-4052-8d62-fe5e5f816bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.811376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82affad-5126-4052-8d62-fe5e5f816bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.812106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82affad-5126-4052-8d62-fe5e5f816bfe admin admin] PATH_INFO: `/v3/projects/fc007f5716204cc1b5c1ec0a82d19269/users/64fc1d4dc2aa4775a38c4b3f14645827/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.863014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82affad-5126-4052-8d62-fe5e5f816bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc007f5716204cc1b5c1ec0a82d19269, user_id=64fc1d4dc2aa4775a38c4b3f14645827, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.864002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35599-15e5-4ad6-bbe0-c87d27d9397a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.867227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82affad-5126-4052-8d62-fe5e5f816bfe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.880737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcb4fff49dcf46dc953f2cff8f2f25f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7225ec592cee45a9842e24c94626072c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:49.881409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.881861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.882147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.886966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorizing `identity:get_project(project_id=c65073d0fb914f13b382c660b200bbfb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:49.889824 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1045/2104] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:49 2022] PUT /identity/v3/projects/fc007f5716204cc1b5c1ec0a82d19269/users/64fc1d4dc2aa4775a38c4b3f14645827/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:49.891175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:49.891779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:49.892285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:49.892796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:49.897114 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1060/2105] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:27:49 2022] GET /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb => generated 393 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:49.899251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:49.927233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:49.941233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1517-6e36-4068-a940-5c4ee8ec1c65 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:49.973205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:49.973205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:50.077206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.078417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.078801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.079180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.080578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:50.082455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.083848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.105483 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1061/2106] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:50.106198 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1046/2107] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:50.106689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.107458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.119182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d420323-0bf3-4089-9f92-319ec21537c4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.125178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e748d47-bfb7-4404-9813-527ed723688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.126223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e748d47-bfb7-4404-9813-527ed723688a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.126660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e748d47-bfb7-4404-9813-527ed723688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.127087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e748d47-bfb7-4404-9813-527ed723688a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.127335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc999532-fd4d-460a-9c8c-cc4af97031ef admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.129422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e748d47-bfb7-4404-9813-527ed723688a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.131608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e748d47-bfb7-4404-9813-527ed723688a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.133731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.134514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.135127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.136092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] PATH_INFO: `/v3/projects/b7af21ec9ff946a8b6f6c2f10deefcb9/users/a54d17dec3a646eaa5287b62a4ab94c1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.146438 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1047/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:50.148090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea923f65-bcb6-4f80-b0b4-39ced55e69f7 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.148627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea923f65-bcb6-4f80-b0b4-39ced55e69f7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.149449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea923f65-bcb6-4f80-b0b4-39ced55e69f7 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.151338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1048/2109] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:50.152366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea923f65-bcb6-4f80-b0b4-39ced55e69f7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.168701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea923f65-bcb6-4f80-b0b4-39ced55e69f7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.174049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.174583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af21ec9ff946a8b6f6c2f10deefcb9, user_id=a54d17dec3a646eaa5287b62a4ab94c1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.176862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.177424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.177909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.179771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.182174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.192457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.223031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1062/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:50 2022] PUT /identity/v3/projects/b7af21ec9ff946a8b6f6c2f10deefcb9/users/a54d17dec3a646eaa5287b62a4ab94c1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:50.227884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.229666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:50.231833 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1049/2111] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:50 2022] POST /identity/v3/projects => generated 403 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:50.236001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.276317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:50.353987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968d15-7004-448a-bb5b-f555c27416c6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.363377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89baca-1e70-43e6-998d-e0fc2bc1e8e3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.380549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.381312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.382108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.382393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] PATH_INFO: `/v3/projects/fc007f5716204cc1b5c1ec0a82d19269/users/64fc1d4dc2aa4775a38c4b3f14645827/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.386536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc007f5716204cc1b5c1ec0a82d19269, user_id=64fc1d4dc2aa4775a38c4b3f14645827, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.390344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.405308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1050/2112] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:50 2022] PUT /identity/v3/projects/fc007f5716204cc1b5c1ec0a82d19269/users/64fc1d4dc2aa4775a38c4b3f14645827/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:50.406154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:27:50.418272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:50.439506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.440506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.440687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.440986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.452703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.455299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.473683 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1063/2113] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:50.474506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.489122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925b36-3778-40f8-81ed-6778b27990b3 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.548099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:50.563032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.597119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.598524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.599133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.600322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.601873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.606702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.638951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1064/2114] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:50.642451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.667690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f4c30-e314-4682-8422-c77fc737854d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.673378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5180edd-7437-4b29-91e9-0832b47f9054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.674133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5180edd-7437-4b29-91e9-0832b47f9054 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.674425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5180edd-7437-4b29-91e9-0832b47f9054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.674898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5180edd-7437-4b29-91e9-0832b47f9054 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.675829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5180edd-7437-4b29-91e9-0832b47f9054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.678384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5180edd-7437-4b29-91e9-0832b47f9054 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.718981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1065/2115] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:50 2022] POST /identity/v3/users => generated 302 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:50.719668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d8930-bc01-4560-90ad-c3a53c29b644 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.719966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d8930-bc01-4560-90ad-c3a53c29b644 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.722066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d8930-bc01-4560-90ad-c3a53c29b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.743633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacaef-13a4-4de1-8776-b99fe0d26ec4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.751199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcb4fff49dcf46dc953f2cff8f2f25f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7225ec592cee45a9842e24c94626072c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.761058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.761673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.762208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.764771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorizing `identity:get_project(project_id=c65073d0fb914f13b382c660b200bbfb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.771649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.777890 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1051/2116] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:27:50 2022] GET /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb => generated 393 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:50.794646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.825575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-100d8930-bc01-4560-90ad-c3a53c29b644 None None] MFA Rules not processed for user `64fc1d4dc2aa4775a38c4b3f14645827`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:50.826937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-100d8930-bc01-4560-90ad-c3a53c29b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:50.833831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b97f21-f391-483f-bbe0-e23e55ec81ac tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:50.839052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:50.839853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.840237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.840590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] PATH_INFO: `/v3/projects/b7af21ec9ff946a8b6f6c2f10deefcb9/users/a54d17dec3a646eaa5287b62a4ab94c1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.842956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af21ec9ff946a8b6f6c2f10deefcb9, user_id=a54d17dec3a646eaa5287b62a4ab94c1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:50.846308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:50.862139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1052/2117] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:50 2022] PUT /identity/v3/projects/b7af21ec9ff946a8b6f6c2f10deefcb9/users/a54d17dec3a646eaa5287b62a4ab94c1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:50.864136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:50.911346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:50.961905 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1066/2118] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:50.964350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:50.965214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:50.966387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:50.999872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287f41-2b54-4854-af7a-cb2d62b118d9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.005831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.006743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.007032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.007369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.008129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.010161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.028849 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1053/2119] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:51.028849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.030409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] MFA Rules not processed for user `a54d17dec3a646eaa5287b62a4ab94c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:51.032083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.127249 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1067/2120] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:51.129223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.139942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41ab95-24a0-4a61-b9af-5dc1efd29993 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.141085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce7275-933a-4a01-9841-ffac8ad6c2a7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.145336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.146099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.146448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.146807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.147573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.147682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.148230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.149199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.149444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.149564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.162693 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1068/2121] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:51.167104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.168939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.183632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a32c6-5733-4252-8dd9-8ded117ea675 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.197250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:51.200269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.200972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.201226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.201499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] PATH_INFO: `/v3/projects/4b2e29038dc64f93b5eebe843cca7172` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.203401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2e29038dc64f93b5eebe843cca7172)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.206802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.272190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.274062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.289374 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1054/2122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:51.290439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.302432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2e29038dc64f93b5eebe843cca7172', 'request_id': 'req-065564ad-4282-4505-af20-26e7024f5dc4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.312605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2e29038dc64f93b5eebe843cca7172', 'request_id': 'req-065564ad-4282-4505-af20-26e7024f5dc4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.315835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f536-6c3d-4171-a3d4-ed98567f7fa9 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.320379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2e29038dc64f93b5eebe843cca7172', 'request_id': 'req-065564ad-4282-4505-af20-26e7024f5dc4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.343775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] The token cache is being invalidate because project 4b2e29038dc64f93b5eebe843cca7172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:51.344452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.345691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.349345 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1069/2123] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:51 2022] DELETE /identity/v3/projects/4b2e29038dc64f93b5eebe843cca7172 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:51.353343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.355359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.399817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fbd83-4b0a-4f78-850e-5e5067cbdad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.401303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fbd83-4b0a-4f78-850e-5e5067cbdad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.401815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fbd83-4b0a-4f78-850e-5e5067cbdad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.403028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fbd83-4b0a-4f78-850e-5e5067cbdad6 admin admin] PATH_INFO: `/v3/projects/fecbac50c16847799a85c148c6c143de/users/368f6c3db9f24561a13f48ce02e7655e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.420779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:51.422921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fbd83-4b0a-4f78-850e-5e5067cbdad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecbac50c16847799a85c148c6c143de, user_id=368f6c3db9f24561a13f48ce02e7655e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.427243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fbd83-4b0a-4f78-850e-5e5067cbdad6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.453199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065564ad-4282-4505-af20-26e7024f5dc4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.456863 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1055/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:51 2022] PUT /identity/v3/projects/fecbac50c16847799a85c148c6c143de/users/368f6c3db9f24561a13f48ce02e7655e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:51.463078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.463919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.465180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.497692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:51.499557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.537199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.537970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.538257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.538923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] PATH_INFO: `/v3/users/a43637f5a40e489a996acf6fb8f0a58d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.539711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43637f5a40e489a996acf6fb8f0a58d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.541688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.604274 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1056/2125] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:51.605618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.607931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.665892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43637f5a40e489a996acf6fb8f0a58d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.673093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:51.709146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43637f5a40e489a996acf6fb8f0a58d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.710319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43637f5a40e489a996acf6fb8f0a58d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.739210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43637f5a40e489a996acf6fb8f0a58d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.740172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43637f5a40e489a996acf6fb8f0a58d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:51.766679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023daea4-84a5-4d64-a4e8-35063bcf1794 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.772330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1070/2126] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:51 2022] DELETE /identity/v3/users/a43637f5a40e489a996acf6fb8f0a58d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:51.773603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:51.777105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.782739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.783535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.783828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.784739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.787116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.915406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:51.920208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eab46e-429b-4901-83bf-e42f5cde1d25 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:51.926635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:51.927625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:51.928373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:51.928790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:51.929399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:51.932198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:51.976846 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1057/2127] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:52.029658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:52.137945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:52.139421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.141656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:52.143129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:52.166113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbe9e-faa6-4458-9eab-272cc1dd7734 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:52.172822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1071/2128] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:52.380477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:52.381970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.392698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:52.395560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:52.395950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:52.396239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:52.407677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66631-0f65-4c4a-aff2-6a9ac210e095 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:52.411026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.423313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:52.423875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:52.424158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:52.424438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] PATH_INFO: `/v3/users/1af05e175fd2437295a8cea9134cada3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:52.426775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af05e175fd2437295a8cea9134cada3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:52.428928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:52.518323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:52.523487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:52.548035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af05e175fd2437295a8cea9134cada3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:52.553603 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1058/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:27:52.556537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:52.561580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.581457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af05e175fd2437295a8cea9134cada3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:52.584374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af05e175fd2437295a8cea9134cada3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:52.602650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716de98-fa47-45f3-8cfb-b240c0452e88 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:52.610444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af05e175fd2437295a8cea9134cada3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:52.611330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7ead582-d7ce-4ba1-b9c9-f5613aeb801e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af05e175fd2437295a8cea9134cada3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:52.617148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:52.617960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:52.618221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:52.618355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:52.642977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.649689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1072/2130] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:52 2022] DELETE /identity/v3/users/1af05e175fd2437295a8cea9134cada3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:52.651171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:52.651398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:52.651691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:52.659104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:52.715796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:52.715796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.821709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:52.823418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:52.848062 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1059/2131] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:52.857503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:52.861396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.882400 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1073/2132] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:52.883705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:52.885963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:52.902130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0c45-3d11-4a02-af7c-3b345364f130 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:52.914399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc37d8-40ba-4350-b894-0d59db3db390 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:52.917339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:52.918013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:52.918300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:52.918581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] PATH_INFO: `/v3/users/d477f91de9224b76b40880623a8c4a18` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:52.922418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d477f91de9224b76b40880623a8c4a18)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:52.924622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:52.932738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:52.932738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:52.933061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:52.933393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] PATH_INFO: `/v3/projects/36833897a3a14bbaad6c935c7421611f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:52.934739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] RBAC: Authorizing `identity:delete_project(project_id=36833897a3a14bbaad6c935c7421611f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:52.936682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.011356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd477f91de9224b76b40880623a8c4a18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.029581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:53.032447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd477f91de9224b76b40880623a8c4a18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.033925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd477f91de9224b76b40880623a8c4a18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.067746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd477f91de9224b76b40880623a8c4a18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.073136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd477f91de9224b76b40880623a8c4a18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.080066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36833897a3a14bbaad6c935c7421611f', 'request_id': 'req-b881908d-63ce-4ddf-92da-4e21a29462be'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.086493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36833897a3a14bbaad6c935c7421611f', 'request_id': 'req-b881908d-63ce-4ddf-92da-4e21a29462be'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.093719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36833897a3a14bbaad6c935c7421611f', 'request_id': 'req-b881908d-63ce-4ddf-92da-4e21a29462be'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.105384 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1060/2133] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:52 2022] DELETE /identity/v3/users/d477f91de9224b76b40880623a8c4a18 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:53.105384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.108077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:53.136253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] The token cache is being invalidate because project 36833897a3a14bbaad6c935c7421611f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:53.136800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.137952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b881908d-63ce-4ddf-92da-4e21a29462be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.144937 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1074/2134] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:52 2022] DELETE /identity/v3/projects/36833897a3a14bbaad6c935c7421611f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:53.151244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec9e5-ea9f-468b-8d0a-941120640823 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.152420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec9e5-ea9f-468b-8d0a-941120640823 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.153727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaec9e5-ea9f-468b-8d0a-941120640823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.187372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ebaec9e5-ea9f-468b-8d0a-941120640823 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:53.189423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ebaec9e5-ea9f-468b-8d0a-941120640823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:53.250503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18ce94-7650-4a30-8d27-60521ae1f11d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:53.269244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:53.269244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.269244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.269244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.269622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:53.292171 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1075/2135] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:53.300780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.301107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.301387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.340782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:53.342179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:53.349663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:53.361986 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1076/2136] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:27:53.363789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.377208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e5f60-6d6f-42c4-8ea3-85632e5e81a0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:53.394250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:53.394967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.395644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.395972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.398951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:53.398951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:53.399583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.421754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1077/2137] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:53.433792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.433952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:53.433952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.437610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a9f08-c32e-4ec9-9dc2-095d3b41c87b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:53.445460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:53.446186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.446545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.446944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.447744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:53.450191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.466993 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1061/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:53.540476 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1078/2139] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:53 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:53.541231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.553989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead36f-7ace-45bf-9d6e-babc801095d7 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:53.561803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.567483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:53.710814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c31ff-c49d-4758-85d6-a88333c0f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:53.712069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0bce6-c590-4e1a-acb2-108b5d5ef15a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:53.712423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c31ff-c49d-4758-85d6-a88333c0f1db admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.713511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c31ff-c49d-4758-85d6-a88333c0f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.714352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c31ff-c49d-4758-85d6-a88333c0f1db admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.716229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c31ff-c49d-4758-85d6-a88333c0f1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:53.717937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:53.719800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.720090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.720374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] PATH_INFO: `/v3/projects/0b4365a5fbc549aaa81cf1c786b52591` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.722263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c31ff-c49d-4758-85d6-a88333c0f1db admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.722752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4365a5fbc549aaa81cf1c786b52591)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:53.725661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.771693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:53.774220 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1062/2140] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:53 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:53.776118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf952-5580-4c24-987d-4822c3f281af None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.777815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf952-5580-4c24-987d-4822c3f281af None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.779548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdf952-5580-4c24-987d-4822c3f281af None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.781075 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1063/2141] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:53.782312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf952-5580-4c24-987d-4822c3f281af None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.841214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdf952-5580-4c24-987d-4822c3f281af None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:53.855879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:53.857328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:53.857765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:53.858222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:53.859191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:53.862502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:53.896577 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1064/2142] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:53.900782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4365a5fbc549aaa81cf1c786b52591', 'request_id': 'req-a9a65912-dcde-4142-810d-32899d9c7264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.903852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:27:53.907491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:53.915051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4365a5fbc549aaa81cf1c786b52591', 'request_id': 'req-a9a65912-dcde-4142-810d-32899d9c7264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.928620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4365a5fbc549aaa81cf1c786b52591', 'request_id': 'req-a9a65912-dcde-4142-810d-32899d9c7264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.958236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] The token cache is being invalidate because project 0b4365a5fbc549aaa81cf1c786b52591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:53.958610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.959301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:53.967084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1079/2143] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:53 2022] DELETE /identity/v3/projects/0b4365a5fbc549aaa81cf1c786b52591 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:53.968379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:53.969905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.022899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:54.025713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.070778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a65912-dcde-4142-810d-32899d9c7264 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.081962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.082506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.082932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.083200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] PATH_INFO: `/v3/users/478ebb4efbc64c71baf3af5245e59c19` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.086067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=478ebb4efbc64c71baf3af5245e59c19)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.088587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.108375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:54.162003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5441-1693-42af-b9a5-8401044d0fe2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.173539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478ebb4efbc64c71baf3af5245e59c19'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.202099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478ebb4efbc64c71baf3af5245e59c19'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.203987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478ebb4efbc64c71baf3af5245e59c19'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.219061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478ebb4efbc64c71baf3af5245e59c19'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.223808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478ebb4efbc64c71baf3af5245e59c19'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.254636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1080/2144] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:53 2022] DELETE /identity/v3/users/478ebb4efbc64c71baf3af5245e59c19 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:54.255648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:54.258178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.271544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffadd1-8012-4e8a-b2b2-2e3a7953bae4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcb4fff49dcf46dc953f2cff8f2f25f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7225ec592cee45a9842e24c94626072c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.272665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffadd1-8012-4e8a-b2b2-2e3a7953bae4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.273442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffadd1-8012-4e8a-b2b2-2e3a7953bae4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.274319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffadd1-8012-4e8a-b2b2-2e3a7953bae4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.276746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffadd1-8012-4e8a-b2b2-2e3a7953bae4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorizing `identity:get_project(project_id=c65073d0fb914f13b382c660b200bbfb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.280061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffadd1-8012-4e8a-b2b2-2e3a7953bae4 tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.285970 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1065/2145] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:27:53 2022] GET /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb => generated 393 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:54.288202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9591f0-b9cc-4ecb-95df-c03387c4df18 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.288644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9591f0-b9cc-4ecb-95df-c03387c4df18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.289369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9591f0-b9cc-4ecb-95df-c03387c4df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.319538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:54.332469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7e9591f0-b9cc-4ecb-95df-c03387c4df18 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:54.333778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e9591f0-b9cc-4ecb-95df-c03387c4df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.442700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee8b0-9bde-4abd-9146-37e1d07d3f7b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.463025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.463662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.463946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.464221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.464882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.466519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.491738 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1081/2146] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:54.493550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:54.500635 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1066/2147] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:54.505215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.509099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.509545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.509833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.523979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1db82-39e3-4686-94f5-68a560caf787 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.529957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.530664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.530950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.531226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] PATH_INFO: `/v3/projects/541365221b2045afbc2f99e613fc9eb0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.534990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541365221b2045afbc2f99e613fc9eb0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.537933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.550546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:54.551769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.581929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1067/2148] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:54.583068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:54.595421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7835df4-f39e-4f74-9b3b-b0ee4d914e20 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.602617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373e8ec-2933-4cb9-972f-bd8bd67494b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.603764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e8ec-2933-4cb9-972f-bd8bd67494b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.604512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e8ec-2933-4cb9-972f-bd8bd67494b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.604977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373e8ec-2933-4cb9-972f-bd8bd67494b6 admin admin] PATH_INFO: `/v3/projects/80be65c9dc654f35ac91e1ff3b87bc1b/users/3cf9798f78514499b8637dcf0e1a96bf/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.623101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e8ec-2933-4cb9-972f-bd8bd67494b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80be65c9dc654f35ac91e1ff3b87bc1b, user_id=3cf9798f78514499b8637dcf0e1a96bf, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.626901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373e8ec-2933-4cb9-972f-bd8bd67494b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.658409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1068/2149] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:54 2022] PUT /identity/v3/projects/80be65c9dc654f35ac91e1ff3b87bc1b/users/3cf9798f78514499b8637dcf0e1a96bf/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:54.658639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541365221b2045afbc2f99e613fc9eb0', 'request_id': 'req-eec11aa6-ae40-4f88-9d96-04195cb2b147'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.659686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b41eba-67d6-4399-8652-ce3c174305b7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.659686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b41eba-67d6-4399-8652-ce3c174305b7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.659686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b41eba-67d6-4399-8652-ce3c174305b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.674299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541365221b2045afbc2f99e613fc9eb0', 'request_id': 'req-eec11aa6-ae40-4f88-9d96-04195cb2b147'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.676177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-49b41eba-67d6-4399-8652-ce3c174305b7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:54.677389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-49b41eba-67d6-4399-8652-ce3c174305b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.693297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541365221b2045afbc2f99e613fc9eb0', 'request_id': 'req-eec11aa6-ae40-4f88-9d96-04195cb2b147'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.717629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] The token cache is being invalidate because project 541365221b2045afbc2f99e613fc9eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:54.719283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.720240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eec11aa6-ae40-4f88-9d96-04195cb2b147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:54.725468 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1082/2150] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:54 2022] DELETE /identity/v3/projects/541365221b2045afbc2f99e613fc9eb0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:54.727546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785381a2-e677-4634-9807-652b8d9caecf None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.727840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785381a2-e677-4634-9807-652b8d9caecf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.728175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785381a2-e677-4634-9807-652b8d9caecf None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.735338 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1083/2151] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:54.737259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785381a2-e677-4634-9807-652b8d9caecf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:54.739519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-785381a2-e677-4634-9807-652b8d9caecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.798797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1069/2152] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:54.798797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.798797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.798797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.817019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:54.826020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785381a2-e677-4634-9807-652b8d9caecf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.835385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.835385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.835385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.835385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.837267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.855199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.857465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.858973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] MFA Rules not processed for user `3cf9798f78514499b8637dcf0e1a96bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:54.859943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.880464 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1084/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:54.882185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:54.884407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.906044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc4e2-ba16-4b30-9a66-f140b2ba56df service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:54.917505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:54.918452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:54.919018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:54.919597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] PATH_INFO: `/v3/users/64fc1d4dc2aa4775a38c4b3f14645827` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:54.922322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fc1d4dc2aa4775a38c4b3f14645827)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:54.925694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:54.977749 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1070/2154] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:54.978821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:27:54.980431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:54.992630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:55.010341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fc1d4dc2aa4775a38c4b3f14645827'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:55.030997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fc1d4dc2aa4775a38c4b3f14645827'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:55.032220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fc1d4dc2aa4775a38c4b3f14645827'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:55.048279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fc1d4dc2aa4775a38c4b3f14645827'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:55.049663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fc1d4dc2aa4775a38c4b3f14645827'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:55.069495 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1085/2155] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:54 2022] DELETE /identity/v3/users/64fc1d4dc2aa4775a38c4b3f14645827 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:55.071040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.074203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:55.110813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.116196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:55.211082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768b295-f136-4dc4-a55d-aab64094750a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.220694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.222679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.223066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.223672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.224465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:55.224999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.228177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.250030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a559cb-2a9b-423e-b744-6e292091e29f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.253897 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1086/2156] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:55.255115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.258103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:55.275710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4dfd9-148c-403b-8748-18548122b367 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.289433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.291078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.291705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.292566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.294163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.297786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.301135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:55.357984 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1087/2157] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:55 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:55.357984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.400120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcb4fff49dcf46dc953f2cff8f2f25f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7225ec592cee45a9842e24c94626072c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.400937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.401308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.401581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.402779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorizing `identity:get_project(project_id=c65073d0fb914f13b382c660b200bbfb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.405658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.419045 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1071/2158] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:27:54 2022] GET /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb => generated 393 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:55.422528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.452771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640283de-acf7-491c-956d-1aa68b8bcddd tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.509084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3508-e3f1-49c2-a768-2a56a37e1542 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.523380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.523380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.523380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.523380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.525469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.538915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.621077 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1088/2159] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:55 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:55.622303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.638960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3c3f1-d16a-43a0-ae0a-bc188304f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.644532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3c3f1-d16a-43a0-ae0a-bc188304f5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.644825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3c3f1-d16a-43a0-ae0a-bc188304f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.645546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3c3f1-d16a-43a0-ae0a-bc188304f5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.646301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3c3f1-d16a-43a0-ae0a-bc188304f5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.653670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3c3f1-d16a-43a0-ae0a-bc188304f5c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.670435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:55.715888 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1072/2160] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:55 2022] POST /identity/v3/users => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:55.715888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53bbf6-80c7-425c-a783-220719828e9c None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.716154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53bbf6-80c7-425c-a783-220719828e9c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.716343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53bbf6-80c7-425c-a783-220719828e9c None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.717915 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1073/2161] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:27:55.718649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53bbf6-80c7-425c-a783-220719828e9c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.771678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b48c8d-fc62-4009-aef1-9e3c31492653 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.781515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.782313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.785803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.786220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.787276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.804243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.863501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53bbf6-80c7-425c-a783-220719828e9c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.870729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.871780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.872152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.872528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.874049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.876230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:55.878916 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1089/2162] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:55 2022] POST /identity/v3/users => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:55.879896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:27:55.881893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:55.896801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1074/2163] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:55.898083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:55.904555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:55.959035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c170d8b-4b5d-4491-9c35-03845e3e22ba admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:55.974703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:55.977547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:55.978258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:55.978675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] PATH_INFO: `/v3/projects/e93b46cfdb944ea5a90c7c7ce92eb749` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:55.981938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93b46cfdb944ea5a90c7c7ce92eb749)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:55.997298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.087526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.089319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.093195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93b46cfdb944ea5a90c7c7ce92eb749', 'request_id': 'req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.103422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93b46cfdb944ea5a90c7c7ce92eb749', 'request_id': 'req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.105432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:56.113423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93b46cfdb944ea5a90c7c7ce92eb749', 'request_id': 'req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.132976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] The token cache is being invalidate because project e93b46cfdb944ea5a90c7c7ce92eb749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:56.133262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.134239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.139294 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1075/2164] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:55 2022] DELETE /identity/v3/projects/e93b46cfdb944ea5a90c7c7ce92eb749 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:56.140461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.142043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.191526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c63-f958-4760-8b7e-d2017a29e9ad admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.289477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:56.297561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e5f4-b8b9-4079-9f13-97bf549c90cb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.313003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.318104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.318771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.319126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.319892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.322945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcb4fff49dcf46dc953f2cff8f2f25f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7225ec592cee45a9842e24c94626072c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.323120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.323730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.324001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.324280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] PATH_INFO: `/v3/projects/3eb0d0a55478414c83dd8345b60903aa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.326152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorizing `identity:get_project(project_id=3eb0d0a55478414c83dd8345b60903aa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.330739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.340667 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1076/2165] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:56.341417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.346167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.351926 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1090/2166] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:27:55 2022] GET /identity/v3/projects/3eb0d0a55478414c83dd8345b60903aa => generated 395 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:56.358919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.372622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc0d84-ab03-432c-bdc3-f451df7e020b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.372743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.387000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.387803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.388266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.388658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] PATH_INFO: `/v3/projects/4e80e77df75449e187015f0ecc636867/users/c801a59e29e546acb3cae89401e1082a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.417107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949e90-9c20-4fb0-93ba-77c86af10f0e tempest-FlavorsAccessNegativeTestJSON-852576076 tempest-FlavorsAccessNegativeTestJSON-852576076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.422997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.424244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.425901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.426467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] PATH_INFO: `/v3/projects/fc007f5716204cc1b5c1ec0a82d19269` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.429211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc007f5716204cc1b5c1ec0a82d19269)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.431984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.436396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e80e77df75449e187015f0ecc636867, user_id=c801a59e29e546acb3cae89401e1082a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.439156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.476859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1077/2167] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:56 2022] PUT /identity/v3/projects/4e80e77df75449e187015f0ecc636867/users/c801a59e29e546acb3cae89401e1082a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:56.477790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.484316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.543622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc007f5716204cc1b5c1ec0a82d19269', 'request_id': 'req-461e61cd-57fc-4b68-a65d-9981a60c5be5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.544052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc007f5716204cc1b5c1ec0a82d19269', 'request_id': 'req-461e61cd-57fc-4b68-a65d-9981a60c5be5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.554103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc007f5716204cc1b5c1ec0a82d19269', 'request_id': 'req-461e61cd-57fc-4b68-a65d-9981a60c5be5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.570750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] The token cache is being invalidate because project fc007f5716204cc1b5c1ec0a82d19269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:56.571186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.571716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.577630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1091/2168] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:56 2022] DELETE /identity/v3/projects/fc007f5716204cc1b5c1ec0a82d19269 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:56.579583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.581810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.609621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f033-b0f3-4eba-ba06-6d0a7ee0b49e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.723981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e61cd-57fc-4b68-a65d-9981a60c5be5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.730169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.731101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.731600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.732087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.732983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.734876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.749997 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1092/2169] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:56.752188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.754543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.761114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.761755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.762036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.762309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] PATH_INFO: `/v3/users/a54d17dec3a646eaa5287b62a4ab94c1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.767414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54d17dec3a646eaa5287b62a4ab94c1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.769325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.777936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:56.785087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c07f7-f64d-4262-af2d-c69f25990294 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.791575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.792600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.793115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.793570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.794496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.797854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.821726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1093/2170] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:56.825641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:56.827789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:56.844754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c22e3-526f-4441-aba7-eda809491ae2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:56.856858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:56.858117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.858690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.859233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] PATH_INFO: `/v3/users/5abef17f2c2e4ce980b10ec4a3de8ea4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:56.861748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abef17f2c2e4ce980b10ec4a3de8ea4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:56.865517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:56.889640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54d17dec3a646eaa5287b62a4ab94c1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.926869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54d17dec3a646eaa5287b62a4ab94c1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.928622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54d17dec3a646eaa5287b62a4ab94c1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.947746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abef17f2c2e4ce980b10ec4a3de8ea4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.948597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54d17dec3a646eaa5287b62a4ab94c1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.949380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-959cbf08-4095-4279-a7eb-c4b1cfea6e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54d17dec3a646eaa5287b62a4ab94c1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:56.954590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:56.975124 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1078/2171] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:56 2022] DELETE /identity/v3/users/a54d17dec3a646eaa5287b62a4ab94c1 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:56.976700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:56.977219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:56.977704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.002013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abef17f2c2e4ce980b10ec4a3de8ea4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:57.008880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abef17f2c2e4ce980b10ec4a3de8ea4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:57.027545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:57.029132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.029248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abef17f2c2e4ce980b10ec4a3de8ea4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:57.029911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abef17f2c2e4ce980b10ec4a3de8ea4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:57.054081 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1094/2172] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:56 2022] DELETE /identity/v3/users/5abef17f2c2e4ce980b10ec4a3de8ea4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:57.054081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.058271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.170721 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1079/2173] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:57.171555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.178506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.198247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841f46-ca32-4546-ba4e-06ed34712d33 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:57.205427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f137ed-8699-4e62-997c-c43828a69d12 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:57.211557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaeae6-5a8e-401d-8903-522386ffd14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:57.212251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaeae6-5a8e-401d-8903-522386ffd14e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.212533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaeae6-5a8e-401d-8903-522386ffd14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.212803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaeae6-5a8e-401d-8903-522386ffd14e admin admin] PATH_INFO: `/v3/projects/4e80e77df75449e187015f0ecc636867/users/c801a59e29e546acb3cae89401e1082a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.216636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaeae6-5a8e-401d-8903-522386ffd14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e80e77df75449e187015f0ecc636867, user_id=c801a59e29e546acb3cae89401e1082a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:57.224142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1305a77-4fba-48e5-9ff7-bee2a55ea579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:57.224747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaeae6-5a8e-401d-8903-522386ffd14e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:57.225734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1305a77-4fba-48e5-9ff7-bee2a55ea579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.227118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1305a77-4fba-48e5-9ff7-bee2a55ea579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.227824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1305a77-4fba-48e5-9ff7-bee2a55ea579 admin admin] PATH_INFO: `/v3/projects/d3873ebc54394a6d8684fb95f30247fa/users/f59ec872768d453a94a0dc3accf81642/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.253905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1305a77-4fba-48e5-9ff7-bee2a55ea579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3873ebc54394a6d8684fb95f30247fa, user_id=f59ec872768d453a94a0dc3accf81642, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:57.257637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1305a77-4fba-48e5-9ff7-bee2a55ea579 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:57.260398 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1080/2174] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:57 2022] PUT /identity/v3/projects/4e80e77df75449e187015f0ecc636867/users/c801a59e29e546acb3cae89401e1082a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:57.261725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761134f-ddb4-496a-986a-76488c260081 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.262015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761134f-ddb4-496a-986a-76488c260081 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.262291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761134f-ddb4-496a-986a-76488c260081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.304388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1095/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:57 2022] PUT /identity/v3/projects/d3873ebc54394a6d8684fb95f30247fa/users/f59ec872768d453a94a0dc3accf81642/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:57.304388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018561e-c62b-483a-8a51-ea98c5249478 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.304912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018561e-c62b-483a-8a51-ea98c5249478 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.305160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a761134f-ddb4-496a-986a-76488c260081 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:57.305487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018561e-c62b-483a-8a51-ea98c5249478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.306393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a761134f-ddb4-496a-986a-76488c260081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.337287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c018561e-c62b-483a-8a51-ea98c5249478 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:57.338900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c018561e-c62b-483a-8a51-ea98c5249478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.451926 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1081/2176] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:57.453773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.454772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.455155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.467274 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1096/2177] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:57.476348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.477182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.477664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.514520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:57.526468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:57.531654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.536000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] MFA Rules not processed for user `c801a59e29e546acb3cae89401e1082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:57.538385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.548698 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1097/2178] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:57.551070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.554873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.636381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:57.645503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866e89f-42e1-4060-ad1c-7261085e5229 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:57.652506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:57.653300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.654284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.654588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.674599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:57.677279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:57.693740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1098/2179] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:57.695371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.700675 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1082/2180] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:57.701571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.703131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.724321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353a305-5b50-4f4d-81c2-ce9a78b24d26 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:57.732674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:57.733375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.733661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.734019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.734587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:57.734895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:57.736583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:57.744481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296a507-0de0-4afa-82f8-f4cf8590e732 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:57.752584 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1099/2181] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:57.753590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.756937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:57.757583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.757702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:57.757859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.758127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.777763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:57.780942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:57.810991 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1083/2182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:57.811939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.829646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174198b8-b58b-45c9-b2c4-b0528788b8b9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:57.846360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:57.847268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:57.847551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:57.847825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:57.848468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:57.850461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:57.905988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1084/2183] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:57 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:57.909714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:57.942197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b3aa2-e631-474d-b6b6-cadea4ac9969 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.023779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5aeec3-6ed8-4595-89b0-ef166b38e419 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.031219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.032351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.033029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.033505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.035037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.039485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.075464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6750c-c6c9-4cf2-9d89-f3100a73ddf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.076233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6750c-c6c9-4cf2-9d89-f3100a73ddf0 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.076524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6750c-c6c9-4cf2-9d89-f3100a73ddf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.076787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6750c-c6c9-4cf2-9d89-f3100a73ddf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.080731 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1085/2184] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:57 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:58.082925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.098943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d5f1c-1136-4ee3-86d6-a9ff4ab257b5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.107159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.107893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.108206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.108480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.109252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.112114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.131472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1086/2185] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:58.133600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.148777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7675-b979-4ab0-bc10-05aa5871ca71 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.155667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.156479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.156772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.157541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.157914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.160144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.179689 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1087/2186] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:58.180700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.199531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfdeda-4116-4c2d-b7e8-06ea33c2b4ce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.211555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.212723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.213032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.213313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] PATH_INFO: `/v3/projects/6a97057031d642499e61fb99733f9702/users/d8be4a84e4104191a2dc23622df7bf5d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.229370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6750c-c6c9-4cf2-9d89-f3100a73ddf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.231055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6750c-c6c9-4cf2-9d89-f3100a73ddf0 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.238276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a97057031d642499e61fb99733f9702, user_id=d8be4a84e4104191a2dc23622df7bf5d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.241481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.243950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1100/2187] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:58.280960 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1088/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:58 2022] PUT /identity/v3/projects/6a97057031d642499e61fb99733f9702/users/d8be4a84e4104191a2dc23622df7bf5d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:58.281265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.281265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.281265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.296833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:58.319003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] MFA Rules not processed for user `d8be4a84e4104191a2dc23622df7bf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:58.320954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:58.352797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.362875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:58.458133 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1101/2189] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:58.459377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.540514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc11cc-6c73-4d09-8a16-4fa1825ffadd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.555177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.555177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.555177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.555177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] PATH_INFO: `/v3/users/3cf9798f78514499b8637dcf0e1a96bf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.559615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf9798f78514499b8637dcf0e1a96bf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.564156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.620196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100f4e6-e3a6-48da-8010-9f974617655d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.629583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.630261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.630771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.631060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.631869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.634978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.681514 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1102/2190] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:58 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:58.682752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.685979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:58.726535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf9798f78514499b8637dcf0e1a96bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.778535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf9798f78514499b8637dcf0e1a96bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.780488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf9798f78514499b8637dcf0e1a96bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.793214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d8711-a618-48c0-97f7-4127ae38328e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:58.803961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:58.804953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:58.805407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:58.805714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] PATH_INFO: `/v3/projects/b7af21ec9ff946a8b6f6c2f10deefcb9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:58.808663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7af21ec9ff946a8b6f6c2f10deefcb9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:58.809698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf9798f78514499b8637dcf0e1a96bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.811192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf9798f78514499b8637dcf0e1a96bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.813139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:58.850013 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1089/2191] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:58 2022] DELETE /identity/v3/users/3cf9798f78514499b8637dcf0e1a96bf => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:27:58.851249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:58.854047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:58.886545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:58.953726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7af21ec9ff946a8b6f6c2f10deefcb9', 'request_id': 'req-d218aad6-ed0a-4b96-8151-b80856c35479'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.977838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7af21ec9ff946a8b6f6c2f10deefcb9', 'request_id': 'req-d218aad6-ed0a-4b96-8151-b80856c35479'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:58.990612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7af21ec9ff946a8b6f6c2f10deefcb9', 'request_id': 'req-d218aad6-ed0a-4b96-8151-b80856c35479'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.009948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd020d-8594-4131-95d3-43b6d844b8dc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.022932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] The token cache is being invalidate because project b7af21ec9ff946a8b6f6c2f10deefcb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:59.023417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.025887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.027813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1103/2192] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:58 2022] DELETE /identity/v3/projects/b7af21ec9ff946a8b6f6c2f10deefcb9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:59.030562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.034726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.081842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:59.124428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.125118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.125401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.125725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] PATH_INFO: `/v3/projects/c65073d0fb914f13b382c660b200bbfb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.126950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65073d0fb914f13b382c660b200bbfb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.129809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.137340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218aad6-ed0a-4b96-8151-b80856c35479 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.146924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b7d4-2680-4796-962a-73a95efbe7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.147699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b7d4-2680-4796-962a-73a95efbe7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.148081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b7d4-2680-4796-962a-73a95efbe7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.148752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b7d4-2680-4796-962a-73a95efbe7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.149513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8b7d4-2680-4796-962a-73a95efbe7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.152673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8b7d4-2680-4796-962a-73a95efbe7b8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.190980 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1104/2193] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:27:59 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:27:59.192868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2ba8-2211-4d45-b7db-c70a1a0f0af5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.193300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2ba8-2211-4d45-b7db-c70a1a0f0af5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.193789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a2ba8-2211-4d45-b7db-c70a1a0f0af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.225052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-801a2ba8-2211-4d45-b7db-c70a1a0f0af5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:59.226490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-801a2ba8-2211-4d45-b7db-c70a1a0f0af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.241072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65073d0fb914f13b382c660b200bbfb', 'request_id': 'req-d4bec536-dd37-4a29-864c-1f3f29efba37'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.288729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65073d0fb914f13b382c660b200bbfb', 'request_id': 'req-d4bec536-dd37-4a29-864c-1f3f29efba37'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.299675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65073d0fb914f13b382c660b200bbfb', 'request_id': 'req-d4bec536-dd37-4a29-864c-1f3f29efba37'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.333463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1105/2194] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:59.335250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.337562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] The token cache is being invalidate because project c65073d0fb914f13b382c660b200bbfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:27:59.337893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.338580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.340109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.341527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.348545 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1090/2195] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:27:58 2022] DELETE /identity/v3/projects/c65073d0fb914f13b382c660b200bbfb => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:59.350145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.353334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.385082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bec536-dd37-4a29-864c-1f3f29efba37 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.391780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:59.396128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.398887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.399988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.401791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.401791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.403979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.405752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.422947 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1106/2196] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:59.422947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.422947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.430776 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1091/2197] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:59.434136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.438100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.475011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056253d-b853-4fca-ae0d-9301a22ffae3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.487773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.488565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.489134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.489554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] PATH_INFO: `/v3/users/fcb4fff49dcf46dc953f2cff8f2f25f0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.491860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb4fff49dcf46dc953f2cff8f2f25f0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.494676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.508355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:59.536663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985aef-f8ee-4e50-9bb2-86761a6681f7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.544710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.545666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.546112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.546478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.551376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.567149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.569446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6a442-f0b3-43e9-a441-d53ae7ed24df service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.581727 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1107/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:27:59.583112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.583472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.583855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.605527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:59.607047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.610174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb4fff49dcf46dc953f2cff8f2f25f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.620492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1108/2199] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:27:59.620492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.629000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a87c7-e723-429d-a6d4-b3a245bac3ae None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.634299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.635048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.635395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.635742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] PATH_INFO: `/v3/projects/90d62b3f4edb4cb8b49a92a6fbedd1e9/users/5dd53a8683774b0888596c7bd6d2a1b6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.667954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb4fff49dcf46dc953f2cff8f2f25f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.668943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb4fff49dcf46dc953f2cff8f2f25f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.669089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d62b3f4edb4cb8b49a92a6fbedd1e9, user_id=5dd53a8683774b0888596c7bd6d2a1b6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.671878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.680407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb4fff49dcf46dc953f2cff8f2f25f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.681596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb4fff49dcf46dc953f2cff8f2f25f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:27:59.709207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1109/2200] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:59 2022] PUT /identity/v3/projects/90d62b3f4edb4cb8b49a92a6fbedd1e9/users/5dd53a8683774b0888596c7bd6d2a1b6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:59.713390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.717642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.725761 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1092/2201] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:27:59 2022] DELETE /identity/v3/users/fcb4fff49dcf46dc953f2cff8f2f25f0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:59.726921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.732630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:27:59.771626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:27:59.854024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f65f3-ebbd-4a33-b48d-c5fb5b86f190 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.859284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4679440-d7b8-4514-a13b-c7a383a46a6f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.869532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.870159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.870439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.870709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.870924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.871361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.871566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.871846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.872121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.873600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:27:59.873716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.874362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.878034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.896439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1093/2202] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:27:59.897472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.907320 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1110/2203] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:27:59.912336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:27:59.912535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a787890-4f2c-41b4-9be1-41ad127c9e3e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.919359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c5807-6e43-467b-849b-044755d8bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:27:59.920237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c5807-6e43-467b-849b-044755d8bd72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.920523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c5807-6e43-467b-849b-044755d8bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.920956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c5807-6e43-467b-849b-044755d8bd72 admin admin] PATH_INFO: `/v3/projects/90d62b3f4edb4cb8b49a92a6fbedd1e9/users/5dd53a8683774b0888596c7bd6d2a1b6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.923094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c5807-6e43-467b-849b-044755d8bd72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d62b3f4edb4cb8b49a92a6fbedd1e9, user_id=5dd53a8683774b0888596c7bd6d2a1b6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:27:59.927712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c5807-6e43-467b-849b-044755d8bd72 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:27:59.938241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fd2e2-31d9-4f3e-94d0-59145bf41e8d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:27:59.952396 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1094/2204] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:27:59 2022] PUT /identity/v3/projects/90d62b3f4edb4cb8b49a92a6fbedd1e9/users/5dd53a8683774b0888596c7bd6d2a1b6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:27:59.954259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:27:59.954622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:27:59.954900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:27:59.989281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] MFA Rules not processed for user `5dd53a8683774b0888596c7bd6d2a1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:27:59.991037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.070425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706904-0893-4653-a69e-46026b959568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.071183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706904-0893-4653-a69e-46026b959568 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.071564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706904-0893-4653-a69e-46026b959568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.071958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35706904-0893-4653-a69e-46026b959568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.072974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706904-0893-4653-a69e-46026b959568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.075259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35706904-0893-4653-a69e-46026b959568 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.114003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1095/2205] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:00.120852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.125487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.130801 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1111/2206] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:27:59 2022] POST /identity/v3/projects => generated 389 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:00.137067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706904-0893-4653-a69e-46026b959568 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.213856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:00.235149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccc7de-8e1f-4ed9-8aa6-82a994f306b9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:00.280611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:00.282906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35706904-0893-4653-a69e-46026b959568 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:00.290055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.290749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.291025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.291211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.292471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.294471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.344777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.345646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.346099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.347207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.354948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1112/2207] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:00 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:00.357089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.359194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.375354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ccf46-2924-4e15-8925-165e2613a91f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:00.380617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.381450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.381919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.382299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] PATH_INFO: `/v3/projects/80be65c9dc654f35ac91e1ff3b87bc1b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.383631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80be65c9dc654f35ac91e1ff3b87bc1b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.386174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.450122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.452731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.453688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80be65c9dc654f35ac91e1ff3b87bc1b', 'request_id': 'req-b737cda4-fcd2-43a2-8f4d-053b38b4e432'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.460288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80be65c9dc654f35ac91e1ff3b87bc1b', 'request_id': 'req-b737cda4-fcd2-43a2-8f4d-053b38b4e432'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.468954 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1096/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:00.470126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.490137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae4b9c-0768-4947-b8d6-9081d5a13870 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:00.511178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80be65c9dc654f35ac91e1ff3b87bc1b', 'request_id': 'req-b737cda4-fcd2-43a2-8f4d-053b38b4e432'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.539480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] The token cache is being invalidate because project 80be65c9dc654f35ac91e1ff3b87bc1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:00.539792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.545527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.547206 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1113/2209] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:00 2022] DELETE /identity/v3/projects/80be65c9dc654f35ac91e1ff3b87bc1b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:00.551161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.556047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.594352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.595404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.595835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.596283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.598211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.600263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.617276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1097/2210] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:00.618635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.620988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.639317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afbf21-3def-4e10-9f8e-ee2c750357c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:00.647085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.648058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.648712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.649225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] PATH_INFO: `/v3/users/c801a59e29e546acb3cae89401e1082a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.651006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c801a59e29e546acb3cae89401e1082a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.653228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.700489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b737cda4-fcd2-43a2-8f4d-053b38b4e432 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:00.710834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:00.711834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:00.712290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:00.712659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:00.715319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.762802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c801a59e29e546acb3cae89401e1082a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.774759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:00.783628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:00.789657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c801a59e29e546acb3cae89401e1082a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.791586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c801a59e29e546acb3cae89401e1082a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.811674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c801a59e29e546acb3cae89401e1082a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.812946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c801a59e29e546acb3cae89401e1082a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:00.845528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1098/2211] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:00 2022] DELETE /identity/v3/users/c801a59e29e546acb3cae89401e1082a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:00.845528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:00.858880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:00.879952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:00.883336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:00.913931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1114/2212] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:01.031735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aabadf-e647-4a9f-82a8-92e290b9346a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:01.042119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef00f1-71f8-4cd1-8919-175b12099a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:01.042754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef00f1-71f8-4cd1-8919-175b12099a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:01.043039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef00f1-71f8-4cd1-8919-175b12099a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:01.043317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef00f1-71f8-4cd1-8919-175b12099a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:01.043984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef00f1-71f8-4cd1-8919-175b12099a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:01.045648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef00f1-71f8-4cd1-8919-175b12099a81 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:01.080452 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1099/2213] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:01.081276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:01.082965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:01.104929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1a5b0-85fa-4493-84ee-e5713073bad0 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:01.115254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:01.117477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:01.117765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:01.118069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] PATH_INFO: `/v3/projects/966924b122294514bc98da18682e7c54/users/6b8dbdec9e87496b868d58ca08515bc6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:01.147048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=966924b122294514bc98da18682e7c54, user_id=6b8dbdec9e87496b868d58ca08515bc6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:01.150570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:01.209204 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1115/2214] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:01 2022] PUT /identity/v3/projects/966924b122294514bc98da18682e7c54/users/6b8dbdec9e87496b868d58ca08515bc6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:01.220261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:01.220688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:01.221011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:01.249736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:01.251872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:01.304443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] MFA Rules not processed for user `6b8dbdec9e87496b868d58ca08515bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:01.307521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:01.450983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ab873-c3b1-408b-8eb3-785466bbabcc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:01.463806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:01.465779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:01.466081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:01.466886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] PATH_INFO: `/v3/projects/7225ec592cee45a9842e24c94626072c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:01.476268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7225ec592cee45a9842e24c94626072c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:01.479874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:01.528206 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1100/2215] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:01.532715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:01.570784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea179cb-73e5-4e65-9e53-c401a7fb8a69 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:01.585616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:01.586291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:01.586577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:01.586853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:01.587552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:01.590286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:01.632430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7225ec592cee45a9842e24c94626072c', 'request_id': 'req-7f2dd9fc-ef41-4568-b489-0676bbc01910'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:01.650281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7225ec592cee45a9842e24c94626072c', 'request_id': 'req-7f2dd9fc-ef41-4568-b489-0676bbc01910'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:01.682234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1101/2216] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:01 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:01.686714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:01.687695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7225ec592cee45a9842e24c94626072c', 'request_id': 'req-7f2dd9fc-ef41-4568-b489-0676bbc01910'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:01.692918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:01.719226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] The token cache is being invalidate because project 7225ec592cee45a9842e24c94626072c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:01.720103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:01.721450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:01.723762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1116/2217] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:01 2022] DELETE /identity/v3/projects/7225ec592cee45a9842e24c94626072c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:01.724873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:01.726736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:01.788318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:01.799169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:01.860449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd9fc-ef41-4568-b489-0676bbc01910 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:01.902626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113acd27-7cbd-4a97-ae79-23b6d1b13a01 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:01.916466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:01.917618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:01.919054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:01.919341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] PATH_INFO: `/v3/users/d8be4a84e4104191a2dc23622df7bf5d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:01.921924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8be4a84e4104191a2dc23622df7bf5d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:01.926656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:02.020427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:02.026006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.026650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.026953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.028097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:02.032516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:02.061163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8be4a84e4104191a2dc23622df7bf5d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.078343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8be4a84e4104191a2dc23622df7bf5d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.079089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8be4a84e4104191a2dc23622df7bf5d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.087764 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1117/2218] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:01 2022] POST /identity/v3/users => generated 301 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:02.087764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:02.090545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8be4a84e4104191a2dc23622df7bf5d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.091301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8be4a84e4104191a2dc23622df7bf5d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.094406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.110076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1102/2219] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:01 2022] DELETE /identity/v3/users/d8be4a84e4104191a2dc23622df7bf5d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:02.111360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:02.114125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.123333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa2865-1604-4a7f-8c36-b9008319a9ae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:02.219564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2a9e6-d481-4691-b6b8-1777dafdcfb3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:02.223987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:02.224884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.226233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.227336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] PATH_INFO: `/v3/projects/4e80e77df75449e187015f0ecc636867` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.230197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e80e77df75449e187015f0ecc636867)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:02.233242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:02.234940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:02.238665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.238906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.240412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] PATH_INFO: `/v3/users/1e5bed911b4b4536b942a82109310b05` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.250086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5bed911b4b4536b942a82109310b05)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:02.250086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:02.366979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e80e77df75449e187015f0ecc636867', 'request_id': 'req-68f852fc-c584-48e4-960d-240d92cf8d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.374761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e80e77df75449e187015f0ecc636867', 'request_id': 'req-68f852fc-c584-48e4-960d-240d92cf8d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.380790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5bed911b4b4536b942a82109310b05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.386035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e80e77df75449e187015f0ecc636867', 'request_id': 'req-68f852fc-c584-48e4-960d-240d92cf8d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.391093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:02.410340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5bed911b4b4536b942a82109310b05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.411344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5bed911b4b4536b942a82109310b05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.425535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] The token cache is being invalidate because project 4e80e77df75449e187015f0ecc636867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:02.425965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.427129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.430973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5bed911b4b4536b942a82109310b05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.431695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5bed911b4b4536b942a82109310b05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.433913 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1118/2220] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:02 2022] DELETE /identity/v3/projects/4e80e77df75449e187015f0ecc636867 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:02.434821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:02.439006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.460223 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1103/2221] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:02 2022] DELETE /identity/v3/users/1e5bed911b4b4536b942a82109310b05 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:02.460223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:02.463358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:02.476391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.590774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f852fc-c584-48e4-960d-240d92cf8d73 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:02.669194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2a318-d810-409e-b053-82d3f7803c1b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:02.678106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b573303-3592-44f3-b219-ef993b6d20cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:02.679084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573303-3592-44f3-b219-ef993b6d20cc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.679429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573303-3592-44f3-b219-ef993b6d20cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.679803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573303-3592-44f3-b219-ef993b6d20cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.680743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b573303-3592-44f3-b219-ef993b6d20cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:02.690808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b573303-3592-44f3-b219-ef993b6d20cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:02.722155 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1104/2222] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:02.735146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64123a-667c-4bc5-9add-85b3b0d89641 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.735647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64123a-667c-4bc5-9add-85b3b0d89641 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.737210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64123a-667c-4bc5-9add-85b3b0d89641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.788299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:02.789209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.789631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.790010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] PATH_INFO: `/v3/users/fa65581361534943b2cda9381e3f7a8c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.792290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa65581361534943b2cda9381e3f7a8c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:02.794423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:02.811925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2b64123a-667c-4bc5-9add-85b3b0d89641 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:02.819183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b64123a-667c-4bc5-9add-85b3b0d89641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.871577 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1105/2223] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:02.871577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42a7f-7828-48ba-9e3c-b4900796f13b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.871577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42a7f-7828-48ba-9e3c-b4900796f13b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.871894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb42a7f-7828-48ba-9e3c-b4900796f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.920014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0eb42a7f-7828-48ba-9e3c-b4900796f13b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:02.922445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0eb42a7f-7828-48ba-9e3c-b4900796f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.934029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa65581361534943b2cda9381e3f7a8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.936123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1106/2224] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:02.938124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81790-e43b-4b13-a0c1-6a18abdae7e3 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.938686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81790-e43b-4b13-a0c1-6a18abdae7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.939105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81790-e43b-4b13-a0c1-6a18abdae7e3 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.942211 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1107/2225] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:02.943448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81790-e43b-4b13-a0c1-6a18abdae7e3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:02.946524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-34f81790-e43b-4b13-a0c1-6a18abdae7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:02.976437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa65581361534943b2cda9381e3f7a8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.977465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa65581361534943b2cda9381e3f7a8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.978043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81790-e43b-4b13-a0c1-6a18abdae7e3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:02.985747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63825524-afd0-48cc-b42b-f2c7d319395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:02.987948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825524-afd0-48cc-b42b-f2c7d319395f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:02.988320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825524-afd0-48cc-b42b-f2c7d319395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:02.988714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825524-afd0-48cc-b42b-f2c7d319395f admin admin] PATH_INFO: `/v3/projects/b85f6bbc881c42489f3f49f57933f6a2/users/7a95981ee6314d76bbf361b194d67cb7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:02.997440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa65581361534943b2cda9381e3f7a8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:02.998080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f0a0082-2cfd-4348-8f82-f47844521695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa65581361534943b2cda9381e3f7a8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:03.017992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63825524-afd0-48cc-b42b-f2c7d319395f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85f6bbc881c42489f3f49f57933f6a2, user_id=7a95981ee6314d76bbf361b194d67cb7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.024094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63825524-afd0-48cc-b42b-f2c7d319395f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.025810 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1119/2226] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:02 2022] DELETE /identity/v3/users/fa65581361534943b2cda9381e3f7a8c => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:03.027602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.028035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.028318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.059403 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1108/2227] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:02 2022] PUT /identity/v3/projects/b85f6bbc881c42489f3f49f57933f6a2/users/7a95981ee6314d76bbf361b194d67cb7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:03.061355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc567ce7-e995-4697-87e4-37703e04f18b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.061686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc567ce7-e995-4697-87e4-37703e04f18b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.062021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc567ce7-e995-4697-87e4-37703e04f18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.074839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:03.076178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.103169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dc567ce7-e995-4697-87e4-37703e04f18b None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:03.106308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc567ce7-e995-4697-87e4-37703e04f18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.125339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:03.181819 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1120/2228] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:03.181819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.188001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.234380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1109/2229] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:03.236076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.236367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.236646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.258330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:03.259560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.275920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1110/2230] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:03.275920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.276444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.298626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0727c54-16ce-41e6-aba4-5b0b497b2eaf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.300247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061b96-d1f3-4c3c-ad47-847c79239f3f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.306753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.307736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.308216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.309685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.312265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.322204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.323666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.323966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.324328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.326002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.327667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.328924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.329182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.349188 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1111/2231] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:03.350112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.351945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.356433 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1121/2232] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:03.357354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.369517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87369eb3-bb49-4c98-a2a1-7585f7cd5fd4 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.375649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.377149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.378220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.378872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.380559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:03.381586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.384160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.404214 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1122/2233] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:03.405540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.407005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bcf65-0d3c-48e4-8491-bc937b1a1c80 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.407825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.414546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.415210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.415485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.415768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] PATH_INFO: `/v3/projects/3eb0d0a55478414c83dd8345b60903aa` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.417043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb0d0a55478414c83dd8345b60903aa)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.419564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.429809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0d9e4-bcaa-459c-8958-ff8b3ff8a3de admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.434871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.435846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.436343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.436823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.446786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.449240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.455172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:03.476337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1123/2234] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:03.477119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.499370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004aa59-94b4-42d6-8bfe-a2ee4a72722e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.503848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.504634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.505069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.505436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.539330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.540296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb0d0a55478414c83dd8345b60903aa', 'request_id': 'req-4ece499f-3edb-4242-9548-cd4a4ec89e59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:03.543289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.557509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb0d0a55478414c83dd8345b60903aa', 'request_id': 'req-4ece499f-3edb-4242-9548-cd4a4ec89e59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:03.566146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb0d0a55478414c83dd8345b60903aa', 'request_id': 'req-4ece499f-3edb-4242-9548-cd4a4ec89e59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:03.584786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1124/2235] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:03.586008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.616703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48efc99-9e66-4180-8799-ba3fd537b3b5 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.617941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] The token cache is being invalidate because project 3eb0d0a55478414c83dd8345b60903aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:03.620215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:03.625207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:03.630448 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1112/2236] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:03 2022] DELETE /identity/v3/projects/3eb0d0a55478414c83dd8345b60903aa => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:03.632007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:03.639936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:03.822022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c997be-2898-4fa1-b710-b64aa4e724a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:03.823601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c997be-2898-4fa1-b710-b64aa4e724a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.824159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c997be-2898-4fa1-b710-b64aa4e724a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.825521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c997be-2898-4fa1-b710-b64aa4e724a4 admin admin] PATH_INFO: `/v3/projects/b85f6bbc881c42489f3f49f57933f6a2/users/7a95981ee6314d76bbf361b194d67cb7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.829563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c997be-2898-4fa1-b710-b64aa4e724a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85f6bbc881c42489f3f49f57933f6a2, user_id=7a95981ee6314d76bbf361b194d67cb7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:03.834707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c997be-2898-4fa1-b710-b64aa4e724a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:03.857725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece499f-3edb-4242-9548-cd4a4ec89e59 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:03.866044 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1125/2237] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:03 2022] PUT /identity/v3/projects/b85f6bbc881c42489f3f49f57933f6a2/users/7a95981ee6314d76bbf361b194d67cb7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:03.869076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:03.869381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:03.869657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:03.930184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:03.931849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.011511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:04.013772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2057b-cabf-47b7-abc9-a8267492414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:04.015155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2057b-cabf-47b7-abc9-a8267492414b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.015489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2057b-cabf-47b7-abc9-a8267492414b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.015814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2057b-cabf-47b7-abc9-a8267492414b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.016369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2057b-cabf-47b7-abc9-a8267492414b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:04.019759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2057b-cabf-47b7-abc9-a8267492414b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:04.069736 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1113/2238] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:03 2022] POST /identity/v3/projects => generated 377 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:04.071157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.071451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.071725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.102081 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1126/2239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:04.104239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:04.105903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.122868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] MFA Rules not processed for user `7a95981ee6314d76bbf361b194d67cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:04.123208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.159688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:04.259248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54db113-0717-43b3-8088-f0fd53304dbe None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:04.281839 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1114/2240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:04.282890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:04.285989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.376778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:04.377556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.378689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.378972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.382430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.398932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:04.400638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:04.444353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adec90-b32b-4685-9e49-f272c91cf75d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:04.446574 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1127/2241] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:04.447565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:04.451466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:04.452746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.453227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.453807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] PATH_INFO: `/v3/projects/a0a161064bfc4b608dabcd8fd2b26037` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.459022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a161064bfc4b608dabcd8fd2b26037)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:04.461661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:04.468127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e61b4-7921-4c0f-95da-c9f956c617c4 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:04.477329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf183f-161c-4dd7-809f-e66d8db61422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:04.478056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf183f-161c-4dd7-809f-e66d8db61422 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.478337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf183f-161c-4dd7-809f-e66d8db61422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.478612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf183f-161c-4dd7-809f-e66d8db61422 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.479532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf183f-161c-4dd7-809f-e66d8db61422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:04.481526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf183f-161c-4dd7-809f-e66d8db61422 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:04.536200 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1128/2242] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:04 2022] POST /identity/v3/users => generated 289 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:04.536200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.536200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.536200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.577667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a161064bfc4b608dabcd8fd2b26037', 'request_id': 'req-f2a774c4-e039-414c-86b6-a34690474284'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.579980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:04.582941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.594064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a161064bfc4b608dabcd8fd2b26037', 'request_id': 'req-f2a774c4-e039-414c-86b6-a34690474284'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.605974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a161064bfc4b608dabcd8fd2b26037', 'request_id': 'req-f2a774c4-e039-414c-86b6-a34690474284'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.630179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] The token cache is being invalidate because project a0a161064bfc4b608dabcd8fd2b26037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:04.630581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.632610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.636448 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1115/2243] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:04 2022] DELETE /identity/v3/projects/a0a161064bfc4b608dabcd8fd2b26037 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:04.637316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:04.641381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.689203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:04.738422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1129/2244] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:04.738422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:04.738422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.743023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:04.757458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7dce-1031-4cce-8de8-1434c9b2b7c5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:04.772701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:04.774632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.774928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.777070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] PATH_INFO: `/v3/projects/6a97057031d642499e61fb99733f9702` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.778194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a97057031d642499e61fb99733f9702)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:04.780110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:04.798537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a774c4-e039-414c-86b6-a34690474284 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:04.813863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:04.814796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:04.816002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:04.816875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:04.818836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.922055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:04.924274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:04.928452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a97057031d642499e61fb99733f9702', 'request_id': 'req-7650eab5-6d2f-4878-903f-a08780bc1ae8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.937703 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1116/2245] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:04 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:04.938837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:04.940270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:04.967089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358e855-85a4-48a1-8623-a6b9c8fd82f2 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:04.968863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a97057031d642499e61fb99733f9702', 'request_id': 'req-7650eab5-6d2f-4878-903f-a08780bc1ae8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:04.993600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a97057031d642499e61fb99733f9702', 'request_id': 'req-7650eab5-6d2f-4878-903f-a08780bc1ae8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.024846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] The token cache is being invalidate because project 6a97057031d642499e61fb99733f9702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:05.025260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.028242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.032050 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1130/2246] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:04 2022] DELETE /identity/v3/projects/6a97057031d642499e61fb99733f9702 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:05.032889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.037250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.134812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.135632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.138455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.138779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.139471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:05.144115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:05.174015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1117/2247] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:05.178833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.180613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.196531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e553a77-a484-4e5e-ad5c-237163b7ab36 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:05.202227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.202990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.204217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.204510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.205207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:05.206171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:05.208404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18a074-4d10-411b-bf13-03bb5ae05a1f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:05.216319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650eab5-6d2f-4878-903f-a08780bc1ae8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:05.223785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.224451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.224733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.225034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] PATH_INFO: `/v3/users/2da3d21b1bdc4e5a854e4afea42eab84` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.226837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da3d21b1bdc4e5a854e4afea42eab84)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:05.228037 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1118/2248] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:05.229027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:05.232175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.232484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.233465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.276145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] MFA Rules not processed for user `368f6c3db9f24561a13f48ce02e7655e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:05.279277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.368108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da3d21b1bdc4e5a854e4afea42eab84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.402750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:05.413128 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1119/2249] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:05.414691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da3d21b1bdc4e5a854e4afea42eab84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.416239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da3d21b1bdc4e5a854e4afea42eab84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.418615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.420486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.423880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:05.434915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da3d21b1bdc4e5a854e4afea42eab84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.437410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da3d21b1bdc4e5a854e4afea42eab84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.444083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad7383-3a91-4581-8e57-125cc3677a6c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:05.452509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.453228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.453512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.453790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] PATH_INFO: `/v3/users/5dd53a8683774b0888596c7bd6d2a1b6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.455017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd53a8683774b0888596c7bd6d2a1b6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:05.457945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:05.506034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1131/2250] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:05 2022] DELETE /identity/v3/users/2da3d21b1bdc4e5a854e4afea42eab84 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:05.508671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.512258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.577279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd53a8683774b0888596c7bd6d2a1b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.594468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd53a8683774b0888596c7bd6d2a1b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.595395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd53a8683774b0888596c7bd6d2a1b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.614466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd53a8683774b0888596c7bd6d2a1b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.615331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd53a8683774b0888596c7bd6d2a1b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:05.642367 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1120/2251] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:05 2022] DELETE /identity/v3/users/5dd53a8683774b0888596c7bd6d2a1b6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:05.645218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.673409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.719484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93679-73f8-48cc-8bcd-a9fa17e2d731 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:05.775825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328844c-dc3b-49d7-aa41-027a7835264e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:05.782573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.783630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.783630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.784023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.784953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:05.786738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:05.808383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1121/2252] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:05.809377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.813431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.833618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f538-6b3e-482b-95f2-948807862a25 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:05.845698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.846224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.846528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.847098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.849597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:05.851852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:05.900129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1122/2253] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:05 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:05.902962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:05.908633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:05.954722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:05.955227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:05.955515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:05.957966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:05.966737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:06.040746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:06.102835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf420c-87b2-47a3-a35c-eef2b7335aec admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:06.108767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:06.110733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97cb71-b1d8-4bc3-8da7-7d7641d90d7b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:06.114656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:06.115293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.118062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.118361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.119025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:06.129412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:06.138298 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1132/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:06.141385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b1c86-40ed-4277-a0a7-1299f8782d38 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.149269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b1c86-40ed-4277-a0a7-1299f8782d38 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.152538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b1c86-40ed-4277-a0a7-1299f8782d38 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.160822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1133/2255] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:28:06 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:06.161949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b1c86-40ed-4277-a0a7-1299f8782d38 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:06.209810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b1c86-40ed-4277-a0a7-1299f8782d38 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:06.234791 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1123/2256] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:05 2022] POST /identity/v3/projects => generated 401 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:06.236016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:06.238388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db18f4-38dd-4307-b700-11810fe15bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:06.239081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db18f4-38dd-4307-b700-11810fe15bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.239348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db18f4-38dd-4307-b700-11810fe15bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.239628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db18f4-38dd-4307-b700-11810fe15bcf admin admin] PATH_INFO: `/v3/projects/4ab154cc46594c6e98c5f33dcfbe6324/users/9818a590441c42d1a924fb2daf4323d2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.305519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db18f4-38dd-4307-b700-11810fe15bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab154cc46594c6e98c5f33dcfbe6324, user_id=9818a590441c42d1a924fb2daf4323d2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:06.308736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db18f4-38dd-4307-b700-11810fe15bcf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:06.324802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:06.339705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1134/2257] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:06 2022] PUT /identity/v3/projects/4ab154cc46594c6e98c5f33dcfbe6324/users/9818a590441c42d1a924fb2daf4323d2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:06.339705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.340685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.341177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.372481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:06.373964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:06.424734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ede9c-62c6-4c24-8149-3f2183655f6e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:06.486996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1135/2258] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:06.490631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:06.574761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:06.575550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.577033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.578509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.580327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:06.584885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:06.625073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f74ad-be84-4de6-b027-03a51b1ee212 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:06.633089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c83e9-8a08-424b-9ee7-2de8a00018b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:06.633824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c83e9-8a08-424b-9ee7-2de8a00018b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.634109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c83e9-8a08-424b-9ee7-2de8a00018b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.634608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c83e9-8a08-424b-9ee7-2de8a00018b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.635412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c83e9-8a08-424b-9ee7-2de8a00018b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:06.637781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c83e9-8a08-424b-9ee7-2de8a00018b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:06.649776 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1124/2259] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:06 2022] POST /identity/v3/users => generated 292 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:06.649776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:06.665129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:06.697342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32e329-1766-4f01-a139-b87c298a862d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:06.704984 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1136/2260] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:06 2022] POST /identity/v3/users => generated 307 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:06.706924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.707215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.707536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.712357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:06.713330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.713615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.714033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] PATH_INFO: `/v3/projects/e220527c548d42c99907296edb416065` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:06.716262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e220527c548d42c99907296edb416065)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:06.718240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:06.744505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] MFA Rules not processed for user `9818a590441c42d1a924fb2daf4323d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:06.746171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:06.854309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e220527c548d42c99907296edb416065', 'request_id': 'req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:06.859884 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1137/2261] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:06.859884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:06.861030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:06.867567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e220527c548d42c99907296edb416065', 'request_id': 'req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:06.876116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:06.876831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e220527c548d42c99907296edb416065', 'request_id': 'req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:06.887153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b6017-61f5-436b-89c2-2432a6b83e5f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:06.902920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] The token cache is being invalidate because project e220527c548d42c99907296edb416065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:06.903310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:06.904141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:06.906724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:06.909746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1125/2262] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:06 2022] DELETE /identity/v3/projects/e220527c548d42c99907296edb416065 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:06.911007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:06.912851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:06.996469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:06.997218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:06.997569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:06.998048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] PATH_INFO: `/v3/projects/90d62b3f4edb4cb8b49a92a6fbedd1e9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.001200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d62b3f4edb4cb8b49a92a6fbedd1e9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.004379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.057251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14401e-ec0f-4f26-bdc1-83e492a16bfb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.075451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.076079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.076360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.076634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.082445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.104715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d62b3f4edb4cb8b49a92a6fbedd1e9', 'request_id': 'req-debf9116-510c-472e-ae49-88ad0bc18f14'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.121550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d62b3f4edb4cb8b49a92a6fbedd1e9', 'request_id': 'req-debf9116-510c-472e-ae49-88ad0bc18f14'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.132856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d62b3f4edb4cb8b49a92a6fbedd1e9', 'request_id': 'req-debf9116-510c-472e-ae49-88ad0bc18f14'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.159661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] The token cache is being invalidate because project 90d62b3f4edb4cb8b49a92a6fbedd1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:07.159661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.160607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.168426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1138/2263] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:06 2022] DELETE /identity/v3/projects/90d62b3f4edb4cb8b49a92a6fbedd1e9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:07.169572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.175513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.272838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.274475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.296395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9116-510c-472e-ae49-88ad0bc18f14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.301331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1126/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:07.302118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.302987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.304791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.305322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.306091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.306600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.307479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.309769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.328704 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1139/2265] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:07.329807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.333434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.335517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe085e-e997-4a7e-862b-09a7451f5782 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.343587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.344589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.345161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.345677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] PATH_INFO: `/v3/users/6b8dbdec9e87496b868d58ca08515bc6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.348776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8dbdec9e87496b868d58ca08515bc6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.350451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3fea-189d-4c38-80bc-91e3eff845e9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.354003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.356585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.357250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.357532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.357810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.358464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.360078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.379845 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1140/2266] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:07.380763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.384637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.399534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2df2-48b3-4064-b10c-0b887a1da46d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.408486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90d1fe-f453-4785-b0d3-dd08da12f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.410240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d1fe-f453-4785-b0d3-dd08da12f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.410583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d1fe-f453-4785-b0d3-dd08da12f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.411027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90d1fe-f453-4785-b0d3-dd08da12f2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.415280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d1fe-f453-4785-b0d3-dd08da12f2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.429731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90d1fe-f453-4785-b0d3-dd08da12f2bb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.436220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8dbdec9e87496b868d58ca08515bc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.457353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8dbdec9e87496b868d58ca08515bc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.458826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8dbdec9e87496b868d58ca08515bc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.469493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8dbdec9e87496b868d58ca08515bc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.473010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a25ec04-816a-483f-89d8-7c426d592b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8dbdec9e87496b868d58ca08515bc6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:07.488350 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1141/2267] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:07.491225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.491536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.491818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.500746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:07.509379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1127/2268] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:07 2022] DELETE /identity/v3/users/6b8dbdec9e87496b868d58ca08515bc6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:07.513907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ae62-7a41-40d7-b03e-73ef6d315980 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.514273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ae62-7a41-40d7-b03e-73ef6d315980 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.514657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ae62-7a41-40d7-b03e-73ef6d315980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.525810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:07.527172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:07.527350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.551745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f1a2ae62-7a41-40d7-b03e-73ef6d315980 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:07.553730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1a2ae62-7a41-40d7-b03e-73ef6d315980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.630336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1128/2269] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:07.632221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.632755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.633348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.638349 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1142/2270] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:07.646874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.646874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.660503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeebb1-7bc8-4cf7-8912-3158d42700fd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.670983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.671617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.671901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.672193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.672845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.675558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.686002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:07.687290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.704079 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1143/2271] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:07.706759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.709039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.731393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474f44-6895-47bd-87ea-07e93c91b206 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.745670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fd09f-2aa8-4cac-b5fe-d730d4743ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.748983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd09f-2aa8-4cac-b5fe-d730d4743ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.749531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd09f-2aa8-4cac-b5fe-d730d4743ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.750311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd09f-2aa8-4cac-b5fe-d730d4743ef5 admin admin] PATH_INFO: `/v3/projects/afbe42c6ef2a4069b0e3633975c402cc/users/78deecd91fde4784af0378a14051af20/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.779456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fd09f-2aa8-4cac-b5fe-d730d4743ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbe42c6ef2a4069b0e3633975c402cc, user_id=78deecd91fde4784af0378a14051af20, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.782203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fd09f-2aa8-4cac-b5fe-d730d4743ef5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.783539 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1129/2272] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:07.785120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:07.786304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.804376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f2215-ae96-4cc3-a589-5a64a66b2184 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:07.812352 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1144/2273] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:07 2022] PUT /identity/v3/projects/afbe42c6ef2a4069b0e3633975c402cc/users/78deecd91fde4784af0378a14051af20/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:07.814358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e3da-5f06-44fb-a660-fb4b4d096c3e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.814664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e3da-5f06-44fb-a660-fb4b4d096c3e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.815410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e3da-5f06-44fb-a660-fb4b4d096c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.843857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e9b3e3da-5f06-44fb-a660-fb4b4d096c3e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:07.849759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9b3e3da-5f06-44fb-a660-fb4b4d096c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.915502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cc3d2-e7b7-4175-b72e-c8a7eb57976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:07.916131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc3d2-e7b7-4175-b72e-c8a7eb57976a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.916843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc3d2-e7b7-4175-b72e-c8a7eb57976a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.916843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cc3d2-e7b7-4175-b72e-c8a7eb57976a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.917433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cc3d2-e7b7-4175-b72e-c8a7eb57976a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:07.925406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cc3d2-e7b7-4175-b72e-c8a7eb57976a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:07.959788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1130/2274] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:07.961283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:07.961573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:07.961851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:07.987697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:07.989188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:07.997007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1145/2275] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:07.999714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.000012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.001297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.001616 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1131/2276] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:08.002604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.017219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3ca94-76bf-4926-a66e-3d15d76acd2e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.022523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.023630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.024086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.025635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] PATH_INFO: `/v3/projects/b31c5115b1924dba8bfa0fc1e6f18130/users/017991f4fde94abdb45c349427a7e2bd/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.054020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:08.054173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31c5115b1924dba8bfa0fc1e6f18130, user_id=017991f4fde94abdb45c349427a7e2bd, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.055252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:08.058058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.082608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1146/2277] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:08.083354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.087012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:08.090145 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1132/2278] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:08 2022] PUT /identity/v3/projects/b31c5115b1924dba8bfa0fc1e6f18130/users/017991f4fde94abdb45c349427a7e2bd/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:08.091123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.120610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:08.212101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1782-f9d7-42a3-ab68-721f55c736f9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.236200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0348-220c-4a12-a7a4-9a0a760ec279 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.244110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.245329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.245618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.245894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.246636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.247878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:08.248226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.272045 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1133/2279] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:08.272045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.284819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3a192-42b2-4e61-909d-96ce33a0ae28 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.294753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.295111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.295397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.295673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.297266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.298992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.311379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1134/2280] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:08.312272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.327048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0209-f018-46ab-846a-2511e966bcab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.328546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.329244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.329525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.329861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.334021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.335015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.335276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.335752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.336506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:08.336817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.339337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.348617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.350271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.356688 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1135/2281] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:08.357454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.363272 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1147/2282] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:08.364053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.378909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985edcf-85ab-481a-a63f-d7df49755ca3 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.384989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.385596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.385879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.386158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.386821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:08.387151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.388780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb02fb9-f5e8-4833-9dfe-a5e0511288cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.390143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17713fc-d383-411d-b8d0-4954cd350432 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.394858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.395591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.395876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.396149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.409635 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1148/2283] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:08.409635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.409635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.409635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.412556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.414044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.426391 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1136/2284] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:08.427237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.438063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf1a9-bd32-4eb7-85f9-227a06e33887 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.443614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] MFA Rules not processed for user `017991f4fde94abdb45c349427a7e2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:08.443779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d96cb-c7f8-45d0-9a7e-821bf7d058ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.444332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d96cb-c7f8-45d0-9a7e-821bf7d058ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.444611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d96cb-c7f8-45d0-9a7e-821bf7d058ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.444837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:08.444987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d96cb-c7f8-45d0-9a7e-821bf7d058ff admin admin] PATH_INFO: `/v3/projects/afbe42c6ef2a4069b0e3633975c402cc/users/78deecd91fde4784af0378a14051af20/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.446891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d96cb-c7f8-45d0-9a7e-821bf7d058ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbe42c6ef2a4069b0e3633975c402cc, user_id=78deecd91fde4784af0378a14051af20, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.449739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d96cb-c7f8-45d0-9a7e-821bf7d058ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.464982 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1137/2285] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:08 2022] PUT /identity/v3/projects/afbe42c6ef2a4069b0e3633975c402cc/users/78deecd91fde4784af0378a14051af20/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:08.464982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.464982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.464982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.510860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] MFA Rules not processed for user `f59ec872768d453a94a0dc3accf81642`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:08.512225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:08.541073 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1149/2286] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:08.541624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.557949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71ee6b-c1b1-47c4-ad46-3758592362cf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.691855 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1138/2287] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:08.692956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.716716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.718801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.719184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.719462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] PATH_INFO: `/v3/projects/0d729f232d2f4815828d4233636e76f2/users/2624f848646e4beabd8f88006cee96d9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.757754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d729f232d2f4815828d4233636e76f2, user_id=2624f848646e4beabd8f88006cee96d9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.763712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.808383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1150/2288] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:08 2022] PUT /identity/v3/projects/0d729f232d2f4815828d4233636e76f2/users/2624f848646e4beabd8f88006cee96d9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:08.809416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:08.837841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:08.849571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:08.863781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3f161-2ba1-4127-a8c7-228d72703c91 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.924058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d213c-e178-400a-9633-1b1937b17d21 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:08.936089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.936720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.938177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.938470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.940879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.942396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:08.985725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:08.986371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:08.986660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:08.987093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:08.987816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:08.991332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.003721 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1151/2289] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:08 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:09.005359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.047110 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1139/2290] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:08 2022] POST /identity/v3/projects => generated 373 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:09.048039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.051601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:09.163011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdc7d-24ea-4fa1-9769-1125c1d23efb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.226864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292aec2-b46f-4723-a352-a0c444f64418 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.236561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.238463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.238771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.239193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.369401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.370045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.370316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.370593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.371241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.373908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.432878 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1152/2291] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:09 2022] POST /identity/v3/projects => generated 383 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:09.434333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.460287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.464059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.477273 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1140/2292] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:09 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:09.478597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.520046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d208de-0457-4653-817b-75a8e7f2b1ed service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.539390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:09.554461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:09.584275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07557358-e546-4240-897a-5ec85568ddbd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.597840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.598619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.598909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.599191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.599859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.601619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.616164 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1153/2293] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:09.620703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.631145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9af64-66b1-4883-9df3-bae4dee3e061 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.636826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.637841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.638228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.639055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.639805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.641997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.667136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.667626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.667914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.668193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.669315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.673091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.716203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1154/2294] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:09 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:09.719950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.722600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:09.729517 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1141/2295] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:09 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:09.729517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.737994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a4130-b41e-4817-b07e-5d0e1433c3dd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.744728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.745500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.745864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.746141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] PATH_INFO: `/v3/projects/966924b122294514bc98da18682e7c54` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.747702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966924b122294514bc98da18682e7c54)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.749756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.755270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c499c-fd62-4373-99b6-3728b3331ba6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.774914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.775972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.776674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.776674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.778087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.781217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.816470 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1142/2296] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:09 2022] POST /identity/v3/users => generated 298 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:09.818812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.829146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966924b122294514bc98da18682e7c54', 'request_id': 'req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:09.834623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c8d20-0001-4f24-9b7b-a1529052369c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:09.838074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966924b122294514bc98da18682e7c54', 'request_id': 'req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:09.847657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966924b122294514bc98da18682e7c54', 'request_id': 'req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:09.866022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] The token cache is being invalidate because project 966924b122294514bc98da18682e7c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:09.869484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:09.870259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:09.872840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1155/2297] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:09 2022] DELETE /identity/v3/projects/966924b122294514bc98da18682e7c54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:09.873877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.878099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:09.915344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:09.916394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:09.916780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:09.917221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] PATH_INFO: `/v3/projects/0d729f232d2f4815828d4233636e76f2/users/2624f848646e4beabd8f88006cee96d9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:09.919425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d729f232d2f4815828d4233636e76f2, user_id=2624f848646e4beabd8f88006cee96d9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:09.924426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:09.944386 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1143/2298] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:09 2022] PUT /identity/v3/projects/0d729f232d2f4815828d4233636e76f2/users/2624f848646e4beabd8f88006cee96d9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:09.945524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:09.948493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:09.975665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5c2b3-8203-40fe-a5a3-842be87fdc98 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.051383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:10.054063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9930118-3e07-424c-90af-24c90bb91449 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.068249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.068917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.069271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.069483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.069705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.070150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.070720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.071161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.071498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.072152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.072276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.074510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.088584 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1156/2299] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:10.089414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1144/2300] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:10.090020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.090289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.095395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.098451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.117874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70919461-7e0e-4e41-94fc-59182195415e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.118531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf318-c85c-4147-a501-b08ef4198190 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.123194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8aff0d-6814-492f-a585-37880a858b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.123779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aff0d-6814-492f-a585-37880a858b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.124066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aff0d-6814-492f-a585-37880a858b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.124496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aff0d-6814-492f-a585-37880a858b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.125345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8aff0d-6814-492f-a585-37880a858b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.126957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8aff0d-6814-492f-a585-37880a858b99 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.131564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.132659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.133175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.133702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] PATH_INFO: `/v3/users/7a95981ee6314d76bbf361b194d67cb7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.135601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a95981ee6314d76bbf361b194d67cb7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.138094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.145929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1157/2301] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:10.147442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.147737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.148019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.156338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:10.181331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] MFA Rules not processed for user `2624f848646e4beabd8f88006cee96d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:10.182875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.207454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a95981ee6314d76bbf361b194d67cb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:10.227971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a95981ee6314d76bbf361b194d67cb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:10.228790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a95981ee6314d76bbf361b194d67cb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:10.240805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a95981ee6314d76bbf361b194d67cb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:10.241596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a95981ee6314d76bbf361b194d67cb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:10.266158 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1145/2302] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:10 2022] DELETE /identity/v3/users/7a95981ee6314d76bbf361b194d67cb7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:10.267267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.269855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.280547 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1158/2303] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:10.281905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.283631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.300839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471d8a-013d-4e46-a1ae-3ed630bf8c9b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.406628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.407490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.407841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.408176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.409549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.411241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.430706 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1159/2304] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:10.431548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.443873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.449676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115664f-87eb-4f14-a441-f5a6351fba11 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.458396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.459101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.459387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.459814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.460472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.462296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.473018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d0725-df37-4b59-9d24-efcc03169841 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.478710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1146/2305] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:10.480179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.483413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.485496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:10.486148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.486744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.490298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] PATH_INFO: `/v3/projects/ca2abc1f631f4c06a118574e071c1198/users/ff992319aba14927952febe75f678bf7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.526588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2abc1f631f4c06a118574e071c1198, user_id=ff992319aba14927952febe75f678bf7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.530700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.561137 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1160/2306] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:10 2022] PUT /identity/v3/projects/ca2abc1f631f4c06a118574e071c1198/users/ff992319aba14927952febe75f678bf7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:10.562298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.610651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:10.673723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4281b-ce90-47c0-9487-6921a1802623 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.710900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fdf3f-218d-483d-825f-d1282c2eb0e4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.722371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.723068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.723772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.724053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] PATH_INFO: `/v3/projects/10beeb5ff94e4c9c9c8b801fd3c56c66/users/3175c74d670a49e0a7efff04e7d4e9a0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.731464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:10.767273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10beeb5ff94e4c9c9c8b801fd3c56c66, user_id=3175c74d670a49e0a7efff04e7d4e9a0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.771059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:10.797756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1161/2307] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:10 2022] PUT /identity/v3/projects/10beeb5ff94e4c9c9c8b801fd3c56c66/users/3175c74d670a49e0a7efff04e7d4e9a0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:10.798751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:10.853087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.853701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.853983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.854260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.962773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ff87-2550-4245-8c5c-e17484dbd19d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:10.975183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8ff2d-1f59-41b9-bf74-aba4100d95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:10.981655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8ff2d-1f59-41b9-bf74-aba4100d95ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:10.981961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8ff2d-1f59-41b9-bf74-aba4100d95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:10.982401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8ff2d-1f59-41b9-bf74-aba4100d95ef admin admin] PATH_INFO: `/v3/projects/c6b91e8c83c14bbd95324f08142e45ab/users/8270152320e849e0bea54c602ba39cc2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:10.994700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:10.996604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:11.014707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8ff2d-1f59-41b9-bf74-aba4100d95ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b91e8c83c14bbd95324f08142e45ab, user_id=8270152320e849e0bea54c602ba39cc2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:11.020831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8ff2d-1f59-41b9-bf74-aba4100d95ef admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:11.025031 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1147/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:11.026042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:11.047940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00ce0-1352-4a2c-b095-3c622d1662be service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:11.058919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cee5ba-980c-4ec1-978e-62e427e13a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:11.059736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cee5ba-980c-4ec1-978e-62e427e13a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.060133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cee5ba-980c-4ec1-978e-62e427e13a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.060511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cee5ba-980c-4ec1-978e-62e427e13a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:11.063067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cee5ba-980c-4ec1-978e-62e427e13a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:11.072072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cee5ba-980c-4ec1-978e-62e427e13a9b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:11.083417 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1162/2309] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:10 2022] PUT /identity/v3/projects/c6b91e8c83c14bbd95324f08142e45ab/users/8270152320e849e0bea54c602ba39cc2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:11.086846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.091138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.092621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:11.116554 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1148/2310] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:11.119273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.120155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.120449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:11.190971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] MFA Rules not processed for user `8270152320e849e0bea54c602ba39cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:11.192507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:11.233985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] MFA Rules not processed for user `3175c74d670a49e0a7efff04e7d4e9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:11.239508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:11.419006 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1149/2311] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:11.420126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:11.423130 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1163/2312] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:11.424023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:11.432624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:11.515182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:11.529049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:11.600721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc9284-8711-4a0a-8e12-97873f4eb89b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:11.616480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:11.618621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eb0fb-6a49-46fc-bfea-6182ff29249b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:11.619119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.619483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.619902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] PATH_INFO: `/v3/projects/ca2abc1f631f4c06a118574e071c1198/users/ff992319aba14927952febe75f678bf7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:11.623818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2abc1f631f4c06a118574e071c1198, user_id=ff992319aba14927952febe75f678bf7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:11.628875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:11.633723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:11.634529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.634858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.635133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] PATH_INFO: `/v3/projects/b85f6bbc881c42489f3f49f57933f6a2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:11.637769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85f6bbc881c42489f3f49f57933f6a2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:11.640327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:11.654768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1150/2313] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:11 2022] PUT /identity/v3/projects/ca2abc1f631f4c06a118574e071c1198/users/ff992319aba14927952febe75f678bf7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:11.657037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:11.773116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85f6bbc881c42489f3f49f57933f6a2', 'request_id': 'req-df1ad8d1-e559-449d-ad0a-c7934904fbf9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:11.797229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85f6bbc881c42489f3f49f57933f6a2', 'request_id': 'req-df1ad8d1-e559-449d-ad0a-c7934904fbf9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:11.807240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f59da-98fc-4341-bda9-bb2fed89ddc5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:11.821715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85f6bbc881c42489f3f49f57933f6a2', 'request_id': 'req-df1ad8d1-e559-449d-ad0a-c7934904fbf9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:11.859462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] The token cache is being invalidate because project b85f6bbc881c42489f3f49f57933f6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:11.860055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:11.862595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:11.868494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1164/2314] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:11 2022] DELETE /identity/v3/projects/b85f6bbc881c42489f3f49f57933f6a2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:11.872560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:11.875527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:11.898226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fbc87-c5e4-4953-8bf7-c74cc6448d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:11.899259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fbc87-c5e4-4953-8bf7-c74cc6448d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.899885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fbc87-c5e4-4953-8bf7-c74cc6448d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.900379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fbc87-c5e4-4953-8bf7-c74cc6448d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:11.901717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fbc87-c5e4-4953-8bf7-c74cc6448d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:11.904311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fbc87-c5e4-4953-8bf7-c74cc6448d07 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:11.958819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1151/2315] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:11 2022] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:11.958819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ac775-7f51-48c1-86c2-7fb63be5f912 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:11.958819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ac775-7f51-48c1-86c2-7fb63be5f912 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:11.960293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ac775-7f51-48c1-86c2-7fb63be5f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.037447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-560ac775-7f51-48c1-86c2-7fb63be5f912 None None] MFA Rules not processed for user `ff992319aba14927952febe75f678bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:12.038762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ad8d1-e559-449d-ad0a-c7934904fbf9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.038913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-560ac775-7f51-48c1-86c2-7fb63be5f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:12.152269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:12.212559 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1152/2316] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:12.212559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.212559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.213857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.259916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:12.262120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:12.263091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.265970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.266148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.266439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.267741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.282194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.294904 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1153/2317] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:12.294904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.294904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:12.296786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:12.318391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd212f-a7db-4a5a-bd7c-8253ca1314c1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.331116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b16231-8997-4580-84b6-9ebded786c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.333335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b16231-8997-4580-84b6-9ebded786c58 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.335112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b16231-8997-4580-84b6-9ebded786c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.336165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b16231-8997-4580-84b6-9ebded786c58 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.338127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b16231-8997-4580-84b6-9ebded786c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.344529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b16231-8997-4580-84b6-9ebded786c58 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.354465 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1165/2318] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:11 2022] POST /identity/v3/projects => generated 377 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:12.355361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.362620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:12.395594 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1154/2319] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:12 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:12.397016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.397529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.397909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.427306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:12.429020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:12.551956 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1155/2320] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:12.553130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.564755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18cc4c-915d-4ec4-967c-3b0325efb336 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.579206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.580314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.581505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.581891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.582646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.586167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.595754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145b667-3123-4714-bcd2-324923c668d8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.610367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.611299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.612241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.612812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.651806 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1156/2321] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:12 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:12.652676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.695175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137f591-08f2-4761-99ee-088e6b547b09 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.713574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.714207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.716667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.718205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.720986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.728591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.775513 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1157/2322] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:12.776207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.804683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababa09-47c9-43ab-a2ea-d214564afd82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.806173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.807809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.820541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.821192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.821484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.821762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.829787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:12.830249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.834954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.859447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1166/2323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:12.860733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.870401 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1158/2324] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:12.871388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.887626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb65ab-f3b0-44d8-9357-c203c586849b service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.892251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d9f7e-e6ed-4ac0-92f5-1ec077b6109b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:12.904030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.905568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:12.906122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.906518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.908184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] PATH_INFO: `/v3/projects/6706df8e1dfb4787b1f99a127640f731/users/118417b3fa3944acb266edcb42fac053/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.912344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:12.912750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:12.913187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:12.915786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.917213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.951586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6706df8e1dfb4787b1f99a127640f731, user_id=118417b3fa3944acb266edcb42fac053, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:12.954841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:12.969866 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1167/2325] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:12.977776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:12.994364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1159/2326] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:12 2022] PUT /identity/v3/projects/6706df8e1dfb4787b1f99a127640f731/users/118417b3fa3944acb266edcb42fac053/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:12.995663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:13.001129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:13.020412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d2578-4f9e-493e-b043-522682525163 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:13.239524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:13.243244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d05ea1-a3c2-4834-95ae-3c6c3524ea46 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:13.250655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:13.250655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:13.250655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:13.250655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:13.251018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:13.251717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:13.261646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:13.263322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:13.265283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:13.265568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] PATH_INFO: `/v3/users/9818a590441c42d1a924fb2daf4323d2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:13.266974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9818a590441c42d1a924fb2daf4323d2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:13.278194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:13.295388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:13.331313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1168/2327] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:12 2022] POST /identity/v3/projects => generated 407 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:13.331313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:13.442187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9818a590441c42d1a924fb2daf4323d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:13.474302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9818a590441c42d1a924fb2daf4323d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:13.477156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9818a590441c42d1a924fb2daf4323d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:13.503335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9818a590441c42d1a924fb2daf4323d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:13.504624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9818a590441c42d1a924fb2daf4323d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:13.534128 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1160/2328] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:12 2022] DELETE /identity/v3/users/9818a590441c42d1a924fb2daf4323d2 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:13.534128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:13.536616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:13.541424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5c68a-c681-4b2b-a15d-59a0bbd2cf33 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:13.677018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:13.677933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:13.678221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:13.678496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] PATH_INFO: `/v3/projects/f4e551b750ea41babf0744667ef2e0f6/users/ad66b7fe98794c7d9971b4010be2dab2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:13.702577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e551b750ea41babf0744667ef2e0f6, user_id=ad66b7fe98794c7d9971b4010be2dab2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:13.706590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:13.721557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d49a-b88f-462d-a887-59234b3aff65 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:13.728092 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1169/2329] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:13 2022] PUT /identity/v3/projects/f4e551b750ea41babf0744667ef2e0f6/users/ad66b7fe98794c7d9971b4010be2dab2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:13.728092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:13.730395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:13.876649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03eb6-b573-41d0-8b0b-eb3d4288495e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:13.893669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc14d22-95a0-47c5-8a81-270f4936c6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:13.894686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc14d22-95a0-47c5-8a81-270f4936c6da admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:13.895073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc14d22-95a0-47c5-8a81-270f4936c6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:13.895189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:13.895546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc14d22-95a0-47c5-8a81-270f4936c6da admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:13.895831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:13.896142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:13.896426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:13.896607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc14d22-95a0-47c5-8a81-270f4936c6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:13.897217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:13.898925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc14d22-95a0-47c5-8a81-270f4936c6da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:13.899489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:13.928963 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1161/2330] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:13.931320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:13.933130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:13.934197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:13.962895 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1170/2331] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:13 2022] POST /identity/v3/users => generated 304 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:13.965298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:13.969956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:13.996326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:13.999385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:14.002520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37859dd-8233-4de6-86b3-4809b57accb9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.013315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.016589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.018797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.018797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.020212 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1162/2332] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:14.035892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.037017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:14.038803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.068676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d139a-1849-4e98-a087-67a70a93fe12 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.078936 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1171/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:14.078936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:14.090278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.090968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.091253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.091530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] PATH_INFO: `/v3/projects/6706df8e1dfb4787b1f99a127640f731/users/118417b3fa3944acb266edcb42fac053/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.099935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6706df8e1dfb4787b1f99a127640f731, user_id=118417b3fa3944acb266edcb42fac053, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.101794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:14.102939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.113991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54064783-91f6-4015-85a5-d03f4e5d811a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.122455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.123308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.123750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.124321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.125190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.129982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.141654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:14.157751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1172/2335] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:14.159139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1163/2335] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:14 2022] PUT /identity/v3/projects/6706df8e1dfb4787b1f99a127640f731/users/118417b3fa3944acb266edcb42fac053/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:14.160258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:14.161887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:14.163056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:14.164138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:14.326779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f79d7-5b92-41c1-8753-fced47539e05 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.364349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da2af9-784d-4faf-b933-3f6e6b1b6c0b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.397888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.398937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.399782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.400454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] PATH_INFO: `/v3/users/017991f4fde94abdb45c349427a7e2bd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.405508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017991f4fde94abdb45c349427a7e2bd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.407628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.449343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.450065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.450481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.451010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.465783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.467670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.501797 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1173/2336] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:14.503940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:14.526589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017991f4fde94abdb45c349427a7e2bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:14.546447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98989-c501-43d2-bdf3-72a34d6dbe85 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.558826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cae3e2-bd50-4a60-91f1-902ed22a6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.559510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae3e2-bd50-4a60-91f1-902ed22a6018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.563275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae3e2-bd50-4a60-91f1-902ed22a6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.563615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cae3e2-bd50-4a60-91f1-902ed22a6018 admin admin] PATH_INFO: `/v3/projects/f4e551b750ea41babf0744667ef2e0f6/users/ad66b7fe98794c7d9971b4010be2dab2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.564427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017991f4fde94abdb45c349427a7e2bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:14.569559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae3e2-bd50-4a60-91f1-902ed22a6018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e551b750ea41babf0744667ef2e0f6, user_id=ad66b7fe98794c7d9971b4010be2dab2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.570249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017991f4fde94abdb45c349427a7e2bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:14.579575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cae3e2-bd50-4a60-91f1-902ed22a6018 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.588642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017991f4fde94abdb45c349427a7e2bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:14.590732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017991f4fde94abdb45c349427a7e2bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:14.622328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1174/2337] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:14 2022] PUT /identity/v3/projects/f4e551b750ea41babf0744667ef2e0f6/users/ad66b7fe98794c7d9971b4010be2dab2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:14.628102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af9b4-1aa2-4815-a8cb-b778107c461f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.628102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af9b4-1aa2-4815-a8cb-b778107c461f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.628102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5af9b4-1aa2-4815-a8cb-b778107c461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.628846 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1164/2338] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:14 2022] DELETE /identity/v3/users/017991f4fde94abdb45c349427a7e2bd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:14.630053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:14.633988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:14.738364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2e5af9b4-1aa2-4815-a8cb-b778107c461f None None] MFA Rules not processed for user `118417b3fa3944acb266edcb42fac053`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:14.742440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2e5af9b4-1aa2-4815-a8cb-b778107c461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:14.843080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83aa10-a823-4207-9b46-bb5dd61b19d3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:14.858393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155af1fa-0efc-4282-ab57-c95a651ee2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:14.859033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155af1fa-0efc-4282-ab57-c95a651ee2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.859315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155af1fa-0efc-4282-ab57-c95a651ee2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.859588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155af1fa-0efc-4282-ab57-c95a651ee2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.860408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155af1fa-0efc-4282-ab57-c95a651ee2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:14.862238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155af1fa-0efc-4282-ab57-c95a651ee2c4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:14.905096 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1165/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:14.907382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:14.907683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:14.907967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:14.966735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:14.971423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:14.989457 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1175/2340] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:15.016150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.017458 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1166/2341] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:15.019084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:15.019786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.022481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.034272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc39e4a-765e-4f3a-b080-9dd95b1f3228 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:15.042695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:15.043815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.044247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.044669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] PATH_INFO: `/v3/projects/d368e9b23b79427cb89d3488a255a201/users/3572b7cdb8c54cc18774639ae032a4c4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.052072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:15.072167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d368e9b23b79427cb89d3488a255a201, user_id=3572b7cdb8c54cc18774639ae032a4c4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:15.077296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:15.121456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] MFA Rules not processed for user `ad66b7fe98794c7d9971b4010be2dab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:15.124621 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1167/2342] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:15 2022] PUT /identity/v3/projects/d368e9b23b79427cb89d3488a255a201/users/3572b7cdb8c54cc18774639ae032a4c4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:15.125006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:15.129447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:15.153053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:15.364847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8410d8-9965-4c09-91f3-8b1e53b75748 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:15.369033 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1176/2343] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:15.369923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:15.372152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:15.382595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:15.382944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.383228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.383433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.384246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:15.384552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:15.386982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00fca-62e6-4688-98cb-84ca6ab0d22b tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:15.421432 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1168/2344] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:15.422830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28ee2-f7c0-45fd-938e-2e1164b99d7b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.423123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28ee2-f7c0-45fd-938e-2e1164b99d7b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.423400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa28ee2-f7c0-45fd-938e-2e1164b99d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.503860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-baa28ee2-f7c0-45fd-938e-2e1164b99d7b None None] MFA Rules not processed for user `3572b7cdb8c54cc18774639ae032a4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:15.505185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-baa28ee2-f7c0-45fd-938e-2e1164b99d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:15.511847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ada6d-f610-46dc-93bf-a1b0f16efa6c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:15.524209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:15.524756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.525062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.525337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.655379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1169/2345] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:15.657035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.657351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.657616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.681250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:15.682721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:15.714346 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1177/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:15.715967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:15.727023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] MFA Rules not processed for user `3175c74d670a49e0a7efff04e7d4e9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:15.731620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:15.755370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e2d0-68cd-4742-870c-7453239fc884 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:15.769114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:15.769740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:15.770023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:15.770301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:15.771983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:15.778417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:15.879275 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1178/2347] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:15 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:15.890825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:15.941753 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1170/2348] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:15.944008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:15.947920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:15.989735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b88f-5bff-4694-921a-23238ad7a108 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:15.995347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:16.019881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:16.035308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14a86-5299-419c-aa72-5cd168c00a77 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:16.042390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.053264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.053430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.053726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.054481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:16.056872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:16.101665 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1179/2349] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:15 2022] POST /identity/v3/projects => generated 407 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:16.102632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:16.151009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.151686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.152102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.152377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] PATH_INFO: `/v3/projects/4ab154cc46594c6e98c5f33dcfbe6324` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.153547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab154cc46594c6e98c5f33dcfbe6324)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:16.159901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:16.253280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a72ad7-7e3d-4764-be3b-015a8eaea633 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:16.263799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.265211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.265652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.266155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.266986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:16.267496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:16.290274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:16.323570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab154cc46594c6e98c5f33dcfbe6324', 'request_id': 'req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:16.323692 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1180/2350] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:16.324566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:16.354579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:16.359559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab154cc46594c6e98c5f33dcfbe6324', 'request_id': 'req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:16.375678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab154cc46594c6e98c5f33dcfbe6324', 'request_id': 'req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:16.398104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] The token cache is being invalidate because project 4ab154cc46594c6e98c5f33dcfbe6324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:16.398463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:16.406719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:16.414369 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1171/2351] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:15 2022] DELETE /identity/v3/projects/4ab154cc46594c6e98c5f33dcfbe6324 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:16.415346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:16.419116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:16.569514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e7ea0-7f74-4fad-a248-ad433d3845ad tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:16.600252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c90fc-218e-41dc-9b43-7914c32d1bdd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:16.617763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.618252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.618526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.618797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.619441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:16.621767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:16.678987 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1172/2352] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:16 2022] POST /identity/v3/users => generated 310 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:16.680391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:16.684246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:16.687923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:16.727854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.728483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.728769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.729073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.732178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:16.734409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:16.840309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01359c8-bb7f-47a7-8353-ee480dd6998a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:16.855897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.857294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.857576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.859596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.867510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:16.875271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:16.878021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:16.890778 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1181/2353] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:16.892589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:16.894307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:16.910181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fa9c9-8d9a-4e79-ba44-23f312994946 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:16.915636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:16.916513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:16.916939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:16.917320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] PATH_INFO: `/v3/users/2624f848646e4beabd8f88006cee96d9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:16.918577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2624f848646e4beabd8f88006cee96d9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:16.922052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:17.021676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:17.023395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:17.055871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2624f848646e4beabd8f88006cee96d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.059227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1173/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:17.060325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:17.078374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2624f848646e4beabd8f88006cee96d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.079139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2624f848646e4beabd8f88006cee96d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.099312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381058f7-ad51-48bc-bb8f-11743fb8fc87 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:17.103372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2624f848646e4beabd8f88006cee96d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.104028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2624f848646e4beabd8f88006cee96d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.106437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068671f-231e-46f2-b5e2-790bb21d1e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:17.108207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068671f-231e-46f2-b5e2-790bb21d1e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:17.108812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068671f-231e-46f2-b5e2-790bb21d1e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:17.109267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068671f-231e-46f2-b5e2-790bb21d1e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:17.110145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068671f-231e-46f2-b5e2-790bb21d1e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:17.113376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068671f-231e-46f2-b5e2-790bb21d1e3c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:17.125152 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1182/2355] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:16 2022] DELETE /identity/v3/users/2624f848646e4beabd8f88006cee96d9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:17.126025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:17.135651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:17.135999 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1174/2356] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:17.137717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338168d-3fad-46fd-9284-9fb13a117427 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:17.138234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338168d-3fad-46fd-9284-9fb13a117427 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:17.138524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338168d-3fad-46fd-9284-9fb13a117427 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:17.147342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1175/2357] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:17.148546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338168d-3fad-46fd-9284-9fb13a117427 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:17.150957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7338168d-3fad-46fd-9284-9fb13a117427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:17.280585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc618c6-149b-408b-a340-aa404a5bfd91 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:17.299810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338168d-3fad-46fd-9284-9fb13a117427 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:17.300571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:17.301402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:17.301686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:17.301965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] PATH_INFO: `/v3/projects/b31c5115b1924dba8bfa0fc1e6f18130` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:17.307275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:17.308482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:17.308846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:17.309221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] PATH_INFO: `/v3/projects/ca12dd07f51242168e4ea0e95357e89d/users/4e91d52e12124cbda21fd9c11d8aa227/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:17.309771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31c5115b1924dba8bfa0fc1e6f18130)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:17.311737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:17.318550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:17.349131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca12dd07f51242168e4ea0e95357e89d, user_id=4e91d52e12124cbda21fd9c11d8aa227, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:17.352321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:17.392084 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1176/2358] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:17 2022] PUT /identity/v3/projects/ca12dd07f51242168e4ea0e95357e89d/users/4e91d52e12124cbda21fd9c11d8aa227/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:17.409386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:17.411118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:17.472700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31c5115b1924dba8bfa0fc1e6f18130', 'request_id': 'req-e55cf936-e709-4aa2-9c7f-1d818cd1578f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.484101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31c5115b1924dba8bfa0fc1e6f18130', 'request_id': 'req-e55cf936-e709-4aa2-9c7f-1d818cd1578f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.499983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31c5115b1924dba8bfa0fc1e6f18130', 'request_id': 'req-e55cf936-e709-4aa2-9c7f-1d818cd1578f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.530997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] The token cache is being invalidate because project b31c5115b1924dba8bfa0fc1e6f18130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:17.531450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.532612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:17.536773 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1183/2359] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:17 2022] DELETE /identity/v3/projects/b31c5115b1924dba8bfa0fc1e6f18130 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:17.537686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:17.542217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:17.545009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:17.624484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:17.630107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:17.727695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cf936-e709-4aa2-9c7f-1d818cd1578f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:17.760983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:17.761985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:17.762447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:17.762896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:17.767258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:17.775847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:17.808861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1184/2360] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:17.811509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:17.814538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:17.855664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81879-315f-4942-8954-eda039ac94e5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:17.864553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4858398-a60a-4652-bca0-155e2117b146 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:17.886339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:17.887550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:17.888032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:17.890288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] PATH_INFO: `/v3/users/ff992319aba14927952febe75f678bf7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:17.892659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff992319aba14927952febe75f678bf7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:17.930023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:18.014335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:18.015998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.016511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.017195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.020396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=42d0dcc9c5664f0d9a9cbc402cc50ed5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:18.025283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:18.044223 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1177/2361] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:17 2022] GET /identity/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 371 bytes in 651 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:18.046550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:18.096334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a873a0-b4ff-4fbc-808f-30c12db95321 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:18.115719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c54e9-363c-4b12-a2b1-9de0b370f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:18.117283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c54e9-363c-4b12-a2b1-9de0b370f9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.117759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c54e9-363c-4b12-a2b1-9de0b370f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.118629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c54e9-363c-4b12-a2b1-9de0b370f9b6 admin admin] PATH_INFO: `/v3/projects/ca12dd07f51242168e4ea0e95357e89d/users/4e91d52e12124cbda21fd9c11d8aa227/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.125654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c54e9-363c-4b12-a2b1-9de0b370f9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca12dd07f51242168e4ea0e95357e89d, user_id=4e91d52e12124cbda21fd9c11d8aa227, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:18.128608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff992319aba14927952febe75f678bf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.130930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c54e9-363c-4b12-a2b1-9de0b370f9b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:18.172164 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1178/2362] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:18 2022] PUT /identity/v3/projects/ca12dd07f51242168e4ea0e95357e89d/users/4e91d52e12124cbda21fd9c11d8aa227/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:18.175438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ba01-a884-40ce-850d-4c3a97cb4bed None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.175438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ba01-a884-40ce-850d-4c3a97cb4bed None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.175438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27ba01-a884-40ce-850d-4c3a97cb4bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.198917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff992319aba14927952febe75f678bf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.202000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff992319aba14927952febe75f678bf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.239954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff992319aba14927952febe75f678bf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.257034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff992319aba14927952febe75f678bf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.279853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:18.292965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1185/2363] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:17 2022] DELETE /identity/v3/users/ff992319aba14927952febe75f678bf7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:18.292965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:18.306254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.331676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1c27ba01-a884-40ce-850d-4c3a97cb4bed None None] MFA Rules not processed for user `78deecd91fde4784af0378a14051af20`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:18.337586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c27ba01-a884-40ce-850d-4c3a97cb4bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.466068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee7892-2311-4138-ad18-375a77aa2739 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:18.480886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:18.483261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.483927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.484471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] PATH_INFO: `/v3/projects/0d729f232d2f4815828d4233636e76f2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.486667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d729f232d2f4815828d4233636e76f2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:18.490893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:18.523914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:18.567040 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1179/2364] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:18.570182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.571092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.571638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.617940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d729f232d2f4815828d4233636e76f2', 'request_id': 'req-4464bee8-0fcb-4286-a703-06c4c68489fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.620795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] MFA Rules not processed for user `4e91d52e12124cbda21fd9c11d8aa227`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:18.622581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.625561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d729f232d2f4815828d4233636e76f2', 'request_id': 'req-4464bee8-0fcb-4286-a703-06c4c68489fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.633846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d729f232d2f4815828d4233636e76f2', 'request_id': 'req-4464bee8-0fcb-4286-a703-06c4c68489fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.656465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] The token cache is being invalidate because project 0d729f232d2f4815828d4233636e76f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:18.661046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.666133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4464bee8-0fcb-4286-a703-06c4c68489fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:18.667643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1186/2365] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:18 2022] DELETE /identity/v3/projects/0d729f232d2f4815828d4233636e76f2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:18.671980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4c4e-6f94-4c47-b55f-cdcf8a5db9fb None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.671980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4c4e-6f94-4c47-b55f-cdcf8a5db9fb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.672771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4c4e-6f94-4c47-b55f-cdcf8a5db9fb None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.681840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1187/2366] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:18.685195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819041-37f0-4cfd-ad0d-e6f97338cedd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.686193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819041-37f0-4cfd-ad0d-e6f97338cedd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.686887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819041-37f0-4cfd-ad0d-e6f97338cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.729309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-88819041-37f0-4cfd-ad0d-e6f97338cedd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:18.730433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-88819041-37f0-4cfd-ad0d-e6f97338cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.803994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1180/2367] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:18.805543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:18.807551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.857836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1188/2368] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:18.870804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:18.870804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:18.870804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:18.906420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:18.907642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.917669 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1189/2369] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:18.918356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:18.919673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:18.967701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:18.991907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:18.993465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.051155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f25f-8574-48db-8720-fe0ca041b7fb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.066709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.069469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.071582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.072253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.078491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.096758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9d6b-3285-4d48-8153-5684b4325618 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.104836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.105504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.105804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.106085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.107294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=42d0dcc9c5664f0d9a9cbc402cc50ed5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.109601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.112296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1181/2370] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:18 2022] GET /identity/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 371 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:19.113160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.124444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f8f19-82ed-4fc4-a4df-1da8211e93cb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.129592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.130218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.130490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.130763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.131430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:19.131739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.133369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.148968 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1182/2371] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:19.150265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.152164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.161608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:19.171147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7409b-9494-45f8-a2e8-0917eb3b3875 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.178075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.179067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.179484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.179869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] PATH_INFO: `/v3/projects/ca2abc1f631f4c06a118574e071c1198` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.181727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2abc1f631f4c06a118574e071c1198)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.184859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.185203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.186894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.204644 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1190/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:18 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:19.205655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.238580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b0035-9b10-4f76-9f3e-036e51319a55 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.246608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.247263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.247602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.247883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.248531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.250494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.281771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2abc1f631f4c06a118574e071c1198', 'request_id': 'req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:19.303983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2abc1f631f4c06a118574e071c1198', 'request_id': 'req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:19.310040 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1191/2373] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:19.310938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.320274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2abc1f631f4c06a118574e071c1198', 'request_id': 'req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:19.351713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] The token cache is being invalidate because project ca2abc1f631f4c06a118574e071c1198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:19.351713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:19.354436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:19.365421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1183/2374] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:19 2022] DELETE /identity/v3/projects/ca2abc1f631f4c06a118574e071c1198 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:19.368190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.369632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.466055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5d11c-b3cc-4199-bf9e-c0b41cd42bfc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.473744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.475613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.475982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.476379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.480289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.495260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d8ef-21c7-4cd9-b88b-9bdd56eae9a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.532732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:19.558568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329016a-5bac-4765-ad3d-d316ec75b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.559362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329016a-5bac-4765-ad3d-d316ec75b163 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.559639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329016a-5bac-4765-ad3d-d316ec75b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.559920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329016a-5bac-4765-ad3d-d316ec75b163 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.560560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329016a-5bac-4765-ad3d-d316ec75b163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.562584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329016a-5bac-4765-ad3d-d316ec75b163 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.578173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.579839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.590847 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1184/2375] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/users => generated 285 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:19.592804 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1192/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:19 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:19.594020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.595385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.605125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.605935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.606458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.615634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db2ed4-bcd3-4fea-9144-9a229ee39a42 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.633553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.634150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.634553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.634850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.637029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.638987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:19.640321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.664586 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1185/2377] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:19.665615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.697718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c53b-f4bf-4179-8c7f-9c6405324d2f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.715058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294e902-fa96-4217-9520-c1c77c2d03c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.715712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e902-fa96-4217-9520-c1c77c2d03c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.715995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e902-fa96-4217-9520-c1c77c2d03c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.716268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294e902-fa96-4217-9520-c1c77c2d03c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.717980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e902-fa96-4217-9520-c1c77c2d03c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.719601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2294e902-fa96-4217-9520-c1c77c2d03c1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.732007 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1186/2378] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:19.733341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.733634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.733913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.753070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:19.766893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:19.768279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:19.771291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.774840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.790937 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1193/2379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:19 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:19.794201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.798064 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1187/2380] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:19.803510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.818940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dad3ca-4c92-4cbb-a379-d3710225d94e service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.829809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ceaea-800e-4e15-a842-cd48d3627b76 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.834635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.835270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.835556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.835833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.838395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.840139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.850264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.851034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.851472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.851788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.852628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:19.853049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.854715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.859933 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1194/2381] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:19.871539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.878611 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1188/2382] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:19.882522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:19.896393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013bd1e-fada-4f6a-b43d-fca626f4a903 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.907940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f9115-c799-41cf-bf79-e93f97246407 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:19.908203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf10090-ac49-46e7-b3d7-611e30e89c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.909029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10090-ac49-46e7-b3d7-611e30e89c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.909318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10090-ac49-46e7-b3d7-611e30e89c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.911722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf10090-ac49-46e7-b3d7-611e30e89c07 admin admin] PATH_INFO: `/v3/projects/6652917123e14c2797cafacc4e31f75a/users/118c1425677b45b98689befb0eb55cce/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.921637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:19.922267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.922550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.922828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.923531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.928104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.944702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf10090-ac49-46e7-b3d7-611e30e89c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6652917123e14c2797cafacc4e31f75a, user_id=118c1425677b45b98689befb0eb55cce, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:19.947829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf10090-ac49-46e7-b3d7-611e30e89c07 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:19.976657 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1195/2383] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:19 2022] PUT /identity/v3/projects/6652917123e14c2797cafacc4e31f75a/users/118c1425677b45b98689befb0eb55cce/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:19.982108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:19.982438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:19.985010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:19.992652 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1189/2384] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:20.000522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.014885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:20.016881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:20.108198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc1679-d6c5-4feb-81d4-68d03318b170 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.125711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.126330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.126609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.126882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.127801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.131373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.160813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1196/2385] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:20.168448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.170732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:20.174871 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1190/2386] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:19 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:20.176151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.189259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716597-ebd9-4b14-bf38-57aa2e02ec6d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.194903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.195686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.195973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.196302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.197064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.199002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.212502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1191/2387] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:20.216404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.229447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:20.230598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670736ec-4818-40ab-9e25-7d1cb098eec0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.239051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.239679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.239962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.240239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.241165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.242696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.265923 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1192/2388] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:28:20.268697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.272824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0014f-61c9-486c-95f3-9bc7a75b7add None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.276630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.277278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.277869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.278763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.287684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7af19-1bfd-44c0-806f-4309330eff02 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.293141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990303e2-dd62-413d-9cbe-146123399b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.296086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990303e2-dd62-413d-9cbe-146123399b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.296086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990303e2-dd62-413d-9cbe-146123399b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.296086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990303e2-dd62-413d-9cbe-146123399b49 admin admin] PATH_INFO: `/v3/projects/ddfca42d14554d6e9839f95250d8060e/users/099dd6e0593943d4b919954251a6f33b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.302892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.326579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.337801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990303e2-dd62-413d-9cbe-146123399b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfca42d14554d6e9839f95250d8060e, user_id=099dd6e0593943d4b919954251a6f33b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.340477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990303e2-dd62-413d-9cbe-146123399b49 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.366513 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1197/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:20.368895 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1193/2390] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:20 2022] PUT /identity/v3/projects/ddfca42d14554d6e9839f95250d8060e/users/099dd6e0593943d4b919954251a6f33b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:20.373653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.375411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:20.381998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3db2c1-f724-4f33-b96c-b6911791059d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.382285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3db2c1-f724-4f33-b96c-b6911791059d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.382560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3db2c1-f724-4f33-b96c-b6911791059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.445278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8f3db2c1-f724-4f33-b96c-b6911791059d None None] MFA Rules not processed for user `099dd6e0593943d4b919954251a6f33b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:20.446643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f3db2c1-f724-4f33-b96c-b6911791059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:20.546289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be0463-73f8-48d2-91e7-b0d81b187250 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.554487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:20.578866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1194/2391] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:20.581411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff424fc-0692-40cd-8464-4cc5aa89b0c2 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.581776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff424fc-0692-40cd-8464-4cc5aa89b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.582065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff424fc-0692-40cd-8464-4cc5aa89b0c2 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.583650 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1195/2392] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:20.584398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff424fc-0692-40cd-8464-4cc5aa89b0c2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.687499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.688338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.688719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.689125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.696982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:20.713193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff424fc-0692-40cd-8464-4cc5aa89b0c2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.719773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:20.720400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:20.720815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:20.723115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:20.723842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.725819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.785459 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1196/2393] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:20.786592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:20.833102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:20.835079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:20.854148 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1198/2394] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:20 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:20.855445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.887480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986954-50c2-4f4f-a306-844d8540e802 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:20.905005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:20.992219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:20.994957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:21.024508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.025772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.026215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.026648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.027554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.029819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.073982 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1199/2395] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:20 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:21.078207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:21.101129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d81b-4e93-4a38-8aa4-6708a276b893 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:21.113278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298d18-242f-4072-8ee0-3bb63edfeae8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:21.115342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.116040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.116917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.116917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.117322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.119016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.119265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.120577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.121064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.121563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.122882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=42d0dcc9c5664f0d9a9cbc402cc50ed5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.125078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.127884 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1197/2396] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:20 2022] GET /identity/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 371 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:21.147424 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1200/2397] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:28:21.152248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:21.162587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:21.170227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af545921-a1d7-478c-9ab3-e99138e5b388 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:21.185955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.189509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.190555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.193987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] PATH_INFO: `/v3/projects/3fa3da459f1e4618a0763c59c7fe2338/users/50e19794afcb48cda998e9151235656e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.201440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f996-314c-49f5-9c5b-fc23cb1a8e09 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:21.213268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.213936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.214227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.215695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.220332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=42d0dcc9c5664f0d9a9cbc402cc50ed5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.227467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.231165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa3da459f1e4618a0763c59c7fe2338, user_id=50e19794afcb48cda998e9151235656e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.244464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.251875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:21.290162 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1198/2398] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:21 2022] PUT /identity/v3/projects/3fa3da459f1e4618a0763c59c7fe2338/users/50e19794afcb48cda998e9151235656e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:21.293559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:21.330957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d0dcc9c5664f0d9a9cbc402cc50ed5', 'request_id': 'req-222c5c67-777d-42b9-8784-a470eb863b9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:21.351016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d0dcc9c5664f0d9a9cbc402cc50ed5', 'request_id': 'req-222c5c67-777d-42b9-8784-a470eb863b9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:21.367237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d0dcc9c5664f0d9a9cbc402cc50ed5', 'request_id': 'req-222c5c67-777d-42b9-8784-a470eb863b9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:21.398933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] The token cache is being invalidate because project 42d0dcc9c5664f0d9a9cbc402cc50ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:21.399231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:21.401365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:21.408288 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1201/2399] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:21 2022] DELETE /identity/v3/projects/42d0dcc9c5664f0d9a9cbc402cc50ed5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:21.461726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c60e87-5c44-4dd3-b100-48888eeeed3e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:21.569219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1313ffa-0521-479a-99c6-417f52c5ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.569970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1313ffa-0521-479a-99c6-417f52c5ea65 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.570321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1313ffa-0521-479a-99c6-417f52c5ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.570721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1313ffa-0521-479a-99c6-417f52c5ea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.571444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1313ffa-0521-479a-99c6-417f52c5ea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.573246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1313ffa-0521-479a-99c6-417f52c5ea65 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.588943 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1199/2400] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:21.590406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:21.592266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:21.616420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c5c67-777d-42b9-8784-a470eb863b9a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:21.621883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a701b-3648-4966-9b6b-81431123e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:21.622677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a701b-3648-4966-9b6b-81431123e700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.622956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a701b-3648-4966-9b6b-81431123e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.623233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a701b-3648-4966-9b6b-81431123e700 admin admin] PATH_INFO: `/v3/projects/3fa3da459f1e4618a0763c59c7fe2338/users/50e19794afcb48cda998e9151235656e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.625487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a701b-3648-4966-9b6b-81431123e700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa3da459f1e4618a0763c59c7fe2338, user_id=50e19794afcb48cda998e9151235656e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:21.628864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a701b-3648-4966-9b6b-81431123e700 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:21.652586 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1202/2401] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:21 2022] PUT /identity/v3/projects/3fa3da459f1e4618a0763c59c7fe2338/users/50e19794afcb48cda998e9151235656e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:21.656798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.657028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.657768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.715473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] MFA Rules not processed for user `50e19794afcb48cda998e9151235656e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:21.716703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:21.727918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:21.727918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:21.728235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:21.729538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1203/2402] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:21.735249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:21.738334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:21.869273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:21.897173 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1200/2403] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:21.906749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:21.908056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:22.046668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e073d-62d3-4624-af63-389b384bdc65 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:22.053226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:22.054543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:22.055140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:22.055524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/c6b91e8c83c14bbd95324f08142e45ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:22.056826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b91e8c83c14bbd95324f08142e45ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:22.059196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:22.061337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1204/2404] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:21 2022] GET /identity/v3/projects/c6b91e8c83c14bbd95324f08142e45ab => generated 373 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:28:22.082837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:22.099963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7144e7-5b48-4695-bb6e-11911d8d5915 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:22.114095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:22.115475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:22.115950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:22.116556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:22.117428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:22.117895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:22.123428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:22.153643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:22.173001 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1201/2405] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:22.180767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251b5a-1661-4e4a-ae5e-5190c22268b3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:22.188202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:22.189617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:22.190023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:22.190333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:22.191000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:22.193248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:22.291897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:22.293591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1205/2406] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:22 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:22.311087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b30ba-e734-4c57-bf31-c0c8ec28e4e2 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:22.322224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:22.423944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:22.424794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:22.425117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:22.425396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:22.426078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:22.426379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:22.428016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856c215-b303-4b71-a104-8b42f0c9bdd3 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:22.446358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1202/2407] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:28:22.489882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:22.491836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:22.638959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42922c00-93fb-4196-9f0f-f85bd427f187 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:22.656106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:22.656944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:22.657341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:22.657823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:22.829735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:22.833408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:22.853384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1206/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:23.166450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50375-bebe-4b8c-b63f-8d8c99587427 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:23.169142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50375-bebe-4b8c-b63f-8d8c99587427 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:23.169142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50375-bebe-4b8c-b63f-8d8c99587427 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:23.169737 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1203/2409] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:23.181804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:23.189879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:23.198055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:23.229698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a87bb-3265-40a9-8b45-4155db545163 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:23.239838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409a107-2f1d-418f-9d2b-799297099d43 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:23.240507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a107-2f1d-418f-9d2b-799297099d43 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:23.240795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a107-2f1d-418f-9d2b-799297099d43 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:23.241137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a107-2f1d-418f-9d2b-799297099d43 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/4f62801fc3ac498db885f0e0a438deac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:23.245307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a107-2f1d-418f-9d2b-799297099d43 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f62801fc3ac498db885f0e0a438deac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:23.251235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a107-2f1d-418f-9d2b-799297099d43 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:23.269267 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1207/2410] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:23 2022] GET /identity/v3/projects/4f62801fc3ac498db885f0e0a438deac => generated 367 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:23.871151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d50375-bebe-4b8c-b63f-8d8c99587427 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:23.873095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-49d50375-bebe-4b8c-b63f-8d8c99587427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:23.907407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272635fb-87c6-4f55-b861-97b77ba5d34a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:23.907643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272635fb-87c6-4f55-b861-97b77ba5d34a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:23.908002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272635fb-87c6-4f55-b861-97b77ba5d34a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:23.910031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1208/2411] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:23.917015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272635fb-87c6-4f55-b861-97b77ba5d34a None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:23.961590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272635fb-87c6-4f55-b861-97b77ba5d34a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:23.985235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272635fb-87c6-4f55-b861-97b77ba5d34a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:24.012749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:24.013766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.014712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.015195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/4f62801fc3ac498db885f0e0a438deac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.016624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f62801fc3ac498db885f0e0a438deac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:24.020368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:24.022952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1209/2412] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:23 2022] GET /identity/v3/projects/4f62801fc3ac498db885f0e0a438deac => generated 367 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:28:24.061252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d50375-bebe-4b8c-b63f-8d8c99587427 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:24.082539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:24.083457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.083887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.084337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] PATH_INFO: `/v3/users/3572b7cdb8c54cc18774639ae032a4c4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.088148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3572b7cdb8c54cc18774639ae032a4c4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:24.090452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:24.132083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:24.156081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e9382-a7e8-4f40-94ce-7e420a8dbc48 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:24.164501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:24.165548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.166087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.166553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.167451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:24.168105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:24.174301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:24.197623 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1210/2413] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:24.199470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:24.232343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e4893-c516-4b0b-8e87-73ba37011bfb tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:24.239225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:24.240284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.240781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.241962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.242543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:24.245735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:24.257687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3572b7cdb8c54cc18774639ae032a4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:24.288030 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1211/2414] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:24 2022] POST /identity/v3/users => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:24.289624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:24.300735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3572b7cdb8c54cc18774639ae032a4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:24.303566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3572b7cdb8c54cc18774639ae032a4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:24.318132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f0334-feb4-456d-9b94-c6ae839eeb76 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:24.328780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3572b7cdb8c54cc18774639ae032a4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:24.329467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e49665e6-cc75-4758-838a-5c7033bf17fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3572b7cdb8c54cc18774639ae032a4c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:24.331791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:24.333474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.333891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.342179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.348144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:24.349238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:24.353857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:24.363528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1204/2415] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:23 2022] DELETE /identity/v3/users/3572b7cdb8c54cc18774639ae032a4c4 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:24.365172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.365460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.365738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.390992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1212/2416] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:24.422758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:24.426069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:24.473349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:24.582488 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1205/2417] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:24.629366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:24.634061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:24.772294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6aefbe-502d-4204-8352-a0d66799df4e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:24.858519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac7f1-9e9d-47d0-b098-765ec8923d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:24.859049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac7f1-9e9d-47d0-b098-765ec8923d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:24.859336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac7f1-9e9d-47d0-b098-765ec8923d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:24.859617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac7f1-9e9d-47d0-b098-765ec8923d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:24.880805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac7f1-9e9d-47d0-b098-765ec8923d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:24.882327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac7f1-9e9d-47d0-b098-765ec8923d79 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:24.902271 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1213/2418] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:25.331113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:25.333108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:25.497368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76c01-fcf3-43a2-9b51-9103fe8ad18c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:25.510295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:25.511129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:25.511497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:25.511852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:25.513867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:25.682687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:25.683252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:25.683252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:25.685709 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1214/2419] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:25.694367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:25.696833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:25.725948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:25.733140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c5fb2-815f-4ebe-8684-e36cf44eeb2f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:25.741287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:25.743573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:25.760593 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1206/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:25.910829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:25.919701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda60c87-5125-4c49-8ea4-bf70e3df373d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:25.935734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:25.936404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:25.936686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:25.937002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/4f62801fc3ac498db885f0e0a438deac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:25.938171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f62801fc3ac498db885f0e0a438deac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:25.940319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:25.954021 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1215/2421] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:25 2022] GET /identity/v3/projects/4f62801fc3ac498db885f0e0a438deac => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:26.673159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f2ce-f47c-45d5-a431-51576d8a4075 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:26.674126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f2ce-f47c-45d5-a431-51576d8a4075 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:26.675076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f2ce-f47c-45d5-a431-51576d8a4075 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:26.676969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1207/2422] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:26.683399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:26.699183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:26.713801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d145d35-b2a9-48e0-9e84-044eb5203411 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:26.722275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:26.723374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:26.724719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:26.725195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/4f62801fc3ac498db885f0e0a438deac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:26.726585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f62801fc3ac498db885f0e0a438deac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:26.730774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:26.759070 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1216/2423] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:26 2022] GET /identity/v3/projects/4f62801fc3ac498db885f0e0a438deac => generated 367 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:26.797203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f2ce-f47c-45d5-a431-51576d8a4075 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:26.819449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f2ce-f47c-45d5-a431-51576d8a4075 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:26.826770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:26.827715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:26.828337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:26.829016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/users/b7bbc8407e0a487ea59842da2faff08e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:26.852148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b7bbc8407e0a487ea59842da2faff08e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:26.854622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:26.925271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:26.929602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7bbc8407e0a487ea59842da2faff08e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:26.948576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7bbc8407e0a487ea59842da2faff08e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:26.950845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7bbc8407e0a487ea59842da2faff08e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:26.968254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7bbc8407e0a487ea59842da2faff08e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:26.969616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7bbc8407e0a487ea59842da2faff08e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:26.992289 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1208/2424] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:26 2022] DELETE /identity/v3/users/b7bbc8407e0a487ea59842da2faff08e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:26.993231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:26.997478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:27.022853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc9268-7a5e-4f73-8933-c22ec986154a tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:27.155361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:27.156214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:27.156683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:27.157177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/4f62801fc3ac498db885f0e0a438deac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:27.160558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f62801fc3ac498db885f0e0a438deac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:27.162763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:27.317220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f62801fc3ac498db885f0e0a438deac', 'request_id': 'req-92472045-da64-4dd3-9a9b-a273c44352a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.339724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f62801fc3ac498db885f0e0a438deac', 'request_id': 'req-92472045-da64-4dd3-9a9b-a273c44352a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.360793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f62801fc3ac498db885f0e0a438deac', 'request_id': 'req-92472045-da64-4dd3-9a9b-a273c44352a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.394543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] The token cache is being invalidate because project 4f62801fc3ac498db885f0e0a438deac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:27.395155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.399627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:27.401763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:27.402598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-92472045-da64-4dd3-9a9b-a273c44352a8 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.406037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1217/2425] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:26 2022] DELETE /identity/v3/projects/4f62801fc3ac498db885f0e0a438deac => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:27.450340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:27.450968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:27.451544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:27.454073 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1218/2426] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:28:27.466148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:27.469067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:27.489325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc54f9-a49d-484b-93fa-f0c91cef64fd tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:27.567105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:27.567650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:27.567933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:27.571614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] PATH_INFO: `/v3/projects/d368e9b23b79427cb89d3488a255a201` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:27.573115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d368e9b23b79427cb89d3488a255a201)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:27.578546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:27.660384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:27.664428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:27.695690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd368e9b23b79427cb89d3488a255a201', 'request_id': 'req-23c8a4f0-327c-4e4d-a558-cf32f98a7149'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.711068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:27.715026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd368e9b23b79427cb89d3488a255a201', 'request_id': 'req-23c8a4f0-327c-4e4d-a558-cf32f98a7149'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.728486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd368e9b23b79427cb89d3488a255a201', 'request_id': 'req-23c8a4f0-327c-4e4d-a558-cf32f98a7149'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.743458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:27.748651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] The token cache is being invalidate because project d368e9b23b79427cb89d3488a255a201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:27.749245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.750554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:27.754602 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1209/2427] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:27 2022] DELETE /identity/v3/projects/d368e9b23b79427cb89d3488a255a201 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:27.759340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:27.765718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:27.800587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c157595-2b26-4b4c-96ca-fb1f51585673 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:27.906229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b742a-9194-430e-845f-cc0cf8107c3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:27.907290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b742a-9194-430e-845f-cc0cf8107c3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:27.908240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b742a-9194-430e-845f-cc0cf8107c3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:27.908240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b742a-9194-430e-845f-cc0cf8107c3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/c6b91e8c83c14bbd95324f08142e45ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:27.909744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8a4f0-327c-4e4d-a558-cf32f98a7149 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:27.909986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b742a-9194-430e-845f-cc0cf8107c3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b91e8c83c14bbd95324f08142e45ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:27.912603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b742a-9194-430e-845f-cc0cf8107c3d tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:27.915555 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1219/2428] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:27 2022] GET /identity/v3/projects/c6b91e8c83c14bbd95324f08142e45ab => generated 373 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:28:27.920839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:27.924542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:27.924871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:27.930418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] PATH_INFO: `/v3/users/4e91d52e12124cbda21fd9c11d8aa227` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:27.942545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e91d52e12124cbda21fd9c11d8aa227)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:27.946496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:28.036205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:28.036680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:28.037406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:28.043628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1220/2429] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:28.048607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e91d52e12124cbda21fd9c11d8aa227'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.051786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:28.054195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:28.068591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e91d52e12124cbda21fd9c11d8aa227'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.069539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e91d52e12124cbda21fd9c11d8aa227'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.106493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e91d52e12124cbda21fd9c11d8aa227'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.107385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e91d52e12124cbda21fd9c11d8aa227'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.157146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1210/2430] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:27 2022] DELETE /identity/v3/users/4e91d52e12124cbda21fd9c11d8aa227 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:28.268468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:28.275940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:28.297053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66429-ff1b-4d4f-90db-cfad90955b4e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:28.526811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60452-9cc9-436c-acae-3d0a6defee79 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:28.529727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60452-9cc9-436c-acae-3d0a6defee79 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:28.530023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60452-9cc9-436c-acae-3d0a6defee79 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:28.530305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60452-9cc9-436c-acae-3d0a6defee79 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/c6b91e8c83c14bbd95324f08142e45ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:28.532084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60452-9cc9-436c-acae-3d0a6defee79 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b91e8c83c14bbd95324f08142e45ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:28.538538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60452-9cc9-436c-acae-3d0a6defee79 tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:28.545297 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1221/2431] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:28 2022] GET /identity/v3/projects/c6b91e8c83c14bbd95324f08142e45ab => generated 373 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:28:28.586548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:28.588134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:28.758304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40fbdd-50da-49d6-826a-e2434879afa9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:28.777632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:28.780874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:28.783009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:28.784494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] PATH_INFO: `/v3/users/099dd6e0593943d4b919954251a6f33b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:28.788187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099dd6e0593943d4b919954251a6f33b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:28.800605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:28.854616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:28.920575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099dd6e0593943d4b919954251a6f33b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.954060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099dd6e0593943d4b919954251a6f33b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.957157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099dd6e0593943d4b919954251a6f33b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.981384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099dd6e0593943d4b919954251a6f33b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:28.982707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a175a74f-aed6-4521-9cdb-31700fa62f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099dd6e0593943d4b919954251a6f33b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:29.003921 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1211/2432] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:28 2022] DELETE /identity/v3/users/099dd6e0593943d4b919954251a6f33b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:29.008074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e657-bcc0-41dc-838b-466b3a3c60fa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.008582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e657-bcc0-41dc-838b-466b3a3c60fa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.008677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e657-bcc0-41dc-838b-466b3a3c60fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.024671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:29.119407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54e6e657-bcc0-41dc-838b-466b3a3c60fa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:29.120932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54e6e657-bcc0-41dc-838b-466b3a3c60fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.146343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff151a-31ba-4f6f-a933-82b5b48c6240 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.147402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff151a-31ba-4f6f-a933-82b5b48c6240 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.147402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff151a-31ba-4f6f-a933-82b5b48c6240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.195249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-83ff151a-31ba-4f6f-a933-82b5b48c6240 None None] MFA Rules not processed for user `368f6c3db9f24561a13f48ce02e7655e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:29.196858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83ff151a-31ba-4f6f-a933-82b5b48c6240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.246058 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1222/2433] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:29.249427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.249427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.249427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.290476 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1212/2434] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:29.291986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66c2b9-5442-48ac-afe4-b5991b974976 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.292458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66c2b9-5442-48ac-afe4-b5991b974976 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.292752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66c2b9-5442-48ac-afe4-b5991b974976 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.294466 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1213/2435] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:29.296384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66c2b9-5442-48ac-afe4-b5991b974976 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:29.298146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae66c2b9-5442-48ac-afe4-b5991b974976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.370725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] MFA Rules not processed for user `118c1425677b45b98689befb0eb55cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:29.371361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.478099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66c2b9-5442-48ac-afe4-b5991b974976 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:29.495809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:29.496594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.497005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.497387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.505670 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1223/2436] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:29.506654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:28:29.508149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.525149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:29.527192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:29.541719 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1214/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:29.542663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:29.544132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.561956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b912a7e-5117-4d9c-b4ac-ebbd9391760c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:29.568833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:29.569836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.570692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.571130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.572178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:29.576079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:29.629216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1215/2438] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:29 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:29.638762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:29.702822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:29.709830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.722753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:29.832211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:29.879822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c6187-58bd-4701-a472-b09d3ab31f17 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:29.891096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:29.891886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:29.892274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:29.892676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:29.894053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:29.904427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:29.937065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e479e-fcc5-49a0-9436-6b44b5cbc411 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:29.958454 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1216/2439] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:29 2022] POST /identity/v3/users => generated 291 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:29.958454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:29.966852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:29.997556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cf96c-c8a8-4fe8-89d3-3dea5e0be025 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.007852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.008748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.009553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.009553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] PATH_INFO: `/v3/projects/ca12dd07f51242168e4ea0e95357e89d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.012389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca12dd07f51242168e4ea0e95357e89d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.014473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.080297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118417b3fa3944acb266edcb42fac053', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6706df8e1dfb4787b1f99a127640f731', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.082193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.082633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.083067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] PATH_INFO: `/v3/projects/c6b91e8c83c14bbd95324f08142e45ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.093842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorizing `identity:get_project(project_id=c6b91e8c83c14bbd95324f08142e45ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.096279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.098333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1224/2440] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:28:29 2022] GET /identity/v3/projects/c6b91e8c83c14bbd95324f08142e45ab => generated 373 bytes in 592 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:30.099309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.125079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abccc1-5d22-4aa7-93bf-65a7102a2c8e tempest-QuotasAdminTestJSON-164698256 tempest-QuotasAdminTestJSON-164698256-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.135957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca12dd07f51242168e4ea0e95357e89d', 'request_id': 'req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.149786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca12dd07f51242168e4ea0e95357e89d', 'request_id': 'req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.158487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca12dd07f51242168e4ea0e95357e89d', 'request_id': 'req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.182197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] The token cache is being invalidate because project ca12dd07f51242168e4ea0e95357e89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:30.184532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.185742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41a9f9a2-cdf6-4dd3-97e8-9c07e103d00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.191565 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1217/2441] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:29 2022] DELETE /identity/v3/projects/ca12dd07f51242168e4ea0e95357e89d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:30.196012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9da2-708d-4c80-9f6d-a5135493250a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.196421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9da2-708d-4c80-9f6d-a5135493250a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.196803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9da2-708d-4c80-9f6d-a5135493250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.233964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5d2c9da2-708d-4c80-9f6d-a5135493250a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:30.237132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d2c9da2-708d-4c80-9f6d-a5135493250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.246171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.246990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.247145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.247334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.247984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.249624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.276965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1225/2442] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:30.279543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.286718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.310003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c1249-070e-487e-ab5d-d296782ac8c0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.328750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.329610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.332539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.332936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] PATH_INFO: `/v3/projects/fda6f066ee8e40c98791ff3534e7eb3d/users/fcdc71ae3bc5416291dc710b283ddfab/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.366906 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1218/2443] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:30.376839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.378219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.378713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.387573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda6f066ee8e40c98791ff3534e7eb3d, user_id=fcdc71ae3bc5416291dc710b283ddfab, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.391312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.421747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1226/2444] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:30 2022] PUT /identity/v3/projects/fda6f066ee8e40c98791ff3534e7eb3d/users/fcdc71ae3bc5416291dc710b283ddfab/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:30.421949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:30.422259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.423782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.425749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.487331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:30.533966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:30.544597 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1219/2445] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:30.545906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.553689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dec337-093a-4483-aaa7-c127ccf2f452 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.559817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b8dc4-72b7-4383-bf56-f82c51331a8d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.560975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.561831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.562436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.562883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] PATH_INFO: `/v3/projects/ddfca42d14554d6e9839f95250d8060e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.565577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfca42d14554d6e9839f95250d8060e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.567239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.567869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.568198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.568743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.569491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.570276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.572269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.589050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1220/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:30.589050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.602297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0344155-8ad5-470b-bf59-f212fe02c857 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.607856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.608852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.609161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.609513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.610138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:30.610548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.612720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.636820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfca42d14554d6e9839f95250d8060e', 'request_id': 'req-9449ad26-f5aa-4151-8957-d50a618224b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.637057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1221/2447] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:30.637767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.646146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfca42d14554d6e9839f95250d8060e', 'request_id': 'req-9449ad26-f5aa-4151-8957-d50a618224b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.656267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfca42d14554d6e9839f95250d8060e', 'request_id': 'req-9449ad26-f5aa-4151-8957-d50a618224b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.656771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d1ab0-4724-4031-9847-486ad15ce4a4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.679543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] The token cache is being invalidate because project ddfca42d14554d6e9839f95250d8060e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:30.680138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.681036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:30.684638 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1227/2448] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:30 2022] DELETE /identity/v3/projects/ddfca42d14554d6e9839f95250d8060e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:30.685761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.687442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.809973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.810951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.811449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.812106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] PATH_INFO: `/v3/projects/fda6f066ee8e40c98791ff3534e7eb3d/users/fcdc71ae3bc5416291dc710b283ddfab/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.815350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449ad26-f5aa-4151-8957-d50a618224b5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.815695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda6f066ee8e40c98791ff3534e7eb3d, user_id=fcdc71ae3bc5416291dc710b283ddfab, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.820832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.821941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.823310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.823591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.823864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.825151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.827302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.849308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1222/2449] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:30 2022] PUT /identity/v3/projects/fda6f066ee8e40c98791ff3534e7eb3d/users/fcdc71ae3bc5416291dc710b283ddfab/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:30.850413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.852390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.873328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1228/2450] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:30 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:30.874928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:30.877320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:30.959874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f0a55-604a-49cc-9ab0-f4cb2a5553e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.960691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd083b-22c2-44ed-a400-83086ddc23d9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:30.965497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.965743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:30.966610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.966868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:30.967363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.967582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] PATH_INFO: `/v3/users/50e19794afcb48cda998e9151235656e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.967846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:30.968306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] PATH_INFO: `/v3/users/8270152320e849e0bea54c602ba39cc2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:30.969193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e19794afcb48cda998e9151235656e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.969896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8270152320e849e0bea54c602ba39cc2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:30.972697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.973118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:30.980526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:31.045503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8270152320e849e0bea54c602ba39cc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.060797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e19794afcb48cda998e9151235656e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.062186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:31.067328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8270152320e849e0bea54c602ba39cc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.068091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8270152320e849e0bea54c602ba39cc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.077744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e19794afcb48cda998e9151235656e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.078577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e19794afcb48cda998e9151235656e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.084064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8270152320e849e0bea54c602ba39cc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.085072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8270152320e849e0bea54c602ba39cc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.092034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e19794afcb48cda998e9151235656e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.093349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-781db763-acd4-4563-8bb1-961bf1fe248e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e19794afcb48cda998e9151235656e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:31.103986 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1229/2451] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:30 2022] DELETE /identity/v3/users/8270152320e849e0bea54c602ba39cc2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:31.105424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.106458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:31.120271 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1223/2452] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:30 2022] DELETE /identity/v3/users/50e19794afcb48cda998e9151235656e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:31.121559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.122167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.122455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.145635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:31.146962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:31.207957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b588c-a057-474e-ae95-8b14082fea54 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:31.246733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1224/2453] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:31.260712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.263399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:31.311760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:31.312602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.312952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.313236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.315544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:31.318296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:31.374221 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1230/2454] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:31 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:31.378377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.383331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:31.388101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac090e-32f1-4e88-8dd7-2f3d6cab5e45 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:31.393910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:31.396932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.397639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.398446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.402175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e417-015f-4abf-9da6-edd17d00f78e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:31.407797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:31.409032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.409325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.409602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.410262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:31.412302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:31.416405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:31.419086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:31.425457 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1231/2455] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:31.429212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.439935 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1225/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:31.442718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f76aa-eba6-44d5-bc21-d12df8949437 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:31.452001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0b161-7071-47d5-ac83-1c0a2dcd0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:31.452631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b161-7071-47d5-ac83-1c0a2dcd0f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.452932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b161-7071-47d5-ac83-1c0a2dcd0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.453334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0b161-7071-47d5-ac83-1c0a2dcd0f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.453869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b161-7071-47d5-ac83-1c0a2dcd0f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:31.455995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0b161-7071-47d5-ac83-1c0a2dcd0f67 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:31.464799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:31.481096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1232/2457] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:28:31.485537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.521382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc93885-b902-4de3-96ec-ca084d37247d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:31.530028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:31.530743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.531078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.531394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] PATH_INFO: `/v3/projects/7a87f178aedc4acbb4bd353bc09a7cb3/users/1d5d53045696469487a6be6640b07f6e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.562499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a87f178aedc4acbb4bd353bc09a7cb3, user_id=1d5d53045696469487a6be6640b07f6e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:31.565777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:31.606973 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1226/2458] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:31 2022] PUT /identity/v3/projects/7a87f178aedc4acbb4bd353bc09a7cb3/users/1d5d53045696469487a6be6640b07f6e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:31.609486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.609945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.610226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:31.699828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] MFA Rules not processed for user `1d5d53045696469487a6be6640b07f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:31.703895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:31.805131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.811685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:31.899503 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1233/2459] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:31.903991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:31.921910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:31.969598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb3d6c-5efc-4636-9577-d8a617247341 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:31.996490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:31.997883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:31.998172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:31.998750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] PATH_INFO: `/v3/projects/3fa3da459f1e4618a0763c59c7fe2338` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.000138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa3da459f1e4618a0763c59c7fe2338)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:32.003804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:32.076032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5270f5-c8fc-46f6-b731-2aaf507da3d1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:32.136850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa3da459f1e4618a0763c59c7fe2338', 'request_id': 'req-7aa258f4-4151-49ae-b4ee-906e200941f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.148618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa3da459f1e4618a0763c59c7fe2338', 'request_id': 'req-7aa258f4-4151-49ae-b4ee-906e200941f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.161611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa3da459f1e4618a0763c59c7fe2338', 'request_id': 'req-7aa258f4-4151-49ae-b4ee-906e200941f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.178259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] The token cache is being invalidate because project 3fa3da459f1e4618a0763c59c7fe2338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:32.178647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.179325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.182316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1227/2460] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:31 2022] DELETE /identity/v3/projects/3fa3da459f1e4618a0763c59c7fe2338 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:32.186680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:32.188162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:32.344878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8450d-661f-48a4-84fb-79826f535f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:32.348425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8450d-661f-48a4-84fb-79826f535f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.351801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8450d-661f-48a4-84fb-79826f535f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.352354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8450d-661f-48a4-84fb-79826f535f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.353825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8450d-661f-48a4-84fb-79826f535f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:32.355655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa258f4-4151-49ae-b4ee-906e200941f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:32.369360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8450d-661f-48a4-84fb-79826f535f3d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:32.371568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:32.372247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.372537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.372816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] PATH_INFO: `/v3/projects/c6b91e8c83c14bbd95324f08142e45ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.376114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b91e8c83c14bbd95324f08142e45ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:32.387471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:32.445317 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1234/2461] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:31 2022] POST /identity/v3/projects => generated 385 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:32.448285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f961b9e-bc4b-46f5-94da-42e0387d18a3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.449640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f961b9e-bc4b-46f5-94da-42e0387d18a3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.450061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f961b9e-bc4b-46f5-94da-42e0387d18a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.530561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5f961b9e-bc4b-46f5-94da-42e0387d18a3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:32.533920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5f961b9e-bc4b-46f5-94da-42e0387d18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:32.556669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b91e8c83c14bbd95324f08142e45ab', 'request_id': 'req-02bcc593-265a-4aba-811d-4fe13341046b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.575742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b91e8c83c14bbd95324f08142e45ab', 'request_id': 'req-02bcc593-265a-4aba-811d-4fe13341046b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.585323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b91e8c83c14bbd95324f08142e45ab', 'request_id': 'req-02bcc593-265a-4aba-811d-4fe13341046b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.603684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:32.615784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] The token cache is being invalidate because project c6b91e8c83c14bbd95324f08142e45ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:32.615929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.616624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:32.620100 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1228/2462] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:32 2022] DELETE /identity/v3/projects/c6b91e8c83c14bbd95324f08142e45ab => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:32.623506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:32.625676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:32.642811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:32.742557 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1235/2463] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:32.744783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac4125-6dfe-46f9-881a-16424e10bfcf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.745269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac4125-6dfe-46f9-881a-16424e10bfcf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.745643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac4125-6dfe-46f9-881a-16424e10bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.784187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcc593-265a-4aba-811d-4fe13341046b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:32.797723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:32.798390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.798674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.798991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.799966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:32.807974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:32.809361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a0ac4125-6dfe-46f9-881a-16424e10bfcf None None] MFA Rules not processed for user `39671ba0b86847f995c96013947fee65`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:32.811448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a0ac4125-6dfe-46f9-881a-16424e10bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:32.876699 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1229/2464] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:32 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:32.876699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:32.881161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:32.912345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238b75-7e59-4c86-b567-e104e5424ac8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:32.924681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:32.925724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.926009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.926285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] PATH_INFO: `/v3/users/118417b3fa3944acb266edcb42fac053` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.929725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=118417b3fa3944acb266edcb42fac053)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:32.930887 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1236/2465] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:32.933163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:32.933669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:32.934325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:32.951471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:32.966051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:32.967634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:32.979996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1237/2466] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:32.981160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.004466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a8b4d-b58f-4d3f-b504-cc2e9e0a21e5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.015392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.019918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.019918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.020718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.021896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.032107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.053028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1238/2467] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:33.060095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.072760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df6f-4f9f-417a-b10b-243e6fd14193 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.078629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.079264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.079543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.079813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.081280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:33.081700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.084119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.094423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118417b3fa3944acb266edcb42fac053'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:33.102971 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1239/2468] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:33.103776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.133024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0e7e3-5720-4fe9-b72e-b4b7295196ea admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.137567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118417b3fa3944acb266edcb42fac053'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:33.139361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118417b3fa3944acb266edcb42fac053'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:33.141809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.143372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.143819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.144283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] PATH_INFO: `/v3/projects/19c4516dd1264ac2859de4efe1d1b65c/users/4c3c9b08350041d38262ea35c9f70812/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.162911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118417b3fa3944acb266edcb42fac053'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:33.165287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118417b3fa3944acb266edcb42fac053'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:33.166106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c4516dd1264ac2859de4efe1d1b65c, user_id=4c3c9b08350041d38262ea35c9f70812, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.172230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.194705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1240/2469] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:33 2022] PUT /identity/v3/projects/19c4516dd1264ac2859de4efe1d1b65c/users/4c3c9b08350041d38262ea35c9f70812/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:33.195770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.198168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:33.199778 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1230/2470] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:32 2022] DELETE /identity/v3/users/118417b3fa3944acb266edcb42fac053 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:33.201787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.203525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:33.322907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80093b2e-d533-4fc4-b3d5-213dfd0980bc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.366245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:33.373670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb93fc0-8db6-467f-b4d5-1adfd831ce4c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.385387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.386116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.386399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.386673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.387535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.389826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.409322 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1231/2471] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:33.410466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.416783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:33.429166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77890810-1a8f-4899-ad9a-cbc3e534fe19 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.443675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdbfab-4761-43fe-bd0c-8ebf166dc02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.446155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdbfab-4761-43fe-bd0c-8ebf166dc02f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.447390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdbfab-4761-43fe-bd0c-8ebf166dc02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.449134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdbfab-4761-43fe-bd0c-8ebf166dc02f admin admin] PATH_INFO: `/v3/projects/19c4516dd1264ac2859de4efe1d1b65c/users/4c3c9b08350041d38262ea35c9f70812/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.454857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdbfab-4761-43fe-bd0c-8ebf166dc02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c4516dd1264ac2859de4efe1d1b65c, user_id=4c3c9b08350041d38262ea35c9f70812, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.457814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdbfab-4761-43fe-bd0c-8ebf166dc02f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.500991 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1232/2472] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:33 2022] PUT /identity/v3/projects/19c4516dd1264ac2859de4efe1d1b65c/users/4c3c9b08350041d38262ea35c9f70812/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:33.509581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9709-3006-4075-8b45-920e78225903 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.512225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9709-3006-4075-8b45-920e78225903 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.512811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9709-3006-4075-8b45-920e78225903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.521143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.521816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.522099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.522380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.523030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.530624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.598103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fbeb9709-3006-4075-8b45-920e78225903 None None] MFA Rules not processed for user `4c3c9b08350041d38262ea35c9f70812`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:33.600245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fbeb9709-3006-4075-8b45-920e78225903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:33.605519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1241/2473] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:33 2022] POST /identity/v3/projects => generated 381 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:33.607203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.754592 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1233/2474] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:33.763921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f242-ff45-496e-906d-ebf31296edbe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.764536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.765799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.766155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.773932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.774564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.774847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.775128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.775771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.777761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.792942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] MFA Rules not processed for user `1d5d53045696469487a6be6640b07f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:33.794172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:33.826327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1242/2475] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:33 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:33.832918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.852169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c6956-606a-41d9-8832-aa6c2b80825e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.865181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.865828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.866115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.868207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.868894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.870549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.900169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1243/2476] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:33.905521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.933197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4bf30-3e65-438d-9260-0375420ce58a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.941421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1234/2477] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:33.948772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d031ebf-4f0d-4754-9685-135127497c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.949545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031ebf-4f0d-4754-9685-135127497c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.949828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031ebf-4f0d-4754-9685-135127497c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.950104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d031ebf-4f0d-4754-9685-135127497c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:33.950768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d031ebf-4f0d-4754-9685-135127497c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:33.952420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d031ebf-4f0d-4754-9685-135127497c15 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:33.972015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:33.982477 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1244/2478] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:33.988641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9592-8e1f-444a-ac01-3f8741b9719d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:33.995464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:33.996434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:33.996884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:33.997277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] PATH_INFO: `/v3/projects/00927bcb15124f60a8d051d3544f8bbe/users/2660e6fcf86d46c9ad0431a5acdac4f3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.022628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00927bcb15124f60a8d051d3544f8bbe, user_id=2660e6fcf86d46c9ad0431a5acdac4f3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:34.026518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:34.052101 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1235/2479] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:33 2022] PUT /identity/v3/projects/00927bcb15124f60a8d051d3544f8bbe/users/2660e6fcf86d46c9ad0431a5acdac4f3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:34.066428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:34.066746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:34.066989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.070965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:34.073613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:34.122938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] MFA Rules not processed for user `2660e6fcf86d46c9ad0431a5acdac4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:34.126402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:34.218388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:34.273621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ceff5-a1fd-42aa-aafd-f6cb5145ec93 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:34.287241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:34.291297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:34.292036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:34.292516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:34.292638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.295749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1245/2480] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:34.301304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:34.301587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:34.443978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eec471-9d46-4ff2-aaf9-ffcd9c3fd8b3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:34.458800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:34.460340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:34.460728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:34.461166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.461952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:34.469004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:34.504974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:34.506851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:34.527375 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1236/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:34.551424 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1246/2482] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:34 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:28:34.555877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:34.578223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3465c-3457-4c2b-84a5-95170d2240b3 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:34.710179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:34.710819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:34.711104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:34.711379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.712031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:34.714001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:34.761637 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1237/2483] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:34 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:34.763809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:34.783028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302af54-c648-4601-a377-4b97ab3655d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:34.795357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:34.796047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:34.797184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:34.797184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.797184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:34.800007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:34.827525 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1247/2484] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:34.829991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:34.847531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496858e-9f34-415e-9bb8-6b8b60b6671c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:34.858858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:34.859552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:34.859840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:34.860167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] PATH_INFO: `/v3/projects/018d57b0a7484e0fb6b746caa1938e26/users/86c14d247b1548338746dba909df3dc6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:34.894720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] RBAC: Authorizing `identity:create_grant(project_id=018d57b0a7484e0fb6b746caa1938e26, user_id=86c14d247b1548338746dba909df3dc6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:34.897593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:34.924579 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1238/2485] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:34 2022] PUT /identity/v3/projects/018d57b0a7484e0fb6b746caa1938e26/users/86c14d247b1548338746dba909df3dc6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:34.929467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:34.943360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05317e6a-bea3-4ba4-840b-173f1ce945a3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:35.080086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520e1b6-d9a7-48cf-b5d8-a69f836d48fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:35.080782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520e1b6-d9a7-48cf-b5d8-a69f836d48fa admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:35.081209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520e1b6-d9a7-48cf-b5d8-a69f836d48fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:35.081608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520e1b6-d9a7-48cf-b5d8-a69f836d48fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:35.082365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520e1b6-d9a7-48cf-b5d8-a69f836d48fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:35.084119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520e1b6-d9a7-48cf-b5d8-a69f836d48fa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:35.126747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1248/2486] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:35.131544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:35.151592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ad2e9-7878-4a28-ab73-8922a970268a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:35.168268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:35.169146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:35.169532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:35.169813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] PATH_INFO: `/v3/projects/018d57b0a7484e0fb6b746caa1938e26/users/86c14d247b1548338746dba909df3dc6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:35.177444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018d57b0a7484e0fb6b746caa1938e26, user_id=86c14d247b1548338746dba909df3dc6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:35.180591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:35.221643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1239/2487] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:35 2022] PUT /identity/v3/projects/018d57b0a7484e0fb6b746caa1938e26/users/86c14d247b1548338746dba909df3dc6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:35.234805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99978-bf6a-455c-b186-1dcc0552275c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:35.235102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99978-bf6a-455c-b186-1dcc0552275c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:35.235383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f99978-bf6a-455c-b186-1dcc0552275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:35.359883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-53f99978-bf6a-455c-b186-1dcc0552275c None None] MFA Rules not processed for user `86c14d247b1548338746dba909df3dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:35.363800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-53f99978-bf6a-455c-b186-1dcc0552275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:35.532024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:35.536140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:35.585995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:35.635739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1249/2488] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:35.732696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:35.787719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05649c96-fc8d-454a-893a-0c80e6599541 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:35.798634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:35.802088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:35.802544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:35.802844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] PATH_INFO: `/v3/projects/6706df8e1dfb4787b1f99a127640f731` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:35.807128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6706df8e1dfb4787b1f99a127640f731)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:35.811985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:35.950791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6706df8e1dfb4787b1f99a127640f731', 'request_id': 'req-0b094cb5-ef0f-449e-98a3-2657ac048f47'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:35.980525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6706df8e1dfb4787b1f99a127640f731', 'request_id': 'req-0b094cb5-ef0f-449e-98a3-2657ac048f47'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:36.001615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6706df8e1dfb4787b1f99a127640f731', 'request_id': 'req-0b094cb5-ef0f-449e-98a3-2657ac048f47'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:36.034581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] The token cache is being invalidate because project 6706df8e1dfb4787b1f99a127640f731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:36.034874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:36.036291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b094cb5-ef0f-449e-98a3-2657ac048f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:36.048492 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1240/2489] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:35 2022] DELETE /identity/v3/projects/6706df8e1dfb4787b1f99a127640f731 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:36.051057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:36.051506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:36.051792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:36.117419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:36.122776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:36.283076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1250/2490] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:36.292252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:36.292863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:36.293223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:36.329177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:36.350584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:36.379906 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1241/2491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:36.396257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:36.399724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:36.417313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:36.474661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206dc6b0-c3aa-4503-b59b-dd42f0408428 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:36.486079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:36.486702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:36.486979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:36.487268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:36.491194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:36.491551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:36.497659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:36.561709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1242/2492] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:36.570745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:36.614058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8505c4f-7697-4115-8428-36887837f771 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:36.635797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:36.636250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:36.636535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:36.636809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:36.637657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:36.640160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:36.759733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1243/2493] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:36 2022] POST /identity/v3/projects => generated 393 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:36.764280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:36.779442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7627fb-a828-446b-b5a8-9aa4349fcde5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:36.925228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675f48-5407-41fb-a81c-64b6662099bb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:36.950900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:36.953711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:36.954001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:36.954312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:36.958898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:36.968352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:36.993408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:36.994029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:36.994307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:36.994612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:37.007749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:37.038883 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1244/2494] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:36 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:37.042506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:37.072493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d6702-6b55-441e-b9fa-2b753b297621 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:37.101264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:37.102438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:37.103763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:37.104839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:37.105632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:37.107024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:37.110954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:37.141544 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1245/2495] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:37.146902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:37.162426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3204-f201-438d-a44c-c3e105ee0162 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:37.171177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6296887-acf1-4c9e-bea5-9d59bc4945a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:37.182219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:37.183901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:37.200776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6296887-acf1-4c9e-bea5-9d59bc4945a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:37.202027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6296887-acf1-4c9e-bea5-9d59bc4945a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:37.202525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6296887-acf1-4c9e-bea5-9d59bc4945a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:37.203511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6296887-acf1-4c9e-bea5-9d59bc4945a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:37.207049 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1251/2496] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 814 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:37.208053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6296887-acf1-4c9e-bea5-9d59bc4945a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:37.217601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:37.232507 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1246/2497] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:37.235790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:37.253901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271ba01-0752-42a1-b159-36df301bb267 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:37.273285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:37.273959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:37.274214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:37.274486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] PATH_INFO: `/v3/projects/a4e29dfc5d134b6eb25c4c35b8fcecc3/users/80deacd67ee24d8d9ff9dfe9395b54bf/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:37.319399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e29dfc5d134b6eb25c4c35b8fcecc3, user_id=80deacd67ee24d8d9ff9dfe9395b54bf, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:37.322188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:37.360503 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1252/2498] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:37 2022] PUT /identity/v3/projects/a4e29dfc5d134b6eb25c4c35b8fcecc3/users/80deacd67ee24d8d9ff9dfe9395b54bf/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:37.374438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:37.375121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:37.375506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:37.475291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] MFA Rules not processed for user `80deacd67ee24d8d9ff9dfe9395b54bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:37.479181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:37.677426 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1247/2499] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:37.681610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:37.842240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4db6-98d2-474a-ac08-fc37bae936f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:37.850313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:37.851146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:37.851674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:37.852209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:37.853100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:37.855575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:37.907710 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1253/2500] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:37 2022] POST /identity/v3/projects => generated 389 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:37.912661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:37.933490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943457-78ff-4d6b-9e7d-c26f34a87db5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:38.086597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:38.087458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:38.087741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:38.088013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:38.088656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:38.100792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:38.148480 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1248/2501] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:37 2022] POST /identity/v3/users => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:38.151812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:38.166843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c30a3-bf88-41d0-adb8-2a3303b0a222 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:38.177754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:38.178386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:38.178779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:38.179088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:38.180630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:38.184735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:38.212736 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1254/2502] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:38.216806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:38.232088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45a3b0-14a8-48c6-b1ab-61952d9ffaa6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:38.250904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:38.251593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:38.251916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:38.252706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] PATH_INFO: `/v3/projects/63621f674d004b30a2b9fd5d4d4ffbc5/users/56726fdf38eb42109474b9eb27e3222e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:38.307429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63621f674d004b30a2b9fd5d4d4ffbc5, user_id=56726fdf38eb42109474b9eb27e3222e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:38.311379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:38.353682 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1249/2503] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:38 2022] PUT /identity/v3/projects/63621f674d004b30a2b9fd5d4d4ffbc5/users/56726fdf38eb42109474b9eb27e3222e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:38.357639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:38.381415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7ab33-fedd-4244-9784-6c502d08a8e9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:38.532364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1f368-7e87-407b-ab82-87442b740b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:38.532518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1f368-7e87-407b-ab82-87442b740b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:38.533489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1f368-7e87-407b-ab82-87442b740b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:38.535631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1f368-7e87-407b-ab82-87442b740b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:38.537585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1f368-7e87-407b-ab82-87442b740b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:38.541823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1f368-7e87-407b-ab82-87442b740b34 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:38.567858 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1255/2504] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:38.572004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:38.584074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d9864-5d0e-43f7-be88-6adbf61b753a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:38.591538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:38.592251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:38.592758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:38.593542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] PATH_INFO: `/v3/projects/63621f674d004b30a2b9fd5d4d4ffbc5/users/56726fdf38eb42109474b9eb27e3222e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:38.601808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63621f674d004b30a2b9fd5d4d4ffbc5, user_id=56726fdf38eb42109474b9eb27e3222e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:38.608015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:38.631253 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1250/2505] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:38 2022] PUT /identity/v3/projects/63621f674d004b30a2b9fd5d4d4ffbc5/users/56726fdf38eb42109474b9eb27e3222e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:38.639538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:38.639900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:38.640247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:38.700028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:38.704529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] MFA Rules not processed for user `56726fdf38eb42109474b9eb27e3222e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:38.706007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:38.854593 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1256/2506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:38.897599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:39.036422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:39.089675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce0610-cfaa-4874-a594-15c6061cdd0d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:39.105755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:39.106757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:39.107602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:39.108101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:39.123994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:39.125987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:39.156835 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1251/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:39.255292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:39.256784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:39.302392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d26699-fb00-4a6c-8aaa-edc8d249747d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:39.313586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:39.315426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:39.315971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:39.316520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:39.378281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:39.379754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:39.515464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d9c1-1141-4dac-bb9b-6fe6c40a7d6b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:39.525227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:39.525996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:39.526343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:39.526979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:39.535786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] PATH_INFO: `/v3/users/2660e6fcf86d46c9ad0431a5acdac4f3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:39.535936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:39.537491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2660e6fcf86d46c9ad0431a5acdac4f3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:39.544723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:39.575329 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1257/2508] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:39.598877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:39.629186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94433d-a7ca-4356-b6a3-b2b464deaa57 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:39.645781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:39.646499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:39.646727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:39.646983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] PATH_INFO: `/v3/users/80deacd67ee24d8d9ff9dfe9395b54bf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:39.648347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80deacd67ee24d8d9ff9dfe9395b54bf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:39.650386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:39.667292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2660e6fcf86d46c9ad0431a5acdac4f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.693401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2660e6fcf86d46c9ad0431a5acdac4f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.694400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2660e6fcf86d46c9ad0431a5acdac4f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.709169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2660e6fcf86d46c9ad0431a5acdac4f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.711027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3e223937-311c-4302-b906-a85516a58e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2660e6fcf86d46c9ad0431a5acdac4f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.731282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80deacd67ee24d8d9ff9dfe9395b54bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.749709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1252/2509] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:39 2022] DELETE /identity/v3/users/2660e6fcf86d46c9ad0431a5acdac4f3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:39.754240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:39.754240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:39.754475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:39.763008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80deacd67ee24d8d9ff9dfe9395b54bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.764154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80deacd67ee24d8d9ff9dfe9395b54bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.787528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80deacd67ee24d8d9ff9dfe9395b54bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.790037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3c11986d-ab28-4213-b3d3-4fe85ebb9686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80deacd67ee24d8d9ff9dfe9395b54bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:39.802269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:39.803799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:39.827551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1258/2510] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:39 2022] DELETE /identity/v3/users/80deacd67ee24d8d9ff9dfe9395b54bf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:39.832200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:39.832660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:39.832997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:39.865996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:39.868604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:39.874542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:39.897578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:39.927076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1253/2511] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:39.968199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:39.969397 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1259/2512] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:39.973990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:39.987832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:39.989510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:40.099715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e72f4-1927-4f51-b21d-fa17f72b051f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:40.109312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:40.110815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a7ab-d741-493e-8f6e-998108260e29 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:40.111761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:40.112050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:40.115153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:40.125281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:40.125916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:40.126197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:40.126468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:40.140609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:40.142360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:40.143480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:40.149969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:40.157366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1254/2513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:40.174206 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1260/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:28:41.374201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:41.376239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:41.401529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defdff4-3554-4918-abbf-7f15d7e75857 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:41.433925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:41.435638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:41.436080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:41.436477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] PATH_INFO: `/v3/projects/00927bcb15124f60a8d051d3544f8bbe` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:41.437987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00927bcb15124f60a8d051d3544f8bbe)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:41.444346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:41.557797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00927bcb15124f60a8d051d3544f8bbe', 'request_id': 'req-bd45723f-9aa2-4d74-8458-6f0850eae96d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.576622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00927bcb15124f60a8d051d3544f8bbe', 'request_id': 'req-bd45723f-9aa2-4d74-8458-6f0850eae96d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.583891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00927bcb15124f60a8d051d3544f8bbe', 'request_id': 'req-bd45723f-9aa2-4d74-8458-6f0850eae96d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.600423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] The token cache is being invalidate because project 00927bcb15124f60a8d051d3544f8bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:41.602774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.604454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd45723f-9aa2-4d74-8458-6f0850eae96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.608375 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1255/2515] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:41 2022] DELETE /identity/v3/projects/00927bcb15124f60a8d051d3544f8bbe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:41.613896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:41.630090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe81684-2dda-470a-b8b3-5638c7313b03 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:41.685895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74becbd5-a61c-41ee-ab88-a9d6e12e1467 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:41.686187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74becbd5-a61c-41ee-ab88-a9d6e12e1467 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:41.686468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74becbd5-a61c-41ee-ab88-a9d6e12e1467 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:41.690325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1256/2516] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:28:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:28:41.730937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:41.731227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:41.731512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:41.780320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:41.780997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:41.781382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:41.781576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] PATH_INFO: `/v3/users/86c14d247b1548338746dba909df3dc6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:41.782784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c14d247b1548338746dba909df3dc6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:41.784866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:41.803688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:41.805911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:41.889000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c14d247b1548338746dba909df3dc6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.897484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:41.911107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c14d247b1548338746dba909df3dc6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.912207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c14d247b1548338746dba909df3dc6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.934754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c14d247b1548338746dba909df3dc6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.937622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c14d247b1548338746dba909df3dc6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:41.964651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1261/2517] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:41 2022] DELETE /identity/v3/users/86c14d247b1548338746dba909df3dc6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:41.971769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1257/2518] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:28:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 05 02:28:42.031168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:42.032622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:42.129623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:42.131472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:42.169893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14867e74-482a-4f6c-ba94-04cd48871334 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:42.192125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:42.255465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c7952-d377-40b0-8f0c-4a4b605e7a94 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:42.267879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:42.269262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:42.271046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:42.271561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:42.290961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:42.292915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:42.345334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1262/2519] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:42.365889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:42.367116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:42.367587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:42.368079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] PATH_INFO: `/v3/users/f59ec872768d453a94a0dc3accf81642` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:42.369846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59ec872768d453a94a0dc3accf81642)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:42.373429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:42.421078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:42.424103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:42.531191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676418f-3157-4c91-8c34-a443524f678f service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:42.537304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:42.537956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:42.538239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:42.538519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] PATH_INFO: `/v3/projects/a4e29dfc5d134b6eb25c4c35b8fcecc3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:42.538894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59ec872768d453a94a0dc3accf81642'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.540703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e29dfc5d134b6eb25c4c35b8fcecc3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:42.548135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:42.577307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59ec872768d453a94a0dc3accf81642'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.578856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59ec872768d453a94a0dc3accf81642'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.601747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59ec872768d453a94a0dc3accf81642'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.603368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59ec872768d453a94a0dc3accf81642'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.639385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1258/2520] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:42 2022] DELETE /identity/v3/users/f59ec872768d453a94a0dc3accf81642 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:42.654109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e29dfc5d134b6eb25c4c35b8fcecc3', 'request_id': 'req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.674101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e29dfc5d134b6eb25c4c35b8fcecc3', 'request_id': 'req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.690746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e29dfc5d134b6eb25c4c35b8fcecc3', 'request_id': 'req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.751841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] The token cache is being invalidate because project a4e29dfc5d134b6eb25c4c35b8fcecc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:42.752647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.753451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:42.757903 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1263/2521] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:42 2022] DELETE /identity/v3/projects/a4e29dfc5d134b6eb25c4c35b8fcecc3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:42.759238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:42.762783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:42.939886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8787ef6-3688-411d-b650-26d887ef6e7a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:42.952942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:42.954308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:42.955436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:42.956144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] PATH_INFO: `/v3/users/56726fdf38eb42109474b9eb27e3222e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:42.957520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56726fdf38eb42109474b9eb27e3222e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:42.960247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:43.013554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:43.036356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56726fdf38eb42109474b9eb27e3222e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.054619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56726fdf38eb42109474b9eb27e3222e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.055480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56726fdf38eb42109474b9eb27e3222e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.066988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56726fdf38eb42109474b9eb27e3222e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.067847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56726fdf38eb42109474b9eb27e3222e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.086782 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1259/2522] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:42 2022] DELETE /identity/v3/users/56726fdf38eb42109474b9eb27e3222e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:43.306667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:43.308156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:43.385888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:43.399932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:43.402581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:43.453507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44b1fc-1d75-470d-bd7d-ca83a8e00672 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:43.654617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:43.655432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866925ea-1b31-412a-9543-fc60af549935 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:43.657590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:43.662602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:43.664274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:43.669982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:43.674969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:43.676024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:43.677466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:43.677750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] PATH_INFO: `/v3/projects/018d57b0a7484e0fb6b746caa1938e26` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:43.678988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018d57b0a7484e0fb6b746caa1938e26)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:43.681033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:43.787171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018d57b0a7484e0fb6b746caa1938e26', 'request_id': 'req-4a787ad6-6ddb-4471-9bde-0331c83d32d7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.812563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:43.814366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:43.818117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018d57b0a7484e0fb6b746caa1938e26', 'request_id': 'req-4a787ad6-6ddb-4471-9bde-0331c83d32d7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.825257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018d57b0a7484e0fb6b746caa1938e26', 'request_id': 'req-4a787ad6-6ddb-4471-9bde-0331c83d32d7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.831085 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1264/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:43.832060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:43.836605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:43.847964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] The token cache is being invalidate because project 018d57b0a7484e0fb6b746caa1938e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:43.848371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.850404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a787ad6-6ddb-4471-9bde-0331c83d32d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:43.854071 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1260/2524] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:43 2022] DELETE /identity/v3/projects/018d57b0a7484e0fb6b746caa1938e26 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:43.858040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324eba6-1f3a-448b-8119-def3e11e5f5a service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:43.864010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c169-0299-41d8-9cc0-7b17aa208c0a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:43.864434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c169-0299-41d8-9cc0-7b17aa208c0a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:43.864831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c169-0299-41d8-9cc0-7b17aa208c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:43.920096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2694c169-0299-41d8-9cc0-7b17aa208c0a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:43.926358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2694c169-0299-41d8-9cc0-7b17aa208c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:44.010879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.011582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.012193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.012193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] PATH_INFO: `/v3/projects/d3873ebc54394a6d8684fb95f30247fa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.013574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3873ebc54394a6d8684fb95f30247fa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.016030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.040117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:44.042766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:44.096998 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1261/2525] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:44.102245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.102553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.104019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.109834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3873ebc54394a6d8684fb95f30247fa', 'request_id': 'req-e32e2229-21f1-4603-a009-4e7372b4aaee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.117867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3873ebc54394a6d8684fb95f30247fa', 'request_id': 'req-e32e2229-21f1-4603-a009-4e7372b4aaee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.132619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3873ebc54394a6d8684fb95f30247fa', 'request_id': 'req-e32e2229-21f1-4603-a009-4e7372b4aaee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.156017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:44.160322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:44.165461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] The token cache is being invalidate because project d3873ebc54394a6d8684fb95f30247fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:44.166320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.167872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e32e2229-21f1-4603-a009-4e7372b4aaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.181668 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1265/2526] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:43 2022] DELETE /identity/v3/projects/d3873ebc54394a6d8684fb95f30247fa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:44.187186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442411-b0d8-439d-adab-ba77b34aa677 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.187594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442411-b0d8-439d-adab-ba77b34aa677 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.188038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442411-b0d8-439d-adab-ba77b34aa677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.223351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7f442411-b0d8-439d-adab-ba77b34aa677 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:44.225422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7f442411-b0d8-439d-adab-ba77b34aa677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:44.266519 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1262/2527] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:44.268280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.282716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff73286-9a62-4b40-bab1-95e876330d46 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:44.289362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.290121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.290408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.290822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.292224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:44.292536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.294953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.316511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1263/2528] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:44.318944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.338177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1266/2529] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:44.344769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a269-f572-4abf-9b39-8b9890640e18 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:44.350197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.350491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.350910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.369600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.370477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.370764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.371037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.375400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.380618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.412005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:44.413438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:44.430696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1267/2530] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:44.440330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.460708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1264/2531] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/projects => generated 411 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:44.461904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.462307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8361d81-9e2a-4048-bc98-d4d0ead0f8f9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:44.621276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.623289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.623736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.624551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.625582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:44.626144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.630429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.656494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1268/2532] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:44.657928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.667167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:44.683912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea9bd-80dd-4353-beaf-6106e8001c79 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:44.698144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.698986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.699375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.699527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.701788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.703308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.709787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22951c9-d069-4380-9903-6c7186b093c6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:44.719306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.719958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.720235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.724280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] PATH_INFO: `/v3/projects/63621f674d004b30a2b9fd5d4d4ffbc5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.725941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63621f674d004b30a2b9fd5d4d4ffbc5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.730235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.768305 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1265/2533] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/users => generated 306 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:28:44.770250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.791037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310538b8-8a6c-4864-9a58-7c3aeec844ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:44.803370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:44.804769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:44.804769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:44.804769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:44.805592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:44.808244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:44.852866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:44.873000 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1266/2534] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:44.878871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.895087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63621f674d004b30a2b9fd5d4d4ffbc5', 'request_id': 'req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.914129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63621f674d004b30a2b9fd5d4d4ffbc5', 'request_id': 'req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.918799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:44.943687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63621f674d004b30a2b9fd5d4d4ffbc5', 'request_id': 'req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.976650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] The token cache is being invalidate because project 63621f674d004b30a2b9fd5d4d4ffbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:44.977372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.980522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:44.982651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1269/2535] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:44 2022] DELETE /identity/v3/projects/63621f674d004b30a2b9fd5d4d4ffbc5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:44.993109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:44.997358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.067999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495d00-6d5e-434a-9226-3ee5783755ed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.074686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2716a1-bb50-4162-8fa9-d47464e627f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.075867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2716a1-bb50-4162-8fa9-d47464e627f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.076046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2716a1-bb50-4162-8fa9-d47464e627f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.076338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2716a1-bb50-4162-8fa9-d47464e627f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.078416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2716a1-bb50-4162-8fa9-d47464e627f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.080853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2716a1-bb50-4162-8fa9-d47464e627f6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.097307 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1267/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:45.099618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.100260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.100697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.130949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:45.139950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.159254 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1268/2537] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:45.164059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.165318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.170952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5a316-5e7a-4064-9b12-fe4bc47ccc3b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.176584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784944a9-b28b-4fbe-8b11-3921db277384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.177352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784944a9-b28b-4fbe-8b11-3921db277384 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.177727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784944a9-b28b-4fbe-8b11-3921db277384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.178099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784944a9-b28b-4fbe-8b11-3921db277384 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.178986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784944a9-b28b-4fbe-8b11-3921db277384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.181153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784944a9-b28b-4fbe-8b11-3921db277384 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.198257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b5fc-fd1e-4295-9f0f-77f643a9b63d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.206867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.207703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.207992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.208266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.209352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.212301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.215783 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1270/2538] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:44 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:45.218356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.218851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.219234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.231687 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1269/2539] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:45.233268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.249483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf74ce-8c92-4197-bf48-b81c5c589e2a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.262942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:45.263125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.263408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.263571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.263850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.264877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.265015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.268232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.290824 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1271/2540] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:45.292388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.294387 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1270/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:45.295828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.313847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60d645-3c47-4767-a6aa-ae835d328001 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.316659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e706-bf1f-4ee9-b602-59f978e2d7fd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.328474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260c649-8db9-40a9-90df-22f21250f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.329370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.332568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.332568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.332812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260c649-8db9-40a9-90df-22f21250f340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.332812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260c649-8db9-40a9-90df-22f21250f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.332812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260c649-8db9-40a9-90df-22f21250f340 admin admin] PATH_INFO: `/v3/projects/9fa095bb596c453b889a05906b2d472c/users/a5b10412c5294f739bb97865e405bdce/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.333078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.333298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:45.333613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.335514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.372366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1271/2542] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:45.374044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260c649-8db9-40a9-90df-22f21250f340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa095bb596c453b889a05906b2d472c, user_id=a5b10412c5294f739bb97865e405bdce, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.376758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260c649-8db9-40a9-90df-22f21250f340 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.379910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.393424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d69ed-253a-466e-bdde-6de763638ecf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.408424 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1272/2543] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:45 2022] PUT /identity/v3/projects/9fa095bb596c453b889a05906b2d472c/users/a5b10412c5294f739bb97865e405bdce/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:45.411309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d421f-dcf8-44ff-85fb-6fb5b1b0a904 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.411604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d421f-dcf8-44ff-85fb-6fb5b1b0a904 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.412933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d421f-dcf8-44ff-85fb-6fb5b1b0a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.414736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.416941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.417317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.417603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.420199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.422791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.458211 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1272/2544] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:45.462588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.485998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfab89c-f456-4893-b1c4-6abceb58c93f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.494751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1a1d421f-dcf8-44ff-85fb-6fb5b1b0a904 None None] MFA Rules not processed for user `fcdc71ae3bc5416291dc710b283ddfab`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:45.497243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1a1d421f-dcf8-44ff-85fb-6fb5b1b0a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.634067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.634694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.634978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.635255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.635904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.637846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.656365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:45.669569 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1273/2545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:45.671734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.674698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.675103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.713728 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1273/2546] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:45.714663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.752870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] MFA Rules not processed for user `a5b10412c5294f739bb97865e405bdce`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:45.754386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.821156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:45.858385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715d8b-919a-4e64-bd3c-2d732de99699 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:45.866670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99949c-3355-40b8-9039-461d1b772c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:45.868384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99949c-3355-40b8-9039-461d1b772c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.868730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99949c-3355-40b8-9039-461d1b772c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.869234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99949c-3355-40b8-9039-461d1b772c21 admin admin] PATH_INFO: `/v3/projects/92e7bf1499e6408da408d85bddc4d95b/users/000b799366da44838465be08b88fb27d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.894887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99949c-3355-40b8-9039-461d1b772c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e7bf1499e6408da408d85bddc4d95b, user_id=000b799366da44838465be08b88fb27d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:45.898492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99949c-3355-40b8-9039-461d1b772c21 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:45.918679 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1274/2547] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:45 2022] PUT /identity/v3/projects/92e7bf1499e6408da408d85bddc4d95b/users/000b799366da44838465be08b88fb27d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:45.920212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8d754-6136-401a-ba17-d7ff1fbb7775 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:45.920514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8d754-6136-401a-ba17-d7ff1fbb7775 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:45.920839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8d754-6136-401a-ba17-d7ff1fbb7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:45.933144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1274/2548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:45.934012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:45.944315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-62d8d754-6136-401a-ba17-d7ff1fbb7775 None None] MFA Rules not processed for user `118c1425677b45b98689befb0eb55cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:45.945593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62d8d754-6136-401a-ba17-d7ff1fbb7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:45.961013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d454e31-14c7-4250-9932-757cb5a3c8d8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.033996 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1275/2549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:46.035986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.036285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.036564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.062809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:46.065212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:46.141860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.144191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.144191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.144191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.144550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.146446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.172002 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1276/2550] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:46.173221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.208147 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1275/2551] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:45 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:46.208363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932d86-8b54-4837-9159-f6f50e72cbbc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.208464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.209970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:46.220185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.221160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.221726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.222283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.223215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.230792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.310912 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1277/2552] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:46 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:46.310912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.317956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:46.340854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1605e2c-5830-45b1-9090-ebc6eeb696cf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.365362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:46.411947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:46.421139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280da43b-5e62-41cd-9827-63bbdb7a53a4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.432595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.433544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.434035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.434643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.492500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.498307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.498604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.498888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.502172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:46.582968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.584826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.600556 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1278/2553] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:46.602016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.625261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015da86-6943-4553-b5fd-d5d860f0afa0 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.636818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.638148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.639747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.640858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.641950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.645058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.664502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.666928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.678946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1279/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:46.680630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.694225 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1276/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:46.695721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.706033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104463b-9a26-4c91-b726-9b3ba4ed8273 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.718662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3414d9-e497-4de3-abad-ce89be56171b service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.720011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.720675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.721039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.721662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.722297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.726771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.734004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.734637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.735522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.735522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.736720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.738220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.761370 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1277/2556] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:46.770891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.782742 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1280/2557] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:46 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:46.785499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.801176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808971d9-ab5f-4795-94dd-aa4ebf7bf885 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.809933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059576-9f69-4e53-a509-6840422212cc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.813649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc853e9a-509c-4ba8-a8a3-974fc04eca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.815126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc853e9a-509c-4ba8-a8a3-974fc04eca99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.815886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc853e9a-509c-4ba8-a8a3-974fc04eca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.816737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc853e9a-509c-4ba8-a8a3-974fc04eca99 admin admin] PATH_INFO: `/v3/projects/6138c57847244b9faa94024ad4693fdc/users/bfc6f083476b4b0bb540a1640b58f5c9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.823455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:46.825251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.825496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.826423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.827008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.830153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.850913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc853e9a-509c-4ba8-a8a3-974fc04eca99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6138c57847244b9faa94024ad4693fdc, user_id=bfc6f083476b4b0bb540a1640b58f5c9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:46.854445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc853e9a-509c-4ba8-a8a3-974fc04eca99 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:46.860584 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1281/2558] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:46.865865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:46.900617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef5927-574c-4e5e-9851-63f3384b73f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:46.901221 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1278/2559] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:46 2022] PUT /identity/v3/projects/6138c57847244b9faa94024ad4693fdc/users/bfc6f083476b4b0bb540a1640b58f5c9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:46.906900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:46.906900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:46.907495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:46.966553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:46.967792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:47.010375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:47.011665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:47.012943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:47.013553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] PATH_INFO: `/v3/projects/1ebe1df9b02349bda979d3c281cc7a95/users/f940b2b6962c415096e54c72b6f35d6c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:47.052145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebe1df9b02349bda979d3c281cc7a95, user_id=f940b2b6962c415096e54c72b6f35d6c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:47.058817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:47.093765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1282/2560] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:46 2022] PUT /identity/v3/projects/1ebe1df9b02349bda979d3c281cc7a95/users/f940b2b6962c415096e54c72b6f35d6c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:47.095326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:47.143615 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1279/2561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:47.173079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:47.200941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:47.216689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e9874-f619-4add-94df-19da561b8491 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:47.230284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:47.231322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:47.232059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:47.233169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:47.234512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:47.241483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:47.245794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:47.264323 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1283/2562] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:47.269564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:47.298545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97852ca9-17ac-424b-a14a-fa22362b7635 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:47.308466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84b6d9-28a8-46f3-9c52-9f5b506a9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:47.309375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b6d9-28a8-46f3-9c52-9f5b506a9709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:47.310330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b6d9-28a8-46f3-9c52-9f5b506a9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:47.311502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84b6d9-28a8-46f3-9c52-9f5b506a9709 admin admin] PATH_INFO: `/v3/projects/1ebe1df9b02349bda979d3c281cc7a95/users/f940b2b6962c415096e54c72b6f35d6c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:47.319198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84b6d9-28a8-46f3-9c52-9f5b506a9709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebe1df9b02349bda979d3c281cc7a95, user_id=f940b2b6962c415096e54c72b6f35d6c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:47.324804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84b6d9-28a8-46f3-9c52-9f5b506a9709 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:47.349388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb314ea1-23d3-48c8-84c7-a003a69d0cb9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:47.365709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1284/2563] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:47 2022] PUT /identity/v3/projects/1ebe1df9b02349bda979d3c281cc7a95/users/f940b2b6962c415096e54c72b6f35d6c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:47.368218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:47.368580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:47.368975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:47.414500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] MFA Rules not processed for user `f940b2b6962c415096e54c72b6f35d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:47.416084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:47.483638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:47.484341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:47.484692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:47.485064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:47.636929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1285/2564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:47.666879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:47.669092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:47.697282 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1280/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:28:48.394522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:48.531726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ec197-4703-426b-9ecf-1b282180a3a3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:48.538421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:48.539519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:48.539903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:48.540427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:48.553900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:48.556615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:48.586103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1286/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:48.887002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:48.889178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:48.926153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83572495-1566-41c4-a46f-bb79db8c7b4e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:48.954955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e90b6-0bd5-43c4-a097-03f30953061f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:48.955741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e90b6-0bd5-43c4-a097-03f30953061f service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:48.956010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e90b6-0bd5-43c4-a097-03f30953061f service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:48.956467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e90b6-0bd5-43c4-a097-03f30953061f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:49.159655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e90b6-0bd5-43c4-a097-03f30953061f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:49.162717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e90b6-0bd5-43c4-a097-03f30953061f service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:49.207218 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1281/2567] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:48 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:49.255715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:49.276665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11824a9e-41d2-459e-8ed6-f57fb67129b1 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:49.294897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:49.295552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:49.295900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:49.296192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] PATH_INFO: `/v3/users/a5b10412c5294f739bb97865e405bdce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:49.297560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b10412c5294f739bb97865e405bdce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:49.305992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:49.397206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:49.441484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b10412c5294f739bb97865e405bdce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:49.481745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b10412c5294f739bb97865e405bdce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:49.483282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b10412c5294f739bb97865e405bdce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:49.510200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b10412c5294f739bb97865e405bdce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:49.510935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b10412c5294f739bb97865e405bdce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:49.576052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:49.576500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:49.577623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:49.582829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1287/2568] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:49 2022] DELETE /identity/v3/users/a5b10412c5294f739bb97865e405bdce => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:49.636200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:49.638777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:49.703682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:49.819996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1282/2569] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:49.829119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:49.831727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:50.022700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f2a00-9151-45d2-b222-78b90cb1857e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:50.029025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49348c-8f3b-4d17-b5fe-fbcee577a076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:50.030143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49348c-8f3b-4d17-b5fe-fbcee577a076 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:50.030708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49348c-8f3b-4d17-b5fe-fbcee577a076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:50.031270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49348c-8f3b-4d17-b5fe-fbcee577a076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:50.059629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49348c-8f3b-4d17-b5fe-fbcee577a076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:50.063319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49348c-8f3b-4d17-b5fe-fbcee577a076 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:50.097758 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1288/2570] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:28:50.179749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:50.181872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:50.199721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f6556-df74-4e61-a070-dceecd6104ce None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:50.214450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:50.215118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:50.215398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:50.215673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] PATH_INFO: `/v3/users/3175c74d670a49e0a7efff04e7d4e9a0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:50.217398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3175c74d670a49e0a7efff04e7d4e9a0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:50.219339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:50.317728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3175c74d670a49e0a7efff04e7d4e9a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:50.341172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3175c74d670a49e0a7efff04e7d4e9a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:50.342497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3175c74d670a49e0a7efff04e7d4e9a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:50.360888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3175c74d670a49e0a7efff04e7d4e9a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:50.362503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3175c74d670a49e0a7efff04e7d4e9a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:50.447475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1283/2571] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:50 2022] DELETE /identity/v3/users/3175c74d670a49e0a7efff04e7d4e9a0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:50.449207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:50.450869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:50.451375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:50.492611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:50.494729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:50.941309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1289/2572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:28:50.982072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:50.983709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:51.115359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334c24d-4fc9-4f8a-86c7-7fab1d397b64 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:51.121296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:51.122001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:51.122304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:51.122732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:51.130921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:51.132464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:51.137384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:51.139153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:51.152822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb80a0a-9ad3-4c7e-9b5d-38f65d7df380 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:51.158473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:51.159920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:51.160449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:51.160993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] PATH_INFO: `/v3/projects/9fa095bb596c453b889a05906b2d472c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:51.162925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa095bb596c453b889a05906b2d472c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:51.163565 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1284/2573] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:28:51.166260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:51.268439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:51.278046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa095bb596c453b889a05906b2d472c', 'request_id': 'req-dc3c5c86-cc05-472d-baad-ff1163940f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.294064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa095bb596c453b889a05906b2d472c', 'request_id': 'req-dc3c5c86-cc05-472d-baad-ff1163940f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.306249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa095bb596c453b889a05906b2d472c', 'request_id': 'req-dc3c5c86-cc05-472d-baad-ff1163940f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.323564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] The token cache is being invalidate because project 9fa095bb596c453b889a05906b2d472c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:51.324006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.324808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.326728 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1290/2574] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:51 2022] DELETE /identity/v3/projects/9fa095bb596c453b889a05906b2d472c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:51.332344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:51.348858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb9f1-d739-4c49-b76b-a3910886ea96 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:51.469458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:51.527035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:51.527938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:51.528614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:51.529068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] PATH_INFO: `/v3/users/f940b2b6962c415096e54c72b6f35d6c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:51.530363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f940b2b6962c415096e54c72b6f35d6c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:51.536150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:51.656896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f940b2b6962c415096e54c72b6f35d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.684152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f940b2b6962c415096e54c72b6f35d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.685174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f940b2b6962c415096e54c72b6f35d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.715230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f940b2b6962c415096e54c72b6f35d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.715857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f940b2b6962c415096e54c72b6f35d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:51.735300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1285/2575] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:51 2022] DELETE /identity/v3/users/f940b2b6962c415096e54c72b6f35d6c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:52.681121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:52.683967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:52.724340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:52.725914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:52.738987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5c86-cc05-472d-baad-ff1163940f59 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:52.856861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a67c7-6959-49ac-bd78-8a988dfbe066 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:52.878949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:52.879850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:52.880485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:52.880936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] PATH_INFO: `/v3/projects/1ebe1df9b02349bda979d3c281cc7a95` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:52.882250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebe1df9b02349bda979d3c281cc7a95)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:52.884320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:52.934198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:52.938137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:52.938506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:52.938807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] PATH_INFO: `/v3/projects/10beeb5ff94e4c9c9c8b801fd3c56c66` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:52.941605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10beeb5ff94e4c9c9c8b801fd3c56c66)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:52.946148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:52.977828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebe1df9b02349bda979d3c281cc7a95', 'request_id': 'req-93cb235c-9ece-49cb-bf6c-0607586ca11e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:52.996965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebe1df9b02349bda979d3c281cc7a95', 'request_id': 'req-93cb235c-9ece-49cb-bf6c-0607586ca11e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:52.999797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:53.006096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebe1df9b02349bda979d3c281cc7a95', 'request_id': 'req-93cb235c-9ece-49cb-bf6c-0607586ca11e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.050786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] The token cache is being invalidate because project 1ebe1df9b02349bda979d3c281cc7a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:53.051335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.055019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-93cb235c-9ece-49cb-bf6c-0607586ca11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.067750 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1286/2576] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:52 2022] DELETE /identity/v3/projects/1ebe1df9b02349bda979d3c281cc7a95 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:53.069731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48153f-8c4a-4868-b839-03dba49c8845 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.070033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48153f-8c4a-4868-b839-03dba49c8845 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.070303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48153f-8c4a-4868-b839-03dba49c8845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.139555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'request_id': 'req-c4f1eb9f-150c-4afe-88b2-6356023323f4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.145748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1f48153f-8c4a-4868-b839-03dba49c8845 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:53.147028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f48153f-8c4a-4868-b839-03dba49c8845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:53.177985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'request_id': 'req-c4f1eb9f-150c-4afe-88b2-6356023323f4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.226518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10beeb5ff94e4c9c9c8b801fd3c56c66', 'request_id': 'req-c4f1eb9f-150c-4afe-88b2-6356023323f4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.255863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] The token cache is being invalidate because project 10beeb5ff94e4c9c9c8b801fd3c56c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:53.256331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.259123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.272973 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1291/2577] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:52 2022] DELETE /identity/v3/projects/10beeb5ff94e4c9c9c8b801fd3c56c66 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:53.276545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:53.279683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:53.306026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1287/2578] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:53.314685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.316290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.316648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.371750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:53.378463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:53.411489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1288/2579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:53.415578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:53.431550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d01fb-632f-455c-8907-dccabc0da720 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:53.453033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:53.454019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.455885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.458236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.459820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:53.460459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:53.462972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:53.479351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1eb9f-150c-4afe-88b2-6356023323f4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:53.493572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1289/2580] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:53.497127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:53.497792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.498070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.498344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] PATH_INFO: `/v3/users/ad66b7fe98794c7d9971b4010be2dab2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.499863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:53.500929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad66b7fe98794c7d9971b4010be2dab2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:53.503811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:53.512880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:53.522852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c548c71-6249-44e0-9e48-a339369f231f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:53.539290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:53.539917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.540214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.540492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.541337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:53.543959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:53.587341 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1290/2581] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:53 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:53.591835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:53.652372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad66b7fe98794c7d9971b4010be2dab2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.713558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad66b7fe98794c7d9971b4010be2dab2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.724973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad66b7fe98794c7d9971b4010be2dab2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.743502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ce348-7bc4-4455-9b2e-609120ee7a5c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:53.749099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad66b7fe98794c7d9971b4010be2dab2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.750320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad66b7fe98794c7d9971b4010be2dab2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:53.773716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:53.774772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.775061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.775337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.775996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:53.778167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:53.779399 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1292/2582] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:28:53 2022] DELETE /identity/v3/users/ad66b7fe98794c7d9971b4010be2dab2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:53.831493 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1291/2583] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:53 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:53.833156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:53.835041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:53.949594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9080-a20b-47de-ae4e-4feeff2b6cba admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:53.973036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:53.973896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:53.975524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:53.975813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:53.978311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:53.979972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:54.005513 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1293/2584] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:54.009389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:54.024269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6869a6-2010-49a1-993e-e5e90616c421 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:54.035027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e65c6-09fc-4c1b-ac75-e1678e6d4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:54.035667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e65c6-09fc-4c1b-ac75-e1678e6d4d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:54.036160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e65c6-09fc-4c1b-ac75-e1678e6d4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:54.036596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e65c6-09fc-4c1b-ac75-e1678e6d4d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:54.037450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e65c6-09fc-4c1b-ac75-e1678e6d4d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:54.039457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e65c6-09fc-4c1b-ac75-e1678e6d4d41 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:54.057741 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1292/2585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:54.062533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:54.076530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288612e-b8ae-4614-bcc2-4ffcd5562b54 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:54.094318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:54.095007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:54.095901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:54.095901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] PATH_INFO: `/v3/projects/91dad199b4d746a09129e354f6134e23/users/d461dd1f61284e858b2bc751d2991319/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:54.130576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dad199b4d746a09129e354f6134e23, user_id=d461dd1f61284e858b2bc751d2991319, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:54.134073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:54.167710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1294/2586] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:54 2022] PUT /identity/v3/projects/91dad199b4d746a09129e354f6134e23/users/d461dd1f61284e858b2bc751d2991319/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:28:54.179029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:54.179329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:54.179621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:54.249168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] MFA Rules not processed for user `d461dd1f61284e858b2bc751d2991319`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:54.250711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:54.303197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:54.465291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1293/2587] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:54.469496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:54.622933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:54.653766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7110ab2-6806-4835-976d-39a0bb56a3cb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:54.683746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:54.684665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:54.685126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:54.685576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:54.686546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:54.688604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:54.782015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1295/2588] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:54 2022] POST /identity/v3/projects => generated 391 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:54.784615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:54.800126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121530f-fdac-40a1-a5cd-fa0d9b0b97d5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:54.929188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:54.929808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:54.930258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:54.930721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:54.931514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:54.933622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:54.985874 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1294/2589] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:54 2022] POST /identity/v3/users => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:54.988204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:55.011592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7edd2-1112-431a-954c-13b972a05781 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:55.016342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:55.016984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:55.017850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:55.018130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:55.018942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:55.020552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:55.046256 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1296/2590] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:55.047898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:55.068505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d8d53-9d29-4ee3-8647-6caf9cbd5737 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:55.075700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:55.076384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:55.076830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:55.078781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] PATH_INFO: `/v3/projects/eda1ac6d15514353b781a664d4c6ea0f/users/e1a4215a00924f3a8403b2beb272dec4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:55.121222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda1ac6d15514353b781a664d4c6ea0f, user_id=e1a4215a00924f3a8403b2beb272dec4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:55.124168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:55.150138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1295/2591] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:55 2022] PUT /identity/v3/projects/eda1ac6d15514353b781a664d4c6ea0f/users/e1a4215a00924f3a8403b2beb272dec4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:55.154141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:55.168482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3b76-c5db-41d3-aa4d-35f1dd4df3b3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:55.304340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c88743-6fb4-4211-bcd1-ffafeb069dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:55.305504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c88743-6fb4-4211-bcd1-ffafeb069dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:55.306369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c88743-6fb4-4211-bcd1-ffafeb069dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:55.307024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c88743-6fb4-4211-bcd1-ffafeb069dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:55.307889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c88743-6fb4-4211-bcd1-ffafeb069dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:55.309758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c88743-6fb4-4211-bcd1-ffafeb069dfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:55.332936 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1297/2592] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:55.337872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:55.354502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb0277-ab54-4b1f-8a99-e66489345d32 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:55.360837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:55.362852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:55.363382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:55.364010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] PATH_INFO: `/v3/projects/eda1ac6d15514353b781a664d4c6ea0f/users/e1a4215a00924f3a8403b2beb272dec4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:55.366466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda1ac6d15514353b781a664d4c6ea0f, user_id=e1a4215a00924f3a8403b2beb272dec4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:55.380696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:55.417723 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1296/2593] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:55 2022] PUT /identity/v3/projects/eda1ac6d15514353b781a664d4c6ea0f/users/e1a4215a00924f3a8403b2beb272dec4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:55.428705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:55.431916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:55.432510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:55.504613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] MFA Rules not processed for user `e1a4215a00924f3a8403b2beb272dec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:55.506067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:55.759112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:55.760986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:55.780624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1298/2594] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:55.866164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9df2e-226a-4eeb-b095-101c6203f16c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:55.874492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:55.876033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:55.885284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:55.887604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:55.888001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:55.888379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] PATH_INFO: `/v3/projects/f4e551b750ea41babf0744667ef2e0f6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:55.890510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e551b750ea41babf0744667ef2e0f6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:55.897542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:55.915220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:55.997736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:56.012715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e551b750ea41babf0744667ef2e0f6', 'request_id': 'req-de8844c8-77ba-4305-b2f2-6c87b2892e01'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:56.027099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e551b750ea41babf0744667ef2e0f6', 'request_id': 'req-de8844c8-77ba-4305-b2f2-6c87b2892e01'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:56.049782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e551b750ea41babf0744667ef2e0f6', 'request_id': 'req-de8844c8-77ba-4305-b2f2-6c87b2892e01'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:56.070915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970fb9-22c2-41b2-9a2a-fb770714895f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.089245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] The token cache is being invalidate because project f4e551b750ea41babf0744667ef2e0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:28:56.089839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:56.091368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de8844c8-77ba-4305-b2f2-6c87b2892e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:28:56.096798 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1297/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:28:55 2022] DELETE /identity/v3/projects/f4e551b750ea41babf0744667ef2e0f6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:56.102897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46e35-f483-4874-9651-fc93575c24e8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.103391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46e35-f483-4874-9651-fc93575c24e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.103853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c46e35-f483-4874-9651-fc93575c24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.178380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-34c46e35-f483-4874-9651-fc93575c24e8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:56.179419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-34c46e35-f483-4874-9651-fc93575c24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:56.250210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.251128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.251417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.251787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.254074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:56.306323 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1298/2596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:56.308060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.308391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.308674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.337073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:56.338664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:56.354314 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1299/2597] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:56.358842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:56.368711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.370492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.379476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5566a-9869-4e29-82f8-c6260a5ba9f1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.402163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.402980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1299/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:28:56.403299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.403583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.403862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.404534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:28:56.404841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.406908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.421156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1300/2599] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:28:56.426871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:56.442249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f869e-9420-4927-a599-36b4514e86ea service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.447346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.448123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.448505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.448880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.449656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.452059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.493588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:56.506841 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1300/2600] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:28:56 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:56.511057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a0ae-0ac3-4b9b-a7f8-a9ebc6db1533 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.600826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.602053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.602470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.603159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.604050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.605898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.642440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1301/2601] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:28:56 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:28:56.646901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:56.662692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe3a00-e425-4534-aca8-6740fa93a5fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.670075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.670891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.671298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.671674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.672450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.675347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.695351 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1301/2602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:56.696305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:56.711291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb6790-cc13-4f4b-b2b9-ebf0076f4ff5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.718310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241785-184f-4be0-b329-3aa35d647c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.719463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241785-184f-4be0-b329-3aa35d647c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.720838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241785-184f-4be0-b329-3aa35d647c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.721376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241785-184f-4be0-b329-3aa35d647c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.722329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241785-184f-4be0-b329-3aa35d647c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.724573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61241785-184f-4be0-b329-3aa35d647c1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.728404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:56.748279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:56.757010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1302/2603] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:28:56.766265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22333895-fd1f-4cd6-8ef8-f81b1ec5f9e9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:56.779499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:56.780186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.780466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.781396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] PATH_INFO: `/v3/projects/407895b8d4e94b74a2cb652eb2c30048/users/f914ca523057422f88748746ba18b525/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.813298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407895b8d4e94b74a2cb652eb2c30048, user_id=f914ca523057422f88748746ba18b525, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:56.816759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:56.855615 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1302/2604] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:28:56 2022] PUT /identity/v3/projects/407895b8d4e94b74a2cb652eb2c30048/users/f914ca523057422f88748746ba18b525/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:28:56.865888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:56.866406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:56.866980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:56.950779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:28:56.952049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:57.070292 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1303/2605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:28:57.141641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:28:57.144533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:28:57.213085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:28:57.291528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f4be-ced4-4994-9f5b-7eeeb2de25f6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:28:57.295806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393d9da-42ca-4763-8cae-ca3d7e4bed7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:28:57.296554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393d9da-42ca-4763-8cae-ca3d7e4bed7c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:28:57.296964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393d9da-42ca-4763-8cae-ca3d7e4bed7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:28:57.297342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393d9da-42ca-4763-8cae-ca3d7e4bed7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:28:57.318629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393d9da-42ca-4763-8cae-ca3d7e4bed7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:28:57.320336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393d9da-42ca-4763-8cae-ca3d7e4bed7c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:28:57.337552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1303/2606] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:00.006943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:00.010129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:00.147095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859565-87cf-4272-8068-3ec94e2d3f10 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:00.156808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:00.159413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:00.160270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:00.160954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:00.165070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:00.264482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:00.268225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:00.289861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1304/2607] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:01.928937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:01.929518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:01.929722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:01.985232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] MFA Rules not processed for user `000b799366da44838465be08b88fb27d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:01.987784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:02.150305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:02.152314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:02.196542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2430a-491e-4c67-82dd-9b4c09c4c5bc service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:02.213226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1304/2608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:02.214418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:02.215241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:02.215776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:02.218084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:02.224104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:02.311281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:02.389106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:02.390664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08794-ccde-44b6-a7e8-56cf03147247 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:02.421157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1305/2609] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:29:02.615527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:02.644020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cb5ba-f41a-4d51-acc1-50adfc326d81 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:02.696024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf48fb-2955-43d1-a2a3-289db6368285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:02.697093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf48fb-2955-43d1-a2a3-289db6368285 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:02.698071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf48fb-2955-43d1-a2a3-289db6368285 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:02.698828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf48fb-2955-43d1-a2a3-289db6368285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:02.721375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf48fb-2955-43d1-a2a3-289db6368285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:02.724039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf48fb-2955-43d1-a2a3-289db6368285 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:02.738245 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1305/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:04.090783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:04.091305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:04.091305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:04.139880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] MFA Rules not processed for user `1d5d53045696469487a6be6640b07f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:04.141165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:04.305701 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1306/2611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:04.475307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94414a9-e626-4826-b65f-530f94438dba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:04.475871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94414a9-e626-4826-b65f-530f94438dba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:04.475871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94414a9-e626-4826-b65f-530f94438dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:04.511952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f94414a9-e626-4826-b65f-530f94438dba None None] MFA Rules not processed for user `bfc6f083476b4b0bb540a1640b58f5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:04.513550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f94414a9-e626-4826-b65f-530f94438dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:04.605747 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1306/2612] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:06.466255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:06.501775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d265fd-87a9-40ac-84cc-d321f5e98562 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:06.515285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:06.516150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:06.516611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:06.517112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:06.539405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:06.541587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:06.561221 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1307/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:11.031297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.031808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.031891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.108598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] MFA Rules not processed for user `f914ca523057422f88748746ba18b525`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:11.110287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:11.166148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:11.215162 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1307/2614] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:11.219564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:11.234484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477a739-ff2e-4867-8cfb-c1916a3f087c service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:11.240135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:11.241141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.241818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.242252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.243199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:11.245787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:11.287082 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1308/2615] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:11 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:11.291853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:11.303465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e457561-b2c3-475d-9cf3-583fe74ed6e9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:11.387147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:11.387776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.388055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.388327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.388989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:11.391679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:11.421594 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1308/2616] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:11 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:11.426157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:11.442230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bec75d-3101-4cf0-b39a-b7b15d2c778f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:11.450187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:11.450865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.451298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.452034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.452942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:11.455623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:11.468951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1309/2617] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:11.472521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:11.486900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62058ce-3906-4dc4-a4ba-4721d5e665d8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:11.495398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:11.496357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.496741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.497150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] PATH_INFO: `/v3/projects/767466ab5520428e8da1e9a76b806158/users/10b7c8f1c683451c8b6cac71d99f5fba/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.527978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767466ab5520428e8da1e9a76b806158, user_id=10b7c8f1c683451c8b6cac71d99f5fba, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:11.544652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:11.598834 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1309/2618] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:11 2022] PUT /identity/v3/projects/767466ab5520428e8da1e9a76b806158/users/10b7c8f1c683451c8b6cac71d99f5fba/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:11.600215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:11.612292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f5884-aa97-4fe2-b8b4-f07014444973 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:11.694578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:11.695298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.695783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.696131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.696852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:11.698567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:11.714236 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1310/2619] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:11.715392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:11.747722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacb494-597d-4f39-bd71-f3d285479747 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:11.755542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac67899-a444-4b37-bfb2-caf78d345e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:11.756647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac67899-a444-4b37-bfb2-caf78d345e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:11.757360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac67899-a444-4b37-bfb2-caf78d345e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:11.757924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac67899-a444-4b37-bfb2-caf78d345e4f admin admin] PATH_INFO: `/v3/projects/767466ab5520428e8da1e9a76b806158/users/10b7c8f1c683451c8b6cac71d99f5fba/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:11.761022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac67899-a444-4b37-bfb2-caf78d345e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=767466ab5520428e8da1e9a76b806158, user_id=10b7c8f1c683451c8b6cac71d99f5fba, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:11.764509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac67899-a444-4b37-bfb2-caf78d345e4f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:11.781439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1310/2620] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:11 2022] PUT /identity/v3/projects/767466ab5520428e8da1e9a76b806158/users/10b7c8f1c683451c8b6cac71d99f5fba/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:14.488062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:14.511789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:14.637415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072a3e-07f0-4ab0-b697-a0f97df4bc2d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:14.781496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:14.782398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:14.783139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:14.783935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:14.789606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:14.921791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:14.923883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:14.940870 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1311/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:17.375734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:17.379103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:17.379790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:17.447081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] MFA Rules not processed for user `10b7c8f1c683451c8b6cac71d99f5fba`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:17.450621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:17.578184 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1311/2622] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:17.591779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:17.593896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:17.730571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ecad9-86e8-4386-837f-53ca0569d17a service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:17.734736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ffb69-fc3d-4f2d-a41e-eb0f445f7a1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:17.735614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ffb69-fc3d-4f2d-a41e-eb0f445f7a1e service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:17.735897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ffb69-fc3d-4f2d-a41e-eb0f445f7a1e service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:17.736170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ffb69-fc3d-4f2d-a41e-eb0f445f7a1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:17.742745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:17.746862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ffb69-fc3d-4f2d-a41e-eb0f445f7a1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:17.748825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ffb69-fc3d-4f2d-a41e-eb0f445f7a1e service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:17.761870 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1312/2623] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:18.355908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:18.357036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:18.363023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:18.615955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf66ed-3aaa-4554-b735-c82e58a412e5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:18.627690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:18.630068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:18.630573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:18.631034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] PATH_INFO: `/v3/users/d461dd1f61284e858b2bc751d2991319` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:18.635375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d461dd1f61284e858b2bc751d2991319)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:18.637755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:18.752648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd461dd1f61284e858b2bc751d2991319'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:18.785348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd461dd1f61284e858b2bc751d2991319'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:18.786162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd461dd1f61284e858b2bc751d2991319'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:18.801345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd461dd1f61284e858b2bc751d2991319'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:18.804458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd461dd1f61284e858b2bc751d2991319'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:18.832657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1312/2624] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:18 2022] DELETE /identity/v3/users/d461dd1f61284e858b2bc751d2991319 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:18.837352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:18.838282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:18.838761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:18.884042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:18.885831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:19.067401 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1313/2625] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:19.073881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:19.075613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:19.240397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094165-9bf9-43de-a2fc-974712316f6b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:19.246033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35e94-e7aa-4280-ac0f-b0163b813438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:19.246743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35e94-e7aa-4280-ac0f-b0163b813438 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:19.247024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35e94-e7aa-4280-ac0f-b0163b813438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:19.247297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35e94-e7aa-4280-ac0f-b0163b813438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:19.260894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf35e94-e7aa-4280-ac0f-b0163b813438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:19.262358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf35e94-e7aa-4280-ac0f-b0163b813438 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:19.291386 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1313/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:19.572693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:19.574231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:19.603566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95349-8964-43c8-a5e5-e5d31b41411b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:19.634933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:19.641530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:19.642390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:19.643945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] PATH_INFO: `/v3/projects/91dad199b4d746a09129e354f6134e23` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:19.645380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91dad199b4d746a09129e354f6134e23)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:19.650198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:19.783598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91dad199b4d746a09129e354f6134e23', 'request_id': 'req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:19.808647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16098b9-c98d-41e1-81a2-0d367717e78d None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:19.809311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16098b9-c98d-41e1-81a2-0d367717e78d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:19.809311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16098b9-c98d-41e1-81a2-0d367717e78d None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:19.810856 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1314/2627] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:29:19.817178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91dad199b4d746a09129e354f6134e23', 'request_id': 'req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:19.822897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:19.822897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:19.823207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:19.833070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91dad199b4d746a09129e354f6134e23', 'request_id': 'req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:19.871986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] The token cache is being invalidate because project 91dad199b4d746a09129e354f6134e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:19.873689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:19.875954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:19.877802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:19.878344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:19.887596 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1314/2628] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:19 2022] DELETE /identity/v3/projects/91dad199b4d746a09129e354f6134e23 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:19.895833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:19.903298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:19.961082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:20.066678 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1315/2629] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:29:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:29:20.071472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3228a-b92e-49ab-aebd-9492b4dc15f5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:20.080822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:20.083233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:20.095764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:20.096529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:20.097529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:20.099094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] PATH_INFO: `/v3/users/e1a4215a00924f3a8403b2beb272dec4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:20.102033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a4215a00924f3a8403b2beb272dec4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:20.104528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:20.167850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:20.200516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98bea8-c7c5-4dee-8399-8ac6ce13f7ad None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:20.210819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960eabe-97b2-4d85-91f9-d40ff51afa56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:20.210819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eabe-97b2-4d85-91f9-d40ff51afa56 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:20.210819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eabe-97b2-4d85-91f9-d40ff51afa56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:20.210819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eabe-97b2-4d85-91f9-d40ff51afa56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:20.222751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a4215a00924f3a8403b2beb272dec4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:20.237860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960eabe-97b2-4d85-91f9-d40ff51afa56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:20.239806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960eabe-97b2-4d85-91f9-d40ff51afa56 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:20.249374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a4215a00924f3a8403b2beb272dec4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:20.250556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a4215a00924f3a8403b2beb272dec4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:20.269913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a4215a00924f3a8403b2beb272dec4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:20.271673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a4215a00924f3a8403b2beb272dec4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:20.297033 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1316/2630] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:29:20.298979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:20.298979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:20.298979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:20.315486 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1315/2631] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:19 2022] DELETE /identity/v3/users/e1a4215a00924f3a8403b2beb272dec4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:20.343569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:20.345559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:20.473774 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1317/2632] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:29:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:20.499006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:20.500388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:20.528707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab345792-b56e-40fc-93b0-0106f18874ee admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:20.544198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16b4a-04fe-4afb-850e-e3d1828a697f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:20.546355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16b4a-04fe-4afb-850e-e3d1828a697f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:20.546715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16b4a-04fe-4afb-850e-e3d1828a697f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:20.547066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16b4a-04fe-4afb-850e-e3d1828a697f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:20.565959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee16b4a-04fe-4afb-850e-e3d1828a697f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:20.567786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee16b4a-04fe-4afb-850e-e3d1828a697f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:20.607880 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1316/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:20.647726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:20.655466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:20.833665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364116f6-9a38-4229-afc1-173cdd74d9d0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:20.842333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:20.843257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:20.843820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:20.844249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] PATH_INFO: `/v3/projects/eda1ac6d15514353b781a664d4c6ea0f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:20.846389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda1ac6d15514353b781a664d4c6ea0f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:20.851253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:20.871702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:20.997230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda1ac6d15514353b781a664d4c6ea0f', 'request_id': 'req-0b86e8e9-6912-46da-a76b-42fadda18edb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:21.011543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda1ac6d15514353b781a664d4c6ea0f', 'request_id': 'req-0b86e8e9-6912-46da-a76b-42fadda18edb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:21.031441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda1ac6d15514353b781a664d4c6ea0f', 'request_id': 'req-0b86e8e9-6912-46da-a76b-42fadda18edb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:21.063321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] The token cache is being invalidate because project eda1ac6d15514353b781a664d4c6ea0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:21.063685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:21.064928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b86e8e9-6912-46da-a76b-42fadda18edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:21.089467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1318/2634] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:20 2022] DELETE /identity/v3/projects/eda1ac6d15514353b781a664d4c6ea0f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:21.094416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.096361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.096894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.170948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:21.172524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:21.329680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.330098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.330362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.333466 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1317/2635] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:21.357831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:21.359267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:21.368502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1319/2636] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:21.373090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:21.385612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408560cc-6cbc-4628-9bd0-f5c788322351 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:21.391135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:21.392230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.392704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.393169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.394043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:29:21.394602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:21.396406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:21.413425 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1318/2637] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:29:21.418778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:21.433070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bd52e-f1ed-47c4-8753-2811e4d8115f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:21.454406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:21.458165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.458727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.459221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.460819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:21.464326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:21.571212 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1320/2638] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:21 2022] POST /identity/v3/projects => generated 395 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:29:21.575710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:21.592621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e80df4-2675-48f6-a2b7-0c83534f4c86 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:21.758363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:21.758986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.759269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.759566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.760250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:21.765104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:21.807550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:21.814388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1319/2639] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:21 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:21.818895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:21.837358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a95e8d-cecf-4c7e-b025-8d54703bf10a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:21.854968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:21.856062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.858735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.863034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.864185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:21.870085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:21.897879 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1321/2640] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:21.902542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:21.926042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb489a01-d56e-4612-91ee-2fde5c525861 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:21.933452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada675e-b134-4bde-ad3e-04850bee5f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:21.934571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada675e-b134-4bde-ad3e-04850bee5f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:21.935148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada675e-b134-4bde-ad3e-04850bee5f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:21.935708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada675e-b134-4bde-ad3e-04850bee5f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:21.936779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada675e-b134-4bde-ad3e-04850bee5f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:21.951375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada675e-b134-4bde-ad3e-04850bee5f5f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:21.971562 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1320/2641] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:21.976349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:21.991569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec80841-9dc1-4042-b156-339d3299691f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:21.999487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.000590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.002628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.003308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] PATH_INFO: `/v3/projects/449ddfb8f22f49a7a294de5f5ef08531/users/005a727f85c54471b45488b0f1d394e1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.037609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449ddfb8f22f49a7a294de5f5ef08531, user_id=005a727f85c54471b45488b0f1d394e1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.041733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.067816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1322/2642] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:21 2022] PUT /identity/v3/projects/449ddfb8f22f49a7a294de5f5ef08531/users/005a727f85c54471b45488b0f1d394e1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:29:22.078965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.080584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.081171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.145160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] MFA Rules not processed for user `005a727f85c54471b45488b0f1d394e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:22.148986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:22.314582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:22.321857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1321/2643] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:22.439790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e607fb-1c42-4915-b578-5a4fe97eaf86 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:22.446880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.447809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.448538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.449103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.449976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.455047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.497906 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1323/2644] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:22 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:29:22.502783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:22.520209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be386382-f5b6-42cc-a245-c0444ab4c5a3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:22.621970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.622770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.623710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.624168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.625669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.629976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.667518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:22.670782 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1322/2645] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:22 2022] POST /identity/v3/users => generated 303 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:22.679806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbabcd5-748d-4936-93a8-a61a7182de3d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:22.685134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.686148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.686148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.686332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.686985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.689582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.709543 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1324/2646] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:29:22.710947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:22.722566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41033695-9bae-4f57-8c39-cf9655276ac3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:22.728868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.729809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.730295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.730770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] PATH_INFO: `/v3/projects/8637c6613c1843f59dc50059de4452ec/users/a5b46f205ec4480aa496d9aefb0f42b6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.767847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8637c6613c1843f59dc50059de4452ec, user_id=a5b46f205ec4480aa496d9aefb0f42b6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.773000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.799144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1323/2647] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:22 2022] PUT /identity/v3/projects/8637c6613c1843f59dc50059de4452ec/users/a5b46f205ec4480aa496d9aefb0f42b6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:22.800977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:22.813174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c6ab7-2818-4085-a8fe-9c3fc3046872 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:22.826527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:22.897511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b6025-2b6e-41d2-9ad5-15400c230340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.898222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6025-2b6e-41d2-9ad5-15400c230340 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.898461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6025-2b6e-41d2-9ad5-15400c230340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.898837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b6025-2b6e-41d2-9ad5-15400c230340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.899467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b6025-2b6e-41d2-9ad5-15400c230340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.901203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b6025-2b6e-41d2-9ad5-15400c230340 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.917034 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1325/2648] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:22.918260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:22.929641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe077f54-e4a0-455b-a776-79a78c5938f0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:22.935737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e887497-3e9e-4ef6-a16e-9f325144c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:22.936652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e887497-3e9e-4ef6-a16e-9f325144c915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:22.937060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e887497-3e9e-4ef6-a16e-9f325144c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:22.937616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e887497-3e9e-4ef6-a16e-9f325144c915 admin admin] PATH_INFO: `/v3/projects/8637c6613c1843f59dc50059de4452ec/users/a5b46f205ec4480aa496d9aefb0f42b6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:22.942450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e887497-3e9e-4ef6-a16e-9f325144c915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8637c6613c1843f59dc50059de4452ec, user_id=a5b46f205ec4480aa496d9aefb0f42b6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:22.945571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e887497-3e9e-4ef6-a16e-9f325144c915 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:22.959858 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1324/2649] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:22 2022] PUT /identity/v3/projects/8637c6613c1843f59dc50059de4452ec/users/a5b46f205ec4480aa496d9aefb0f42b6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:23.075705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:23.076218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:23.076654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:23.124073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] MFA Rules not processed for user `a5b46f205ec4480aa496d9aefb0f42b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:23.125533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:23.243761 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1326/2650] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:23 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:23.257705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f6973-e15c-4910-be64-c284d4fb84a1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:23.258261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f6973-e15c-4910-be64-c284d4fb84a1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:23.258261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f6973-e15c-4910-be64-c284d4fb84a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:23.294457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fa4f6973-e15c-4910-be64-c284d4fb84a1 None None] MFA Rules not processed for user `005a727f85c54471b45488b0f1d394e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:23.296345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fa4f6973-e15c-4910-be64-c284d4fb84a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:23.362902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:23.434373 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1325/2651] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:24.312170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:24.314745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:24.445445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae2724-e2f8-4bd6-b7d9-b79a232fa1b3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:24.456128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b77ab-7ed8-4c47-85ad-f80b4893b6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:24.456961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b77ab-7ed8-4c47-85ad-f80b4893b6ef service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:24.457347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b77ab-7ed8-4c47-85ad-f80b4893b6ef service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:24.457730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b77ab-7ed8-4c47-85ad-f80b4893b6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:24.468354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b77ab-7ed8-4c47-85ad-f80b4893b6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:24.470465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b77ab-7ed8-4c47-85ad-f80b4893b6ef service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:24.488207 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1327/2652] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:25.855946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:25.856595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:25.857918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:25.883329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] MFA Rules not processed for user `000b799366da44838465be08b88fb27d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:25.884688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:25.978032 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1326/2653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:30.152660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a2e9-9ca1-49b8-9954-222f3720b0f7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:30.153263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a2e9-9ca1-49b8-9954-222f3720b0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:30.153545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1a2e9-9ca1-49b8-9954-222f3720b0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:30.175830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-71c1a2e9-9ca1-49b8-9954-222f3720b0f7 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:30.178734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-71c1a2e9-9ca1-49b8-9954-222f3720b0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:30.194413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:30.262178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1328/2654] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:29:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:30.307134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:30.308660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:30.382837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ff6b3-56eb-48ae-81d3-818978dcfa97 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:30.387722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:30.389304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:30.389304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:30.389304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:30.397874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:30.399644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:30.408583 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1327/2655] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:29:40.254772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=18 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:40.405274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=68 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:42.471560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:42.472514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:42.476407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:42.522947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] MFA Rules not processed for user `39671ba0b86847f995c96013947fee65`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:42.524546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:42.715983 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1329/2656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:45.075408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:45.083764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:45.609675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66c7bc-c8f3-4a0c-932b-1e776cf971ee service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:45.621502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:45.623708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:45.629344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:45.629344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] PATH_INFO: `/v3/users/bfc6f083476b4b0bb540a1640b58f5c9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:45.631892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc6f083476b4b0bb540a1640b58f5c9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:45.640227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:45.804269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc6f083476b4b0bb540a1640b58f5c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:45.846953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc6f083476b4b0bb540a1640b58f5c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:45.854737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc6f083476b4b0bb540a1640b58f5c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:45.885697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc6f083476b4b0bb540a1640b58f5c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:45.888175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e62ba1c-f650-45a8-848a-22d37126909a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc6f083476b4b0bb540a1640b58f5c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:45.942223 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1328/2657] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:45 2022] DELETE /identity/v3/users/bfc6f083476b4b0bb540a1640b58f5c9 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:46.307372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:46.326094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c798-22ba-4915-8002-1228105d3a00 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:46.511530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:46.512347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:46.512764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:46.513173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] PATH_INFO: `/v3/projects/6138c57847244b9faa94024ad4693fdc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:46.519427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6138c57847244b9faa94024ad4693fdc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:46.521665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:46.672317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6138c57847244b9faa94024ad4693fdc', 'request_id': 'req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:46.686864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6138c57847244b9faa94024ad4693fdc', 'request_id': 'req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:46.697089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6138c57847244b9faa94024ad4693fdc', 'request_id': 'req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:46.717512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] The token cache is being invalidate because project 6138c57847244b9faa94024ad4693fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:46.717812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:46.718667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10e8c2e8-5640-4e3b-b284-f2bdd8bb423f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:46.721588 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1330/2658] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:46 2022] DELETE /identity/v3/projects/6138c57847244b9faa94024ad4693fdc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:46.726775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:46.727755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:46.728190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:46.753671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:46.754903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:46.861924 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1329/2659] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:46.875913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:46.876219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:46.876510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:46.886602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:46.893487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:46.913020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:46.914264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:46.928793 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1331/2660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:46.934012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:46.948160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8439-4cbf-4d41-93dd-09c9d98c456e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:46.953995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:46.954756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:46.955144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:46.955512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:46.956315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:29:46.956532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:46.956752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:46.958518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:46.983974 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1332/2661] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:29:46.989176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.000052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7658854-77e8-4311-9546-e1380e344b14 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.006341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.007020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.007395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.007734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.008781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.011603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.029361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:47.036511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f805-d8ad-4318-af85-b0fcf04256db None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.042890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.043745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.044029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.044508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.046720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:47.054620 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1333/2662] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:46 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:47.055993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.152373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909e590-de1f-4bee-9af9-b800eb712a14 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.153794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.155396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.158038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.158678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.158959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.159236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.160034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.162133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.167245 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1330/2663] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:29:47.196954 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1334/2664] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:47 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:47.198163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.216057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3c7f4-ab79-4fa1-a9f9-6798d77486e0 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.226604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.227572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.228123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.228787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.230175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.233257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.255706 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1331/2665] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:47.259550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.283008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6cca-87ec-4259-9d4c-21aecda79913 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.301232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ecce8-ddf4-4278-94fe-ab46644c3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.302097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecce8-ddf4-4278-94fe-ab46644c3508 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.303198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecce8-ddf4-4278-94fe-ab46644c3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.305758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ecce8-ddf4-4278-94fe-ab46644c3508 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.306887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ecce8-ddf4-4278-94fe-ab46644c3508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.314065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ecce8-ddf4-4278-94fe-ab46644c3508 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.338684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.338905 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1335/2666] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:47.353159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf27ea-1782-42a1-84e6-cebb3af40a5a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.361343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.362333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.362849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.363972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] PATH_INFO: `/v3/projects/771c0fc94e084c97a1359a1827c432f3/users/2e1341253c2c40f986039ce69e1cda85/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.386636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771c0fc94e084c97a1359a1827c432f3, user_id=2e1341253c2c40f986039ce69e1cda85, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.393360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.417046 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1332/2667] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:47 2022] PUT /identity/v3/projects/771c0fc94e084c97a1359a1827c432f3/users/2e1341253c2c40f986039ce69e1cda85/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:47.430909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.431331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.432750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.471371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.473247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:47.490987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] MFA Rules not processed for user `2e1341253c2c40f986039ce69e1cda85`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:47.492745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:47.576940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af41068-3c4f-421d-9d21-192f67b925f9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.581716 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1336/2668] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:47.582633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.583268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.583550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.583822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] PATH_INFO: `/v3/users/1d5d53045696469487a6be6640b07f6e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.585255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5d53045696469487a6be6640b07f6e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.593443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.594567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.595698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:47.618916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:47.689088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5d53045696469487a6be6640b07f6e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:47.718044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5d53045696469487a6be6640b07f6e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:47.720257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211374a-a811-425e-b623-6ade06eb77cb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:47.725563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5d53045696469487a6be6640b07f6e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:47.736686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:47.737384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.737663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.737971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.740062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:47.754584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5d53045696469487a6be6640b07f6e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:47.755532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5d53045696469487a6be6640b07f6e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:47.762899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:47.765014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a68a6-f6ef-4d36-893d-0dae643f2c19 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:47.778491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1337/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:47.779779 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1333/2670] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:47 2022] DELETE /identity/v3/users/1d5d53045696469487a6be6640b07f6e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:29:47.784725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec114b3-ccaf-40af-b777-4bbf12ccef00 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:47.785223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec114b3-ccaf-40af-b777-4bbf12ccef00 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:47.785504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec114b3-ccaf-40af-b777-4bbf12ccef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:47.793983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:47.807102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7ec114b3-ccaf-40af-b777-4bbf12ccef00 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:47.810038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7ec114b3-ccaf-40af-b777-4bbf12ccef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:47.966215 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1338/2671] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:47.994960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:47.998497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:48.067999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:48.068829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:48.069018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:48.091759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda48778-f5cb-4e93-a834-69ec21505bfe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:48.103351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:48.104638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:48.108361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e19f-5707-406a-96fd-08f58cd28fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:48.109419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e19f-5707-406a-96fd-08f58cd28fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:48.109707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e19f-5707-406a-96fd-08f58cd28fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:48.110567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e19f-5707-406a-96fd-08f58cd28fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:48.124362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95e19f-5707-406a-96fd-08f58cd28fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:48.128176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95e19f-5707-406a-96fd-08f58cd28fe0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:48.146606 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1334/2672] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:29:48.148204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:48.148494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:48.148963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:48.169788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] MFA Rules not processed for user `118c1425677b45b98689befb0eb55cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:48.170897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:48.181883 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1339/2673] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:29:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:29:48.196628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:48.197999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:48.241114 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1335/2674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:48.305810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1083-250d-4227-a4ef-35dff6aec45d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:48.311803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:48.312428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:48.313854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:48.314159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:48.337451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:48.339421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:48.350497 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1340/2675] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:29:48.663862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:48.665664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:48.701574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff04ad-ad1e-4825-ae48-ff9a9002eb2a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:48.715207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:48.716145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:48.716436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:48.717204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] PATH_INFO: `/v3/projects/7a87f178aedc4acbb4bd353bc09a7cb3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:48.721161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a87f178aedc4acbb4bd353bc09a7cb3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:48.723137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:48.809161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:48.815249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a87f178aedc4acbb4bd353bc09a7cb3', 'request_id': 'req-29c37e68-3fc8-40e4-99fc-980b335d34e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:48.823397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a87f178aedc4acbb4bd353bc09a7cb3', 'request_id': 'req-29c37e68-3fc8-40e4-99fc-980b335d34e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:48.837419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a87f178aedc4acbb4bd353bc09a7cb3', 'request_id': 'req-29c37e68-3fc8-40e4-99fc-980b335d34e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:48.861770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] The token cache is being invalidate because project 7a87f178aedc4acbb4bd353bc09a7cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:48.862069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:48.863044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:48.864950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1336/2676] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:48 2022] DELETE /identity/v3/projects/7a87f178aedc4acbb4bd353bc09a7cb3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:48.868968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:48.879828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0dee0-9c2e-4d2b-aa50-a4afc019ed4b service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:48.928607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:48.952884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:48.953372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:48.954259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:48.954545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] PATH_INFO: `/v3/users/4c3c9b08350041d38262ea35c9f70812` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:48.956482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3c9b08350041d38262ea35c9f70812)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:48.958530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:49.050593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3c9b08350041d38262ea35c9f70812'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:49.068440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3c9b08350041d38262ea35c9f70812'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:49.069644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3c9b08350041d38262ea35c9f70812'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:49.083636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3c9b08350041d38262ea35c9f70812'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:49.084929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5acf81f5-ba6f-496e-aa99-ca2606687212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3c9b08350041d38262ea35c9f70812'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:49.108247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1341/2677] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:48 2022] DELETE /identity/v3/users/4c3c9b08350041d38262ea35c9f70812 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:49.783651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:49.786323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:49.857131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c37e68-3fc8-40e4-99fc-980b335d34e9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:50.075046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:50.077400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.077975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.080808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] PATH_INFO: `/v3/projects/19c4516dd1264ac2859de4efe1d1b65c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.082856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c4516dd1264ac2859de4efe1d1b65c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:50.085511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:50.258993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c4516dd1264ac2859de4efe1d1b65c', 'request_id': 'req-79bd756e-d4f7-400c-8009-be021cef45cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:50.274164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c4516dd1264ac2859de4efe1d1b65c', 'request_id': 'req-79bd756e-d4f7-400c-8009-be021cef45cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:50.292203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c4516dd1264ac2859de4efe1d1b65c', 'request_id': 'req-79bd756e-d4f7-400c-8009-be021cef45cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:50.343449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] The token cache is being invalidate because project 19c4516dd1264ac2859de4efe1d1b65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:50.343905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:50.347835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79bd756e-d4f7-400c-8009-be021cef45cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:50.353234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1337/2678] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:49 2022] DELETE /identity/v3/projects/19c4516dd1264ac2859de4efe1d1b65c => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:50.358200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fecafa-ff1c-46aa-8abc-6c5c6be0257d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.358696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fecafa-ff1c-46aa-8abc-6c5c6be0257d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.358794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fecafa-ff1c-46aa-8abc-6c5c6be0257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.399491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a7fecafa-ff1c-46aa-8abc-6c5c6be0257d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:50.401377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7fecafa-ff1c-46aa-8abc-6c5c6be0257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:50.412259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.412551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.413475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.519207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] MFA Rules not processed for user `f914ca523057422f88748746ba18b525`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:50.521263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:50.578141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1342/2679] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:50.586538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.587092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.587582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.636658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:50.637977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:50.652576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1343/2680] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:50.663940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:50.683064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f14a1-9777-456b-8fa2-53e998e0e87c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:50.699067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:50.699842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.700166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.701320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.702884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:29:50.703448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:50.708632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:50.715216 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1338/2681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:50.733261 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1344/2682] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:29:50.738987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:50.765720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed8cba-89e7-49f7-8286-32f843abcf56 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:50.777290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:50.777968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.778262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.778551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.779255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:50.781481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:50.787735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:50.817313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1339/2683] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:50 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:29:50.821725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:50.835763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019f0f3-2d1c-433b-87e2-da9207b045c6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:50.891842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:50.918845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:50.919779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:50.920066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:50.920345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:50.921183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:50.923993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:50.978597 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1345/2684] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:50 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:50.982568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.006478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48470c89-c299-42c4-97a3-1f3e53dacc0c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:51.013229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:51.033477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.034058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.034206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.035221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:51.037157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:51.051419 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1340/2685] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:51.055126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.070056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0fc35-a7a7-4256-9219-4bbac3e57320 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:51.080819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b54faa-3df2-42fc-822d-8e4a59bc9944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:51.093020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54faa-3df2-42fc-822d-8e4a59bc9944 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.093456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54faa-3df2-42fc-822d-8e4a59bc9944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.093746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54faa-3df2-42fc-822d-8e4a59bc9944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.098060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b54faa-3df2-42fc-822d-8e4a59bc9944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:51.101890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b54faa-3df2-42fc-822d-8e4a59bc9944 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:51.131097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1346/2686] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:51.132522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.147770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269906b-dd7b-439a-b037-c84517560b30 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:51.153507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:51.154175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.154454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.154725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] PATH_INFO: `/v3/projects/c6918daa4f884786b45bc88dd1e4e94a/users/c73227214e404f4db779694b8c11779e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.188804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6918daa4f884786b45bc88dd1e4e94a, user_id=c73227214e404f4db779694b8c11779e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:51.191941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:51.208415 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1341/2687] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:51 2022] PUT /identity/v3/projects/c6918daa4f884786b45bc88dd1e4e94a/users/c73227214e404f4db779694b8c11779e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:51.219153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.219153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.219153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.257922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] MFA Rules not processed for user `c73227214e404f4db779694b8c11779e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:51.259281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:51.376708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1347/2688] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:51.381149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.534795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd177e-a10c-4dd8-95e0-f009a7958bdc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:51.547023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:51.548834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.549378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.549854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.550704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:51.556303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:51.622398 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1342/2689] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:51 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:51.626791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.640264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0df753-91cc-41c2-99e6-96890d1b76ed None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:51.821286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:51.822277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.822779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.823210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.825473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:51.830723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:51.898043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.899021 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1348/2690] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:51 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:51.913964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f207c-055e-4afb-b6bd-38ceb1eed107 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:51.925674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:51.927753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:51.928199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:51.928552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:51.929338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:51.934308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:51.968317 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1343/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:29:51.970268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:51.987520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb8eee-4978-49a4-adfb-788e57ee7501 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:52.006938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:52.006938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.006938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.007513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] PATH_INFO: `/v3/projects/ec1802aaa2f44429947b01dc6f5b351d/users/6883cff0f7314848a0181495c39d4562/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.017960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:52.020020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:52.043821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b88c3-d591-4626-b4b1-21fca20e159f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:52.063764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:52.065001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.065995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.066969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] PATH_INFO: `/v3/users/005a727f85c54471b45488b0f1d394e1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.067436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1802aaa2f44429947b01dc6f5b351d, user_id=6883cff0f7314848a0181495c39d4562, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:52.069789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005a727f85c54471b45488b0f1d394e1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:52.073798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:52.075695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:52.122514 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1349/2692] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:51 2022] PUT /identity/v3/projects/ec1802aaa2f44429947b01dc6f5b351d/users/6883cff0f7314848a0181495c39d4562/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:52.123949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:52.169353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:52.202952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005a727f85c54471b45488b0f1d394e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:52.221666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005a727f85c54471b45488b0f1d394e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:52.222650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005a727f85c54471b45488b0f1d394e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:52.253663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005a727f85c54471b45488b0f1d394e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:52.254521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e2328d66-d779-411c-a381-66bd76447114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005a727f85c54471b45488b0f1d394e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:52.261709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:52.277017 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1344/2693] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:52 2022] DELETE /identity/v3/users/005a727f85c54471b45488b0f1d394e1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:29:52.283976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.284623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.285153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.305357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b5fb9-b885-4ab9-97c9-f88bee6748fb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:52.322005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:52.324092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:52.430351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:52.431005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.431604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.431889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.432810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:52.433675 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1345/2694] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:52.434670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:52.448031 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1350/2695] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:29:52.453418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:52.455485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:52.456790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:52.458274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:52.478234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b15777-8609-4162-98f6-914d529ca550 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:52.488982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063f0ec-1093-4e36-80a4-ede93b7c636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:52.489781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063f0ec-1093-4e36-80a4-ede93b7c636b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.490064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063f0ec-1093-4e36-80a4-ede93b7c636b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.490339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063f0ec-1093-4e36-80a4-ede93b7c636b admin admin] PATH_INFO: `/v3/projects/ec1802aaa2f44429947b01dc6f5b351d/users/6883cff0f7314848a0181495c39d4562/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.493723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063f0ec-1093-4e36-80a4-ede93b7c636b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1802aaa2f44429947b01dc6f5b351d, user_id=6883cff0f7314848a0181495c39d4562, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:52.496861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063f0ec-1093-4e36-80a4-ede93b7c636b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:52.522879 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1346/2696] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:52 2022] PUT /identity/v3/projects/ec1802aaa2f44429947b01dc6f5b351d/users/6883cff0f7314848a0181495c39d4562/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:52.524390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad532d3-3045-46a1-a804-35196774dfa2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.524689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad532d3-3045-46a1-a804-35196774dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.524966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad532d3-3045-46a1-a804-35196774dfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.560970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8eaa7-5cd8-47cc-ba2a-1d65162dbb25 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:52.583153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0ad532d3-3045-46a1-a804-35196774dfa2 None None] MFA Rules not processed for user `6883cff0f7314848a0181495c39d4562`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:52.584550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0ad532d3-3045-46a1-a804-35196774dfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:52.701531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:52.702222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.702624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.702936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.743332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:52.772631 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1347/2697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:52.774643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:52.774880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:52.775154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:52.802619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] MFA Rules not processed for user `c73227214e404f4db779694b8c11779e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:52.804025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:52.812184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:52.815685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:52.861702 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1351/2698] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:52.881133 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1348/2699] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:53.236333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:53.238892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:53.390982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf5a0-a5de-4efc-8a96-7cbc81d92811 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:53.398813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:53.399545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:53.400160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:53.400551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:53.403269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:53.418360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:53.420707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:53.444178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1352/2700] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:53.573855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:53.576186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:53.600621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750d2f0-e785-43bd-b475-2fc6c2fa0d4e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:53.611708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:53.613052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:53.613471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:53.613876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] PATH_INFO: `/v3/projects/449ddfb8f22f49a7a294de5f5ef08531` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:53.615521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449ddfb8f22f49a7a294de5f5ef08531)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:53.617856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:53.630321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:53.744250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449ddfb8f22f49a7a294de5f5ef08531', 'request_id': 'req-6f83299d-0702-4f03-9506-76c9df965fe7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:53.758132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449ddfb8f22f49a7a294de5f5ef08531', 'request_id': 'req-6f83299d-0702-4f03-9506-76c9df965fe7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:53.766728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449ddfb8f22f49a7a294de5f5ef08531', 'request_id': 'req-6f83299d-0702-4f03-9506-76c9df965fe7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:53.792036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] The token cache is being invalidate because project 449ddfb8f22f49a7a294de5f5ef08531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:53.792340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:53.793989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f83299d-0702-4f03-9506-76c9df965fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:53.795622 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1349/2701] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:53 2022] DELETE /identity/v3/projects/449ddfb8f22f49a7a294de5f5ef08531 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:53.800293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:53.819513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f38328-f613-4161-8c4e-0ba95ad7ec1b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:53.913622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:53.914256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:53.914689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:53.914981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] PATH_INFO: `/v3/users/a5b46f205ec4480aa496d9aefb0f42b6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:53.916188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b46f205ec4480aa496d9aefb0f42b6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:53.918114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:54.005501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b46f205ec4480aa496d9aefb0f42b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:54.008848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:54.023523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b46f205ec4480aa496d9aefb0f42b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:54.024253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b46f205ec4480aa496d9aefb0f42b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:54.033458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b46f205ec4480aa496d9aefb0f42b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:54.034113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b46f205ec4480aa496d9aefb0f42b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:54.049946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1353/2702] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:29:53 2022] DELETE /identity/v3/users/a5b46f205ec4480aa496d9aefb0f42b6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:54.222619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87a43-7292-4cfe-bc84-e14c08a987e0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:54.222989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87a43-7292-4cfe-bc84-e14c08a987e0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:54.223340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce87a43-7292-4cfe-bc84-e14c08a987e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:54.258788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bce87a43-7292-4cfe-bc84-e14c08a987e0 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:54.265151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bce87a43-7292-4cfe-bc84-e14c08a987e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:54.414225 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1350/2703] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:29:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:54.415248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:54.417025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:54.438760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:54.439193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:54.440155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:54.481575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] MFA Rules not processed for user `c73227214e404f4db779694b8c11779e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:54.485642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:54.580058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad896cf-f212-4312-b14b-6e305b8bc3a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:54.583510 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1351/2704] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:54.590999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509171de-0e3e-484a-b47d-913b4e781e33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:54.591614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509171de-0e3e-484a-b47d-913b4e781e33 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:54.591895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509171de-0e3e-484a-b47d-913b4e781e33 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:54.592171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509171de-0e3e-484a-b47d-913b4e781e33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:54.602854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509171de-0e3e-484a-b47d-913b4e781e33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:54.605634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509171de-0e3e-484a-b47d-913b4e781e33 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:54.618039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1354/2705] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:29:54.932929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:54.935758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:55.091146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:55.129114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50217ec9-3712-4bdd-b065-a296ccf7483d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:55.134099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:55.134643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:55.134996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:55.135519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] PATH_INFO: `/v3/projects/8637c6613c1843f59dc50059de4452ec` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:55.142827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8637c6613c1843f59dc50059de4452ec)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:55.147387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:55.265461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8637c6613c1843f59dc50059de4452ec', 'request_id': 'req-4346a4bd-81a8-4b32-8037-be5c11722a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:55.289571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8637c6613c1843f59dc50059de4452ec', 'request_id': 'req-4346a4bd-81a8-4b32-8037-be5c11722a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:55.311681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8637c6613c1843f59dc50059de4452ec', 'request_id': 'req-4346a4bd-81a8-4b32-8037-be5c11722a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:55.350660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] The token cache is being invalidate because project 8637c6613c1843f59dc50059de4452ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:29:55.352590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:55.355283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4346a4bd-81a8-4b32-8037-be5c11722a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:29:55.363296 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1352/2706] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:29:54 2022] DELETE /identity/v3/projects/8637c6613c1843f59dc50059de4452ec => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:29:55.368145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:55.368582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:55.368974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:55.430359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:55.432893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:55.565335 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1355/2707] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:29:55.569152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:55.569641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:55.570014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:55.621583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:55.627639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:55.648456 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1353/2708] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:55.653185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:55.670539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb10008-0fed-4166-a569-ddd15535e124 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:55.683540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:55.684420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:55.684777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:55.685142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:55.685869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:29:55.686243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:55.688827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:55.720224 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1356/2709] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:29:55.725675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:55.736394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ad46f-d3d6-4a7b-ab43-4c73c32add19 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:55.744577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:55.745330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:55.745713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:55.746183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:55.746931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:55.749089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:55.792440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1354/2710] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:55 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:55.796351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:55.811853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028cafc-41c7-4eee-b00b-4d1036bd2063 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:55.898214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:55.941760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:55.942999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:55.945051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:55.945702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:55.946560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:55.948800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.011601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1357/2711] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:55 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:29:56.016692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.037190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ad698-0463-4814-b12d-7e4de78cf4da admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.044400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.045343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.046000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.047231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.048304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:56.050162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.077292 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1355/2712] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:29:56.083232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.096779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0802f9-e4d6-42c0-a8c0-305916c8fc4c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.102466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa513c27-4c3e-45e2-b3e7-b55166eeb46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.103201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513c27-4c3e-45e2-b3e7-b55166eeb46b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.103583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513c27-4c3e-45e2-b3e7-b55166eeb46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.104026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa513c27-4c3e-45e2-b3e7-b55166eeb46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.104769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa513c27-4c3e-45e2-b3e7-b55166eeb46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:56.107637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa513c27-4c3e-45e2-b3e7-b55166eeb46b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.155941 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1358/2713] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:56.159845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.177797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0737d7-ac17-43ca-be7f-702bb4a73be1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.192764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.205094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.205094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.205483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] PATH_INFO: `/v3/projects/68c7d71b3c0143e8b5247b08cff3b280/users/d698bef448a74da2ac299d978c5a6c66/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.264340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68c7d71b3c0143e8b5247b08cff3b280, user_id=d698bef448a74da2ac299d978c5a6c66, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:56.275701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.309984 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1356/2714] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:56 2022] PUT /identity/v3/projects/68c7d71b3c0143e8b5247b08cff3b280/users/d698bef448a74da2ac299d978c5a6c66/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:29:56.323187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.324173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.325137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.375478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] MFA Rules not processed for user `d698bef448a74da2ac299d978c5a6c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:56.377627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:56.522493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1359/2715] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:56.527631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.623901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ba8f9-c9aa-4861-bcb3-5f371ebdbb65 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.630918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.631775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.632209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.632656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.633454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:56.635737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.710822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:56.737500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.739209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1357/2716] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:29:56 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:56.754914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed296b-6648-4b31-bcfe-3c96f420323d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.871550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.872256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.872608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.873021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.874096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:56.876483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.918274 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1360/2717] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:29:56 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:29:56.922970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.937693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91450e-4e61-483c-96f2-3d3fb88bd8a0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.944077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.945690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.945690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.945690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:56.946111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:56.948295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:56.966927 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1358/2718] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:56.967602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:56.982675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51abee-e56b-4eaa-839b-6356af40bf2d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:56.994517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:56.995488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:56.995977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:56.996456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] PATH_INFO: `/v3/projects/0c87b47093f543d5b57248ab5ee7fedc/users/cda4b470c6cf4f8691197454fe98464a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:57.041719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c87b47093f543d5b57248ab5ee7fedc, user_id=cda4b470c6cf4f8691197454fe98464a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:57.056964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:57.092313 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1361/2719] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:56 2022] PUT /identity/v3/projects/0c87b47093f543d5b57248ab5ee7fedc/users/cda4b470c6cf4f8691197454fe98464a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:29:57.097007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:57.109639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b321b-9bb8-40fb-bd15-19e4bbb1b9a9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:57.238724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd826b4-6fa1-4d9e-9cb2-c7dcafeea92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:57.239423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd826b4-6fa1-4d9e-9cb2-c7dcafeea92a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:57.254600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd826b4-6fa1-4d9e-9cb2-c7dcafeea92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:57.255034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd826b4-6fa1-4d9e-9cb2-c7dcafeea92a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:57.255750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd826b4-6fa1-4d9e-9cb2-c7dcafeea92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:57.260155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd826b4-6fa1-4d9e-9cb2-c7dcafeea92a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:57.305804 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1359/2720] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:29:57.307640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:57.332971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53521ee-837f-406b-a384-26fa74482e2f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:57.358920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a88321-9107-4d15-b4c0-b75bd1d02a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:57.360508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88321-9107-4d15-b4c0-b75bd1d02a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:57.361330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88321-9107-4d15-b4c0-b75bd1d02a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:57.362236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a88321-9107-4d15-b4c0-b75bd1d02a3e admin admin] PATH_INFO: `/v3/projects/0c87b47093f543d5b57248ab5ee7fedc/users/cda4b470c6cf4f8691197454fe98464a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:57.397381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a88321-9107-4d15-b4c0-b75bd1d02a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c87b47093f543d5b57248ab5ee7fedc, user_id=cda4b470c6cf4f8691197454fe98464a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:57.404297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a88321-9107-4d15-b4c0-b75bd1d02a3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:57.488344 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1362/2721] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:29:57 2022] PUT /identity/v3/projects/0c87b47093f543d5b57248ab5ee7fedc/users/cda4b470c6cf4f8691197454fe98464a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:29:57.498419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145702e-6b36-4d94-a351-490790a810cf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:57.498782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145702e-6b36-4d94-a351-490790a810cf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:57.499124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145702e-6b36-4d94-a351-490790a810cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:57.593725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b145702e-6b36-4d94-a351-490790a810cf None None] MFA Rules not processed for user `cda4b470c6cf4f8691197454fe98464a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:57.600112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b145702e-6b36-4d94-a351-490790a810cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:57.884336 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1360/2722] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:57.900654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:57.901237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:57.901354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:57.918541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:57.952474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] MFA Rules not processed for user `d698bef448a74da2ac299d978c5a6c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:29:57.957639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:58.163373 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1363/2723] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:29:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:29:58.808461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145702e-6b36-4d94-a351-490790a810cf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:58.810403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b145702e-6b36-4d94-a351-490790a810cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:58.940607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145702e-6b36-4d94-a351-490790a810cf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:58.949649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:29:58.951580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:29:58.952814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:29:58.953494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:29:58.956448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:58.978515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:29:58.981510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:29:58.989517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:29:59.008970 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1361/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:29:59.782954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:29:59.786627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:29:59.986925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfc9a1-a046-4411-9647-a77768f7a2d2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:29:59.999444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7ad2-d3fb-4b24-869e-11de6024c4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:00.002363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7ad2-d3fb-4b24-869e-11de6024c4ca service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:00.003224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7ad2-d3fb-4b24-869e-11de6024c4ca service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:00.004055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7ad2-d3fb-4b24-869e-11de6024c4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:00.039391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7ad2-d3fb-4b24-869e-11de6024c4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:00.046001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7ad2-d3fb-4b24-869e-11de6024c4ca service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:00.089550 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1364/2725] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:29:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:03.740568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:03.763849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd717df-ded8-45c9-a819-3a17f1762860 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:03.779844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:03.781564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:03.782642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:03.783097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:03.788387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:03.817861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:03.820059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:03.845090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1362/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:04.956140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:04.956671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:04.956671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:04.987177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:04.989764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:05.061218 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1365/2727] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:30:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:05.076168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:05.076710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:05.179761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086de3d-dfd4-44fe-ac55-e8bccfe8ad8e service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:05.186605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bf86e-4dae-44d5-8ebb-55a9a9e8ff44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:05.187530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bf86e-4dae-44d5-8ebb-55a9a9e8ff44 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:05.188558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bf86e-4dae-44d5-8ebb-55a9a9e8ff44 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:05.189476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bf86e-4dae-44d5-8ebb-55a9a9e8ff44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:05.197854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bf86e-4dae-44d5-8ebb-55a9a9e8ff44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:05.199833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bf86e-4dae-44d5-8ebb-55a9a9e8ff44 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:05.211604 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1363/2728] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:30:05.371221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:05.372683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:05.421164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:05.447282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d6f46-dbf0-4996-86a6-dd6b6827c9a2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:05.455782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:05.455782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:05.455782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:05.455782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] PATH_INFO: `/v3/users/2e1341253c2c40f986039ce69e1cda85` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:05.458085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1341253c2c40f986039ce69e1cda85)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:05.460110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:05.532580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1341253c2c40f986039ce69e1cda85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:05.555685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1341253c2c40f986039ce69e1cda85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:05.557253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1341253c2c40f986039ce69e1cda85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:05.571745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1341253c2c40f986039ce69e1cda85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:05.572941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1341253c2c40f986039ce69e1cda85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:05.587639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1366/2729] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:30:05 2022] DELETE /identity/v3/users/2e1341253c2c40f986039ce69e1cda85 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:30:05.593150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:05.593443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:05.593729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:05.632545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:05.634400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:05.729178 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1364/2730] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:05.751464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:05.753061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:05.831002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959151e-839d-48c7-94e0-c1a75a2dd3dc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:05.835306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1df105-e9c1-44f8-9ceb-78e9e42a70e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:05.835805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df105-e9c1-44f8-9ceb-78e9e42a70e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:05.836149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df105-e9c1-44f8-9ceb-78e9e42a70e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:05.836775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df105-e9c1-44f8-9ceb-78e9e42a70e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:05.849221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1df105-e9c1-44f8-9ceb-78e9e42a70e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:05.850665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1df105-e9c1-44f8-9ceb-78e9e42a70e1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:05.862614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1367/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:30:07.680584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:07.682824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:07.695950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b117054-2f3f-449d-bc1e-0d79078f2f2f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:07.701359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:07.702528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:07.702972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:07.704045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] PATH_INFO: `/v3/projects/771c0fc94e084c97a1359a1827c432f3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:07.705668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771c0fc94e084c97a1359a1827c432f3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:07.709732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:07.812844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771c0fc94e084c97a1359a1827c432f3', 'request_id': 'req-23a7bddb-ab68-4516-a542-f656dfb3bcb9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:07.818913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771c0fc94e084c97a1359a1827c432f3', 'request_id': 'req-23a7bddb-ab68-4516-a542-f656dfb3bcb9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:07.825838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771c0fc94e084c97a1359a1827c432f3', 'request_id': 'req-23a7bddb-ab68-4516-a542-f656dfb3bcb9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:07.839781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:07.850027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] The token cache is being invalidate because project 771c0fc94e084c97a1359a1827c432f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:30:07.850542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:07.851600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23a7bddb-ab68-4516-a542-f656dfb3bcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:07.854165 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1365/2732] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:30:07 2022] DELETE /identity/v3/projects/771c0fc94e084c97a1359a1827c432f3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:30:07.859947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:07.860472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:07.860595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:07.887312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:07.889066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:07.984610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1368/2733] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:08.051456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.051750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.052029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.077369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:08.079329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:08.091168 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1366/2734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:08.092080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.098611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:08.106557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3793358-0dab-4d66-9d51-ad71617eee83 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:08.114880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:08.115827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.116120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.116399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.117808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:30:08.118123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:08.119820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:08.136775 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1369/2735] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:30:08.138541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.148560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec15e7-1536-426a-9082-70293de0939e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:08.154135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:08.154617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.154901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.155175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.155923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:08.159051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:08.197294 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1367/2736] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:30:08 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:30:08.199680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.212824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94149ea5-b121-45d7-a0a6-60cee4ef1c95 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:08.309806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:08.310544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.310923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.311333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.312244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:08.315021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:08.347598 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1370/2737] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:30:08 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:30:08.350289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.365950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a3bc-3871-4004-97ef-13e127cce241 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:08.377794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:08.378521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.390065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.390660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.391793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:08.393868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:08.406877 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1368/2738] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:30:08.411103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.426147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc7c0-1fe7-4f22-b311-086960e8b5cd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:08.432801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d7c72-7fef-4a9b-bdd9-b16802149528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:08.433497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7c72-7fef-4a9b-bdd9-b16802149528 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.434980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7c72-7fef-4a9b-bdd9-b16802149528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.434980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d7c72-7fef-4a9b-bdd9-b16802149528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.434980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d7c72-7fef-4a9b-bdd9-b16802149528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:08.436407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d7c72-7fef-4a9b-bdd9-b16802149528 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:08.457705 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1371/2739] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:30:08.458101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.469409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66309-13c4-491c-bff5-cb6acef7e699 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:08.476092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:08.476758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.477066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.477343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] PATH_INFO: `/v3/projects/8072e08fc827483684eb2f358cb0b9ac/users/461c391ba5ae4e57885297bfaf4a3c5e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.499009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8072e08fc827483684eb2f358cb0b9ac, user_id=461c391ba5ae4e57885297bfaf4a3c5e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:08.504356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:08.531778 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1369/2740] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:30:08 2022] PUT /identity/v3/projects/8072e08fc827483684eb2f358cb0b9ac/users/461c391ba5ae4e57885297bfaf4a3c5e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:30:08.543566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:08.543857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:08.544135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:08.578268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] MFA Rules not processed for user `461c391ba5ae4e57885297bfaf4a3c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:08.579814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:08.693002 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1372/2741] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:08.962130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:08.964043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:09.141707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a3f8-d44b-4a12-bac1-bbbd719baf37 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:09.181570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:09.183367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:09.183654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:09.185001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:09.207031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:09.209235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:09.225547 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1370/2742] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:09.792281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:09.796246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:09.931685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:09.939598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2626fd-e8e2-4e57-930c-13faa754d2bd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:09.955022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:09.955677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:09.955962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:09.956238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] PATH_INFO: `/v3/users/000b799366da44838465be08b88fb27d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:09.957535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000b799366da44838465be08b88fb27d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:09.959468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:10.046227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000b799366da44838465be08b88fb27d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.078645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000b799366da44838465be08b88fb27d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.080732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000b799366da44838465be08b88fb27d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.095816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000b799366da44838465be08b88fb27d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.096492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000b799366da44838465be08b88fb27d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.116202 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1373/2743] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:30:09 2022] DELETE /identity/v3/users/000b799366da44838465be08b88fb27d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:30:10.336531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:10.365679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51b597-19a9-4470-bef9-fda09888ddc3 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:10.383714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:10.385383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:10.445188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:10.446376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.447056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.448660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] PATH_INFO: `/v3/users/461c391ba5ae4e57885297bfaf4a3c5e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.450172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461c391ba5ae4e57885297bfaf4a3c5e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:10.452340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:10.495107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94611fa-e8ac-40a0-9f5f-0a5e86b05d46 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:10.495586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:10.502907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:10.503666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.504297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.504787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] PATH_INFO: `/v3/projects/92e7bf1499e6408da408d85bddc4d95b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.506226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e7bf1499e6408da408d85bddc4d95b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:10.508477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:10.576831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461c391ba5ae4e57885297bfaf4a3c5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.584115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e7bf1499e6408da408d85bddc4d95b', 'request_id': 'req-47f226a2-394d-4c43-bee7-5f2dc6efe799'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.594961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e7bf1499e6408da408d85bddc4d95b', 'request_id': 'req-47f226a2-394d-4c43-bee7-5f2dc6efe799'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.602258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e7bf1499e6408da408d85bddc4d95b', 'request_id': 'req-47f226a2-394d-4c43-bee7-5f2dc6efe799'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.602455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461c391ba5ae4e57885297bfaf4a3c5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.603351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461c391ba5ae4e57885297bfaf4a3c5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.617619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461c391ba5ae4e57885297bfaf4a3c5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.618504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c656436f-dc48-48b6-bbb5-6462a51d2ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461c391ba5ae4e57885297bfaf4a3c5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.619631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] The token cache is being invalidate because project 92e7bf1499e6408da408d85bddc4d95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:30:10.621293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.622148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f226a2-394d-4c43-bee7-5f2dc6efe799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:10.624873 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1374/2744] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:30:10 2022] DELETE /identity/v3/projects/92e7bf1499e6408da408d85bddc4d95b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:30:10.630833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ba124-d1a1-4272-80f2-a338374ffc87 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.631399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ba124-d1a1-4272-80f2-a338374ffc87 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.631620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ba124-d1a1-4272-80f2-a338374ffc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.635145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1371/2745] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:30:10 2022] DELETE /identity/v3/users/461c391ba5ae4e57885297bfaf4a3c5e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:30:10.639264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.639592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.639872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.657629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:10.667782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-513ba124-d1a1-4272-80f2-a338374ffc87 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:10.669032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:10.669680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-513ba124-d1a1-4272-80f2-a338374ffc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:10.670269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:10.752537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1372/2746] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:10.761859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1375/2747] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:10.763592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:10.765103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:10.837646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.838221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.838221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.883097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fcda8-48ba-46d1-8f4b-b714c0196b0d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:10.891932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:10.893286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:10.899357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:10.900410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.900848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.901983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.914181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:10.916467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:10.928576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1376/2748] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:10.930641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:10.931147 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1373/2749] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:10.956764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff65ad-d419-46bd-9e3a-7bdbe59fff22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:10.970448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:10.971263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:10.971650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:10.972022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:10.972794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:30:10.973227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:10.975212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.010122 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1377/2750] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:30:11.014431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.028509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6ad6b-958c-4ab9-a8dc-24ec999712ad service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.042419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.043043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.043332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.043883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.044573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.046493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.088504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1374/2751] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:30:11 2022] POST /identity/v3/projects => generated 397 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:30:11.092533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.104065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbda2c1-c33b-4189-b01d-6d4919a46e49 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.184823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.185559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.185881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.186114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.186773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.189236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.221092 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1378/2752] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:30:11 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:30:11.224406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.237804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded72c6-e4f9-44ce-a26b-54b9239174cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.242951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.243577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.243874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.244569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.244931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.246633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.260034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1375/2753] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:30:11.263891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.281024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c70a08-9d09-4068-9a69-5d7828ce03a5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.286780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344b97-541b-4260-b747-7d7597dfa63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.287625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344b97-541b-4260-b747-7d7597dfa63c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.287909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344b97-541b-4260-b747-7d7597dfa63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.288185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344b97-541b-4260-b747-7d7597dfa63c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.289000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344b97-541b-4260-b747-7d7597dfa63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.290860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344b97-541b-4260-b747-7d7597dfa63c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.304772 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1379/2754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:30:11.309120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.325998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65020b70-5aa3-45d3-bbb4-056957c8f13b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.334483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.335066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.335344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.335633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] PATH_INFO: `/v3/projects/87b237b4e2594addbd899828d222aa9d/users/f596b5b1188a4384a2efdafbd08242ba/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.339368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:11.368625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b237b4e2594addbd899828d222aa9d, user_id=f596b5b1188a4384a2efdafbd08242ba, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.373167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.402782 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1376/2755] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:30:11 2022] PUT /identity/v3/projects/87b237b4e2594addbd899828d222aa9d/users/f596b5b1188a4384a2efdafbd08242ba/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:30:11.409110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.409409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.409691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.433190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:11.434556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:11.554739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1380/2756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:11.578866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.581290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:11.656133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd45df-eecb-47aa-b61e-94284507b6e6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.685836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8cd4-3111-4755-9688-0af957fcd4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.686956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8cd4-3111-4755-9688-0af957fcd4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.688823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8cd4-3111-4755-9688-0af957fcd4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.689556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8cd4-3111-4755-9688-0af957fcd4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.711659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8cd4-3111-4755-9688-0af957fcd4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.713313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8cd4-3111-4755-9688-0af957fcd4f3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.732725 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1377/2757] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:11.951673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:11.954086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:11.969509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f33377-d03d-4b6f-bc60-8ed5e5c9cf91 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:11.976931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:11.979159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:11.979159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:11.979597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] PATH_INFO: `/v3/projects/8072e08fc827483684eb2f358cb0b9ac` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:11.982257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8072e08fc827483684eb2f358cb0b9ac)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:11.984383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:11.987253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:12.111333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8072e08fc827483684eb2f358cb0b9ac', 'request_id': 'req-63ce65e5-a20b-4172-9446-5d0382d589c6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:12.134861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8072e08fc827483684eb2f358cb0b9ac', 'request_id': 'req-63ce65e5-a20b-4172-9446-5d0382d589c6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:12.153740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8072e08fc827483684eb2f358cb0b9ac', 'request_id': 'req-63ce65e5-a20b-4172-9446-5d0382d589c6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:12.170399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] The token cache is being invalidate because project 8072e08fc827483684eb2f358cb0b9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:30:12.170741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:12.171687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63ce65e5-a20b-4172-9446-5d0382d589c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:30:12.179184 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1381/2758] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:30:11 2022] DELETE /identity/v3/projects/8072e08fc827483684eb2f358cb0b9ac => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:30:12.180267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a846-edef-4250-8baa-fbede445d555 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.180525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a846-edef-4250-8baa-fbede445d555 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.180814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214a846-edef-4250-8baa-fbede445d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.212090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a214a846-edef-4250-8baa-fbede445d555 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:12.213844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a214a846-edef-4250-8baa-fbede445d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:12.357553 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1378/2759] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:30:12.367920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.368386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.368745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.391658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:12.393521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:12.405276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1382/2760] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:12.410540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a846-edef-4250-8baa-fbede445d555 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.422838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214a846-edef-4250-8baa-fbede445d555 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.430598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.432537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.433333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.433333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.434406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:30:12.434685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.436469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:12.453184 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1379/2761] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:30:12.457971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.472394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542de38b-7c7f-49ed-bb99-0778f36d08c5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.477508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.478061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.478855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.479143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.479909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.482249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:12.516984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1383/2762] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:30:12 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:30:12.519633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.530045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398febf-1205-41a4-a459-00ff8bfef8de admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.606971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.607749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.608029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.608300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.609242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.611930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:12.640540 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1380/2763] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:30:12 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:30:12.644276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.655800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd779b-afa0-4960-87fd-ba151898ba79 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.662689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.663393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.663751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.664227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.664990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.667277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:12.678581 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1384/2764] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:30:12.682639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.689478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:12.694621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64b175-8f47-488a-9ba6-2449c9a0bb5f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.700685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127743c-19d5-45a2-ba5a-8248aa6a21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.701330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127743c-19d5-45a2-ba5a-8248aa6a21a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.701618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127743c-19d5-45a2-ba5a-8248aa6a21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.701891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127743c-19d5-45a2-ba5a-8248aa6a21a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.702537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127743c-19d5-45a2-ba5a-8248aa6a21a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.704655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127743c-19d5-45a2-ba5a-8248aa6a21a7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:12.719508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1381/2765] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:30:12.721270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.732527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beb722-8e12-4085-8fdf-d0b448a1f590 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.738397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.738622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.738976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.739321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] PATH_INFO: `/v3/projects/f42fe97af30047fd999c08abc89dc2ea/users/9af06771f33b4bff85a7ec7bb746a44b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.755859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42fe97af30047fd999c08abc89dc2ea, user_id=9af06771f33b4bff85a7ec7bb746a44b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.759144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:12.777216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1385/2766] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:30:12 2022] PUT /identity/v3/projects/f42fe97af30047fd999c08abc89dc2ea/users/9af06771f33b4bff85a7ec7bb746a44b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:30:12.783716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb27924-1ff5-475d-ae1d-2caf45d4cb29 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.784423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb27924-1ff5-475d-ae1d-2caf45d4cb29 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.784423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb27924-1ff5-475d-ae1d-2caf45d4cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.805950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cfb27924-1ff5-475d-ae1d-2caf45d4cb29 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:12.807299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cfb27924-1ff5-475d-ae1d-2caf45d4cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:12.877653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1382/2767] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:12.888815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:12.891344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:12.972920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de68ab-7042-42fa-83e3-59c25ef68cd0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:12.979097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeacc5-ffd6-4cf1-a50a-deb7ccf8f5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:12.979743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeacc5-ffd6-4cf1-a50a-deb7ccf8f5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:12.980029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeacc5-ffd6-4cf1-a50a-deb7ccf8f5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:12.980306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeacc5-ffd6-4cf1-a50a-deb7ccf8f5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:12.990265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adeacc5-ffd6-4cf1-a50a-deb7ccf8f5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:12.991694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adeacc5-ffd6-4cf1-a50a-deb7ccf8f5a1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:13.002564 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1386/2768] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:15.957644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a047d7-d7de-4750-aac1-47614d953b6d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:15.958197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a047d7-d7de-4750-aac1-47614d953b6d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:15.958197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a047d7-d7de-4750-aac1-47614d953b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:15.982964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-40a047d7-d7de-4750-aac1-47614d953b6d None None] MFA Rules not processed for user `368f6c3db9f24561a13f48ce02e7655e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:15.984977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-40a047d7-d7de-4750-aac1-47614d953b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:16.115007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1383/2769] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:21.935046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:21.935604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:21.935604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:21.972626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] MFA Rules not processed for user `9af06771f33b4bff85a7ec7bb746a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:21.974626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:21.995368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:22.069727 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1387/2770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:22.080589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3719c7-2edb-42e0-b799-245902fb020a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:22.087654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3719c7-2edb-42e0-b799-245902fb020a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:22.087950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3719c7-2edb-42e0-b799-245902fb020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:22.139929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4e3719c7-2edb-42e0-b799-245902fb020a None None] MFA Rules not processed for user `9af06771f33b4bff85a7ec7bb746a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:22.141415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4e3719c7-2edb-42e0-b799-245902fb020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:22.152319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1384/2771] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:22.684941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:22.686342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:22.806858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31aa5ce-ddc6-4db8-b556-b020dc79ac3c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:22.815942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf83e7-6a86-4644-ab18-52d48ee93c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:22.816739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf83e7-6a86-4644-ab18-52d48ee93c66 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:22.817147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf83e7-6a86-4644-ab18-52d48ee93c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:22.817490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf83e7-6a86-4644-ab18-52d48ee93c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:22.829116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf83e7-6a86-4644-ab18-52d48ee93c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:22.830872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf83e7-6a86-4644-ab18-52d48ee93c66 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:22.844333 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1388/2772] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:24.422935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252126d-af59-4540-b034-ce31ac64cc6e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:24.423881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252126d-af59-4540-b034-ce31ac64cc6e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:24.424344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252126d-af59-4540-b034-ce31ac64cc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:24.445329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f252126d-af59-4540-b034-ce31ac64cc6e None None] MFA Rules not processed for user `c73227214e404f4db779694b8c11779e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:24.446868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f252126d-af59-4540-b034-ce31ac64cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:24.520156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1385/2773] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:26.294881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:26.295377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:26.295900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:26.369825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:26.371246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:26.528949 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1389/2774] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:26.542434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:26.543584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:26.544260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:26.583324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:26.586058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:26.602014 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1386/2775] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:30:27.251347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:27.273790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79b935-b209-4ca8-a487-43c7e94d686a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:27.291976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:27.292816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:27.293134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:27.293416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:27.321695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:27.324926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:27.357255 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1390/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:36.562592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:37.335104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:30:49.307739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:49.328079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12065040-7585-46ca-a7d5-3a911b555af5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:49.333748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:49.334507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:49.334989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:49.335264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:49.337057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:49.404263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:49.411415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8162f-de68-4179-9273-29bda5455bba service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:49.426869 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1387/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:51.756484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:30:51.770468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d228e2-0cde-4671-8cfe-884a2068b83b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:30:51.778873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:30:51.779518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:51.779784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:51.780061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:51.782692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:51.871200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:30:51.874186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1a31-2163-436d-9d13-b27e132dba6b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:30:51.893095 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1391/2778] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:30:52.369770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6a4d1-b9d0-4b58-9a8f-1b249a369318 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:52.370646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6a4d1-b9d0-4b58-9a8f-1b249a369318 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:52.371119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6a4d1-b9d0-4b58-9a8f-1b249a369318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:52.420342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9dd6a4d1-b9d0-4b58-9a8f-1b249a369318 None None] MFA Rules not processed for user `118c1425677b45b98689befb0eb55cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:52.421697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9dd6a4d1-b9d0-4b58-9a8f-1b249a369318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:52.552405 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1388/2779] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:54.091096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd3cc3-ad63-4c9a-84ab-da052d578677 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:54.091670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd3cc3-ad63-4c9a-84ab-da052d578677 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:54.092589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd3cc3-ad63-4c9a-84ab-da052d578677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:54.116305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5edd3cc3-ad63-4c9a-84ab-da052d578677 None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:54.117996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5edd3cc3-ad63-4c9a-84ab-da052d578677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:54.136624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1392/2780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:54.201432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b6bb7-cf4a-44c6-88d3-f73e9547311a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:54.201950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b6bb7-cf4a-44c6-88d3-f73e9547311a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:54.202063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b6bb7-cf4a-44c6-88d3-f73e9547311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:54.229112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b23b6bb7-cf4a-44c6-88d3-f73e9547311a None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:54.230600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b23b6bb7-cf4a-44c6-88d3-f73e9547311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:54.240839 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1389/2781] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:54.272687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d2cc-4a27-4c14-9bef-fd99a75e8112 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:54.273263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d2cc-4a27-4c14-9bef-fd99a75e8112 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:54.273789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6d2cc-4a27-4c14-9bef-fd99a75e8112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:54.356420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1af6d2cc-4a27-4c14-9bef-fd99a75e8112 None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:54.358290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1af6d2cc-4a27-4c14-9bef-fd99a75e8112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:54.377816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1393/2782] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:54.404287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:54.404556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:54.405069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:54.428473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:54.429694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:54.440769 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1390/2783] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:30:54.470320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:30:54.470877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:30:54.471806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:30:54.502521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] MFA Rules not processed for user `f596b5b1188a4384a2efdafbd08242ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:30:54.503728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:30:54.512150 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1394/2784] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:00.524927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:00.540863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ec119-47ff-4970-b997-171c0c44ac0c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:00.545756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:00.546781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:00.547064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:00.547340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] PATH_INFO: `/v3/users/9af06771f33b4bff85a7ec7bb746a44b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:00.548820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af06771f33b4bff85a7ec7bb746a44b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:00.551004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:00.603347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af06771f33b4bff85a7ec7bb746a44b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:00.623953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af06771f33b4bff85a7ec7bb746a44b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:00.625836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af06771f33b4bff85a7ec7bb746a44b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:00.635622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af06771f33b4bff85a7ec7bb746a44b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:00.636279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-009544b2-a92d-4df1-8888-5ed8073d2822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af06771f33b4bff85a7ec7bb746a44b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:00.645972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:00.658724 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1391/2785] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:00 2022] DELETE /identity/v3/users/9af06771f33b4bff85a7ec7bb746a44b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:01.390293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:01.406370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b1d25-7c01-49e3-9f5c-8ec66d841956 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:01.490977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:01.491838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.492223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.492577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] PATH_INFO: `/v3/projects/f42fe97af30047fd999c08abc89dc2ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.494339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42fe97af30047fd999c08abc89dc2ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:01.496203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:01.559305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42fe97af30047fd999c08abc89dc2ea', 'request_id': 'req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:01.569130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42fe97af30047fd999c08abc89dc2ea', 'request_id': 'req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:01.576942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42fe97af30047fd999c08abc89dc2ea', 'request_id': 'req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:01.592437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] The token cache is being invalidate because project f42fe97af30047fd999c08abc89dc2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:31:01.592755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:01.594081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d0dfcbf8-5285-4a52-bd03-cd461c466dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:01.595945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1395/2786] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:31:01 2022] DELETE /identity/v3/projects/f42fe97af30047fd999c08abc89dc2ea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:01.601124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.601617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.601735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.621773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:01.622918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:01.695213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1392/2787] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:01.703848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54929-c486-46da-9142-4477086ea377 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.704131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54929-c486-46da-9142-4477086ea377 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.704418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca54929-c486-46da-9142-4477086ea377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.713196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:01.725659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aca54929-c486-46da-9142-4477086ea377 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:01.727737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aca54929-c486-46da-9142-4477086ea377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:01.737608 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1396/2788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:01.741729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:01.753439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5b8c-5279-4442-b9be-7be3fab01e39 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:01.758852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:01.759144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.759498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.760124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.760577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:31:01.761286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:01.763329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:01.783024 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1393/2789] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:31:01.787540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca54929-c486-46da-9142-4477086ea377 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:01.797020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca54929-c486-46da-9142-4477086ea377 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:01.801885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:01.802487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.802768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.803048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.803685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:01.805628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:01.835130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1397/2790] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:31:01 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:01.839518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:01.850394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a32c4-a8ed-4836-b1c8-c784d3694bbf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:01.922996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:01.923602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.923938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.924415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.924855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:01.927149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:01.950642 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1394/2791] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:31:01 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:01.953030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:01.963783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2feef-8325-42fd-b14a-0474fe2e0ee5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:01.969823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:01.970481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:01.970813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:01.970988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:01.971627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:01.973278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:01.990850 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1398/2792] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:01.992804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:02.005514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acc8f-c340-4150-885f-5dbdcd754ba0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:02.010764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6535b-3aa4-4c4e-bc6f-f52701dcae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:02.011467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6535b-3aa4-4c4e-bc6f-f52701dcae4a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:02.011829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6535b-3aa4-4c4e-bc6f-f52701dcae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:02.012172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6535b-3aa4-4c4e-bc6f-f52701dcae4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:02.012961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6535b-3aa4-4c4e-bc6f-f52701dcae4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:02.015600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6535b-3aa4-4c4e-bc6f-f52701dcae4a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:02.035793 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1395/2793] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:02.038812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:02.049190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975480cc-173f-4b3b-8069-e6af26c1b488 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:02.053698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:02.054384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:02.054667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:02.054947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] PATH_INFO: `/v3/projects/c96108fae56640b6aa0cb68523504c43/users/9925b3a9a63c4b1cb98a8adcc28f916d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:02.071975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96108fae56640b6aa0cb68523504c43, user_id=9925b3a9a63c4b1cb98a8adcc28f916d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:02.074694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:02.089063 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1399/2794] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:31:02 2022] PUT /identity/v3/projects/c96108fae56640b6aa0cb68523504c43/users/9925b3a9a63c4b1cb98a8adcc28f916d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:31:02.095404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:02.096786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:02.096786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:02.120072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:02.121422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:02.192629 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1396/2795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:02.203044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:02.204807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:02.269576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997328b7-5a4d-43b3-a9a4-ea30c886a341 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:02.274819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:02.275446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:02.275726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:02.275997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:02.294404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:02.297018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:02.310411 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1400/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:06.209717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:06.211261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:06.224684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:06.232878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9fb36-e164-4a35-aa4a-fa4ea548af18 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:06.245480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:06.246129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:06.246590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:06.247032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] PATH_INFO: `/v3/users/f596b5b1188a4384a2efdafbd08242ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:06.250187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f596b5b1188a4384a2efdafbd08242ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:06.257152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:06.359680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f596b5b1188a4384a2efdafbd08242ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:06.379498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f596b5b1188a4384a2efdafbd08242ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:06.380441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f596b5b1188a4384a2efdafbd08242ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:06.391166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f596b5b1188a4384a2efdafbd08242ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:06.392260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e9d9e43f-5705-404a-bc72-76aff38282e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f596b5b1188a4384a2efdafbd08242ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:06.411550 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1397/2797] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:06 2022] DELETE /identity/v3/users/f596b5b1188a4384a2efdafbd08242ba => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:06.797969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:06.810858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ee5c-2a1f-49a0-bd0f-b150ef46e847 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:06.910324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:06.911968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:06.912833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:06.912975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] PATH_INFO: `/v3/projects/87b237b4e2594addbd899828d222aa9d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:06.915257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b237b4e2594addbd899828d222aa9d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:06.920480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:06.999262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:07.005801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b237b4e2594addbd899828d222aa9d', 'request_id': 'req-f5f93038-ac26-40a9-97c2-13f1ec441ffd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:07.016617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b237b4e2594addbd899828d222aa9d', 'request_id': 'req-f5f93038-ac26-40a9-97c2-13f1ec441ffd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:07.024649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b237b4e2594addbd899828d222aa9d', 'request_id': 'req-f5f93038-ac26-40a9-97c2-13f1ec441ffd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:07.045538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] The token cache is being invalidate because project 87b237b4e2594addbd899828d222aa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:31:07.046526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:07.047607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f5f93038-ac26-40a9-97c2-13f1ec441ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:07.055677 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1401/2798] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:31:06 2022] DELETE /identity/v3/projects/87b237b4e2594addbd899828d222aa9d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:31:07.057808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.058115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.058396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.079598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:07.080965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:07.157192 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1398/2799] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:07.165484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.167116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.167564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.210174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:07.217284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:07.234396 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1402/2800] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:07.239372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.251183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499def2-a360-4c75-8d7b-8ec096af5abf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:07.257206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:07.258027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.258413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.259278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.260229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:31:07.260646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:07.262468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:07.291803 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1399/2801] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:31:07.293064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.305443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d6e81-e46b-47e2-975d-ac006a70e032 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:07.310444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:07.311086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.311354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.312779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.313656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:07.315940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:07.391667 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1403/2802] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:31:07 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:07.396688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.410213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94155c9-d309-48d3-a59b-8fbae7ef14b5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:07.514083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:07.515708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.515708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.516214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.517079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:07.519319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:07.532617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:07.565150 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1400/2803] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:31:07 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:07.566219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.613178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3aa2e-8663-4f10-8e78-cac2eaf3ef26 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:07.621477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:07.622108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.622398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.622677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.623337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:07.626187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:07.640953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1404/2804] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:07.643604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.661433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f7d7a-640d-42e6-bdd4-87f9a2fd177d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:07.675177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d1fd8-26d5-4c2d-b95f-4300e07f9fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:07.676102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1fd8-26d5-4c2d-b95f-4300e07f9fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.676537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1fd8-26d5-4c2d-b95f-4300e07f9fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.676975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d1fd8-26d5-4c2d-b95f-4300e07f9fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.677806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1fd8-26d5-4c2d-b95f-4300e07f9fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:07.688536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d1fd8-26d5-4c2d-b95f-4300e07f9fd7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:07.705994 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1401/2805] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:07.708626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.728551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561270d6-cb6f-43b8-9418-5c3de7612887 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:07.736819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:07.737540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.737819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.738091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] PATH_INFO: `/v3/projects/1c46317b81ae456ebfb65d1d3eb0906e/users/3f6748c4cd29482ca1bcfee6781a0cf3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.781103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c46317b81ae456ebfb65d1d3eb0906e, user_id=3f6748c4cd29482ca1bcfee6781a0cf3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:07.784172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:07.810278 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1405/2806] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:31:07 2022] PUT /identity/v3/projects/1c46317b81ae456ebfb65d1d3eb0906e/users/3f6748c4cd29482ca1bcfee6781a0cf3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:07.815428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d9ba-9320-45a4-97ab-880ca2230bce None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:07.815714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d9ba-9320-45a4-97ab-880ca2230bce None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:07.815994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d9ba-9320-45a4-97ab-880ca2230bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:07.836845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-21e3d9ba-9320-45a4-97ab-880ca2230bce None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:07.838089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21e3d9ba-9320-45a4-97ab-880ca2230bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:07.916011 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1402/2807] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:07.927497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:07.929330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:08.016839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85f476-be34-4063-8498-acaa6e5f4106 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:08.021888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:08.023998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:08.024464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:08.025054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:08.039828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:08.041615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:08.056378 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1406/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:08.410635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772b1f-1dc1-4cba-b60d-dd6cd585c0eb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:08.411217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772b1f-1dc1-4cba-b60d-dd6cd585c0eb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:08.411326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772b1f-1dc1-4cba-b60d-dd6cd585c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:08.446652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-41772b1f-1dc1-4cba-b60d-dd6cd585c0eb None None] MFA Rules not processed for user `9925b3a9a63c4b1cb98a8adcc28f916d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:08.447963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-41772b1f-1dc1-4cba-b60d-dd6cd585c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:08.535832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1403/2809] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:31:08.547965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:08.549690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:08.665069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97cf6-7d4a-43cf-9837-6b585ede8a23 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:08.672203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd97e-a238-4a20-a439-b944e04d80e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:08.673102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd97e-a238-4a20-a439-b944e04d80e7 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:08.673390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd97e-a238-4a20-a439-b944e04d80e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:08.673665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd97e-a238-4a20-a439-b944e04d80e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:08.685724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd97e-a238-4a20-a439-b944e04d80e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:08.690622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd97e-a238-4a20-a439-b944e04d80e7 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:08.696098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:08.703920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1407/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:31:09.351144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:09.351673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:09.352156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:09.375537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] MFA Rules not processed for user `9925b3a9a63c4b1cb98a8adcc28f916d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:09.376846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:09.383913 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1404/2811] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:14.027976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:14.028475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:14.028684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:14.087784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] MFA Rules not processed for user `3f6748c4cd29482ca1bcfee6781a0cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:14.089397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:14.192847 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1408/2812] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:14.193767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:14.207597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d98f7b-39a4-45ce-ba70-4933b28bb76e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:14.213203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:14.214276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:14.215043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:14.215591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:14.216461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:14.220144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:14.263483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:14.271207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1405/2813] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:31:14 2022] POST /identity/v3/projects => generated 405 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:14.275684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cc0ef-fe67-4bd1-9810-92599e2d86b0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:14.393706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:14.395624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:14.395624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:14.395624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:14.401073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:14.403440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:14.472714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1409/2814] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:31:14 2022] POST /identity/v3/users => generated 303 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:31:14.473373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:14.485287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa7695-1382-46a4-96ee-b7cefa161cb4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:14.494001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:14.495023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:14.495446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:14.495869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:14.497157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:14.508126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:14.532381 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1406/2815] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:14.535390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:14.548191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67542c-5c67-4280-93c2-0dd778ce439b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:14.566983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace15e-1267-4990-983a-d2a223c6474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:14.567669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace15e-1267-4990-983a-d2a223c6474b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:14.567963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace15e-1267-4990-983a-d2a223c6474b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:14.568245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace15e-1267-4990-983a-d2a223c6474b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:14.568960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace15e-1267-4990-983a-d2a223c6474b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:14.570571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace15e-1267-4990-983a-d2a223c6474b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:14.597762 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1410/2816] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:14.602654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:14.617913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5755dd-a56a-4013-84d1-40a9cc1d0d1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:14.623421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119f563-de4f-42fc-9272-d778f9912fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:14.624828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f563-de4f-42fc-9272-d778f9912fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:14.625427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f563-de4f-42fc-9272-d778f9912fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:14.625800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f563-de4f-42fc-9272-d778f9912fc0 admin admin] PATH_INFO: `/v3/projects/4386dc7d86894345bf78700e0cd419ab/users/e364f959cf53436290bc2bb897e1f5c8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:14.645480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119f563-de4f-42fc-9272-d778f9912fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4386dc7d86894345bf78700e0cd419ab, user_id=e364f959cf53436290bc2bb897e1f5c8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:14.648547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119f563-de4f-42fc-9272-d778f9912fc0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:14.678703 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1407/2817] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:31:14 2022] PUT /identity/v3/projects/4386dc7d86894345bf78700e0cd419ab/users/e364f959cf53436290bc2bb897e1f5c8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:20.441673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:20.444148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:20.444436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:20.480223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] MFA Rules not processed for user `e364f959cf53436290bc2bb897e1f5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:20.481671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:20.569686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:20.591520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:20.592099 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1411/2818] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:20.592226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:20.592389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:20.613819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] MFA Rules not processed for user `3f6748c4cd29482ca1bcfee6781a0cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:20.615039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:20.619470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:20.694104 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1408/2819] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:20 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:20.705574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:20.707092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:20.805968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe47e94-085f-4516-961d-a45809eca4fd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:20.813696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb44db-0474-49cb-8fec-56123361cd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:20.814517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb44db-0474-49cb-8fec-56123361cd31 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:20.814802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb44db-0474-49cb-8fec-56123361cd31 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:20.815078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb44db-0474-49cb-8fec-56123361cd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:20.825057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb44db-0474-49cb-8fec-56123361cd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:20.830828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb44db-0474-49cb-8fec-56123361cd31 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:20.845108 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1412/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:20 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:30.684763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=21 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:30.837386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=36 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:31.486102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:31.488171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:31.615193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf8037-88f9-4150-8b4d-56df0ecc5f44 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:31.620784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:31.621610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:31.622063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:31.622491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] PATH_INFO: `/v3/users/d698bef448a74da2ac299d978c5a6c66` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:31.624043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d698bef448a74da2ac299d978c5a6c66)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:31.626691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:31.720289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd698bef448a74da2ac299d978c5a6c66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:31.753832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd698bef448a74da2ac299d978c5a6c66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:31.754922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd698bef448a74da2ac299d978c5a6c66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:31.767902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd698bef448a74da2ac299d978c5a6c66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:31.769858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd698bef448a74da2ac299d978c5a6c66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:31.791925 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1409/2821] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:31 2022] DELETE /identity/v3/users/d698bef448a74da2ac299d978c5a6c66 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:31.792941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:31.793241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:31.793525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:31.822183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:31.823915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:31.934308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1413/2822] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:31:31.954726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:31.958375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:32.062465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904d80-4ec7-4a6e-87f7-d37437d81583 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:32.068156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:32.069100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:32.069591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:32.070028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:32.082586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:32.084731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:32.101226 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1410/2823] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:32.584596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:32.586349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:32.613013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a418c-8380-42fe-88ae-756286177227 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:32.626473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:32.627602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:32.628068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:32.628566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] PATH_INFO: `/v3/projects/68c7d71b3c0143e8b5247b08cff3b280` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:32.630741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68c7d71b3c0143e8b5247b08cff3b280)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:32.633800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:32.694059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68c7d71b3c0143e8b5247b08cff3b280', 'request_id': 'req-828814fa-54d2-4174-b814-d5a5b0d1714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.706548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68c7d71b3c0143e8b5247b08cff3b280', 'request_id': 'req-828814fa-54d2-4174-b814-d5a5b0d1714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.715372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68c7d71b3c0143e8b5247b08cff3b280', 'request_id': 'req-828814fa-54d2-4174-b814-d5a5b0d1714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.730250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] The token cache is being invalidate because project 68c7d71b3c0143e8b5247b08cff3b280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:31:32.730695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.737174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.737174 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1414/2824] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:31:32 2022] DELETE /identity/v3/projects/68c7d71b3c0143e8b5247b08cff3b280 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:32.737534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:32.748242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3b5f2-f5ec-4d57-848b-3cf5dc2adee1 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:32.773236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:32.873849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:32.874818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:32.875362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:32.875812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] PATH_INFO: `/v3/users/cda4b470c6cf4f8691197454fe98464a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:32.877513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda4b470c6cf4f8691197454fe98464a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:32.879766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:32.962148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda4b470c6cf4f8691197454fe98464a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.980819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda4b470c6cf4f8691197454fe98464a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.981895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda4b470c6cf4f8691197454fe98464a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.993570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda4b470c6cf4f8691197454fe98464a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:32.994335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b03ed7e1-0926-44ef-9376-afe4d4fc78e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda4b470c6cf4f8691197454fe98464a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:33.011432 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1411/2825] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:32 2022] DELETE /identity/v3/users/cda4b470c6cf4f8691197454fe98464a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:33.594908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:33.596769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:33.610352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828814fa-54d2-4174-b814-d5a5b0d1714f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:33.682919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:33.683575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:33.683856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:33.684287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] PATH_INFO: `/v3/projects/0c87b47093f543d5b57248ab5ee7fedc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:33.685439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c87b47093f543d5b57248ab5ee7fedc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:33.687605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:33.722721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:33.753513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c87b47093f543d5b57248ab5ee7fedc', 'request_id': 'req-4d5e75cf-4933-4e72-a81a-7fa975e45747'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:33.767005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c87b47093f543d5b57248ab5ee7fedc', 'request_id': 'req-4d5e75cf-4933-4e72-a81a-7fa975e45747'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:33.774547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c87b47093f543d5b57248ab5ee7fedc', 'request_id': 'req-4d5e75cf-4933-4e72-a81a-7fa975e45747'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:33.790395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] The token cache is being invalidate because project 0c87b47093f543d5b57248ab5ee7fedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:31:33.790776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:33.791510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d5e75cf-4933-4e72-a81a-7fa975e45747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:33.793417 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1415/2826] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:31:33 2022] DELETE /identity/v3/projects/0c87b47093f543d5b57248ab5ee7fedc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:33.801617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:33.802269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:33.802269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:33.822961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:33.824259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:33.920215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1412/2827] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:33.928155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:33.928522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:33.928811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:33.951574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:33.952967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:33.961974 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1416/2828] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:31:33.965990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:33.978691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acc49e-1029-4301-a14d-b35bbd00be4f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:33.984609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:33.985333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:33.985615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:33.985885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:33.986538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:31:33.987068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:33.988655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.006462 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1413/2829] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:31:34.007120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:34.023314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc4777-302e-4db5-9851-2f4e03e35135 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:34.029190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:34.029907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.030234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.030598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.031317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:34.033234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.067443 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1417/2830] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:31:34.068688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:34.080388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc8741-db65-4092-b11b-6a5628550611 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:34.109708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:34.180966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:34.180966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.180966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.180966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.181560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:34.181560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.207561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1414/2831] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:31:34 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:34.211632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:34.225054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c921-ef0e-43e9-be73-113e63055cfc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:34.232536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:34.234472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.234835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.235171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.236048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:34.237816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.253391 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1418/2832] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:34.254600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:34.265742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41d87-e1e0-4a48-804b-eee10e3285dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:34.271328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8baa99-1d95-4fc5-b6ce-6537a789cfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:34.272464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baa99-1d95-4fc5-b6ce-6537a789cfaa admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.273019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baa99-1d95-4fc5-b6ce-6537a789cfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.273449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8baa99-1d95-4fc5-b6ce-6537a789cfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.274484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baa99-1d95-4fc5-b6ce-6537a789cfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:34.276382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8baa99-1d95-4fc5-b6ce-6537a789cfaa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.291489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1415/2833] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:31:34.295708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:34.307417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3cb06-c7a2-4e8b-a016-de2ee9a8fe3d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:34.312730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:34.313440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.313724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.314003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] PATH_INFO: `/v3/projects/3526d69fdeff43be95a2760b14b33abc/users/40ee91bc3e4044c588799f3894df24e7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.333574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3526d69fdeff43be95a2760b14b33abc, user_id=40ee91bc3e4044c588799f3894df24e7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:34.336288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.352433 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1419/2834] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:31:34 2022] PUT /identity/v3/projects/3526d69fdeff43be95a2760b14b33abc/users/40ee91bc3e4044c588799f3894df24e7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:31:34.357410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d108-0bbd-46b3-884c-5410487c8a8b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.357680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d108-0bbd-46b3-884c-5410487c8a8b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.358476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9d108-0bbd-46b3-884c-5410487c8a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.379048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-22b9d108-0bbd-46b3-884c-5410487c8a8b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:34.380261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22b9d108-0bbd-46b3-884c-5410487c8a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:34.456587 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1416/2835] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:34.466549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:34.469307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:34.567355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59719e-d37e-4637-ba16-791c18bbd688 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:34.572187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea0e85-abd0-45c6-bded-61b1993d1a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:34.572804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0e85-abd0-45c6-bded-61b1993d1a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:34.573189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0e85-abd0-45c6-bded-61b1993d1a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:34.573526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea0e85-abd0-45c6-bded-61b1993d1a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:34.589799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0e85-abd0-45c6-bded-61b1993d1a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:34.591318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea0e85-abd0-45c6-bded-61b1993d1a12 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:34.614434 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1420/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:35.935120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:35.935602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:35.935784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:35.958223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] MFA Rules not processed for user `9925b3a9a63c4b1cb98a8adcc28f916d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:35.959682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:36.026070 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1417/2837] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:39.699054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:39.699551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:39.699638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:39.771365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] MFA Rules not processed for user `40ee91bc3e4044c588799f3894df24e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:39.774588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:39.836470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:39.879308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1421/2838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:39.896272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:39.898562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:39.963166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:39.988743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fadb0-2733-4ae3-8b42-172aed2731d6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:39.995593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:39.996212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:39.997117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:39.997869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:40.010936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:40.012634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:40.029281 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1418/2839] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:31:40.046640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:40.048736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:40.067657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d557d-5dfb-4977-b318-432e2e1489dd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:40.073869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:40.074556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:40.074911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:40.075260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:40.077923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:40.164408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:40.166212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:40.179389 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1422/2840] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:40 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:48.882773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:48.884234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:48.896742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894825e0-4b6d-4ee9-a9be-bb647486c414 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:48.900313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:48.900988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:48.901226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:48.901502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:48.903260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:48.917638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:48.919074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:48.931291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1419/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:49.356974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:49.376642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a59b2-8be1-4e3c-967d-701465de28cc service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:49.382633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:49.383643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:49.384350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:49.384873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:49.389212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:49.405660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:49.407713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:49.431602 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1423/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:31:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:31:57.059836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:57.062899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:57.098352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d44a6-d56b-446a-ad84-45d0320547ea service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:57.115212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:57.117590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:57.118299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:57.118820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] PATH_INFO: `/v3/users/3f6748c4cd29482ca1bcfee6781a0cf3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:57.122275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6748c4cd29482ca1bcfee6781a0cf3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:57.128673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:57.275789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6748c4cd29482ca1bcfee6781a0cf3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:57.314021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6748c4cd29482ca1bcfee6781a0cf3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:57.315697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6748c4cd29482ca1bcfee6781a0cf3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:57.334379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6748c4cd29482ca1bcfee6781a0cf3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:57.335661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6748c4cd29482ca1bcfee6781a0cf3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:57.401161 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1420/2843] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:57 2022] DELETE /identity/v3/users/3f6748c4cd29482ca1bcfee6781a0cf3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:57.756274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:57.780339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401a265-9c75-42a4-bb78-b77ad7c3d505 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:57.853655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:57.854561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:57.855028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:57.855460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] PATH_INFO: `/v3/projects/1c46317b81ae456ebfb65d1d3eb0906e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:57.856768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c46317b81ae456ebfb65d1d3eb0906e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:57.870629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:58.006454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c46317b81ae456ebfb65d1d3eb0906e', 'request_id': 'req-34fa25cf-8883-4138-9401-f3d1b20a4a8f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.021533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c46317b81ae456ebfb65d1d3eb0906e', 'request_id': 'req-34fa25cf-8883-4138-9401-f3d1b20a4a8f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.039062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c46317b81ae456ebfb65d1d3eb0906e', 'request_id': 'req-34fa25cf-8883-4138-9401-f3d1b20a4a8f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.051887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:58.058996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] The token cache is being invalidate because project 1c46317b81ae456ebfb65d1d3eb0906e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:31:58.062053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.063620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.066106 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1424/2844] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:31:57 2022] DELETE /identity/v3/projects/1c46317b81ae456ebfb65d1d3eb0906e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:58.069983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:58.071428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:58.095536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908c6c3-7a25-4a07-9954-eb6c86a9f2b3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:58.223781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:58.224435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:58.224715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:58.225042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] PATH_INFO: `/v3/users/e364f959cf53436290bc2bb897e1f5c8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:58.226439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e364f959cf53436290bc2bb897e1f5c8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:58.229140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:58.293856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:31:58.305359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e364f959cf53436290bc2bb897e1f5c8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.328585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e364f959cf53436290bc2bb897e1f5c8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.330132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e364f959cf53436290bc2bb897e1f5c8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.361912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e364f959cf53436290bc2bb897e1f5c8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.362831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f13d0e07-420c-41bc-b516-e285df95ff92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e364f959cf53436290bc2bb897e1f5c8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:58.395781 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1421/2845] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:58 2022] DELETE /identity/v3/users/e364f959cf53436290bc2bb897e1f5c8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:59.333909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:59.335362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:59.348132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa25cf-8883-4138-9401-f3d1b20a4a8f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:59.422634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:59.423193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:59.423455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:59.423725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] PATH_INFO: `/v3/projects/4386dc7d86894345bf78700e0cd419ab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:59.425539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4386dc7d86894345bf78700e0cd419ab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:59.428799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:59.498248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4386dc7d86894345bf78700e0cd419ab', 'request_id': 'req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:59.509408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4386dc7d86894345bf78700e0cd419ab', 'request_id': 'req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:59.517368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4386dc7d86894345bf78700e0cd419ab', 'request_id': 'req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:59.533179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] The token cache is being invalidate because project 4386dc7d86894345bf78700e0cd419ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:31:59.533702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:59.538518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce35b50b-d15c-4864-ae96-7dbd8ae5f182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:31:59.545122 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1425/2846] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:31:59 2022] DELETE /identity/v3/projects/4386dc7d86894345bf78700e0cd419ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:31:59.545901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:59.546379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:59.546495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:59.572484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:59.573988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:59.672446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1422/2847] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:59.680081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:59.680659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:59.680974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:59.718580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:31:59.720802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:59.736286 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1426/2848] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:31:59.737155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:59.750417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11f91e-6157-4f3e-a798-dc37c3cd374f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:59.756825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:59.757516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:59.757799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:59.758079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:59.758942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:31:59.759257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:59.760888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:59.783573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:59.785089 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1423/2849] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:31:59.794846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac161-4ddd-4fab-92f2-a644744b14ab None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:59.809973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:59.810721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:59.812488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:59.812488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:59.815763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:59.824114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:59.835649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:31:59.837445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:31:59.862599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180fec6-0be3-4b94-bf91-83b9e46c2795 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:31:59.885606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:31:59.886811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:31:59.887108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:31:59.887991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] PATH_INFO: `/v3/users/40ee91bc3e4044c588799f3894df24e7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:31:59.891983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ee91bc3e4044c588799f3894df24e7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:31:59.899481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:31:59.924451 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1427/2850] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:31:59 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:31:59.924451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.007934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ee91bc3e4044c588799f3894df24e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.008130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a7e75-0532-4390-a6b7-5ed1c3504544 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.013059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.013779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.014066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.014773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.015638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.017973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.027296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:00.027704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ee91bc3e4044c588799f3894df24e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.029211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ee91bc3e4044c588799f3894df24e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.052455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ee91bc3e4044c588799f3894df24e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.053677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ee91bc3e4044c588799f3894df24e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.058025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1428/2851] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:31:59 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:00.060547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.064678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.072981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1424/2852] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:31:59 2022] DELETE /identity/v3/users/40ee91bc3e4044c588799f3894df24e7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:00.103813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fa5cd-5ed4-4d96-b739-8e89c1a72609 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.205198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.206357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.206794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.207355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.208344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.210319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.222298 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1429/2853] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:00.227237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.241058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a6f3-ab3d-4d5c-b2d2-66d791a248dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.247816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc2720-e582-46df-8723-b5177b1ec8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.248537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc2720-e582-46df-8723-b5177b1ec8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.249020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc2720-e582-46df-8723-b5177b1ec8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.249355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc2720-e582-46df-8723-b5177b1ec8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.250076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc2720-e582-46df-8723-b5177b1ec8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.252066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc2720-e582-46df-8723-b5177b1ec8ec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.267138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1425/2854] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:00.270219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.282681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93ca7d-1060-49b5-b9f2-500034763fd4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.297060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.297565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.297847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.298124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] PATH_INFO: `/v3/projects/3b649132448b44278c6dd55cdb6ff3de/users/e4b5243d9ffe46c4b32033da558d1e2c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.317729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b649132448b44278c6dd55cdb6ff3de, user_id=e4b5243d9ffe46c4b32033da558d1e2c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.321312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.349225 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1430/2855] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:00 2022] PUT /identity/v3/projects/3b649132448b44278c6dd55cdb6ff3de/users/e4b5243d9ffe46c4b32033da558d1e2c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:00.354835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.355140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.355482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.367277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:00.380257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.383089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.395784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:00.398203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.490989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34802f2f-666f-4aad-ac04-0485fc2028c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.496894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.498017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.498309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.498591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] PATH_INFO: `/v3/projects/3526d69fdeff43be95a2760b14b33abc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.500612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3526d69fdeff43be95a2760b14b33abc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.503347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.543351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1426/2856] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:00.552144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.553911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.637910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3526d69fdeff43be95a2760b14b33abc', 'request_id': 'req-bd12f358-c194-43a3-a997-e38a4272231d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.647610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a5ce-cf99-481b-83a1-79a3ebd348b9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.656817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3526d69fdeff43be95a2760b14b33abc', 'request_id': 'req-bd12f358-c194-43a3-a997-e38a4272231d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.669825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:00.673132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3526d69fdeff43be95a2760b14b33abc', 'request_id': 'req-bd12f358-c194-43a3-a997-e38a4272231d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.689913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] The token cache is being invalidate because project 3526d69fdeff43be95a2760b14b33abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:00.690466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.691547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd12f358-c194-43a3-a997-e38a4272231d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:00.693642 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1431/2857] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:00 2022] DELETE /identity/v3/projects/3526d69fdeff43be95a2760b14b33abc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:00.698484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26df70-01a5-43bb-87e7-ea53106a7b12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.698781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26df70-01a5-43bb-87e7-ea53106a7b12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.699048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26df70-01a5-43bb-87e7-ea53106a7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.724497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ca26df70-01a5-43bb-87e7-ea53106a7b12 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:00.726023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ca26df70-01a5-43bb-87e7-ea53106a7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.740824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.741553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.741844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.742120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.745542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.853352 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1432/2858] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:00.854515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.854807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.855086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.855525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.857045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.876862 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1427/2859] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:00.894435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:00.896768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:00.907083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1433/2860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:00.912165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.929565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27fb83-5636-494f-b97c-deb2d437dc82 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.937483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.938362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.939085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.939085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.939687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:00.940027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.942394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:00.950809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:00.961339 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1428/2861] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:32:00.964973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:00.977302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d71b09-44f0-4e55-9ed5-094551854bd7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:00.984695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:00.985407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:00.985678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:00.985990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:00.986799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:00.990374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.044445 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1434/2862] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:00 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:01.044657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:01.057732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344d949-c86b-4e5e-b292-a37f04050edd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:01.170315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:01.172584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.172953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.173314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.174226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:01.177322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.218754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1429/2863] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:01 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:01.223609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:01.240193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25903420-6079-4dda-a5d2-e95bf40b9c8d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:01.256926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:01.256926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.256926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.256926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.257434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:01.257434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.268869 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1435/2864] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:01.273108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:01.285144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebd72-1fa3-4ea2-b5c5-e3b40f224cfe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:01.290865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58da20c-4d3c-4bbc-ae09-594ac8ad9662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:01.291612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58da20c-4d3c-4bbc-ae09-594ac8ad9662 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.291931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58da20c-4d3c-4bbc-ae09-594ac8ad9662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.292332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58da20c-4d3c-4bbc-ae09-594ac8ad9662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.293086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58da20c-4d3c-4bbc-ae09-594ac8ad9662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:01.294784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58da20c-4d3c-4bbc-ae09-594ac8ad9662 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.306810 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1430/2865] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:01.312132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:01.321688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2c232-b7a8-4cc0-89e4-e1f9268392cc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:01.326144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:01.326831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.327226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.327504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] PATH_INFO: `/v3/projects/91e0286f34a549ed90c758652f0d20ae/users/9f23399a5f1c4af6855a098198ca4ced/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.344027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e0286f34a549ed90c758652f0d20ae, user_id=9f23399a5f1c4af6855a098198ca4ced, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:01.346729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.362217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1436/2866] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:01 2022] PUT /identity/v3/projects/91e0286f34a549ed90c758652f0d20ae/users/9f23399a5f1c4af6855a098198ca4ced/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:01.367109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.367973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.368265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.393040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:01.395830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:01.466083 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1431/2867] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:01.476712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:01.478456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:01.542700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbef9-26af-44b7-9314-88896b174ed0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:01.548438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:01.549262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.549674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.550168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.560244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:01.562427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.572657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1437/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:01.701368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:01.703446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:01.718126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017a4a7-6df9-41f6-a737-b893a8713437 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:01.723296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:01.723964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:01.724677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:01.724677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:01.726819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:01.739478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:01.741676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:01.759894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1432/2869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:02.846440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:02.857515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0082-638e-435e-b085-22ea65c68214 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:02.864601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:02.867782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:02.868085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:02.868400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:02.871999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:02.898323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:02.899773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7d813-a52e-4829-addf-f47f91060818 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:02.925898 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1438/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:05.188862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:05.190307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:05.339973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:05.354816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85fc13-86cf-4281-8bf4-09cb6b346d66 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:05.364317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:05.365251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:05.365748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:05.366226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:05.369042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:05.387810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:05.390444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528c675-b195-45ee-9d07-33f62ab1e6a8 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:05.409900 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1433/2871] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:07.137066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:07.137624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:07.137783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:07.203696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] MFA Rules not processed for user `9f23399a5f1c4af6855a098198ca4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:07.207445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:07.222871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:07.397724 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1439/2872] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:07.408188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:07.408834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:07.409423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:07.445194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] MFA Rules not processed for user `9f23399a5f1c4af6855a098198ca4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:07.446352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:07.463790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1434/2873] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:07.545507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:07.577022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5537-d782-4f8c-99ad-8169a1fb3ca2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:07.583438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafffb5-c028-4c11-b455-6a5471b2bd05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:07.584065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafffb5-c028-4c11-b455-6a5471b2bd05 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:07.584347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafffb5-c028-4c11-b455-6a5471b2bd05 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:07.584623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafffb5-c028-4c11-b455-6a5471b2bd05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:07.608782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafffb5-c028-4c11-b455-6a5471b2bd05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:07.610432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafffb5-c028-4c11-b455-6a5471b2bd05 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:07.632714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1440/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:09.161769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:09.173347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:09.476823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934126f1-602d-44bd-9e38-14d13c9272d0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:09.489125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:09.490006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:09.490445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:09.491549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:09.493901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:09.526880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:09.528873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:09.547989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1435/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:13.799998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:13.800565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:13.800565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:13.874266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] MFA Rules not processed for user `e4b5243d9ffe46c4b32033da558d1e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:13.875751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:14.036332 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1441/2876] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:14.511140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:14.512671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:14.515615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:14.547883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313f730-1515-4556-919a-48fbcd070da8 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:14.555934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e553ea6-9f63-46c9-8551-02d286241578 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:14.558852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92f163-63e9-4e8e-a839-0340bed41900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:14.560752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f163-63e9-4e8e-a839-0340bed41900 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:14.562409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f163-63e9-4e8e-a839-0340bed41900 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:14.563008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92f163-63e9-4e8e-a839-0340bed41900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:14.568198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:14.568981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:14.569288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:14.569539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:14.578379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:14.582953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92f163-63e9-4e8e-a839-0340bed41900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:14.589903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92f163-63e9-4e8e-a839-0340bed41900 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:14.603588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:14.605939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:14.620803 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1436/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:14.628541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1442/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:17.530334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60435071-c0b2-45b3-89b3-3097599a1e87 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:17.531589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60435071-c0b2-45b3-89b3-3097599a1e87 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:17.532304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60435071-c0b2-45b3-89b3-3097599a1e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:17.590147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-60435071-c0b2-45b3-89b3-3097599a1e87 None None] MFA Rules not processed for user `e4b5243d9ffe46c4b32033da558d1e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:17.591806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-60435071-c0b2-45b3-89b3-3097599a1e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:17.604293 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1437/2879] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:22.974997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:22.988267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5349c17-ba51-4ee8-925c-82944ead5ed8 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:23.000968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:23.002338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:23.002772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:23.003219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:23.012048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:23.027992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:23.031865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:23.046137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1443/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:27.574984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=49 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:29.426829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:29.427350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:29.427435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:29.474966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:29.476243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:29.557822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1438/2881] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:32:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:29.648317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:29.649907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:29.785455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:29.810896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683bff9-005d-4ae5-a7b1-c43bc6bd2cfa service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:29.817544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:29.818571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:29.818858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:29.819139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:29.830824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:29.832992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:29.844016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1444/2882] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:32:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:31.515516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:31.518241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:31.556224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5cabc-88d0-4372-9daa-fd19ab0bbf35 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:31.572942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:31.574084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:31.574539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:31.575134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:31.583263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:31.616040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:31.617972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:31.646139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1439/2883] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:32.804581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:32.825633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9def432-0d45-4909-b7b0-6593facdc161 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:32.832397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:32.833935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:32.834395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:32.834821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:32.836953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:32.911130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:32.912728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c1863-6cf0-47d0-b1b4-78c23a78f5df service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:32.931683 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1445/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:36.327029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:36.329220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:36.350801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473ded-42a7-44bc-abfb-492315be8bf4 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:36.364082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:36.365069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:36.365510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:36.365940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] PATH_INFO: `/v3/users/c73227214e404f4db779694b8c11779e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:36.370233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73227214e404f4db779694b8c11779e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:36.372165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:36.552105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73227214e404f4db779694b8c11779e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:36.557501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73227214e404f4db779694b8c11779e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:36.559851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73227214e404f4db779694b8c11779e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:36.581651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73227214e404f4db779694b8c11779e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:36.584390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73227214e404f4db779694b8c11779e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:36.624952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1440/2885] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:36 2022] DELETE /identity/v3/users/c73227214e404f4db779694b8c11779e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:36.626101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:36.626570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:36.626677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:36.664320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:36.666983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:36.797357 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1446/2886] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:32:36.802632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:36.804634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:36.900190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391138-56d1-4008-b4bd-033208e3f7d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:36.907006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ae14d-100b-4344-a3d8-752a126fb5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:36.907751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae14d-100b-4344-a3d8-752a126fb5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:36.908035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae14d-100b-4344-a3d8-752a126fb5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:36.908655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ae14d-100b-4344-a3d8-752a126fb5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:36.930221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae14d-100b-4344-a3d8-752a126fb5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:36.931717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ae14d-100b-4344-a3d8-752a126fb5e0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:36.972566 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1441/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:37.479385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:37.481122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:37.491989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:37.493852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:37.493992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:37.505414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf3d62-9fb4-4648-b410-359a08914552 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:37.510717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:37.516132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:37.525660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:37.525912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:37.526571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:37.527043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] PATH_INFO: `/v3/projects/c6918daa4f884786b45bc88dd1e4e94a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:37.527803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:37.529592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6918daa4f884786b45bc88dd1e4e94a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:37.533471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:37.652645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6918daa4f884786b45bc88dd1e4e94a', 'request_id': 'req-b8e6b598-b1b5-4944-bac1-20961f6a86df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:37.683188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6918daa4f884786b45bc88dd1e4e94a', 'request_id': 'req-b8e6b598-b1b5-4944-bac1-20961f6a86df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:37.710491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6918daa4f884786b45bc88dd1e4e94a', 'request_id': 'req-b8e6b598-b1b5-4944-bac1-20961f6a86df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:37.729672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] The token cache is being invalidate because project c6918daa4f884786b45bc88dd1e4e94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:37.730361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:37.731382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:37.733672 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1442/2888] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:32:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:32:37.749527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:37.750945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1447/2889] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:37 2022] DELETE /identity/v3/projects/c6918daa4f884786b45bc88dd1e4e94a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:37.751117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:37.755638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:37.760858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:37.787250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:37.914989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2498a-69a1-454a-a868-d116514b2b41 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:37.963835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6b598-b1b5-4944-bac1-20961f6a86df admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:37.987098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:37.987098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:37.987098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:37.994469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] PATH_INFO: `/v3/users/6883cff0f7314848a0181495c39d4562` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:37.995529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6883cff0f7314848a0181495c39d4562)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:37.997210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:38.117493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:38.117493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:38.117493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:38.118471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:38.124620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:38.126545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6883cff0f7314848a0181495c39d4562'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:38.162015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6883cff0f7314848a0181495c39d4562'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:38.162899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6883cff0f7314848a0181495c39d4562'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:38.187742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6883cff0f7314848a0181495c39d4562'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:38.188506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6883cff0f7314848a0181495c39d4562'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:38.210613 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1448/2890] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:37 2022] DELETE /identity/v3/users/6883cff0f7314848a0181495c39d4562 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:38.342232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:38.347812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:38.354592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:38.400394 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1443/2891] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:32:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:32:38.970062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:38.971633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:39.161034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60878c-f792-464c-96cd-28fe76711829 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:39.182743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:39.183617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:39.184300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:39.184739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] PATH_INFO: `/v3/users/9925b3a9a63c4b1cb98a8adcc28f916d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:39.187584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9925b3a9a63c4b1cb98a8adcc28f916d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:39.190610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:39.289648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:39.320125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9925b3a9a63c4b1cb98a8adcc28f916d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:39.347492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9925b3a9a63c4b1cb98a8adcc28f916d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:39.348647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9925b3a9a63c4b1cb98a8adcc28f916d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:39.365397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9925b3a9a63c4b1cb98a8adcc28f916d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:39.366705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9925b3a9a63c4b1cb98a8adcc28f916d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:39.402353 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1449/2892] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:38 2022] DELETE /identity/v3/users/9925b3a9a63c4b1cb98a8adcc28f916d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:39.759642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:39.762248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:39.807972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936b6dc-6b39-4bf0-9626-1f2adb562702 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:39.910753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:39.911601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:39.911957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:39.912237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] PATH_INFO: `/v3/projects/c96108fae56640b6aa0cb68523504c43` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:39.928298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96108fae56640b6aa0cb68523504c43)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:39.932555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:40.035723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:40.039134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:40.045652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96108fae56640b6aa0cb68523504c43', 'request_id': 'req-1a4de5ff-918e-4aef-8bca-5499f0efc117'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.057826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96108fae56640b6aa0cb68523504c43', 'request_id': 'req-1a4de5ff-918e-4aef-8bca-5499f0efc117'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.071714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3edb6-693e-4987-bd0a-5194f9a68392 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:40.073784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96108fae56640b6aa0cb68523504c43', 'request_id': 'req-1a4de5ff-918e-4aef-8bca-5499f0efc117'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.118993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] The token cache is being invalidate because project c96108fae56640b6aa0cb68523504c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:40.119447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.120060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1a4de5ff-918e-4aef-8bca-5499f0efc117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.127291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1444/2893] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:39 2022] DELETE /identity/v3/projects/c96108fae56640b6aa0cb68523504c43 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:40.135203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0a4d-cbb1-41e8-a298-c53f1e390cb9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.135499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0a4d-cbb1-41e8-a298-c53f1e390cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.135912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c0a4d-cbb1-41e8-a298-c53f1e390cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.185598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f25c0a4d-cbb1-41e8-a298-c53f1e390cb9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:40.187631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f25c0a4d-cbb1-41e8-a298-c53f1e390cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:40.244975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:40.245644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.245933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.246211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] PATH_INFO: `/v3/projects/ec1802aaa2f44429947b01dc6f5b351d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.247381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1802aaa2f44429947b01dc6f5b351d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:40.251962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:40.339208 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1445/2894] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:40.347850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.348147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.348419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.369670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1802aaa2f44429947b01dc6f5b351d', 'request_id': 'req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.390472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1802aaa2f44429947b01dc6f5b351d', 'request_id': 'req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.400597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1802aaa2f44429947b01dc6f5b351d', 'request_id': 'req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.402022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:40.406871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:40.428646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] The token cache is being invalidate because project ec1802aaa2f44429947b01dc6f5b351d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:40.430836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.431293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94e06ae6-635a-4e5d-8d2b-405faef9bb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:40.441547 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1450/2895] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:40 2022] DELETE /identity/v3/projects/ec1802aaa2f44429947b01dc6f5b351d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:40.447813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258632d-8eb1-40ee-9064-7d1f8d5fe73d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.448098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258632d-8eb1-40ee-9064-7d1f8d5fe73d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.448557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258632d-8eb1-40ee-9064-7d1f8d5fe73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.459475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:40.504790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4258632d-8eb1-40ee-9064-7d1f8d5fe73d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:40.506234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4258632d-8eb1-40ee-9064-7d1f8d5fe73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:40.558915 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1446/2896] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:40.564152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:40.581548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:40.582485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81add5-1156-404f-a9dd-77558da7f46e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:40.601465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:40.602375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.602637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.602913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.603662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:40.604107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:40.605753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:40.631316 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1447/2897] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:32:40.635601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:40.636060 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1451/2898] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:40.644089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.644699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.648987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.667828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429530-4cc2-4007-91d8-5513e0070e8a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:40.681850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:40.682485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.682768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.683046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.683698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:40.685689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:40.711274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:40.712528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:40.722820 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1452/2899] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:40.726719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:40.748742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f3006-e666-4725-99bc-0b88a442a8c9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:40.763068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:40.765149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1448/2900] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/projects => generated 359 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:40.769084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.769269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:40.770679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.771569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.773550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:40.774838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:40.784033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:40.810163 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1453/2901] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:32:40.817392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:40.844275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ab33-b7f3-4fa2-8160-467f5f4382f6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:40.932440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1aff11-043e-4c61-880f-6361842dce4b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:40.951193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:40.951876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:40.952296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:40.952641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:40.953445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:40.955789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:40.996853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1449/2902] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/users => generated 280 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:41.002944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.020668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.021564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.022192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.022658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.023615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.023980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889681ad-f455-48e3-89d2-81dca61bacfe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.025751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.035702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.036323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.036604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.036879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.037561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.039169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.061608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1450/2903] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:41.065523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.084655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd1cd-58c6-4147-9c5a-fbd5b10627da admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.095324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1454/2904] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:40 2022] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:41.098005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.101024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.101793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.102326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.102598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.103253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.105286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.125902 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1451/2905] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:32:41.130012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.154936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70d073-1e50-4097-912c-3e28866cedf3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.259313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded27a64-52ee-429e-8b39-d8cdc1bf61b7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.278305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.278849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.279654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.280830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.280830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.282660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.316364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acd181-b4a5-4838-98c5-d3f14ba4a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.319549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acd181-b4a5-4838-98c5-d3f14ba4a913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.320145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acd181-b4a5-4838-98c5-d3f14ba4a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.320723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acd181-b4a5-4838-98c5-d3f14ba4a913 admin admin] PATH_INFO: `/v3/projects/2f6ff9047ffc4f76862730dabeb6bd0d/users/769c065fada04581aed8b04f86d8a871/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.330957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:41.333226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1455/2906] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:41 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:41.337584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.367241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cf25-6f08-4669-92ce-3ecc40182f9a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.376466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acd181-b4a5-4838-98c5-d3f14ba4a913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6ff9047ffc4f76862730dabeb6bd0d, user_id=769c065fada04581aed8b04f86d8a871, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.379435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acd181-b4a5-4838-98c5-d3f14ba4a913 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.387985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.388732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.389191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.390565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.392456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.397621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.426924 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1452/2907] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:41 2022] PUT /identity/v3/projects/2f6ff9047ffc4f76862730dabeb6bd0d/users/769c065fada04581aed8b04f86d8a871/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:41.438000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.438365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.438555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.445486 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1456/2908] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:41.449452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.477306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e58005-5eed-4084-9366-4ac39850fcd5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.530751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] MFA Rules not processed for user `769c065fada04581aed8b04f86d8a871`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:41.534463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:41.547235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:41.739950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.740578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.740862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.741165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.741823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.743449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.776864 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1457/2909] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:41.781230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.800826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5682d-29e5-48dd-b3ff-edae20eed91b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:41.802062 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1453/2910] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:32:41.808267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb733f-e80b-4d3c-bc36-37de97a783a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:41.809279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb733f-e80b-4d3c-bc36-37de97a783a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.809742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb733f-e80b-4d3c-bc36-37de97a783a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.810204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb733f-e80b-4d3c-bc36-37de97a783a2 admin admin] PATH_INFO: `/v3/projects/a47ec5d2ebf94f92b4458197ead29783/users/beb5506586a046e0bba6f68725375b63/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.814421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:41.816350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:41.866892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb733f-e80b-4d3c-bc36-37de97a783a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47ec5d2ebf94f92b4458197ead29783, user_id=beb5506586a046e0bba6f68725375b63, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:41.875397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb733f-e80b-4d3c-bc36-37de97a783a2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:41.917121 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1458/2911] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:41 2022] PUT /identity/v3/projects/a47ec5d2ebf94f92b4458197ead29783/users/beb5506586a046e0bba6f68725375b63/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:41.921672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:41.921967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:41.922264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:41.974554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] MFA Rules not processed for user `beb5506586a046e0bba6f68725375b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:41.978088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:42.046898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961b93a-2e8b-4584-8211-0d0f8a78ad1d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:42.196067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:42.196722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:42.197026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:42.197297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:42.219145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:42.229368 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1459/2912] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:42.236065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:42.317309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:42.320453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:42.390783 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1454/2913] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:32:42.528061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c132d6a-690d-4067-be92-37a4707ed25c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:42.532376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:42.555309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58dad-8e5c-413e-9c93-128a81836d20 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:42.558635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:42.562850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:42.563264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:42.563648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:42.567179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:42.571780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:42.574397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:42.581419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:42.584673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:42.585664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] PATH_INFO: `/v3/users/769c065fada04581aed8b04f86d8a871` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:42.590984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769c065fada04581aed8b04f86d8a871)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:42.598418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:42.695929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1460/2914] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:42 2022] POST /identity/v3/projects => generated 393 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:42.700974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:42.755186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769c065fada04581aed8b04f86d8a871'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:42.772518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:42.775503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769c065fada04581aed8b04f86d8a871'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:42.776803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769c065fada04581aed8b04f86d8a871'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:42.821768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769c065fada04581aed8b04f86d8a871'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:42.821768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b5e18fc-6472-4ec3-8f4a-a2d68c6e4868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769c065fada04581aed8b04f86d8a871'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:42.877642 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1455/2915] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:42 2022] DELETE /identity/v3/users/769c065fada04581aed8b04f86d8a871 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:42.883156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:42.883461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:42.883729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:42.916964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeb85b-070f-4166-9d10-50cde2c74a9f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:42.923071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:42.924487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:43.066997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:43.068034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:43.070081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:43.070618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:43.074749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:43.079688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:43.088240 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1456/2916] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:43.112256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:43.114082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:43.147907 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1461/2917] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:42 2022] POST /identity/v3/users => generated 303 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:43.148880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:43.159682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:43.179035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:43.186049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b98c5-4c09-4ed4-98cb-4a173c43dfd5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:43.203867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:43.204697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:43.205012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:43.205295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] PATH_INFO: `/v3/users/368f6c3db9f24561a13f48ce02e7655e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:43.209693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=368f6c3db9f24561a13f48ce02e7655e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:43.211768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:43.248477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1eba9f-c61f-43f3-b712-71d4d5169785 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:43.254064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:43.254980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:43.255651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:43.256213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:43.274771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:43.277139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:43.296147 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1457/2918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:43.296147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:43.296147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:43.303422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368f6c3db9f24561a13f48ce02e7655e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:43.310681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561d90c-7e10-48ff-8ec0-3e447097001a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:43.317385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:43.318384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:43.318773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:43.319037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:43.320068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:43.322271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:43.336515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368f6c3db9f24561a13f48ce02e7655e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:43.338627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368f6c3db9f24561a13f48ce02e7655e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:43.353842 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1458/2919] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:43.355213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:43.359617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368f6c3db9f24561a13f48ce02e7655e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:43.360706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:43.361027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368f6c3db9f24561a13f48ce02e7655e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:43.377792 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1462/2920] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:43 2022] DELETE /identity/v3/users/368f6c3db9f24561a13f48ce02e7655e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:43.392138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c647e-e767-4bee-9085-268ae6647cca admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:43.551915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:43.554904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:43.556290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:43.557843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] PATH_INFO: `/v3/projects/38bf706dbd594ca6976e36131cbec776/users/ffad09415c8f47859ad8542ff56d35cf/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:43.600650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bf706dbd594ca6976e36131cbec776, user_id=ffad09415c8f47859ad8542ff56d35cf, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:43.610164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:43.648794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:43.649893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1459/2921] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:43 2022] PUT /identity/v3/projects/38bf706dbd594ca6976e36131cbec776/users/ffad09415c8f47859ad8542ff56d35cf/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:43.665548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7f58b-28dc-4b13-9681-767f3cf80028 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:43.705314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:43.842611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:43.844414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:43.913641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:43.917671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:43.922171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:43.923709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:43.924501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:43.941998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:44.016991 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1463/2922] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:32:44.020604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:44.076593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc751c1-9d56-4f75-ab52-78293d3760fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:44.106178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bf1fa-6cef-4a98-8025-b69b511738d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:44.106883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bf1fa-6cef-4a98-8025-b69b511738d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:44.110900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bf1fa-6cef-4a98-8025-b69b511738d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:44.114004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bf1fa-6cef-4a98-8025-b69b511738d0 admin admin] PATH_INFO: `/v3/projects/38bf706dbd594ca6976e36131cbec776/users/ffad09415c8f47859ad8542ff56d35cf/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:44.128520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bf1fa-6cef-4a98-8025-b69b511738d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bf706dbd594ca6976e36131cbec776, user_id=ffad09415c8f47859ad8542ff56d35cf, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:44.136181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bf1fa-6cef-4a98-8025-b69b511738d0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:44.164686 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1464/2923] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:44 2022] PUT /identity/v3/projects/38bf706dbd594ca6976e36131cbec776/users/ffad09415c8f47859ad8542ff56d35cf/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:44.177731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:44.178098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:44.178374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:44.187705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb9914-6428-4176-b7be-9c3687d5f524 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:44.254912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] MFA Rules not processed for user `ffad09415c8f47859ad8542ff56d35cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:44.259819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:44.350924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:44.417705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:44.418360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:44.418643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:44.418919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] PATH_INFO: `/v3/projects/fecbac50c16847799a85c148c6c143de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:44.421942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecbac50c16847799a85c148c6c143de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:44.423868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:44.431448 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1465/2924] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:32:44.433190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:44.435506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:44.484336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413e652-abe2-4c60-9e0f-9140f74c765a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:44.495531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:44.497429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:44.498826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:44.499168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] PATH_INFO: `/v3/projects/2f6ff9047ffc4f76862730dabeb6bd0d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:44.501709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6ff9047ffc4f76862730dabeb6bd0d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:44.507372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:44.560836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecbac50c16847799a85c148c6c143de', 'request_id': 'req-ca50b7d4-e4cb-46ab-8e55-8e0790530966'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.569436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecbac50c16847799a85c148c6c143de', 'request_id': 'req-ca50b7d4-e4cb-46ab-8e55-8e0790530966'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.577172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecbac50c16847799a85c148c6c143de', 'request_id': 'req-ca50b7d4-e4cb-46ab-8e55-8e0790530966'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.617992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] The token cache is being invalidate because project fecbac50c16847799a85c148c6c143de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:44.618327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.619466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.628717 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1460/2925] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:43 2022] DELETE /identity/v3/projects/fecbac50c16847799a85c148c6c143de => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:44.628717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:44.629606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6ff9047ffc4f76862730dabeb6bd0d', 'request_id': 'req-d96774f7-fedb-440f-be58-6751f2af805c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.633254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:44.660062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6ff9047ffc4f76862730dabeb6bd0d', 'request_id': 'req-d96774f7-fedb-440f-be58-6751f2af805c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.675296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6ff9047ffc4f76862730dabeb6bd0d', 'request_id': 'req-d96774f7-fedb-440f-be58-6751f2af805c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.704568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] The token cache is being invalidate because project 2f6ff9047ffc4f76862730dabeb6bd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:44.704865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.706834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:44.713821 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1466/2926] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:44 2022] DELETE /identity/v3/projects/2f6ff9047ffc4f76862730dabeb6bd0d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:44.716289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:44.718550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:44.755834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:44.831015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50b7d4-e4cb-46ab-8e55-8e0790530966 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:44.891144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96774f7-fedb-440f-be58-6751f2af805c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:44.905044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:44.907864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:44.908208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:44.908491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] PATH_INFO: `/v3/users/78deecd91fde4784af0378a14051af20` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:44.912686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=78deecd91fde4784af0378a14051af20)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:44.915282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:44.981005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:44.983390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:44.983846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:44.984311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:44.988072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:45.011660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:45.024555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78deecd91fde4784af0378a14051af20'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:45.070605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78deecd91fde4784af0378a14051af20'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:45.071371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78deecd91fde4784af0378a14051af20'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:45.083378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78deecd91fde4784af0378a14051af20'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:45.084301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4a2492c2-1e90-4eda-90dc-d0f82b6366ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78deecd91fde4784af0378a14051af20'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:45.117112 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1467/2927] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:44 2022] DELETE /identity/v3/users/78deecd91fde4784af0378a14051af20 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:45.126132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:45.126717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:45.126717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:45.197210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:45.198439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:45.212243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:45.220097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c726128-67a4-4179-aa75-3be405e82ee9 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:45.271685 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1461/2928] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:45.382028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:45.382561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:45.382860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:45.421207 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1468/2929] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:45.423047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:45.424281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:45.453589 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1462/2930] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:32:45.455020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:45.470220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647071f3-4dc7-4c58-a8ee-c880f2e282f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:45.508153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:45.508782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:45.509089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:45.509366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:45.510031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:45.510336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:45.518522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:45.573945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:45.576082 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1469/2931] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:32:45.592808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96e0af-c306-4f2f-a97d-cf6482e39092 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:45.616990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:45.617911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:45.619307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:45.619822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:45.621064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:45.626591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:45.709555 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1463/2932] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:45 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:32:45.710738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:45.730037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48b68e-889e-4bc7-b9f8-1968748fb2a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:45.784841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:45.894719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:45.895633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:45.896205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:45.896653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:45.898624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:45.917101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:45.998502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1470/2933] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:45 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:46.000464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:46.006775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:46.013391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96d91b-5466-4b3e-8244-8a8cd943f424 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:46.015642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:46.050079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:46.050717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.050996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.051269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.051939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:46.053637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:46.119086 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1464/2934] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:32:46.121910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:46.151642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d92fef-083d-4e32-974d-b02fd1743544 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:46.170704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:46.172756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.174930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.175345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.176057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:46.180380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:46.221493 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1465/2935] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:46.222490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:46.228052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:46.251382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b358430-ad87-4a5a-8f04-a45782e5a7ce admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:46.258902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:46.259561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.259845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.260129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] PATH_INFO: `/v3/projects/afbe42c6ef2a4069b0e3633975c402cc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.273578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbe42c6ef2a4069b0e3633975c402cc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:46.275646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:46.328148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07fe49-e854-47c8-a8f9-31caea7b8245 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:46.353339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:46.354052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.354245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.354525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.364205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:46.478426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbe42c6ef2a4069b0e3633975c402cc', 'request_id': 'req-596d69bb-5979-40b2-bf12-b6b2a2af933f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:46.504435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbe42c6ef2a4069b0e3633975c402cc', 'request_id': 'req-596d69bb-5979-40b2-bf12-b6b2a2af933f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:46.527469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbe42c6ef2a4069b0e3633975c402cc', 'request_id': 'req-596d69bb-5979-40b2-bf12-b6b2a2af933f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:46.559005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] The token cache is being invalidate because project afbe42c6ef2a4069b0e3633975c402cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:46.560990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:46.562201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:46.570813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1466/2936] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:46 2022] DELETE /identity/v3/projects/afbe42c6ef2a4069b0e3633975c402cc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:46.573714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:46.579408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:46.598828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:46.603421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4427846-7ca3-4ef5-a0db-0dc37486af11 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:46.629879 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1471/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:46.631479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.633277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.633753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.695908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:46.697197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:46.757388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:46.792995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:46.832157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d69bb-5979-40b2-bf12-b6b2a2af933f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:46.845991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7440a-5c4a-43db-bb00-d069866139cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:46.846692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7440a-5c4a-43db-bb00-d069866139cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.847049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7440a-5c4a-43db-bb00-d069866139cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.847336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7440a-5c4a-43db-bb00-d069866139cc admin admin] PATH_INFO: `/v3/projects/4a08a51781e84e1eb215037744ee3a7b/users/a262a7ca2be4451a89330098b6134c77/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.847732 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1472/2938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:46.848691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:46.851937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:46.872493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7440a-5c4a-43db-bb00-d069866139cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a08a51781e84e1eb215037744ee3a7b, user_id=a262a7ca2be4451a89330098b6134c77, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:46.876662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7440a-5c4a-43db-bb00-d069866139cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:46.900371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eaff2-2991-4bfa-9f1f-b1a58a2701ae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:46.910331 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1467/2939] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:46 2022] PUT /identity/v3/projects/4a08a51781e84e1eb215037744ee3a7b/users/a262a7ca2be4451a89330098b6134c77/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:46.918526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3318b-1731-4aff-8851-430e1ff4305d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:46.918935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3318b-1731-4aff-8851-430e1ff4305d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:46.919225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3318b-1731-4aff-8851-430e1ff4305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:46.948355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3fb3318b-1731-4aff-8851-430e1ff4305d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:46.949764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3fb3318b-1731-4aff-8851-430e1ff4305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:47.104895 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1468/2940] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:47.106494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:47.108718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:47.109056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:47.116049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:47.116718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:47.117022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:47.117296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] PATH_INFO: `/v3/users/beb5506586a046e0bba6f68725375b63` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:47.127842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb5506586a046e0bba6f68725375b63)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:47.129838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:47.147594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:47.150096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:47.170753 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1469/2941] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:47.171940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:47.186174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1338ab8-3e26-40fd-ba21-b55c0015435b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:47.193398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:47.195227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:47.195722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:47.196166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:47.197082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:47.198911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:47.206566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:47.271993 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1470/2942] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:32:47.273130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:47.277544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:47.289460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb5506586a046e0bba6f68725375b63'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:47.322236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb5506586a046e0bba6f68725375b63'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:47.323417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb5506586a046e0bba6f68725375b63'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:47.346263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb5506586a046e0bba6f68725375b63'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:47.348058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb5506586a046e0bba6f68725375b63'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:47.374978 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1473/2943] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:46 2022] DELETE /identity/v3/users/beb5506586a046e0bba6f68725375b63 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:47.376138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:47.377988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:47.454096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea32f82-afc6-4225-bbea-7b69c5334e5e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:47.573859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c229fc-cbba-4a4d-8dc5-6e388df4e9b3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:47.584800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb364-cf6c-4558-b465-5026f9c65e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:47.587946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb364-cf6c-4558-b465-5026f9c65e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:47.588332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb364-cf6c-4558-b465-5026f9c65e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:47.588709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb364-cf6c-4558-b465-5026f9c65e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:47.589516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb364-cf6c-4558-b465-5026f9c65e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:47.591607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb364-cf6c-4558-b465-5026f9c65e55 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:47.617650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:47.665164 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1474/2944] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:47 2022] POST /identity/v3/projects => generated 391 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:47.666644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:47.667042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:47.667422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:47.675782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:47.676421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:47.676777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:47.677681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:47.682105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:47.705337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:47.706797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:47.714949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:47.718348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:47.724437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:47.782469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1471/2945] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:47.783395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:47.841081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9e5f-cda0-43a0-a007-4ae4c0dd194d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:47.897238 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1475/2946] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:47.908662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:47.910251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:48.077419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:48.079404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:48.080045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:48.080536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:48.081786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:48.086006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:48.102277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7be0d-e290-40a8-96f5-640ff28bd154 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:48.123551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:48.123551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:48.123551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:48.123551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:48.124172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:48.124172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:48.139189 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1476/2947] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:32:48.172743 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1472/2948] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:47 2022] POST /identity/v3/users => generated 296 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:48.174089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:48.207965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e1f5-8592-49e0-94b3-87bf70873f8e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:48.218958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:48.220079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:48.220445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:48.221240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:48.222471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:48.228953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:48.257425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1477/2949] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:48.261917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:48.286141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeaddb-2124-4be4-9191-a5bf25551b14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:48.308024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c662ae1-16ec-4090-bad2-051843a04bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:48.311137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662ae1-16ec-4090-bad2-051843a04bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:48.314691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662ae1-16ec-4090-bad2-051843a04bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:48.314874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662ae1-16ec-4090-bad2-051843a04bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:48.316764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c662ae1-16ec-4090-bad2-051843a04bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:48.320891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c662ae1-16ec-4090-bad2-051843a04bbc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:48.378585 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1473/2950] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:48.379200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:48.396406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9caa-04f3-4b86-a87c-834e5d6b5914 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:48.409917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:48.423294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:48.423799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:48.424190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] PATH_INFO: `/v3/projects/0fe5606f9c144deebe561caef3f51f94/users/e71c7cc3619b48a19ac11e6f68b3ec05/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:48.471722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe5606f9c144deebe561caef3f51f94, user_id=e71c7cc3619b48a19ac11e6f68b3ec05, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:48.480248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:48.521838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1478/2951] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:48 2022] PUT /identity/v3/projects/0fe5606f9c144deebe561caef3f51f94/users/e71c7cc3619b48a19ac11e6f68b3ec05/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:48.538663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b95a-9e29-48c5-9846-03f1c6683217 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:48.538972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b95a-9e29-48c5-9846-03f1c6683217 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:48.539381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b95a-9e29-48c5-9846-03f1c6683217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:48.629315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1b81b95a-9e29-48c5-9846-03f1c6683217 None None] MFA Rules not processed for user `e71c7cc3619b48a19ac11e6f68b3ec05`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:48.635888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1b81b95a-9e29-48c5-9846-03f1c6683217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:48.669651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:48.672201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:48.971219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:48.986556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f08bad-d93a-4b74-9432-97201b29cfa7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:49.001457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:49.002407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:49.002869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:49.003299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] PATH_INFO: `/v3/projects/a47ec5d2ebf94f92b4458197ead29783` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:49.005555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47ec5d2ebf94f92b4458197ead29783)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:49.008750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:49.012987 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1474/2952] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:49.016616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:49.017130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:49.018376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:49.072879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] MFA Rules not processed for user `39671ba0b86847f995c96013947fee65`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:49.076298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:49.148048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47ec5d2ebf94f92b4458197ead29783', 'request_id': 'req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.168941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47ec5d2ebf94f92b4458197ead29783', 'request_id': 'req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.180830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47ec5d2ebf94f92b4458197ead29783', 'request_id': 'req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.211431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] The token cache is being invalidate because project a47ec5d2ebf94f92b4458197ead29783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:49.213362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.215820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.223567 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1479/2953] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:48 2022] DELETE /identity/v3/projects/a47ec5d2ebf94f92b4458197ead29783 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:49.226602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:49.229967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:49.246005 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1475/2954] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:49.250130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:49.254502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:49.294167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849ffb7-a91d-462e-b3ad-5fcfd4602c68 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:49.312946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:49.422606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431c898-d35e-4cf8-a2c4-3a54aa8bc535 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:49.454575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:49.456075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:49.458858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:49.459800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:49.461165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:49.475532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:49.520415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:49.526492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:49.528569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:49.531046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] PATH_INFO: `/v3/users/ffad09415c8f47859ad8542ff56d35cf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:49.533686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffad09415c8f47859ad8542ff56d35cf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:49.538096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:49.599842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1480/2955] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:49 2022] POST /identity/v3/projects => generated 391 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:49.605139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:49.707261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffad09415c8f47859ad8542ff56d35cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.737212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffad09415c8f47859ad8542ff56d35cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.738260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffad09415c8f47859ad8542ff56d35cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.773114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffad09415c8f47859ad8542ff56d35cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.774011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffad09415c8f47859ad8542ff56d35cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:49.784774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22aae1-c6dc-434e-9eda-a158e2fdaa32 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:49.793230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:49.793856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:49.794140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:49.794421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:49.795766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:49.798006 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1476/2956] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:49 2022] DELETE /identity/v3/users/ffad09415c8f47859ad8542ff56d35cf => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:49.810837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:49.870914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:49.883062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:49.884639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:49.887204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1481/2957] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:49 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:50.103786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8da04-75f5-4ae3-823e-45148da5b557 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:50.112346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:50.113436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:50.114104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:50.114545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:50.115408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:50.118573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:50.144840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1477/2958] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:32:50.151461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:50.173238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8abd8f-a998-483b-95d2-68014fd007c3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:50.209753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:50.210377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:50.210693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:50.210940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] PATH_INFO: `/v3/projects/946dc3a2bf464af48dab60d1de0c927f/users/70b8324646e540b1b64b370d1e7c5e26/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:50.266266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] RBAC: Authorizing `identity:create_grant(project_id=946dc3a2bf464af48dab60d1de0c927f, user_id=70b8324646e540b1b64b370d1e7c5e26, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:50.268861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:50.303551 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1482/2959] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:50 2022] PUT /identity/v3/projects/946dc3a2bf464af48dab60d1de0c927f/users/70b8324646e540b1b64b370d1e7c5e26/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:50.308767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:50.323209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ebb7-a2b5-4061-b2cc-d656baa7a9de admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:50.394369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:50.451813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596b80f-4b13-408d-ad91-f333ea2d1b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:50.452880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b80f-4b13-408d-ad91-f333ea2d1b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:50.453245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b80f-4b13-408d-ad91-f333ea2d1b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:50.453534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596b80f-4b13-408d-ad91-f333ea2d1b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:50.454207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596b80f-4b13-408d-ad91-f333ea2d1b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:50.456044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596b80f-4b13-408d-ad91-f333ea2d1b3f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:50.472794 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1478/2960] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:50.474263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:50.493696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fc02d-52d9-4aa5-af40-19a601d0993f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:50.515226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:50.515987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:50.516392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:50.516747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] PATH_INFO: `/v3/projects/946dc3a2bf464af48dab60d1de0c927f/users/70b8324646e540b1b64b370d1e7c5e26/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:50.519011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=946dc3a2bf464af48dab60d1de0c927f, user_id=70b8324646e540b1b64b370d1e7c5e26, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:50.521784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:50.568234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1483/2961] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:50 2022] PUT /identity/v3/projects/946dc3a2bf464af48dab60d1de0c927f/users/70b8324646e540b1b64b370d1e7c5e26/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:50.569778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e00e9-ad50-4333-9bd0-61d589c55bfa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:50.570184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e00e9-ad50-4333-9bd0-61d589c55bfa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:50.571311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e00e9-ad50-4333-9bd0-61d589c55bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:50.633190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-562e00e9-ad50-4333-9bd0-61d589c55bfa None None] MFA Rules not processed for user `70b8324646e540b1b64b370d1e7c5e26`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:50.636629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-562e00e9-ad50-4333-9bd0-61d589c55bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:50.758406 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1479/2962] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:50.777007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:50.913865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9a6e4-83a0-4f9c-a63c-dc0f6e3a39b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:50.921121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:50.922012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:50.922400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:50.922783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] PATH_INFO: `/v3/users/e71c7cc3619b48a19ac11e6f68b3ec05` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:50.924344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71c7cc3619b48a19ac11e6f68b3ec05)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:50.928006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:51.021934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71c7cc3619b48a19ac11e6f68b3ec05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.037614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71c7cc3619b48a19ac11e6f68b3ec05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.038460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71c7cc3619b48a19ac11e6f68b3ec05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.056758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71c7cc3619b48a19ac11e6f68b3ec05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.058196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71c7cc3619b48a19ac11e6f68b3ec05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.108103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1484/2963] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:50 2022] DELETE /identity/v3/users/e71c7cc3619b48a19ac11e6f68b3ec05 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:51.114147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:51.114962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:51.115435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:51.143342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:51.145320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:51.414940 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1480/2964] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:51.434210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:51.436290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:51.530654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:51.532060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:51.559289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dec5d7-aeea-4598-a5b2-8440e09694f5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:51.584721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:51.585417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:51.585693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:51.585973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] PATH_INFO: `/v3/projects/38bf706dbd594ca6976e36131cbec776` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:51.588172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bf706dbd594ca6976e36131cbec776)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:51.590124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:51.600431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:51.640653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb664c-5e39-47b4-bb91-3d3d5c271f92 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:51.655681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ceebf-6ffa-4bbc-816c-3079bc5463ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:51.656325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceebf-6ffa-4bbc-816c-3079bc5463ee service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:51.665389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceebf-6ffa-4bbc-816c-3079bc5463ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:51.665781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceebf-6ffa-4bbc-816c-3079bc5463ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:51.702004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ceebf-6ffa-4bbc-816c-3079bc5463ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:51.710532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ceebf-6ffa-4bbc-816c-3079bc5463ee service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:51.745435 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1485/2965] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:32:51.751115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:51.756504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bf706dbd594ca6976e36131cbec776', 'request_id': 'req-4132825a-fac0-43b3-aeb3-725beb97abed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.774557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bf706dbd594ca6976e36131cbec776', 'request_id': 'req-4132825a-fac0-43b3-aeb3-725beb97abed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.787176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bf706dbd594ca6976e36131cbec776', 'request_id': 'req-4132825a-fac0-43b3-aeb3-725beb97abed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.822922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] The token cache is being invalidate because project 38bf706dbd594ca6976e36131cbec776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:51.822922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.823790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4132825a-fac0-43b3-aeb3-725beb97abed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:51.833619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:51.833953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:51.834330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:51.841181 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1481/2966] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:51 2022] DELETE /identity/v3/projects/38bf706dbd594ca6976e36131cbec776 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:51.873645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:51.876587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:52.105785 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1486/2967] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:52.113677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:52.114752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:52.115035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:52.212154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:52.214636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:52.258181 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1482/2968] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:52.262611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:52.278604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ae1c-f6b8-489e-be2e-b9faf7976a86 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:52.295998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:52.297101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:52.298288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:52.298820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:52.301221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:52.304565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:52.309169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:52.361171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:52.362003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1487/2969] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:32:52.376501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9806e-f6a0-4a94-b910-f8ab1f4dc7c7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:52.400895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:52.401890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:52.402448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:52.403681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:52.408744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:52.415675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:52.537609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1483/2970] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:52 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:32:52.541419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:52.581796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a656-f971-46c9-8377-cd0fb59c286b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:52.759022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:52.761612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:52.765337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:52.765945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:52.766855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:52.769366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:52.828327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1488/2971] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:52 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:52.832220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:52.844479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5957d-09d5-43b8-a777-3f6697952d2b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:52.861528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:52.864961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:52.865695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:52.865695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:52.866315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:52.868027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:52.900695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1484/2972] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:52.904652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:52.924815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8806e99-be5c-4246-837d-4c0fff0f2259 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:52.943427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36481b2e-f6ed-4da3-8c10-48bc9a89b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:52.944062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481b2e-f6ed-4da3-8c10-48bc9a89b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:52.944347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481b2e-f6ed-4da3-8c10-48bc9a89b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:52.944625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36481b2e-f6ed-4da3-8c10-48bc9a89b3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:52.945775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481b2e-f6ed-4da3-8c10-48bc9a89b3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:52.947160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36481b2e-f6ed-4da3-8c10-48bc9a89b3fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:53.005489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:53.006874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1489/2973] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:53.030655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56357d6-7d23-47f8-849f-9cd6f400de29 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:53.046007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:53.047474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:53.048504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:53.049879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] PATH_INFO: `/v3/projects/d4276a8be8c541159a4d1d575995dcc6/users/6c889d2c39af44c693a3c15b5ba4bca9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:53.103162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4276a8be8c541159a4d1d575995dcc6, user_id=6c889d2c39af44c693a3c15b5ba4bca9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:53.113077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:53.162678 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1485/2974] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:53 2022] PUT /identity/v3/projects/d4276a8be8c541159a4d1d575995dcc6/users/6c889d2c39af44c693a3c15b5ba4bca9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:53.167826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:53.168334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:53.168445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:53.228978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:53.235473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:53.275558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:53.280153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:53.414923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:53.481901 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1490/2975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:53.520946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:53.522139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:53.553574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8cf9c-ab97-4900-958b-a30d97bf6beb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:53.582587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:53.583978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:53.585018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:53.586726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] PATH_INFO: `/v3/projects/0fe5606f9c144deebe561caef3f51f94` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:53.595570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe5606f9c144deebe561caef3f51f94)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:53.597749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:53.703862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe5606f9c144deebe561caef3f51f94', 'request_id': 'req-bd83e57b-4259-4ab7-8654-b2e1b755e563'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:53.719363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe5606f9c144deebe561caef3f51f94', 'request_id': 'req-bd83e57b-4259-4ab7-8654-b2e1b755e563'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:53.749349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe5606f9c144deebe561caef3f51f94', 'request_id': 'req-bd83e57b-4259-4ab7-8654-b2e1b755e563'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:53.767797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e81a11-7f95-4568-bc19-0ce3961337f8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:53.773024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:53.777176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] The token cache is being invalidate because project 0fe5606f9c144deebe561caef3f51f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:53.777603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:53.778385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:53.782489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1486/2976] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:53 2022] DELETE /identity/v3/projects/0fe5606f9c144deebe561caef3f51f94 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:53.786792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:53.792245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:53.984199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:53.984844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:53.985231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:53.985516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:53.989097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:54.031364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83e57b-4259-4ab7-8654-b2e1b755e563 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:54.050869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:54.051527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:54.052129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:54.052418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] PATH_INFO: `/v3/users/70b8324646e540b1b64b370d1e7c5e26` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:54.054896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b8324646e540b1b64b370d1e7c5e26)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:54.056936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:54.207559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:54.213221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:54.240246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b8324646e540b1b64b370d1e7c5e26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:54.245554 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1491/2977] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:32:54.283475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b8324646e540b1b64b370d1e7c5e26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:54.285320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b8324646e540b1b64b370d1e7c5e26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:54.307672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b8324646e540b1b64b370d1e7c5e26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:54.311547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4328236-cb68-4cf0-ab2b-3bce137fd9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b8324646e540b1b64b370d1e7c5e26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:54.366497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1487/2978] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:53 2022] DELETE /identity/v3/users/70b8324646e540b1b64b370d1e7c5e26 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:57.138264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:57.153108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c304-04a4-416d-8bf0-21c6182591ee service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:57.492997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:57.523424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:57.524099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:57.524384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:57.524662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] PATH_INFO: `/v3/projects/946dc3a2bf464af48dab60d1de0c927f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:57.526249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=946dc3a2bf464af48dab60d1de0c927f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:57.528236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:57.689247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946dc3a2bf464af48dab60d1de0c927f', 'request_id': 'req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:57.707913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946dc3a2bf464af48dab60d1de0c927f', 'request_id': 'req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:57.724757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946dc3a2bf464af48dab60d1de0c927f', 'request_id': 'req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:57.772259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] The token cache is being invalidate because project 946dc3a2bf464af48dab60d1de0c927f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:32:57.772583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:57.777457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2f92b76c-3f75-4dd1-ab0c-6e160135a6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:57.796491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1492/2979] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:32:57 2022] DELETE /identity/v3/projects/946dc3a2bf464af48dab60d1de0c927f => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:57.802331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:57.802905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:57.803014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:57.893708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:57.895081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:58.234747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1488/2980] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:58.242985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:58.243509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:58.243509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:58.276221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:58.290191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:58.313331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1493/2981] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:58.317739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:58.334769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351f97-bf67-4298-9bf8-753e56a77c39 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:58.354001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:58.354631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:58.354922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:58.355209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:58.355878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:32:58.356193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:58.358448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:58.415642 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1489/2982] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:32:58.505610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:58.534191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e0de4-8fbe-4e08-9364-8b976a02529b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:58.554552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:58.563069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:58.569798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:58.570476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:58.571694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:58.581739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:58.728924 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1494/2983] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:58 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:58.733681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:58.744527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:58.753489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dd5c0-f445-4ee8-96a9-35b8ecd9ea22 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:59.030217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:59.030862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.031145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.031418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.032062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:59.039621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:59.117551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1490/2984] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:58 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:32:59.121781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:59.143640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84775b7d-c2a9-4524-bc21-6d068a33b37d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:59.169379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:59.173163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.174386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.175096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.176931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:59.180059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:59.215305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:59.235151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1495/2985] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:32:59.237357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a7f0-4e27-44cd-a38f-87f9e4f2bd79 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:59.250952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7651fef-e314-4eb0-8a91-03db6fccf647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:59.253102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7651fef-e314-4eb0-8a91-03db6fccf647 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.253658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7651fef-e314-4eb0-8a91-03db6fccf647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.254614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7651fef-e314-4eb0-8a91-03db6fccf647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.255946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7651fef-e314-4eb0-8a91-03db6fccf647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:59.260682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7651fef-e314-4eb0-8a91-03db6fccf647 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:59.293769 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1491/2986] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:32:59.299810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:59.313491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0301968-7b5d-48ff-9575-2837ad8228e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:59.350997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:59.353411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.359597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.363171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27/users/7051a9f8ca40426e9e73ca02bb1bc9d9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.418082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5dc5879ace42149508d74038d0fd27, user_id=7051a9f8ca40426e9e73ca02bb1bc9d9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:59.420875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:59.462605 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1496/2987] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:32:59 2022] PUT /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27/users/7051a9f8ca40426e9e73ca02bb1bc9d9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:32:59.464387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.464970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.465568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.489656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:59.491703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:59.557861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] MFA Rules not processed for user `7051a9f8ca40426e9e73ca02bb1bc9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:32:59.559546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:59.649184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecad9e-118c-4196-b0fc-eff1e6ebc823 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:59.654828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:59.657176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.658026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.658544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] PATH_INFO: `/v3/users/f914ca523057422f88748746ba18b525` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.660043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f914ca523057422f88748746ba18b525)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:59.662267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:59.712675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:32:59.756066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1492/2988] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:32:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:32:59.759542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:59.801858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f914ca523057422f88748746ba18b525'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:59.812501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0499f5-3f3c-4492-a403-fddaf29f42d0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:32:59.823349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:32:59.825500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:32:59.826789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:32:59.827431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:32:59.828518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:32:59.831655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:32:59.854514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f914ca523057422f88748746ba18b525'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:59.856419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f914ca523057422f88748746ba18b525'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:59.890042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f914ca523057422f88748746ba18b525'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:59.891309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f914ca523057422f88748746ba18b525'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:32:59.907028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1493/2989] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:32:59 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:32:59.912368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:32:59.914400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:32:59.949843 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1497/2990] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:32:59 2022] DELETE /identity/v3/users/f914ca523057422f88748746ba18b525 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:32:59.992199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:00.017313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb3140-1d60-443b-8821-0ba57f535378 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:00.153021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:00.154923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:00.155261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:00.155646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:00.156407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:00.158683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:00.199094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1494/2991] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:32:59 2022] POST /identity/v3/users => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:33:00.203286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:00.231068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac30ce3-0a63-4a16-a27a-4fbc0d1bf517 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:00.246860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:00.252355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:00.252716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:00.253025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:00.260295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:00.271609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:00.327695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:00.327955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1498/2992] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:00.342750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3ff6-3df5-4a97-ac31-811f46590750 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:00.362623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:00.365318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:00.365318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:00.365318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] PATH_INFO: `/v3/projects/ef48a70192be46109b2c886ba495cbd6/users/ef6b67500cc141a4894bd858fdcc96ab/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:00.427439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef48a70192be46109b2c886ba495cbd6, user_id=ef6b67500cc141a4894bd858fdcc96ab, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:00.439076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:00.491203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1495/2993] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:00 2022] PUT /identity/v3/projects/ef48a70192be46109b2c886ba495cbd6/users/ef6b67500cc141a4894bd858fdcc96ab/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:00.494658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:00.515527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5d16b-6ccc-4071-bfed-7923cfec063d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:00.721921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:00.723756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:00.833717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:00.837292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:00.837593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:00.839537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:00.840287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:00.848194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:00.905086 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1499/2994] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:00.907311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:00.960377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265744c4-cbd1-4796-b12d-f7ab95333336 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:00.973974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25683a-ac6d-419e-86bd-fb46adb8cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:00.975029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25683a-ac6d-419e-86bd-fb46adb8cfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:00.975322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25683a-ac6d-419e-86bd-fb46adb8cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:00.980652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25683a-ac6d-419e-86bd-fb46adb8cfa9 admin admin] PATH_INFO: `/v3/projects/ef48a70192be46109b2c886ba495cbd6/users/ef6b67500cc141a4894bd858fdcc96ab/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:00.987327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25683a-ac6d-419e-86bd-fb46adb8cfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef48a70192be46109b2c886ba495cbd6, user_id=ef6b67500cc141a4894bd858fdcc96ab, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:00.994291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7bddc-58d2-4533-8a40-583eaca9b2c9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:01.008121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25683a-ac6d-419e-86bd-fb46adb8cfa9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:01.022819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:01.023525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:01.023832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:01.024076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] PATH_INFO: `/v3/projects/407895b8d4e94b74a2cb652eb2c30048` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:01.027878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=407895b8d4e94b74a2cb652eb2c30048)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:01.033798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:01.078306 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1500/2995] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:00 2022] PUT /identity/v3/projects/ef48a70192be46109b2c886ba495cbd6/users/ef6b67500cc141a4894bd858fdcc96ab/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:01.093517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:01.093887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:01.094092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:01.241561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] MFA Rules not processed for user `ef6b67500cc141a4894bd858fdcc96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:01.242030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:01.259521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407895b8d4e94b74a2cb652eb2c30048', 'request_id': 'req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.275828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407895b8d4e94b74a2cb652eb2c30048', 'request_id': 'req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.294061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407895b8d4e94b74a2cb652eb2c30048', 'request_id': 'req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.304048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:01.360084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] The token cache is being invalidate because project 407895b8d4e94b74a2cb652eb2c30048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:01.360351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.364347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.375885 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1496/2996] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:00 2022] DELETE /identity/v3/projects/407895b8d4e94b74a2cb652eb2c30048 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:01.379875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:01.381956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:01.475425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:01.489645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1501/2997] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:01.512175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:01.514936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:01.693184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc84a9f-ff6e-499f-86a1-d0a7dced77ba admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:01.703943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:01.704598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:01.704877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:01.705202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] PATH_INFO: `/v3/users/10b7c8f1c683451c8b6cac71d99f5fba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:01.713702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b7c8f1c683451c8b6cac71d99f5fba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:01.720160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:01.780450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5b099-df9c-49dc-9656-2064dcdf0182 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:01.802658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06083de-f9a5-459f-81fc-22c0d9a01f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:01.803305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06083de-f9a5-459f-81fc-22c0d9a01f72 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:01.803584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06083de-f9a5-459f-81fc-22c0d9a01f72 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:01.803865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06083de-f9a5-459f-81fc-22c0d9a01f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:01.843720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b7c8f1c683451c8b6cac71d99f5fba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.844443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06083de-f9a5-459f-81fc-22c0d9a01f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:01.851108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06083de-f9a5-459f-81fc-22c0d9a01f72 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:01.893565 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1502/2998] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:01.912968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b7c8f1c683451c8b6cac71d99f5fba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.917299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b7c8f1c683451c8b6cac71d99f5fba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.937624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:01.938421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:01.938972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:01.941372 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1503/2999] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:01.944891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b7c8f1c683451c8b6cac71d99f5fba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.946696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-00114a95-f1eb-4ab6-8728-f34ed75a53e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b7c8f1c683451c8b6cac71d99f5fba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:01.953738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:01.955994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:01.988792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1497/3000] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:33:01 2022] DELETE /identity/v3/users/10b7c8f1c683451c8b6cac71d99f5fba => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:02.054308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:02.059599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:02.126841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199214-a6f1-4042-adbd-e0b0250bbb90 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:02.351734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:02.353019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:02.353890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:02.354419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:02.356457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:02.362165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:02.378371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1504/3001] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:01 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:02.461099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab13b-34c8-4c1f-803b-67dddced804e None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:02.461663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab13b-34c8-4c1f-803b-67dddced804e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:02.461663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab13b-34c8-4c1f-803b-67dddced804e None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:02.463821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1498/3002] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:02.474644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:02.732384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:02.754448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9916f9c-2fb5-408c-bf53-56865ef3435b tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:02.788483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:02.790199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:02.791341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:02.791718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:02.798653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:02.800948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:02.802779 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1505/3003] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:02 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:03.005032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21647b0-691a-487c-804a-574e4eba401c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:03.006079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21647b0-691a-487c-804a-574e4eba401c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:03.006441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21647b0-691a-487c-804a-574e4eba401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:03.067273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a21647b0-691a-487c-804a-574e4eba401c None None] MFA Rules not processed for user `7051a9f8ca40426e9e73ca02bb1bc9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:03.070107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a21647b0-691a-487c-804a-574e4eba401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:03.264526 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1499/3004] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:03.284052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:03.309484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d57fb-c5ea-49e7-a844-d9b3b149e073 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:03.359273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:03.361917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:03.366348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:03.366868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:03.388666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:03.396650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21647b0-691a-487c-804a-574e4eba401c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:03.399467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a21647b0-691a-487c-804a-574e4eba401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:03.462743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:03.464386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61807692-7734-47ac-841c-2e48c418b0ef service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:03.479759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:03.492467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:03.509803 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1506/3005] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:03.691137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21647b0-691a-487c-804a-574e4eba401c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:03.707476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:03.708176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:03.708601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:03.708931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] PATH_INFO: `/v3/projects/767466ab5520428e8da1e9a76b806158` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:03.710249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767466ab5520428e8da1e9a76b806158)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:03.712424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:03.827226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767466ab5520428e8da1e9a76b806158', 'request_id': 'req-9ce3954f-a204-4d13-b9e3-fd054656c906'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:03.859862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767466ab5520428e8da1e9a76b806158', 'request_id': 'req-9ce3954f-a204-4d13-b9e3-fd054656c906'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:03.890736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767466ab5520428e8da1e9a76b806158', 'request_id': 'req-9ce3954f-a204-4d13-b9e3-fd054656c906'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:03.923925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:03.924350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:03.924456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:03.949293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] The token cache is being invalidate because project 767466ab5520428e8da1e9a76b806158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:03.949593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:03.952270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce3954f-a204-4d13-b9e3-fd054656c906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:03.960962 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1500/3006] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:03 2022] DELETE /identity/v3/projects/767466ab5520428e8da1e9a76b806158 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:03.963844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fc98-414e-4a7b-a284-1d9909ef2d5f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:03.963844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fc98-414e-4a7b-a284-1d9909ef2d5f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:03.963844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1fc98-414e-4a7b-a284-1d9909ef2d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.001696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] MFA Rules not processed for user `a262a7ca2be4451a89330098b6134c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:04.003391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:04.010916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b9e1fc98-414e-4a7b-a284-1d9909ef2d5f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:04.012212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b9e1fc98-414e-4a7b-a284-1d9909ef2d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:04.244174 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1501/3007] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:04.248145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:04.248452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:04.252273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.286795 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1507/3008] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:04.342535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:04.347143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:04.382916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:04.383795 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1502/3009] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:04.409629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3183-3c2a-4d4a-8669-a5fa154f687d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:04.446802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:04.447367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:04.447645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:04.447921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.448593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:33:04.448922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:04.469033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:04.515894 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1508/3010] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:33:04.520174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:04.531451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78264a85-5ca3-457e-b2a7-740dbe66d477 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:04.553027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:04.553670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:04.553957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:04.554243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.554901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:04.556986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:04.645988 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1503/3011] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:33:04 2022] POST /identity/v3/projects => generated 411 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:04.646928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:04.675094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfbf8d-9ada-42f2-b9fe-e3b3a92ecbcc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:04.805977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:04.807403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:04.807854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:04.808307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.809387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:04.811580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:04.860817 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1509/3012] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:33:04 2022] POST /identity/v3/users => generated 306 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:33:04.863531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:04.879281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19072b9f-64b5-42d3-9a7c-fa4199f62e67 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:04.894678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:04.897196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:04.897448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:04.897736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.898416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:04.900041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:04.931330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1504/3013] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:04.933695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:04.954276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73352811-a681-4dd3-85f9-bd6e58f8051c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:04.974802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05771b1-8fe2-4309-ad23-f8a719357a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:04.979702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05771b1-8fe2-4309-ad23-f8a719357a92 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:04.979997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05771b1-8fe2-4309-ad23-f8a719357a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:04.980304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05771b1-8fe2-4309-ad23-f8a719357a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:04.982335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05771b1-8fe2-4309-ad23-f8a719357a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:04.984715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05771b1-8fe2-4309-ad23-f8a719357a92 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:05.003769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1510/3014] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:33:05.005083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:05.020034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339d42-3c3b-48f8-9449-110737c1d0aa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:05.033363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:05.034020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:05.034595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:05.035040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] PATH_INFO: `/v3/projects/dc5e5d31e8a94667b52be18ed414d846/users/0b8c2b48f17b470aaa79d4f4a4a7215c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:05.041969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:05.072115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5e5d31e8a94667b52be18ed414d846, user_id=0b8c2b48f17b470aaa79d4f4a4a7215c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:05.076172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:05.110900 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1505/3015] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:05 2022] PUT /identity/v3/projects/dc5e5d31e8a94667b52be18ed414d846/users/0b8c2b48f17b470aaa79d4f4a4a7215c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:05.116092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:05.116752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:05.117270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:05.167562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:05.170367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:05.349738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:05.404981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1511/3016] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:05.437164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:05.439076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:05.629274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c79509-d712-4727-9f55-5bbaa0fcfaa6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:05.634231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e952ca0-5696-4afa-b536-08ff56fc7e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:05.635372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952ca0-5696-4afa-b536-08ff56fc7e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:05.635773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952ca0-5696-4afa-b536-08ff56fc7e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:05.636149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e952ca0-5696-4afa-b536-08ff56fc7e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:05.658450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e952ca0-5696-4afa-b536-08ff56fc7e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:05.663292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e952ca0-5696-4afa-b536-08ff56fc7e7c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:05.699696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1506/3017] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:10.024104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:10.026319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:10.306468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505c2fe-be00-438a-b088-114dcefbf9aa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:10.327752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafeaa-f726-4ec4-a7f5-ddfd775b423e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:10.328383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafeaa-f726-4ec4-a7f5-ddfd775b423e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:10.328666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafeaa-f726-4ec4-a7f5-ddfd775b423e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:10.328970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafeaa-f726-4ec4-a7f5-ddfd775b423e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:10.468617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafeaa-f726-4ec4-a7f5-ddfd775b423e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:10.470062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafeaa-f726-4ec4-a7f5-ddfd775b423e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:10.511638 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1512/3018] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:10.884652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd609-b33d-42d5-99e4-d6ff3831cd08 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:10.885921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd609-b33d-42d5-99e4-d6ff3831cd08 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:10.885921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd609-b33d-42d5-99e4-d6ff3831cd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:10.945954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:10.946537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:10.947012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:10.948552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1513/3019] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:10.954701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:10.956990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:10.982913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a5ffd609-b33d-42d5-99e4-d6ff3831cd08 None None] MFA Rules not processed for user `6c889d2c39af44c693a3c15b5ba4bca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:10.986487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a5ffd609-b33d-42d5-99e4-d6ff3831cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:11.009624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:11.012417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:11.211846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5c0d4-f60e-41f3-bd50-13dca97c7567 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:11.226526 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1507/3020] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:11.228175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:11.228342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:11.229413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:11.229847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:11.230766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:11.231349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:11.233043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:11.238517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:11.240770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:11.244328 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1514/3021] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:10 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:11.245384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:11.257260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:11.300145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382419d7-0aa6-418d-8758-8c65b0732ffd tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:11.303006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:11.307188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:11.316669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:11.317606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:11.318065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:11.318518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:11.319337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:11.321603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:11.393544 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1515/3022] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:11.395702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:11.425741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:11.498160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1508/3023] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:33:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:11.517631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:11.523751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:11.584407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06c0d8-9e69-40f7-8a4c-b12af0bb39cf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:11.609817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:11.610464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:11.610753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:11.611064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:11.611665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:11.613799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:11.623294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:11.686365 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1516/3024] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:33:11 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:11.687340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:11.698707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce146a-5c9e-4116-a01b-b7c7a8a272c3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:11.706367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:11.707156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:11.707474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:11.707845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:11.708794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:11.710687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:11.736012 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1517/3025] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:11.740369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:11.767752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cf94d-a04c-4d4e-9df3-187eae7eaaa9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:11.779173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:11.781503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:11.783350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:11.783881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] PATH_INFO: `/v3/projects/5271c4a34ba547dfa6cb40a569394ef7/users/0f6f5c78d11f4ecf9ff99a95df8e1a00/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:11.814180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661885fe-d0e7-474e-8d38-a7800b609d5d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:11.834012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271c4a34ba547dfa6cb40a569394ef7, user_id=0f6f5c78d11f4ecf9ff99a95df8e1a00, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:11.843268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:11.882981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1518/3026] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:11 2022] PUT /identity/v3/projects/5271c4a34ba547dfa6cb40a569394ef7/users/0f6f5c78d11f4ecf9ff99a95df8e1a00/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:11.896306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:12.056878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:12.066607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:12.067181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:12.067613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:12.094135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016087-1965-4426-9028-1ca474b0b206 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:12.108577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:12.109632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:12.110170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:12.110666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:12.111716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:12.126128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:12.165811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:12.166215 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1519/3027] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:12.167407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:12.167536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:12.173598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:12.180438 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1509/3028] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:33:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:33:12.183727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:12.220411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b949c-8a24-4de6-870c-cb6e4c75d6a9 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:12.234420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55932e0c-4c3e-4246-bb6a-8b280b6466fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:12.238565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55932e0c-4c3e-4246-bb6a-8b280b6466fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:12.239100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55932e0c-4c3e-4246-bb6a-8b280b6466fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:12.239626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55932e0c-4c3e-4246-bb6a-8b280b6466fc admin admin] PATH_INFO: `/v3/projects/5271c4a34ba547dfa6cb40a569394ef7/users/0f6f5c78d11f4ecf9ff99a95df8e1a00/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:12.246178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55932e0c-4c3e-4246-bb6a-8b280b6466fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271c4a34ba547dfa6cb40a569394ef7, user_id=0f6f5c78d11f4ecf9ff99a95df8e1a00, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:12.267312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55932e0c-4c3e-4246-bb6a-8b280b6466fc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:12.306080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1510/3029] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:12 2022] PUT /identity/v3/projects/5271c4a34ba547dfa6cb40a569394ef7/users/0f6f5c78d11f4ecf9ff99a95df8e1a00/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:12.408716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:12.444701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b6a3-eaaf-4cda-b4f5-50a4f56c2838 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:12.628107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:12.629112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:12.629812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:12.630276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:12.634415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:12.687630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:12.689522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:12.725330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1520/3030] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:12.932522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabe17-8e1e-479f-b192-912dcccb4f39 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:12.932852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabe17-8e1e-479f-b192-912dcccb4f39 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:12.934317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddabe17-8e1e-479f-b192-912dcccb4f39 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:12.937368 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1511/3031] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:12.945105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:13.132514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:13.345250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0969c-e143-474e-a249-af49d5c7b4c7 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:13.353497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f13c1-3c2e-4261-9b25-6a7149aa7455 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:13.354170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f13c1-3c2e-4261-9b25-6a7149aa7455 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:13.354460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f13c1-3c2e-4261-9b25-6a7149aa7455 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:13.354738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f13c1-3c2e-4261-9b25-6a7149aa7455 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:13.356325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f13c1-3c2e-4261-9b25-6a7149aa7455 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:13.368027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f13c1-3c2e-4261-9b25-6a7149aa7455 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:13.383804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1521/3032] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:12 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:13.863372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:13.863968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:13.863968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:13.888670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dd06d-219a-44d3-835e-fafbc1eaf6e1 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:13.889360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dd06d-219a-44d3-835e-fafbc1eaf6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:13.889360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dd06d-219a-44d3-835e-fafbc1eaf6e1 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:13.891360 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1522/3033] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:13.902647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dd06d-219a-44d3-835e-fafbc1eaf6e1 None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:13.913392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] MFA Rules not processed for user `9f23399a5f1c4af6855a098198ca4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:13.922609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:13.935049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dd06d-219a-44d3-835e-fafbc1eaf6e1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:13.972721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dd06d-219a-44d3-835e-fafbc1eaf6e1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:13.986104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b8a08-4e5e-4e99-b0ee-17bf4bc17c6c tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:13.986767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8a08-4e5e-4e99-b0ee-17bf4bc17c6c tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:13.987338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8a08-4e5e-4e99-b0ee-17bf4bc17c6c tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:13.987685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8a08-4e5e-4e99-b0ee-17bf4bc17c6c tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:13.989378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b8a08-4e5e-4e99-b0ee-17bf4bc17c6c tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:13.991483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b8a08-4e5e-4e99-b0ee-17bf4bc17c6c tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:13.993768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1523/3034] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:13 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:33:14.010773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:14.032726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1512/3035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:14.210624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8412f-81c6-488e-a5f4-41b34f498938 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:14.210912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8412f-81c6-488e-a5f4-41b34f498938 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:14.211213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8412f-81c6-488e-a5f4-41b34f498938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:14.257609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-24d8412f-81c6-488e-a5f4-41b34f498938 None None] MFA Rules not processed for user `7051a9f8ca40426e9e73ca02bb1bc9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:14.262455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24d8412f-81c6-488e-a5f4-41b34f498938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:14.307668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:14.425985 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1524/3036] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:15.440391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:15.574135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941dd7-ca6b-4802-a017-822d4739d764 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:15.583294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:15.583998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:15.584351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:15.584692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:15.589626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:15.634669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:15.636411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ec274-e18f-4511-ab42-3995c131e892 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:15.669545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1513/3037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:16.325059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192dce-f030-4681-a571-40fb573d216f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:16.325923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192dce-f030-4681-a571-40fb573d216f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:16.326536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192dce-f030-4681-a571-40fb573d216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:16.384141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0d192dce-f030-4681-a571-40fb573d216f None None] MFA Rules not processed for user `a262a7ca2be4451a89330098b6134c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:16.390818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d192dce-f030-4681-a571-40fb573d216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:16.546870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1525/3038] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:17.711916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f56b0-0a5f-404d-8df8-3931269d47b8 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:17.712422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f56b0-0a5f-404d-8df8-3931269d47b8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:17.712547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f56b0-0a5f-404d-8df8-3931269d47b8 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:17.713914 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1514/3039] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:17.720378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192dce-f030-4681-a571-40fb573d216f None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:17.749843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192dce-f030-4681-a571-40fb573d216f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:17.777045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192dce-f030-4681-a571-40fb573d216f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:17.786876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:17.788095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:17.788602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:17.789150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:17.791373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:17.801882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:17.808652 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1526/3040] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:17 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:18.555708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712423f8-634e-4597-a305-ec9f3b8e976b None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:18.555995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712423f8-634e-4597-a305-ec9f3b8e976b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:18.556501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712423f8-634e-4597-a305-ec9f3b8e976b None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:18.558571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1515/3041] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:18.577671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:18.611045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:18.669865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439142e-ce26-457b-9da6-136fca376577 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:18.700671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:18.701773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:18.702517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:18.702888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:18.704481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:18.710299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:18.756140 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1527/3042] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:18 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:19.038393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff2773-9416-4713-b31a-c736a30bcbb3 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:19.039422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff2773-9416-4713-b31a-c736a30bcbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:19.040929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff2773-9416-4713-b31a-c736a30bcbb3 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:19.043460 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1516/3043] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:19.051313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:19.084322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:19.129690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc7cda-e037-4315-85de-b4853b0e1252 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:19.150703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5510dd0-1650-4a2e-ae09-97c6666651ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:19.151958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510dd0-1650-4a2e-ae09-97c6666651ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:19.153527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510dd0-1650-4a2e-ae09-97c6666651ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:19.156634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5510dd0-1650-4a2e-ae09-97c6666651ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:19.159995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510dd0-1650-4a2e-ae09-97c6666651ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:19.165841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5510dd0-1650-4a2e-ae09-97c6666651ac tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:19.186874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1528/3044] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:19 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:19.452825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:19.453104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:19.454640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:19.515473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] MFA Rules not processed for user `7051a9f8ca40426e9e73ca02bb1bc9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:19.518576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:19.562326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1517/3045] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:20.535529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330bea6-410a-4326-b3e5-fdfa18a8f049 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:20.539072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330bea6-410a-4326-b3e5-fdfa18a8f049 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:20.540106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330bea6-410a-4326-b3e5-fdfa18a8f049 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:20.545324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1529/3046] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:33:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:33:20.562043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:33:20.589676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:20.615596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b345-557a-4e21-a0c6-4685552fe696 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:20.628377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef6b67500cc141a4894bd858fdcc96ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef48a70192be46109b2c886ba495cbd6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:20.629063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:20.629352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:20.629635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:20.633726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorizing `identity:get_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:20.636398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:20.655202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1518/3047] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:33:20 2022] GET /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 383 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:20.802961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40880-4c32-4169-889b-0cc113c7ff52 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:20.802961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40880-4c32-4169-889b-0cc113c7ff52 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:20.805152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40880-4c32-4169-889b-0cc113c7ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:20.938423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a0d40880-4c32-4169-889b-0cc113c7ff52 None None] MFA Rules not processed for user `0b8c2b48f17b470aaa79d4f4a4a7215c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:20.941088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a0d40880-4c32-4169-889b-0cc113c7ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:21.063820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:21.065676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:21.201843 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1530/3048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:20 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:21.210490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:21.210804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:21.211133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:21.293789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] MFA Rules not processed for user `0b8c2b48f17b470aaa79d4f4a4a7215c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:21.297815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:21.305496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d04be4-0613-46f3-838d-9186688667b0 tempest-QuotasAdminNegativeTest-1522352604 tempest-QuotasAdminNegativeTest-1522352604-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:21.322175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1531/3049] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:21.330528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:21.335625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:21.336320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:21.336637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:21.336930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] PATH_INFO: `/v3/users/7051a9f8ca40426e9e73ca02bb1bc9d9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:21.341966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7051a9f8ca40426e9e73ca02bb1bc9d9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:21.344154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:21.378169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bce92-b444-4473-a439-d4ea8dab24b4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:21.400830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f853ba-1146-4703-9eb5-214007e61eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:21.401860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f853ba-1146-4703-9eb5-214007e61eed service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:21.402358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f853ba-1146-4703-9eb5-214007e61eed service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:21.402874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f853ba-1146-4703-9eb5-214007e61eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:21.417748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f853ba-1146-4703-9eb5-214007e61eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:21.420833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f853ba-1146-4703-9eb5-214007e61eed service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:21.436102 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1532/3050] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:21 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:33:21.543745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7051a9f8ca40426e9e73ca02bb1bc9d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:21.569699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7051a9f8ca40426e9e73ca02bb1bc9d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:21.570485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7051a9f8ca40426e9e73ca02bb1bc9d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:21.591483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7051a9f8ca40426e9e73ca02bb1bc9d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:21.592418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7051a9f8ca40426e9e73ca02bb1bc9d9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:21.617620 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1519/3051] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:33:21 2022] DELETE /identity/v3/users/7051a9f8ca40426e9e73ca02bb1bc9d9 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:21.623742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:21.624280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:21.624525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:21.667588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:21.672277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:21.697894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:21.824843 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1533/3052] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:21.892248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:21.893944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:21.902179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:22.142502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9476c8-1178-4ffe-b93a-3d7a3d3892f7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:22.167126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:22.167992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:22.168442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:22.168963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:22.198758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:22.200776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:22.231317 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1520/3053] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:23.148597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:23.150935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:23.174798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106c6fb-ee20-47f3-8846-715b6457f523 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:23.186932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:23.187589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:23.187865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:23.188140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] PATH_INFO: `/v3/projects/1f5dc5879ace42149508d74038d0fd27` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:23.193342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5dc5879ace42149508d74038d0fd27)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:23.196039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:23.336947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5dc5879ace42149508d74038d0fd27', 'request_id': 'req-ada9d2c0-8468-4fe1-9089-e6b28e02216e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.364314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5dc5879ace42149508d74038d0fd27', 'request_id': 'req-ada9d2c0-8468-4fe1-9089-e6b28e02216e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.374410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5dc5879ace42149508d74038d0fd27', 'request_id': 'req-ada9d2c0-8468-4fe1-9089-e6b28e02216e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.426375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] The token cache is being invalidate because project 1f5dc5879ace42149508d74038d0fd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:23.427190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.434286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.445061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1534/3054] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:23 2022] DELETE /identity/v3/projects/1f5dc5879ace42149508d74038d0fd27 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:23.451382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:23.482272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169f423-d394-4cc3-8009-325d6968133d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:23.745988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:23.746715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:23.747246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:23.747696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] PATH_INFO: `/v3/users/ef6b67500cc141a4894bd858fdcc96ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:23.751529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6b67500cc141a4894bd858fdcc96ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:23.757131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:23.858449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6b67500cc141a4894bd858fdcc96ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.878753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6b67500cc141a4894bd858fdcc96ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.879895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6b67500cc141a4894bd858fdcc96ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.898158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6b67500cc141a4894bd858fdcc96ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.899097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2f5cd5e6-a928-413b-8985-6bc743b371ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6b67500cc141a4894bd858fdcc96ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:23.933294 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1521/3055] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:33:23 2022] DELETE /identity/v3/users/ef6b67500cc141a4894bd858fdcc96ab => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:25.042063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:25.045791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:25.104680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9d2c0-8468-4fe1-9089-e6b28e02216e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:25.323313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:25.327749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:25.328926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:25.329466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] PATH_INFO: `/v3/projects/ef48a70192be46109b2c886ba495cbd6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:25.331179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef48a70192be46109b2c886ba495cbd6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:25.333909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:25.428803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:25.448244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef48a70192be46109b2c886ba495cbd6', 'request_id': 'req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:25.467222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef48a70192be46109b2c886ba495cbd6', 'request_id': 'req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:25.481260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef48a70192be46109b2c886ba495cbd6', 'request_id': 'req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:25.501424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] The token cache is being invalidate because project ef48a70192be46109b2c886ba495cbd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:25.502489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:25.504233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fdd1c7aa-3256-4642-b47d-fe9b7b3a799c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:25.506694 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1535/3056] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:25 2022] DELETE /identity/v3/projects/ef48a70192be46109b2c886ba495cbd6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:25.513124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:25.514778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:25.518806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:25.582361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:25.583870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:25.631493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:25.698955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1522/3057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:25.707035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:25.707461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:25.707835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:25.736516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:25.738444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:25.753513 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1536/3058] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:25.760557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:25.790231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb580c0-d262-4ff4-a2df-b211feeb586c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:25.797910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:25.798688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:25.799032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:25.799314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:25.802673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:33:25.803219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:25.808889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:25.840357 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1523/3059] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:25.845185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:25.860486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145ba71-d580-4f63-8509-2c20a047a2bf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:25.874500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:25.875288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:25.875804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:25.876187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:25.876964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:25.879026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:26.010843 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1537/3060] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:33:25 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:26.012134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:26.031257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9af4b6-25cd-40de-8413-d6ab3aeae084 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:26.198897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:26.200802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:26.201220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:26.201648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:26.202566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:26.205251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:26.267019 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1524/3061] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:33:26 2022] POST /identity/v3/users => generated 305 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:26.267155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:26.291604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26b18-4716-47a0-b819-4f1eafee4e98 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:26.302893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:26.307461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:26.308095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:26.309214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:26.310764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:26.313882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:26.346621 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1538/3062] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:26.347419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:26.366756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f8e63-d322-4399-b6ee-c3ea6d30e459 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:26.385010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e8ce5-d0b6-45bc-bb12-813069a84d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:26.386686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e8ce5-d0b6-45bc-bb12-813069a84d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:26.388536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e8ce5-d0b6-45bc-bb12-813069a84d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:26.390393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e8ce5-d0b6-45bc-bb12-813069a84d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:26.391750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e8ce5-d0b6-45bc-bb12-813069a84d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:26.396007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e8ce5-d0b6-45bc-bb12-813069a84d30 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:26.437301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:26.447378 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1525/3063] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:26.452977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdbefa-4677-4d3c-bd2b-3058cb1dd7e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:26.473592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:26.474518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:26.474677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:26.474921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] PATH_INFO: `/v3/projects/c1492de64d174096b36c4ff52e75babb/users/4f1a04c0cbda420a8f0a90f650842ad3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:26.515580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1492de64d174096b36c4ff52e75babb, user_id=4f1a04c0cbda420a8f0a90f650842ad3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:26.526338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:26.571756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1539/3064] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:26 2022] PUT /identity/v3/projects/c1492de64d174096b36c4ff52e75babb/users/4f1a04c0cbda420a8f0a90f650842ad3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:26.583362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:26.583965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:26.584073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:26.646963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] MFA Rules not processed for user `4f1a04c0cbda420a8f0a90f650842ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:26.650324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:26.804015 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1526/3065] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:26.808764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:26.971960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7318e0-a70a-425e-a2da-d0e49e042633 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:26.987258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:26.987844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:26.988131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:26.988456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:26.989151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:26.991271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:27.078160 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1540/3066] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:33:26 2022] POST /identity/v3/projects => generated 409 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:27.082034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:27.117141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41400943-1ab5-4915-8629-0a00fd02039a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:27.160451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:27.245904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:27.246545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:27.246838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:27.247337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:27.248020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:27.275291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:27.335677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1527/3067] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:33:27 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:27.339890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:27.365376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4e737-4f8e-4428-8574-78f6622f9fe0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:27.385043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:27.385916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:27.386356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:27.386729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:27.387503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:27.390489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:27.406316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1541/3068] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:27.411018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:27.423714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1bfb-8875-41bf-bc63-87afb1e59762 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:27.429428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:27.430110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:27.430394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:27.430677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] PATH_INFO: `/v3/projects/53b538305d2b43c2a035f05b65ca0fcf/users/f1140d7f76ab4e6c933a398ba3615d5f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:27.472280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b538305d2b43c2a035f05b65ca0fcf, user_id=f1140d7f76ab4e6c933a398ba3615d5f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:27.475115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:27.513949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1528/3069] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:27 2022] PUT /identity/v3/projects/53b538305d2b43c2a035f05b65ca0fcf/users/f1140d7f76ab4e6c933a398ba3615d5f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:27.517909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:27.532965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956e1ef-38da-4848-9697-7ab09746f638 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:27.592514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:27.657514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb6ca3-2865-4f83-b0b9-e40487ca2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:27.657514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb6ca3-2865-4f83-b0b9-e40487ca2bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:27.657514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb6ca3-2865-4f83-b0b9-e40487ca2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:27.657514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb6ca3-2865-4f83-b0b9-e40487ca2bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:27.657878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb6ca3-2865-4f83-b0b9-e40487ca2bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:27.657878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb6ca3-2865-4f83-b0b9-e40487ca2bbf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:27.666785 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1542/3070] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:27.667633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:27.679578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514002-b78c-448d-918a-4af41164e934 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:27.686148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:27.686530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:27.686802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:27.687416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] PATH_INFO: `/v3/projects/53b538305d2b43c2a035f05b65ca0fcf/users/f1140d7f76ab4e6c933a398ba3615d5f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:27.689652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b538305d2b43c2a035f05b65ca0fcf, user_id=f1140d7f76ab4e6c933a398ba3615d5f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:27.692540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:27.719135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1529/3071] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:27 2022] PUT /identity/v3/projects/53b538305d2b43c2a035f05b65ca0fcf/users/f1140d7f76ab4e6c933a398ba3615d5f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:27.723545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f156-c4ef-4efa-8158-e6d300670732 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:27.724039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f156-c4ef-4efa-8158-e6d300670732 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:27.724482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f156-c4ef-4efa-8158-e6d300670732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:27.787513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2470f156-c4ef-4efa-8158-e6d300670732 None None] MFA Rules not processed for user `f1140d7f76ab4e6c933a398ba3615d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:27.788803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2470f156-c4ef-4efa-8158-e6d300670732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:27.930025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1543/3072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:27.938809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:28.097739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65803ab9-5d93-4ef5-9b63-38172f1340d4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:28.111479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:28.116605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:28.116605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:28.116926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] PATH_INFO: `/v3/users/4f1a04c0cbda420a8f0a90f650842ad3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:28.118232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1a04c0cbda420a8f0a90f650842ad3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:28.121280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:28.245308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1a04c0cbda420a8f0a90f650842ad3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:28.299188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1a04c0cbda420a8f0a90f650842ad3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:28.303102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1a04c0cbda420a8f0a90f650842ad3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:28.329454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1a04c0cbda420a8f0a90f650842ad3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:28.330103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1a04c0cbda420a8f0a90f650842ad3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:28.343948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:28.368947 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1530/3073] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:33:27 2022] DELETE /identity/v3/users/4f1a04c0cbda420a8f0a90f650842ad3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:28.374162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:28.374657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:28.374752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:28.402709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:28.404164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:28.588282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1544/3074] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:28.678505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:28.680600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:28.839280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f417-7a98-465a-8b57-20a397475edd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:28.850571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:28.851206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:28.851513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:28.851796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:28.875503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:28.878950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:28.907787 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1531/3075] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:30.566602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:30.568602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:30.593187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2552-3b18-4970-b636-926f90e2d726 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:30.599284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:30.599941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:30.600275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:30.600562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] PATH_INFO: `/v3/projects/c1492de64d174096b36c4ff52e75babb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:30.602020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1492de64d174096b36c4ff52e75babb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:30.604300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:30.686959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1492de64d174096b36c4ff52e75babb', 'request_id': 'req-811ab935-dddf-4472-8c75-5187653c8b32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:30.694161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:30.715153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1492de64d174096b36c4ff52e75babb', 'request_id': 'req-811ab935-dddf-4472-8c75-5187653c8b32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:30.726438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1492de64d174096b36c4ff52e75babb', 'request_id': 'req-811ab935-dddf-4472-8c75-5187653c8b32'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:30.746259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] The token cache is being invalidate because project c1492de64d174096b36c4ff52e75babb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:30.747739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:30.749087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:30.758263 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1545/3076] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:30 2022] DELETE /identity/v3/projects/c1492de64d174096b36c4ff52e75babb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:30.759641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:30.774094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bd669-c4f5-461f-862e-b8e6f8e31adc service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:30.995897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:30.997533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:30.998890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:30.999942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] PATH_INFO: `/v3/users/f1140d7f76ab4e6c933a398ba3615d5f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:31.002560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1140d7f76ab4e6c933a398ba3615d5f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:31.017276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:31.176598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1140d7f76ab4e6c933a398ba3615d5f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:31.205023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1140d7f76ab4e6c933a398ba3615d5f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:31.206173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1140d7f76ab4e6c933a398ba3615d5f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:31.225746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1140d7f76ab4e6c933a398ba3615d5f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:31.228652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4249f97-a7e6-4292-bd67-cbfc45aae9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1140d7f76ab4e6c933a398ba3615d5f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:31.252277 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1532/3077] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:33:30 2022] DELETE /identity/v3/users/f1140d7f76ab4e6c933a398ba3615d5f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:32.298888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:32.300514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:32.321226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ab935-dddf-4472-8c75-5187653c8b32 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:32.391559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:32.392882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:32.393189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:32.393596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] PATH_INFO: `/v3/projects/53b538305d2b43c2a035f05b65ca0fcf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:32.394714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b538305d2b43c2a035f05b65ca0fcf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:32.396937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:32.494118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b538305d2b43c2a035f05b65ca0fcf', 'request_id': 'req-1efc0864-906b-45b7-b761-97a87626d63b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:32.506294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b538305d2b43c2a035f05b65ca0fcf', 'request_id': 'req-1efc0864-906b-45b7-b761-97a87626d63b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:32.514126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b538305d2b43c2a035f05b65ca0fcf', 'request_id': 'req-1efc0864-906b-45b7-b761-97a87626d63b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:32.526707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] The token cache is being invalidate because project 53b538305d2b43c2a035f05b65ca0fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:32.527003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:32.527661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1efc0864-906b-45b7-b761-97a87626d63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:32.534668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1546/3078] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:32 2022] DELETE /identity/v3/projects/53b538305d2b43c2a035f05b65ca0fcf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:32.536268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:32.536758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:32.536866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:32.566617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:32.568522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:32.599291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:32.672619 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1533/3079] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:32.681360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:32.681658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:32.682012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:32.712379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:32.713593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:32.732690 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1547/3080] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:32.736875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:32.761096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120c991-eb0d-4c08-a8d4-b3c4d8975e09 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:32.769680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:32.770843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:32.771499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:32.772170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:32.773933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:33:32.774409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:32.776153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:32.817931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1534/3081] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:33:32.822343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:32.833161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034f7a2-470d-4490-828c-2c61520b7cd1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:32.841365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:32.842298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:32.842749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:32.843404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:32.844488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:32.847586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:32.897514 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1548/3082] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:33:32 2022] POST /identity/v3/projects => generated 403 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:33:32.899982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:32.925665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b04437-4efd-4c4a-afcd-de471412febf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:33.011315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:33.014616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.014616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.014853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.015471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:33.017731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:33.045774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1535/3083] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:33:32 2022] POST /identity/v3/users => generated 302 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:33:33.050069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:33.066187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d52c4-0fbf-4b8d-9d55-f63305e0d7f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:33.071502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:33.072297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.072495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.072864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.074099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:33.076031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:33.092677 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1549/3084] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:33.094974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:33.107604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c729e9b-e860-417b-a645-bc600481d368 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:33.114094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840099-f0fb-4f0c-b115-8c5bd2e72aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:33.115076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840099-f0fb-4f0c-b115-8c5bd2e72aad admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.115580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840099-f0fb-4f0c-b115-8c5bd2e72aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.116143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840099-f0fb-4f0c-b115-8c5bd2e72aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.116988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840099-f0fb-4f0c-b115-8c5bd2e72aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:33.121248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840099-f0fb-4f0c-b115-8c5bd2e72aad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:33.136702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1536/3085] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:33.141101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:33.152617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbd072-20c9-4390-87fb-57ac3f4a6417 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:33.158506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713e0fb-9bf3-4f31-804b-af70a6f345ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:33.159656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e0fb-9bf3-4f31-804b-af70a6f345ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.160168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e0fb-9bf3-4f31-804b-af70a6f345ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.160776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713e0fb-9bf3-4f31-804b-af70a6f345ec admin admin] PATH_INFO: `/v3/projects/14134ed022a24bafb4c1a385c72b08a8/users/2aacac390d324eab9de3ab40579cdb3e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.181063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713e0fb-9bf3-4f31-804b-af70a6f345ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=14134ed022a24bafb4c1a385c72b08a8, user_id=2aacac390d324eab9de3ab40579cdb3e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:33.186419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713e0fb-9bf3-4f31-804b-af70a6f345ec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:33.211717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.212454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.212965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.220057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1550/3086] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:33 2022] PUT /identity/v3/projects/14134ed022a24bafb4c1a385c72b08a8/users/2aacac390d324eab9de3ab40579cdb3e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:33.230535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.230811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.231213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.271092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] MFA Rules not processed for user `0f6f5c78d11f4ecf9ff99a95df8e1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:33.272467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:33.274110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:33.275490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:33.291753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:33.409868 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1551/3087] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:33.421456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:33.431109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:33.446640 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1537/3088] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:33.471511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:33.473107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:33.490028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:33.528777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd942-31a9-4947-bd9f-93cf5cd77aa6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:33.541044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab755d0-7306-435d-b0ac-c3a8e244f85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:33.542216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab755d0-7306-435d-b0ac-c3a8e244f85b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.542690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab755d0-7306-435d-b0ac-c3a8e244f85b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.543125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab755d0-7306-435d-b0ac-c3a8e244f85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.569090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab755d0-7306-435d-b0ac-c3a8e244f85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:33.570833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab755d0-7306-435d-b0ac-c3a8e244f85b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:33.587662 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1552/3089] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:33.614086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdebcf-6c3f-4a78-be33-9aa4d9f2f187 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:33.621414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:33.623456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:33.623763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:33.624045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:33.627570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:33.753185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:33.758752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:33.776259 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1538/3090] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:33:40.096801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c1500-9dd1-4933-a4dd-50c81b680c50 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:40.097375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c1500-9dd1-4933-a4dd-50c81b680c50 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:40.097375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c1500-9dd1-4933-a4dd-50c81b680c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:40.133851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-947c1500-9dd1-4933-a4dd-50c81b680c50 None None] MFA Rules not processed for user `6c889d2c39af44c693a3c15b5ba4bca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:40.141146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-947c1500-9dd1-4933-a4dd-50c81b680c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:40.160083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1553/3091] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:41.409882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:41.425435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34f62-dbcd-4b77-ad23-4e513add27dd service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:41.435125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:41.435898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:41.436181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:41.436657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:41.441776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:41.467280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:41.469212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:41.488822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1539/3092] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:44.287290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:44.287836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:44.287836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:44.354140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] MFA Rules not processed for user `2aacac390d324eab9de3ab40579cdb3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:44.357927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:44.504839 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1554/3093] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:44.702121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:44.705623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:44.746277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f3ac-00e1-48e3-a871-e2bd8db531ea service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:44.753885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:44.755244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:44.755718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:44.756165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:44.769970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:44.772792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:44.789707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1540/3094] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:44 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:45.690739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:45.704711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2ddc-8840-4184-afc2-f5d15db47414 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:45.711363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:45.712401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:45.712876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:45.723911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:45.730153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:45.798336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:45.848764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:45.850675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:45.863294 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1555/3095] 10.222.0.16 () {60 vars in 1396 bytes} [Wed Oct 5 02:33:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:51.507048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:51.518207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd06f8e-a3f9-4d69-a468-e92e11e0d826 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:51.523445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:51.524215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:51.524350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:51.524831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] PATH_INFO: `/v3/users/2aacac390d324eab9de3ab40579cdb3e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:51.526011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aacac390d324eab9de3ab40579cdb3e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:51.528719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:51.606535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aacac390d324eab9de3ab40579cdb3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:51.626152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aacac390d324eab9de3ab40579cdb3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:51.628250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aacac390d324eab9de3ab40579cdb3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:51.641479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aacac390d324eab9de3ab40579cdb3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:51.642262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d98d77f-dabb-481f-8cc8-2abaf0da25da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aacac390d324eab9de3ab40579cdb3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:51.643824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:51.662592 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1541/3096] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:33:51 2022] DELETE /identity/v3/users/2aacac390d324eab9de3ab40579cdb3e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:51.838651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:51.861735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a18d-d9c1-454a-a157-0a5c0041af56 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:51.955526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:51.956191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:51.956473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:51.956749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] PATH_INFO: `/v3/projects/14134ed022a24bafb4c1a385c72b08a8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:51.958508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14134ed022a24bafb4c1a385c72b08a8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:51.960553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.026656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14134ed022a24bafb4c1a385c72b08a8', 'request_id': 'req-b98f3b7c-44be-4daa-9c66-b753adf1cc69'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:52.036594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14134ed022a24bafb4c1a385c72b08a8', 'request_id': 'req-b98f3b7c-44be-4daa-9c66-b753adf1cc69'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:52.042816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14134ed022a24bafb4c1a385c72b08a8', 'request_id': 'req-b98f3b7c-44be-4daa-9c66-b753adf1cc69'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:52.054945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] The token cache is being invalidate because project 14134ed022a24bafb4c1a385c72b08a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:33:52.055247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:52.056028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b98f3b7c-44be-4daa-9c66-b753adf1cc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:33:52.061045 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1556/3097] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:33:51 2022] DELETE /identity/v3/projects/14134ed022a24bafb4c1a385c72b08a8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:52.062837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.063942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.064224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.084975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:52.087513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:52.164766 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1542/3098] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:52.166396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.167207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.167682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.193714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:52.195282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:52.205808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1557/3099] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:52.210076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.220208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3b89-434b-4a07-8e8d-02566edf806b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.225393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.225616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.226108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.226452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.227182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:33:52.227560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.229608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.243457 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1543/3100] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:33:52.248204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.257590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61d959-1004-4b8c-aff2-197d6ef1506c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.263053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.263739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.264089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.264434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.265222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.267241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.300732 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1558/3101] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:33:52 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:33:52.302010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.312029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0465b-9195-4ec3-becc-937bd661df34 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.385150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.386245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.386629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.387036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.388287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.390322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.417920 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1544/3102] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:33:52 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:33:52.421858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.464355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6687-f15f-4073-b6c1-527c60f23f55 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.471788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.472408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.472689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.472993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.473644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.489280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.517398 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1559/3103] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:33:52.517645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.532724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5d4f8-9bfc-4ee0-a079-4672dbe7c7bf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.541147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30dc95-fe64-482a-ad08-a9ac013dbe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.541849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30dc95-fe64-482a-ad08-a9ac013dbe61 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.542219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30dc95-fe64-482a-ad08-a9ac013dbe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.543538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30dc95-fe64-482a-ad08-a9ac013dbe61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.544468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30dc95-fe64-482a-ad08-a9ac013dbe61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.546410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30dc95-fe64-482a-ad08-a9ac013dbe61 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.563657 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1545/3104] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:33:52.567449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.583805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f110dd-810f-43e2-a705-4725bf33f31f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.598010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.598010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.598320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.598454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] PATH_INFO: `/v3/projects/47098be734b14277a4d9a9d6b8464998/users/4c441be8c87648bf9f1ff5cd4aff2532/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.631982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47098be734b14277a4d9a9d6b8464998, user_id=4c441be8c87648bf9f1ff5cd4aff2532, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.634784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.648732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:52.661528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1560/3105] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:33:52 2022] PUT /identity/v3/projects/47098be734b14277a4d9a9d6b8464998/users/4c441be8c87648bf9f1ff5cd4aff2532/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:33:52.662975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181674-5910-4efb-acfb-281e30cecc6e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.663266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181674-5910-4efb-acfb-281e30cecc6e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.663544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12181674-5910-4efb-acfb-281e30cecc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.713420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-12181674-5910-4efb-acfb-281e30cecc6e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:52.716457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12181674-5910-4efb-acfb-281e30cecc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:52.773096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:33:52.787276 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1546/3106] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:33:52.801801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:33:52.803761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:52.888194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb929b8-fe04-491b-b2d9-faa58d1c7d5d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:33:52.893082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989232d-37f0-481e-9b0a-4aaaf1bc6410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:33:52.894534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989232d-37f0-481e-9b0a-4aaaf1bc6410 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:52.895081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989232d-37f0-481e-9b0a-4aaaf1bc6410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:52.895572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989232d-37f0-481e-9b0a-4aaaf1bc6410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:52.910024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989232d-37f0-481e-9b0a-4aaaf1bc6410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:33:52.911945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989232d-37f0-481e-9b0a-4aaaf1bc6410 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:33:52.926536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1561/3107] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:33:59.547722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:59.548311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:59.548311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:59.602333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] MFA Rules not processed for user `4c441be8c87648bf9f1ff5cd4aff2532`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:59.604796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:59.742709 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1547/3108] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:33:59.806030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:33:59.806030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:33:59.806030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:33:59.832865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] MFA Rules not processed for user `4c441be8c87648bf9f1ff5cd4aff2532`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:33:59.834156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:33:59.842000 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1562/3109] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:00.462410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:00.464265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:00.662781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709660c-002e-4ced-be49-0c73f16f193b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:00.685532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e061acd-8b49-4cbd-9ad9-0fff4e53906c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:00.690664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e061acd-8b49-4cbd-9ad9-0fff4e53906c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:00.691784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e061acd-8b49-4cbd-9ad9-0fff4e53906c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:00.692383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e061acd-8b49-4cbd-9ad9-0fff4e53906c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:00.706663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e061acd-8b49-4cbd-9ad9-0fff4e53906c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:00.708788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e061acd-8b49-4cbd-9ad9-0fff4e53906c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:00.722297 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1548/3110] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:34:06.792920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:06.794804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:06.822150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73695b63-0662-4991-b3e9-c659e9362f7f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:06.841863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:06.845691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:06.846221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:06.846683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:06.857922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:07.009858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:07.011497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:07.042097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1563/3111] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:06 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:34:10.715656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=68 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:10.818180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:10.818480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:10.818759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:10.838247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] MFA Rules not processed for user `118c1425677b45b98689befb0eb55cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:10.839443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:10.897247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1549/3112] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:12.428870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:12.444844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21942e-6fc1-44ab-bc93-cf14ead00809 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:12.451258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:12.451978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:12.452326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:12.452675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:12.457026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:12.474482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:12.476851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:12.492709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1564/3113] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:34:12.527360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:12.544975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcba00b-6d8c-4b5c-a677-0fb9fe9a7946 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:12.551572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:12.553021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:12.554068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:12.554435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:12.560079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:12.577649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:12.580014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:12.597818 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1550/3114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:34:20.394970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:20.401775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:20.460876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ec165-516d-48ee-bb0c-0ccf394d5551 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:20.473867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:20.476800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:20.477132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:20.477418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] PATH_INFO: `/v3/users/0b8c2b48f17b470aaa79d4f4a4a7215c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:20.487576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8c2b48f17b470aaa79d4f4a4a7215c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:20.489766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:20.675842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8c2b48f17b470aaa79d4f4a4a7215c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:20.706039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8c2b48f17b470aaa79d4f4a4a7215c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:20.707291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8c2b48f17b470aaa79d4f4a4a7215c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:20.730219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8c2b48f17b470aaa79d4f4a4a7215c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:20.734239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2730b928-fe5a-4581-b77f-7a2f88c31cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8c2b48f17b470aaa79d4f4a4a7215c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:20.739418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:20.789306 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1565/3115] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:34:20 2022] DELETE /identity/v3/users/0b8c2b48f17b470aaa79d4f4a4a7215c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:34:21.149863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:21.165513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a88862-519c-4488-b668-9c353b9e5f7d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:21.209941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc870-e92a-4a22-a889-a895ae759724 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.211015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc870-e92a-4a22-a889-a895ae759724 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.212804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cc870-e92a-4a22-a889-a895ae759724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.277051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b27cc870-e92a-4a22-a889-a895ae759724 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:21.278467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b27cc870-e92a-4a22-a889-a895ae759724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:21.302732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:21.303765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.304049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.304510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] PATH_INFO: `/v3/projects/dc5e5d31e8a94667b52be18ed414d846` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.306169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5e5d31e8a94667b52be18ed414d846)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:21.309543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:21.382434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5e5d31e8a94667b52be18ed414d846', 'request_id': 'req-9bab0b85-f39c-42e4-8da1-571fab84963d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:21.396678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5e5d31e8a94667b52be18ed414d846', 'request_id': 'req-9bab0b85-f39c-42e4-8da1-571fab84963d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:21.406151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5e5d31e8a94667b52be18ed414d846', 'request_id': 'req-9bab0b85-f39c-42e4-8da1-571fab84963d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:21.413521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1566/3116] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:34:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:21.423596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] The token cache is being invalidate because project dc5e5d31e8a94667b52be18ed414d846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:34:21.424179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:21.427131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:34:21.429127 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1551/3117] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:34:21 2022] DELETE /identity/v3/projects/dc5e5d31e8a94667b52be18ed414d846 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:34:21.434342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41018-eebe-4680-989f-1c7311f32487 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.435666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41018-eebe-4680-989f-1c7311f32487 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.436397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41018-eebe-4680-989f-1c7311f32487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.460833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0bc41018-eebe-4680-989f-1c7311f32487 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:21.462129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0bc41018-eebe-4680-989f-1c7311f32487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:21.511188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:21.520176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:21.554829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:21.564049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1567/3118] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:34:21.566192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.566561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.566852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.619929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:21.622518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:21.622773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab0b85-f39c-42e4-8da1-571fab84963d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:21.628938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:21.629550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.629830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.630106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.631913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:21.634344 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1568/3119] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:34:21.638409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:21.657921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf68506-dbe7-483d-a337-38ee1899b5fa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:21.664209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:21.665112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.669616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.671594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.672297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:34:21.672608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:21.680273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:21.700395 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1569/3120] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:34:21.705604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:21.717896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:21.718145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f129f-93e4-4068-817a-0c8ceb7c3bed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:21.719846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:21.723105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:21.724090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.724470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.725114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.726058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:21.728056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:21.740275 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1552/3121] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:21.778985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:21.779861 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1570/3122] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:34:21 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:34:21.791547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3cdc8-0fdc-4cc1-86de-fac44e7a4988 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:21.884315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:21.885620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.886270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.887427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.888370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:21.891129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:21.936171 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1553/3123] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:34:21 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:34:21.940821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:21.964851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096f394-bba1-47fd-8eed-afb9f463a104 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:21.976591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:21.977495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:21.977890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:21.978455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:21.980952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:21.984508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:22.018994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1571/3124] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:34:22.019595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:22.033679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27ed2-341b-4938-a8d9-3c27590f7e57 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:22.044451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c4c9e-cddd-4fea-a916-9d0c9f21f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:22.045168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4c9e-cddd-4fea-a916-9d0c9f21f1be admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:22.045493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4c9e-cddd-4fea-a916-9d0c9f21f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:22.046162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c4c9e-cddd-4fea-a916-9d0c9f21f1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:22.047657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c4c9e-cddd-4fea-a916-9d0c9f21f1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:22.049626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c4c9e-cddd-4fea-a916-9d0c9f21f1be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:22.072715 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1554/3125] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:34:22.075473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:22.098117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50621a1-97eb-4ac2-b31d-42a8bbf8cd03 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:22.104998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:22.108548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:22.109307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:22.109846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] PATH_INFO: `/v3/projects/7719a3153f66484c8758bb0999719851/users/f551e15d65a34daaac2b4d4f5963c522/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:22.154025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7719a3153f66484c8758bb0999719851, user_id=f551e15d65a34daaac2b4d4f5963c522, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:22.157139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:22.189043 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1572/3126] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:34:22 2022] PUT /identity/v3/projects/7719a3153f66484c8758bb0999719851/users/f551e15d65a34daaac2b4d4f5963c522/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:34:22.201102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f877bcf-3145-4c4f-96f0-cd385c61d8cb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:22.203555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f877bcf-3145-4c4f-96f0-cd385c61d8cb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:22.204432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f877bcf-3145-4c4f-96f0-cd385c61d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:22.311304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6f877bcf-3145-4c4f-96f0-cd385c61d8cb None None] MFA Rules not processed for user `f551e15d65a34daaac2b4d4f5963c522`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:22.318420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6f877bcf-3145-4c4f-96f0-cd385c61d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:22.404129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:22.482422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1555/3127] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:26.338762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:26.341243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:26.367543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:26.473726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16028d-7053-4d23-ad45-13202ca70599 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:26.479896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:26.483811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:26.484104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:26.484587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:26.515091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:26.517604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:26.534829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1573/3128] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:34:27.401222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f17f5-7847-4f74-bd46-a94614726715 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:27.401800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f17f5-7847-4f74-bd46-a94614726715 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:27.401800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f17f5-7847-4f74-bd46-a94614726715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:27.426184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e10f17f5-7847-4f74-bd46-a94614726715 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:27.427574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e10f17f5-7847-4f74-bd46-a94614726715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:27.523418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1556/3129] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:34:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:27.539731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:27.618977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef252-75c0-464e-854b-3e70490ecd3b service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:27.624442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:27.625161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:27.625448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:27.625728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:27.635125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:27.637409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:27.647750 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1574/3130] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:34:34.404049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5cb94-18d4-45c8-97b8-cf2f00ca97c8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:34.404608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5cb94-18d4-45c8-97b8-cf2f00ca97c8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:34.404608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5cb94-18d4-45c8-97b8-cf2f00ca97c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:34.425334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-10a5cb94-18d4-45c8-97b8-cf2f00ca97c8 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:34.426549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10a5cb94-18d4-45c8-97b8-cf2f00ca97c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:34.435447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1557/3131] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:34:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:34.462811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:34.476978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3794d9-60d3-447a-b4e3-90002055b428 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:34.484115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:34.485030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:34.485557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:34.486017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:34.510398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:34.512835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:34.533738 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1575/3132] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:36.290233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88150c81-485f-49e1-b810-f065f9358662 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:36.290834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88150c81-485f-49e1-b810-f065f9358662 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:36.290834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88150c81-485f-49e1-b810-f065f9358662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:36.342511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-88150c81-485f-49e1-b810-f065f9358662 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:36.343739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-88150c81-485f-49e1-b810-f065f9358662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:36.373089 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1558/3133] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:34:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:36.387612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:36.404091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda166-34c0-449b-bb0f-6ca70814055b service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:36.437364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:36.442431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:36.443741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:36.444272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:36.484289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:36.492224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:36.533151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1576/3134] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:38.239958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5806-8f05-46f9-babc-a1604e8f82c6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:38.240993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5806-8f05-46f9-babc-a1604e8f82c6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:38.241621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de5806-8f05-46f9-babc-a1604e8f82c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:38.280708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98de5806-8f05-46f9-babc-a1604e8f82c6 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:38.282371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98de5806-8f05-46f9-babc-a1604e8f82c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:38.294398 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1559/3135] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:38.324161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:38.340768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fa95f-0d65-43a9-b634-ed0012c113cd service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:38.346637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09e349-078b-4446-a4e6-df92832015a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:38.347249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09e349-078b-4446-a4e6-df92832015a3 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:38.347666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09e349-078b-4446-a4e6-df92832015a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:38.347937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09e349-078b-4446-a4e6-df92832015a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:38.373192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09e349-078b-4446-a4e6-df92832015a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:38.374936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09e349-078b-4446-a4e6-df92832015a3 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:38.389922 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1577/3136] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:39.335846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75dd77-32d8-4717-a23e-e5b8d11e7ba2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:39.336433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75dd77-32d8-4717-a23e-e5b8d11e7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:39.337421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75dd77-32d8-4717-a23e-e5b8d11e7ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:39.375205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6e75dd77-32d8-4717-a23e-e5b8d11e7ba2 None None] MFA Rules not processed for user `f551e15d65a34daaac2b4d4f5963c522`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:39.380343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6e75dd77-32d8-4717-a23e-e5b8d11e7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:39.397465 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1560/3137] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:40.076362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec56e-05b0-4fc9-825a-2531d70ddb1c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:40.077638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec56e-05b0-4fc9-825a-2531d70ddb1c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:40.078603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec56e-05b0-4fc9-825a-2531d70ddb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:40.168186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-caaec56e-05b0-4fc9-825a-2531d70ddb1c None None] MFA Rules not processed for user `f551e15d65a34daaac2b4d4f5963c522`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:40.171981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-caaec56e-05b0-4fc9-825a-2531d70ddb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:40.216228 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1578/3138] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:41.900516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea27dd-f5df-4fb8-b3f4-aff385385809 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:41.901134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea27dd-f5df-4fb8-b3f4-aff385385809 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:41.901325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea27dd-f5df-4fb8-b3f4-aff385385809 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:41.903554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1561/3139] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:34:41.932707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b84c-3f54-4ee0-a28c-ca760913a7b6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:41.933847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b84c-3f54-4ee0-a28c-ca760913a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:41.934703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7b84c-3f54-4ee0-a28c-ca760913a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:41.974706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-80d7b84c-3f54-4ee0-a28c-ca760913a7b6 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:41.977833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80d7b84c-3f54-4ee0-a28c-ca760913a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:42.081188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:42.118737 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1579/3140] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:34:42.190130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea27dd-f5df-4fb8-b3f4-aff385385809 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:42.190130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7bea27dd-f5df-4fb8-b3f4-aff385385809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:42.454792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea27dd-f5df-4fb8-b3f4-aff385385809 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:42.464647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:42.466886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:42.467200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:42.470412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:42.579780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:42.582450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:42.644422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1562/3141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:34:45.227190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181b5a-e12a-466e-a154-44e7c00db43e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:45.227770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181b5a-e12a-466e-a154-44e7c00db43e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:45.227770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181b5a-e12a-466e-a154-44e7c00db43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:45.250054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2e181b5a-e12a-466e-a154-44e7c00db43e None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:45.251194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e181b5a-e12a-466e-a154-44e7c00db43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:45.258537 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1580/3142] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:34:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:45.275041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:45.295150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fb6cf-bfe5-4ddc-9890-ffd9ff80ce40 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:45.308859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c746ff-d02e-4b6f-93e9-9bc13001a620 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:45.309615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c746ff-d02e-4b6f-93e9-9bc13001a620 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:45.309898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c746ff-d02e-4b6f-93e9-9bc13001a620 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:45.310167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c746ff-d02e-4b6f-93e9-9bc13001a620 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:45.335413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c746ff-d02e-4b6f-93e9-9bc13001a620 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:45.337897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c746ff-d02e-4b6f-93e9-9bc13001a620 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:45.360410 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1563/3143] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:46.265117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:46.265997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:46.266514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:46.283544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074522e-add8-4ea4-8081-6eee052cf208 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:46.284444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074522e-add8-4ea4-8081-6eee052cf208 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:46.284883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074522e-add8-4ea4-8081-6eee052cf208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:46.310841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5074522e-add8-4ea4-8081-6eee052cf208 None None] MFA Rules not processed for user `4c441be8c87648bf9f1ff5cd4aff2532`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:46.312713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5074522e-add8-4ea4-8081-6eee052cf208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:46.321192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] MFA Rules not processed for user `9f23399a5f1c4af6855a098198ca4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:46.324152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:46.366874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:46.423942 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1564/3144] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:46.431981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1581/3145] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:56.394315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:56.421759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=30 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:34:59.024353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:59.025361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:59.025785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:59.130827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:34:59.132425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:34:59.188451 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1565/3146] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:34:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:34:59.194734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:59.282442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee1b8c-c2ad-457c-a073-7de0145843a9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:34:59.297552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549caee5-9702-4299-9658-511b6048d298 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:34:59.298416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549caee5-9702-4299-9658-511b6048d298 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:34:59.298880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549caee5-9702-4299-9658-511b6048d298 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:34:59.299324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549caee5-9702-4299-9658-511b6048d298 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:34:59.319387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549caee5-9702-4299-9658-511b6048d298 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:34:59.321559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549caee5-9702-4299-9658-511b6048d298 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:34:59.347787 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1582/3147] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:34:59.826891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:34:59.828801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:00.108558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056818d-edce-4acd-80f3-5f63e23a840f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:00.119709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:00.121165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:00.121644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:00.121921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:00.124037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:00.146925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:00.151803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cae693-f443-454d-a3a8-8d8545409602 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:00.178541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1566/3148] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:34:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:09.327552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=17 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:10.168070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=61 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:13.084026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549caee5-9702-4299-9658-511b6048d298 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:13.101613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549caee5-9702-4299-9658-511b6048d298 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:13.110920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:13.111654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:13.112042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:13.112422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:13.114530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:13.130150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:13.132315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:13.145376 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1583/3149] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:19.288055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c1124-7c58-46e0-93f1-8a73bc9e486b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:19.288596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c1124-7c58-46e0-93f1-8a73bc9e486b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:19.288773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c1124-7c58-46e0-93f1-8a73bc9e486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:19.309609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e85c1124-7c58-46e0-93f1-8a73bc9e486b None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:19.310849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e85c1124-7c58-46e0-93f1-8a73bc9e486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:19.326155 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1567/3150] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:35:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:19.338667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:19.353297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5253f-7d82-4175-896b-de3e4e7efa57 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:19.359293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:19.360245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:19.360774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:19.361313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:19.372535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:19.374960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:19.401080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1584/3151] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:35:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:35:23.107840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:23.108387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:23.108387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:23.142646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:23.145513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:23.156561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1568/3152] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:23.212776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:23.224695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43097b-57f1-41b6-86c8-87644b14e760 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:23.231509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:23.232127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:23.232416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:23.232690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:23.241695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:23.243542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:23.253331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1585/3153] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:35:27.193783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:27.195368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:27.255911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56598125-f984-4504-aed9-21d83f9bee04 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:27.261870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:27.265860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:27.266710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:27.267555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:27.269813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:27.413629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:27.415010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:27.440951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1569/3154] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:29.169012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:29.171241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:29.201986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e9ee-4729-4e7b-861e-f6264ea0d8dc service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:29.211715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:29.212670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:29.218961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:29.219507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] PATH_INFO: `/v3/users/a262a7ca2be4451a89330098b6134c77` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:29.221562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a262a7ca2be4451a89330098b6134c77)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:29.224053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:29.332069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a262a7ca2be4451a89330098b6134c77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.352437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a262a7ca2be4451a89330098b6134c77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.353418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a262a7ca2be4451a89330098b6134c77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.393462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a262a7ca2be4451a89330098b6134c77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.395298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9d11829-125c-4d5a-bd65-1609db6dd0fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a262a7ca2be4451a89330098b6134c77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.438379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1586/3155] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:35:29 2022] DELETE /identity/v3/users/a262a7ca2be4451a89330098b6134c77 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:29.717405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:29.745060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0d020-859d-49f5-89cb-4d0edb75013c service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:29.815861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:29.816835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:29.817365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:29.817967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] PATH_INFO: `/v3/projects/4a08a51781e84e1eb215037744ee3a7b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:29.819372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a08a51781e84e1eb215037744ee3a7b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:29.833663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:29.896889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:29.917525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a08a51781e84e1eb215037744ee3a7b', 'request_id': 'req-90f1460b-8aa7-45f7-9377-eaf0a293122c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.925403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a08a51781e84e1eb215037744ee3a7b', 'request_id': 'req-90f1460b-8aa7-45f7-9377-eaf0a293122c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.949737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a08a51781e84e1eb215037744ee3a7b', 'request_id': 'req-90f1460b-8aa7-45f7-9377-eaf0a293122c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.976627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] The token cache is being invalidate because project 4a08a51781e84e1eb215037744ee3a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:35:29.978121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.981458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90f1460b-8aa7-45f7-9377-eaf0a293122c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:29.984437 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1570/3156] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:29 2022] DELETE /identity/v3/projects/4a08a51781e84e1eb215037744ee3a7b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:29.989069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:29.989544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:29.989975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.071675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:30.073366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:30.219708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1587/3157] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:30.240494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:30.240494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:30.240494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.333159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:30.334367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:30.370184 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1571/3158] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:30.374380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:30.379770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:30.398908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cd5bd-dd0e-4dd4-9f7c-87640407f973 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:30.420770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:30.421652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:30.422022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:30.422642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.424356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:35:30.425430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:30.429108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:30.469352 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1588/3159] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:35:30.471483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:30.497647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83407-8850-4b19-8dd8-854eb600bd00 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:30.517137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:30.518022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:30.518331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:30.518564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.519216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:30.521164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:30.582753 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1572/3160] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:35:30 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:35:30.584357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:30.603362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30313a-8a0c-4e33-8ffd-382f7f33500a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:30.778900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:30.779792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:30.780297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:30.780664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.781433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:30.791176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:30.851955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1589/3161] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:35:30 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:35:30.856138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:30.874561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0648560-2df9-4438-97d4-b92359fd3426 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:30.887582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:30.892616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:30.893167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:30.893583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.895014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:30.902687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:30.924311 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1573/3162] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:35:30.927550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:30.943302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84894f6-cc6c-453d-8336-748d54f5fa67 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:30.971944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35db6b-b2d8-45d3-8600-85da0c5feca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:30.973321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35db6b-b2d8-45d3-8600-85da0c5feca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:30.973694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35db6b-b2d8-45d3-8600-85da0c5feca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:30.974045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35db6b-b2d8-45d3-8600-85da0c5feca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:30.974790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35db6b-b2d8-45d3-8600-85da0c5feca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:30.979156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35db6b-b2d8-45d3-8600-85da0c5feca6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:31.016957 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1590/3163] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:35:31.017813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:31.043874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b55b1-3f49-49a0-afa3-1fb859720357 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:31.064765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16905-793b-49e3-86b7-16380b54e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:31.065907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16905-793b-49e3-86b7-16380b54e2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:31.067028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16905-793b-49e3-86b7-16380b54e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:31.067651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16905-793b-49e3-86b7-16380b54e2e6 admin admin] PATH_INFO: `/v3/projects/fc3fd0eb45ed4080af876031348f367a/users/9e5ffbccdbec4a4bb21a3e48c1f7beaf/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:31.110576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16905-793b-49e3-86b7-16380b54e2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3fd0eb45ed4080af876031348f367a, user_id=9e5ffbccdbec4a4bb21a3e48c1f7beaf, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:31.116755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16905-793b-49e3-86b7-16380b54e2e6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:31.177446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1574/3164] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:35:31 2022] PUT /identity/v3/projects/fc3fd0eb45ed4080af876031348f367a/users/9e5ffbccdbec4a4bb21a3e48c1f7beaf/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:35:31.182442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:31.183173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:31.183615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:31.224938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:31.227002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:31.297332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:31.298161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:31.298585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:31.363638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:31.365526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:31.479831 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1591/3165] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:31.487674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:31.489675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:31.642064 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1575/3166] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:35:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:31.668960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:31.670554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:31.797572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22f4f6-ba52-4b42-9db5-1f1ae7970e5a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:31.801814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:31.802764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:31.803274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:31.803799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:31.819954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:31.821733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:31.849232 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1592/3167] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:31.899452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:31.943437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8d85d-bba3-4f24-8687-9e888de49749 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:31.958173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:31.958948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:31.959882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:31.962342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:31.997018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:31.998890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:32.007835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:32.009921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:32.028415 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1576/3168] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:35:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:35:32.030894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:32.250601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612c428-ca95-429d-bcc8-279055465863 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:32.277425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:32.278345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:32.278811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:32.279232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:32.281270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:32.437535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:32.445090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0574707-cc56-40f7-9588-5e80611ee63b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:32.474914 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1593/3169] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:35.742999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:35.744600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:35.921700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dd52a-376d-4e9e-843f-7c6136ab9ac9 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:35.927356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:35.927982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:35.928264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:35.928589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:35.938753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:35.965736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:35.967363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:35.987908 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1577/3170] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:36.201904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:36.202440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:36.202528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:36.250567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] MFA Rules not processed for user `4c441be8c87648bf9f1ff5cd4aff2532`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:36.252466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:36.446569 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1594/3171] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:36 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:39.119242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:39.122483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:39.199613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fca87-3289-4591-81b0-d62d1b772013 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:39.219745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:39.220382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:39.232294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:39.232609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:39.239184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:39.292533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:39.298367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58eb4b-763f-483d-a7c1-7b4cc9d116e5 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:39.336222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1578/3172] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:39.490464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:39.511478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f171-ef92-4dc7-a0d1-6046c0dbe60a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:39.523270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:39.524143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:39.524569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:39.525057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:39.531426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:39.560852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:39.562605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:39.587555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1595/3173] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:44.422273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1437ac-45fd-499b-ad7f-05c3970ec43c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:44.422948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1437ac-45fd-499b-ad7f-05c3970ec43c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:44.422948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1437ac-45fd-499b-ad7f-05c3970ec43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:44.491293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1c1437ac-45fd-499b-ad7f-05c3970ec43c None None] MFA Rules not processed for user `9e5ffbccdbec4a4bb21a3e48c1f7beaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:44.493095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1c1437ac-45fd-499b-ad7f-05c3970ec43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:44.595125 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1579/3174] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:44.607379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:44.626986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbafba-7325-4ebf-8867-f5824cbec06d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:44.632613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:44.633510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:44.633794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:44.634069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:44.668993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:44.671356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:44.732371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1596/3175] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:48.218408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b26a-9fee-411b-a4d7-a0a80de7efd2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:48.218929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b26a-9fee-411b-a4d7-a0a80de7efd2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:48.219040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b26a-9fee-411b-a4d7-a0a80de7efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:48.253901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0bc8b26a-9fee-411b-a4d7-a0a80de7efd2 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:48.255506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0bc8b26a-9fee-411b-a4d7-a0a80de7efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:48.285838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:48.293356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:48.293965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1580/3176] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:35:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:48.306524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7092e-0acc-47ec-b37b-2076e805700c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:48.314305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:48.315405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:48.315911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:48.316405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:48.331761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:48.335083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:48.347990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1597/3177] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:35:50.835462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:50.836804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:50.837394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:50.882060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] MFA Rules not processed for user `9e5ffbccdbec4a4bb21a3e48c1f7beaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:50.883830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:50.896571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1581/3178] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:51.669410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:51.670867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:51.702215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b776d-ab9e-4c3e-b818-b9ff0808e39b service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:51.719614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:51.720521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:51.732098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:51.733006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] PATH_INFO: `/v3/users/39671ba0b86847f995c96013947fee65` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:51.735028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=39671ba0b86847f995c96013947fee65)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:51.746340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:51.888728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39671ba0b86847f995c96013947fee65'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:51.919257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39671ba0b86847f995c96013947fee65'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:51.920602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39671ba0b86847f995c96013947fee65'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:51.946829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39671ba0b86847f995c96013947fee65'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:51.948894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39671ba0b86847f995c96013947fee65'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:51.989700 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1598/3179] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:35:51 2022] DELETE /identity/v3/users/39671ba0b86847f995c96013947fee65 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:52.520510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:52.541446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fccaa-fec0-448e-8f09-a6121c0d45e7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:52.694007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:52.735168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:52.735625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:52.735909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:52.736190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] PATH_INFO: `/v3/projects/bbd25b0a68f749029eeed701c77462ce` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:52.745217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd25b0a68f749029eeed701c77462ce)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:52.754412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:52.910934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd25b0a68f749029eeed701c77462ce', 'request_id': 'req-e62707c6-ea76-4e86-83ee-78be1c00a5c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:52.939632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd25b0a68f749029eeed701c77462ce', 'request_id': 'req-e62707c6-ea76-4e86-83ee-78be1c00a5c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:52.964611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd25b0a68f749029eeed701c77462ce', 'request_id': 'req-e62707c6-ea76-4e86-83ee-78be1c00a5c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.010974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] The token cache is being invalidate because project bbd25b0a68f749029eeed701c77462ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:35:53.011799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.017919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.022642 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1582/3180] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:52 2022] DELETE /identity/v3/projects/bbd25b0a68f749029eeed701c77462ce => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:53.026395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:53.030780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:53.070289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554045e-0091-4f95-bf7a-d0dab57350bc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:53.238482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:53.239892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:53.241605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:53.243943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] PATH_INFO: `/v3/users/6dfa347c77704102857f5fea97bc130b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:53.245664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfa347c77704102857f5fea97bc130b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:53.252406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:53.401816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfa347c77704102857f5fea97bc130b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.451853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:53.458044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfa347c77704102857f5fea97bc130b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.465099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfa347c77704102857f5fea97bc130b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.487227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfa347c77704102857f5fea97bc130b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.487860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8fdf75e3-eb59-4535-bb66-b84eee431001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfa347c77704102857f5fea97bc130b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:53.517391 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1599/3181] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:35:53 2022] DELETE /identity/v3/users/6dfa347c77704102857f5fea97bc130b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:53.952857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:53.954446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:53.988035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62707c6-ea76-4e86-83ee-78be1c00a5c7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:54.360406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:54.361208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:54.363021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:54.376377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] PATH_INFO: `/v3/projects/73917320d66041dab18fbbb7afe26d6e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:54.387414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73917320d66041dab18fbbb7afe26d6e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:54.397855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:54.526841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73917320d66041dab18fbbb7afe26d6e', 'request_id': 'req-42a50875-d21c-48e3-8d89-69c1008f6384'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:54.545111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73917320d66041dab18fbbb7afe26d6e', 'request_id': 'req-42a50875-d21c-48e3-8d89-69c1008f6384'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:54.568365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73917320d66041dab18fbbb7afe26d6e', 'request_id': 'req-42a50875-d21c-48e3-8d89-69c1008f6384'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:54.593851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:54.603727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] The token cache is being invalidate because project 73917320d66041dab18fbbb7afe26d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:35:54.604669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:54.607809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42a50875-d21c-48e3-8d89-69c1008f6384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:35:54.611480 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1583/3182] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:35:53 2022] DELETE /identity/v3/projects/73917320d66041dab18fbbb7afe26d6e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:54.616724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:54.617974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:54.618720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:54.673957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:54.675811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:54.825332 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1600/3183] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:54.828336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:54.828620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:54.828986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:54.879936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:54.882092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:54.895569 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1584/3184] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:54.896893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:54.918761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adfb2-8163-45be-a7e6-a288722234c6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:54.932491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:54.933755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:54.935904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:54.936328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:54.937246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:35:54.937665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:54.942187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:54.977708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1601/3185] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:35:54.980124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:54.994202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3613e-39c9-48a3-9c99-d00a436201f7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:55.004309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:55.004955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:55.005243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:55.005523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:55.011953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:55.014811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:55.091419 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1585/3186] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:35:54 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:35:55.100928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:55.106205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398fc94-6212-4009-a249-b4858d4250f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:55.251309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:55.252179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:55.252689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:55.253096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:55.253907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:55.257471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:55.345194 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1602/3187] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:35:55 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:35:55.345459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:55.396362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fa71-01c5-4f50-9c3d-5c434a5f4a7d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:55.406251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:55.407258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:55.407788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:55.408228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:55.409721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:55.412782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:55.433658 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1586/3188] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:35:55.436483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:55.478149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5145d57-1c50-4fb6-a527-84849a0599e2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:55.519744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d2c04-d838-4300-a3d3-89254d74f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:55.520385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2c04-d838-4300-a3d3-89254d74f6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:55.520668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2c04-d838-4300-a3d3-89254d74f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:55.520983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d2c04-d838-4300-a3d3-89254d74f6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:55.521643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d2c04-d838-4300-a3d3-89254d74f6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:55.523258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d2c04-d838-4300-a3d3-89254d74f6bc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:55.570089 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1603/3189] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:35:55.575329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:55.613185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b798e-4063-455f-a434-081b0ae0da4e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:55.631681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:55.644829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:55.645419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:55.645878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] PATH_INFO: `/v3/projects/f3da93d761a04982824f4310b4686521/users/44a39799d0764e0cbc435dc2da88a886/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:55.730901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3da93d761a04982824f4310b4686521, user_id=44a39799d0764e0cbc435dc2da88a886, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:55.744047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:55.788758 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1587/3190] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:35:55 2022] PUT /identity/v3/projects/f3da93d761a04982824f4310b4686521/users/44a39799d0764e0cbc435dc2da88a886/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:55.801870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316672b8-de58-4191-93a7-48725ebb857c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:55.802364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316672b8-de58-4191-93a7-48725ebb857c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:55.802705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316672b8-de58-4191-93a7-48725ebb857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:55.882847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-316672b8-de58-4191-93a7-48725ebb857c None None] MFA Rules not processed for user `44a39799d0764e0cbc435dc2da88a886`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:55.884533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-316672b8-de58-4191-93a7-48725ebb857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:56.002642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:56.152440 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1604/3191] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:56.153722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:56.329224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56247c0b-1e63-4d0b-be16-aa91b453711d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:56.344071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:56.344717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:56.346244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:56.346546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:56.347213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:56.352468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:56.453202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1588/3192] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:35:56 2022] POST /identity/v3/projects => generated 375 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:35:56.456824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316672b8-de58-4191-93a7-48725ebb857c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:56.478193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316672b8-de58-4191-93a7-48725ebb857c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:56.689258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:56.689894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:56.694675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:56.695012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:56.695687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:56.700295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:56.859124 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1605/3193] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:35:56 2022] POST /identity/v3/users => generated 294 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:35:56.881574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:56.894665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d62ff0-af13-441c-932a-3af4fd8656ee admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:56.899728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:56.900364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:56.901368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:56.904767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:56.904767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:56.905215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:56.922419 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1589/3194] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:35:56.926647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:56.948668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b22925-2a61-4a0c-af55-b56d19975bca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:56.956044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:56.956954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:56.957409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:56.957839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] PATH_INFO: `/v3/projects/1424d0777aa34701b754ff3f75e1fab1/users/bc02cfd339c645048f25f0c7a1ca5107/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:56.995811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1424d0777aa34701b754ff3f75e1fab1, user_id=bc02cfd339c645048f25f0c7a1ca5107, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:56.998585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:57.022767 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1606/3195] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:35:56 2022] PUT /identity/v3/projects/1424d0777aa34701b754ff3f75e1fab1/users/bc02cfd339c645048f25f0c7a1ca5107/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:57.027293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:57.040491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c711334-0685-4492-a58b-0c33cb27e288 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:57.178495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da299019-778f-4163-95b2-60c043d4b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:57.179266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da299019-778f-4163-95b2-60c043d4b517 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:57.179416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da299019-778f-4163-95b2-60c043d4b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:57.179701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da299019-778f-4163-95b2-60c043d4b517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:57.180365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da299019-778f-4163-95b2-60c043d4b517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:57.185626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da299019-778f-4163-95b2-60c043d4b517 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:57.216609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1590/3196] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:35:57.221872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:57.236202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f4369-cdf6-4b9d-86f2-719c18eb9b4c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:57.270901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:57.271589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:57.271874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:57.272155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] PATH_INFO: `/v3/projects/1424d0777aa34701b754ff3f75e1fab1/users/bc02cfd339c645048f25f0c7a1ca5107/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:57.277766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1424d0777aa34701b754ff3f75e1fab1, user_id=bc02cfd339c645048f25f0c7a1ca5107, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:57.280539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:57.308124 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1607/3197] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:35:57 2022] PUT /identity/v3/projects/1424d0777aa34701b754ff3f75e1fab1/users/bc02cfd339c645048f25f0c7a1ca5107/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:35:57.318769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:57.319060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:57.319555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:57.360536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:35:57.396201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] MFA Rules not processed for user `bc02cfd339c645048f25f0c7a1ca5107`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:35:57.396430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:57.578454 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1591/3198] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:35:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:35:57.585190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:57.600168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968e9d0-29be-4fa6-b34b-2dd67ccbcd7a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:57.622225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:57.623486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:57.624090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:57.624584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:57.625626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:35:57.626176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:57.628050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:57.643855 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1608/3199] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:35:57.648279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:57.667668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c47e-2095-4872-a7da-c9d12ffce194 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:57.690498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:57.695272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:57.695710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:57.696030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:57.698160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:57.703846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:57.762334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1592/3200] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:35:57 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:35:57.766258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:57.783665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb62732-0ea8-43f0-8bef-29e9449c63fc tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:57.883374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:57.884867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:57.886200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:57.886697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:57.887586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:35:57.889217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:57.891216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea615f-da18-4873-8809-4f8f52e5eca0 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:57.926152 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1609/3201] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:35:59.343478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:59.348878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:35:59.559861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1a568-adc7-4258-8afd-8f310acfbb9a tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:59.572547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:59.573642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:59.574171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:59.574653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:59.611733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:59.624576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:59.639715 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1593/3202] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:35:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:35:59.658152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e69a-04b8-4859-a8ec-723696ce828e None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:59.673315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e69a-04b8-4859-a8ec-723696ce828e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:59.676042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e69a-04b8-4859-a8ec-723696ce828e None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:59.679743 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1610/3203] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:35:59 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:35:59.685477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:35:59.707081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:35:59.732164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef696af0-96aa-4e19-9386-bc7cc30eef0e service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:35:59.742097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3320a8-46e7-4fe2-b946-dce02cf818b8 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:35:59.742749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3320a8-46e7-4fe2-b946-dce02cf818b8 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:35:59.745174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3320a8-46e7-4fe2-b946-dce02cf818b8 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:35:59.745868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3320a8-46e7-4fe2-b946-dce02cf818b8 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:35:59.752359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3320a8-46e7-4fe2-b946-dce02cf818b8 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac0d0bc5b06941d3a6ee0870eb7c72a6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:35:59.755015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3320a8-46e7-4fe2-b946-dce02cf818b8 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:35:59.763048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1594/3204] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:35:59 2022] GET /identity/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6 => generated 369 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:00.020564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e69a-04b8-4859-a8ec-723696ce828e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:00.042901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e69a-04b8-4859-a8ec-723696ce828e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:00.048817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:00.049680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.049965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.050246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.052392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:00.060205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:00.179400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:00.181740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:00.206107 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1611/3205] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:00.455124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036a05-eb6a-44fc-94ea-08ee6b14908a None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.455721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036a05-eb6a-44fc-94ea-08ee6b14908a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.455961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036a05-eb6a-44fc-94ea-08ee6b14908a None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.458112 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1595/3206] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:36:00.473457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:36:00.492989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:00.543219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381de4-3cd3-4ec0-bb57-fe8b2e0bb198 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:00.548386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:00.549082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.549393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.550999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.552270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac0d0bc5b06941d3a6ee0870eb7c72a6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:00.555953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:00.560767 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1612/3207] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:36:00 2022] GET /identity/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6 => generated 369 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:00.643417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036a05-eb6a-44fc-94ea-08ee6b14908a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:00.669777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036a05-eb6a-44fc-94ea-08ee6b14908a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:00.680725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:00.681376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.681672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.682471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.683144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:36:00.683454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:00.685096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fdebf-99d4-424b-baef-750588dc3553 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:00.718877 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1596/3208] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:00.723060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:00.741438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac92cf-dbf3-418c-a2d2-ecb585f495bf tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:00.753133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:00.754102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.754591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.755071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.756295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:00.759185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:00.800676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfbd5b-8297-4865-b9b6-526a2fb4f7f6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.801509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfbd5b-8297-4865-b9b6-526a2fb4f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.801937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfbd5b-8297-4865-b9b6-526a2fb4f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.802229 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1613/3209] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:36:00 2022] POST /identity/v3/users => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:00.808179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:00.827730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67051b15-0057-4ab9-8044-7b3654572dd9 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:00.833636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:00.834716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:00.835237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:00.835719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:00.836652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:36:00.837229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:00.839861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:00.872728 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1614/3210] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:00.881298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b4cfbd5b-8297-4865-b9b6-526a2fb4f7f6 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:00.882193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b4cfbd5b-8297-4865-b9b6-526a2fb4f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:00.939125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:01.043106 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1597/3211] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:36:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 05 02:36:01.070756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:01.072769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:01.289553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b064f4-c864-4f15-b291-ee7b2f1396e4 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:01.326108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:01.326753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:01.327041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:01.328587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:01.380581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:01.383432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:01.438474 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1615/3212] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:02.054629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af470f8f-c72d-43aa-aa92-191cf6224259 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:02.055134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af470f8f-c72d-43aa-aa92-191cf6224259 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:02.055342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af470f8f-c72d-43aa-aa92-191cf6224259 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:02.058290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1598/3213] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:36:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:36:02.065855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:36:02.068382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:02.100345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:02.113015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ca2c-4c8b-421a-a1f6-6f4bb76bf6f0 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:02.133617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:02.134613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:02.135852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:02.136443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:02.138265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac0d0bc5b06941d3a6ee0870eb7c72a6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:02.140742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:02.155952 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1616/3214] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:36:02 2022] GET /identity/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6 => generated 369 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:02.609325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d49a-9fb0-4dd3-a7f3-38aff8b7b83f None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:02.609675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d49a-9fb0-4dd3-a7f3-38aff8b7b83f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:02.610027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d49a-9fb0-4dd3-a7f3-38aff8b7b83f None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:02.611520 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1599/3215] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:36:02.617887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:36:02.633941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:02.646928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233091-42d5-43ef-950c-87bf0ad9d444 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:02.673997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b83af-357e-4537-8c31-4eb125fff228 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:02.676848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b83af-357e-4537-8c31-4eb125fff228 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:02.677818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b83af-357e-4537-8c31-4eb125fff228 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:02.679026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b83af-357e-4537-8c31-4eb125fff228 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:02.681077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b83af-357e-4537-8c31-4eb125fff228 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:get_project(project_id=ac0d0bc5b06941d3a6ee0870eb7c72a6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:02.685110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b83af-357e-4537-8c31-4eb125fff228 tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:02.697934 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1617/3216] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:36:02 2022] GET /identity/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6 => generated 369 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:02.731552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d49a-9fb0-4dd3-a7f3-38aff8b7b83f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:02.751316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d49a-9fb0-4dd3-a7f3-38aff8b7b83f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:02.758856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:02.760896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:02.761549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:02.762030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/users/5bb36ffd6097461287d5fab1b405b080` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:02.794043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5bb36ffd6097461287d5fab1b405b080)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:02.796386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:02.937293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:02.941368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:02.941890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:02.990722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb36ffd6097461287d5fab1b405b080'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:02.998584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] MFA Rules not processed for user `9f23399a5f1c4af6855a098198ca4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:03.001072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:03.017075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb36ffd6097461287d5fab1b405b080'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.022460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb36ffd6097461287d5fab1b405b080'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.042866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb36ffd6097461287d5fab1b405b080'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.044033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb36ffd6097461287d5fab1b405b080'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.062937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:03.085158 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1600/3217] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:36:02 2022] DELETE /identity/v3/users/5bb36ffd6097461287d5fab1b405b080 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:03.098104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:03.103701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:03.110175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1618/3218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:03.281822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9cdf-97a9-41c5-9775-11328111082b tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:03.310069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc02cfd339c645048f25f0c7a1ca5107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1424d0777aa34701b754ff3f75e1fab1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:03.311006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:03.311435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:03.311895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] PATH_INFO: `/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:03.313297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac0d0bc5b06941d3a6ee0870eb7c72a6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:03.315477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:03.425985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:03.438500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0d0bc5b06941d3a6ee0870eb7c72a6', 'request_id': 'req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.458201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0d0bc5b06941d3a6ee0870eb7c72a6', 'request_id': 'req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.477423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0d0bc5b06941d3a6ee0870eb7c72a6', 'request_id': 'req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.515237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] The token cache is being invalidate because project ac0d0bc5b06941d3a6ee0870eb7c72a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:36:03.515545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.516873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e6ffc572-8a7b-4dc9-9c84-b70dadab319d tempest-QuotasAdminTestV236-1032272778 tempest-QuotasAdminTestV236-1032272778-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.523268 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1601/3219] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:03 2022] DELETE /identity/v3/projects/ac0d0bc5b06941d3a6ee0870eb7c72a6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:03.528770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:03.530417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:03.684331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a846a1-7d5c-453c-8425-1c08931edc16 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:03.830857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:03.831622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:03.831906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:03.832185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] PATH_INFO: `/v3/users/44a39799d0764e0cbc435dc2da88a886` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:03.835529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a39799d0764e0cbc435dc2da88a886)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:03.837769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:03.916796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a39799d0764e0cbc435dc2da88a886'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.933818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a39799d0764e0cbc435dc2da88a886'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.934796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a39799d0764e0cbc435dc2da88a886'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.958175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a39799d0764e0cbc435dc2da88a886'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.959451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a39799d0764e0cbc435dc2da88a886'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:03.985256 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1619/3220] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:36:03 2022] DELETE /identity/v3/users/44a39799d0764e0cbc435dc2da88a886 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:03.989816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:03.991092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:03.991609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:04.046912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:04.052532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:04.198396 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1602/3221] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:04.211384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:04.213936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:04.226223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:04.376180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150fd28-bfe3-4853-9989-f76a30348722 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:04.385562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:04.387813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:04.388097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:04.388373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:04.402415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:04.415088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:04.454862 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1620/3222] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:04.945183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:04.946750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:04.971824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0d895-f3ae-4c94-8b2f-c41057d53b19 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:04.996273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:04.997421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:04.997828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:05.001324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] PATH_INFO: `/v3/projects/f3da93d761a04982824f4310b4686521` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:05.003815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3da93d761a04982824f4310b4686521)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:05.008717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:05.238449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3da93d761a04982824f4310b4686521', 'request_id': 'req-aec67c01-09a7-4490-8841-c743acfd79c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.259719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3da93d761a04982824f4310b4686521', 'request_id': 'req-aec67c01-09a7-4490-8841-c743acfd79c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.275285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3da93d761a04982824f4310b4686521', 'request_id': 'req-aec67c01-09a7-4490-8841-c743acfd79c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.321725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] The token cache is being invalidate because project f3da93d761a04982824f4310b4686521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:36:05.322584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.325536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.330897 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1603/3223] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:04 2022] DELETE /identity/v3/projects/f3da93d761a04982824f4310b4686521 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:05.336444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:05.352682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8209c9-8e91-4c4d-a009-4a5e23ba02c9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:05.511475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:05.512576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:05.513034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:05.513503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] PATH_INFO: `/v3/users/bc02cfd339c645048f25f0c7a1ca5107` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:05.516152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc02cfd339c645048f25f0c7a1ca5107)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:05.520936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:05.638641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc02cfd339c645048f25f0c7a1ca5107'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.673313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc02cfd339c645048f25f0c7a1ca5107'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.674440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc02cfd339c645048f25f0c7a1ca5107'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.689368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc02cfd339c645048f25f0c7a1ca5107'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.690697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c3704c-5890-4009-923d-20a76dd00ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc02cfd339c645048f25f0c7a1ca5107'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:05.719441 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1621/3224] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:36:05 2022] DELETE /identity/v3/users/bc02cfd339c645048f25f0c7a1ca5107 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:08.280067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:08.281571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:08.315343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec67c01-09a7-4490-8841-c743acfd79c4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:08.432457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:08.459242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:08.460042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:08.460389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:08.461567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] PATH_INFO: `/v3/projects/1424d0777aa34701b754ff3f75e1fab1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:08.463575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1424d0777aa34701b754ff3f75e1fab1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:08.473207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:08.601375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1424d0777aa34701b754ff3f75e1fab1', 'request_id': 'req-163c6b43-25b5-4054-b2fd-e271d85e7ce7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:08.610145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1424d0777aa34701b754ff3f75e1fab1', 'request_id': 'req-163c6b43-25b5-4054-b2fd-e271d85e7ce7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:08.617816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1424d0777aa34701b754ff3f75e1fab1', 'request_id': 'req-163c6b43-25b5-4054-b2fd-e271d85e7ce7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:08.644083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] The token cache is being invalidate because project 1424d0777aa34701b754ff3f75e1fab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:36:08.644604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:08.646285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-163c6b43-25b5-4054-b2fd-e271d85e7ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:08.648527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1604/3225] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:08 2022] DELETE /identity/v3/projects/1424d0777aa34701b754ff3f75e1fab1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:08.654815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:08.656010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:08.657902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:08.707567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:08.708817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:08.763137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:08.847289 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1622/3226] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:08.856756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:08.857327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:08.857756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:08.914105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:08.915374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:08.939160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1605/3227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:08.943937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:08.956526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137140eb-fc57-426f-b040-3d63e1638b6f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:08.971439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:08.972100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:08.972312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:08.972587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:08.977688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:36:08.980006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:08.982025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:09.035026 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1623/3228] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:09.040535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:09.054863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6259e-9b9b-4717-b06a-4ab470d285c4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:09.076005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:09.076752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:09.077136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:09.077549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:09.078192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:09.082761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:09.181511 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1606/3229] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:36:09 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:09.182722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:09.198088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102b6e-15c9-42db-bd83-c9a31ff60e1e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:09.381731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:09.382484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:09.382840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:09.383182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:09.383908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:09.386440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:09.439910 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1624/3230] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:36:09 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:09.442538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:09.458530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77babae-3d1d-4ad6-8f67-9890c264e6df admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:09.474726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:09.474726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:09.475129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:09.475208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:09.475830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:09.477542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:09.502541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1607/3231] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:09.504110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:09.517311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bcc0d-1a20-4ec7-a154-a0fe1ef4692b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:09.546992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cd4fa-44fa-43ac-82a6-1e6baa19b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:09.547630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cd4fa-44fa-43ac-82a6-1e6baa19b077 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:09.547914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cd4fa-44fa-43ac-82a6-1e6baa19b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:09.548191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cd4fa-44fa-43ac-82a6-1e6baa19b077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:09.548850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cd4fa-44fa-43ac-82a6-1e6baa19b077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:09.551706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cd4fa-44fa-43ac-82a6-1e6baa19b077 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:09.587506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:09.595038 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1625/3232] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:09.599327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dc792-97a0-44dd-aab3-a9b0e2b0bd68 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:09.618117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:09.618876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:09.620017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:09.620342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] PATH_INFO: `/v3/projects/eccc732cf08749648be251ca96d18cd1/users/83a280fd56304b47acca3f0b4061e18a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:09.659349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccc732cf08749648be251ca96d18cd1, user_id=83a280fd56304b47acca3f0b4061e18a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:09.661291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:09.688417 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1608/3233] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:36:09 2022] PUT /identity/v3/projects/eccc732cf08749648be251ca96d18cd1/users/83a280fd56304b47acca3f0b4061e18a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:36:09.778100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:09.778784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:09.779084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:09.811582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] MFA Rules not processed for user `83a280fd56304b47acca3f0b4061e18a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:09.813116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:09.932761 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1626/3234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:09.937283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:10.039141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dfe2b-6801-490f-bee9-f9ea95a30ff9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:10.045098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:10.045856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.046016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.046452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.047199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:10.050448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:10.099835 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1609/3235] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:36:09 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:10.100791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:10.118126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a24f3-b6a3-4505-8493-33bab5c0b510 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:10.151192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:10.206263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:10.207531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.209050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.209650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.210563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:10.213398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:10.247247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1627/3236] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:36:10 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:10.251292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:10.258637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:10.263100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea43e4-937f-4af0-9c0a-0be1ab998e7c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:10.283149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:10.284119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.284671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.285122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.285938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:10.287946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:10.324494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1610/3237] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:10.325671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:10.342167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758591c-e94a-4140-98b2-3a675f80c01a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:10.359689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:10.359689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.359689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.359689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] PATH_INFO: `/v3/projects/071483f03fe14dc58fbd18ee9f167372/users/5f174aa8d19d4073a57d9c60fb11c10c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.403027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=071483f03fe14dc58fbd18ee9f167372, user_id=5f174aa8d19d4073a57d9c60fb11c10c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:10.422246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:10.464945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1628/3238] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:36:10 2022] PUT /identity/v3/projects/071483f03fe14dc58fbd18ee9f167372/users/5f174aa8d19d4073a57d9c60fb11c10c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:10.468864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:10.483507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0068-7a30-4ef4-a768-e3f224713f5e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:10.601294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67ed0a-cf99-428a-a1f4-b475aac7c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:10.602122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ed0a-cf99-428a-a1f4-b475aac7c488 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.602503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ed0a-cf99-428a-a1f4-b475aac7c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.603111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67ed0a-cf99-428a-a1f4-b475aac7c488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.604296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67ed0a-cf99-428a-a1f4-b475aac7c488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:10.607272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67ed0a-cf99-428a-a1f4-b475aac7c488 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:10.622358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1611/3239] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:10.627262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:10.643149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a435920-79ae-442d-903f-6e721268e86f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:10.687914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520348-fbbf-45d3-a694-13481c771310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:10.688614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520348-fbbf-45d3-a694-13481c771310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.688931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520348-fbbf-45d3-a694-13481c771310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.689801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520348-fbbf-45d3-a694-13481c771310 admin admin] PATH_INFO: `/v3/projects/071483f03fe14dc58fbd18ee9f167372/users/5f174aa8d19d4073a57d9c60fb11c10c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.710926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520348-fbbf-45d3-a694-13481c771310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071483f03fe14dc58fbd18ee9f167372, user_id=5f174aa8d19d4073a57d9c60fb11c10c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:10.729534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520348-fbbf-45d3-a694-13481c771310 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:10.756456 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1629/3240] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:36:10 2022] PUT /identity/v3/projects/071483f03fe14dc58fbd18ee9f167372/users/5f174aa8d19d4073a57d9c60fb11c10c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:10.768068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:10.768586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:10.769658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:10.867211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] MFA Rules not processed for user `5f174aa8d19d4073a57d9c60fb11c10c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:10.870670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:11.163029 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1612/3241] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:11.179022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9afded-4101-4966-b064-d0911de84cb9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:11.180104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9afded-4101-4966-b064-d0911de84cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:11.180967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9afded-4101-4966-b064-d0911de84cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:11.252305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bd9afded-4101-4966-b064-d0911de84cb9 None None] MFA Rules not processed for user `83a280fd56304b47acca3f0b4061e18a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:11.254096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bd9afded-4101-4966-b064-d0911de84cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:11.363434 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1630/3242] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:11.834788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:11.836337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:11.956519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2eb45-2e91-4107-a0fd-41578cc5205f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:11.965226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337b797-e499-406d-9bed-96ae1bb9cd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:11.965680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b797-e499-406d-9bed-96ae1bb9cd64 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:11.966070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b797-e499-406d-9bed-96ae1bb9cd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:11.966411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337b797-e499-406d-9bed-96ae1bb9cd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:11.977991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337b797-e499-406d-9bed-96ae1bb9cd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:11.980762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337b797-e499-406d-9bed-96ae1bb9cd64 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:11.990237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:11.995677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1613/3243] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:12.829785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:12.830246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:12.830442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:12.906078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] MFA Rules not processed for user `6c889d2c39af44c693a3c15b5ba4bca9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:12.913824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:13.055647 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1631/3244] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:23.034821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:24.746973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:24.747508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:24.747508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:24.777661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:24.778937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:24.892025 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1614/3245] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:24.916319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:24.917914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:25.024182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df255dd-b07f-457a-bae4-17e1e2da02b9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:25.030456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:25.031306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:25.031700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:25.032280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:25.064527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:25.066189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:25.094801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1632/3246] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:36:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:36:26.333309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:26.335247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:26.474363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c8de3-fe26-4290-8730-5f90654b0b78 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:26.489236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:26.489988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:26.490365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:26.490753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] PATH_INFO: `/v3/users/4c441be8c87648bf9f1ff5cd4aff2532` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:26.491989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c441be8c87648bf9f1ff5cd4aff2532)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:26.495282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:26.578142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c441be8c87648bf9f1ff5cd4aff2532'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:26.600232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c441be8c87648bf9f1ff5cd4aff2532'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:26.601391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c441be8c87648bf9f1ff5cd4aff2532'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:26.624992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c441be8c87648bf9f1ff5cd4aff2532'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:26.625783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-86e2c900-374c-4aa4-aea7-8ec73912df62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c441be8c87648bf9f1ff5cd4aff2532'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:26.645880 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1615/3247] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:36:26 2022] DELETE /identity/v3/users/4c441be8c87648bf9f1ff5cd4aff2532 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:27.028486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.064043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bee103-ebae-4bd4-a054-d7caec953f07 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.193013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.193812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.194098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.194552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] PATH_INFO: `/v3/projects/47098be734b14277a4d9a9d6b8464998` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.195718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47098be734b14277a4d9a9d6b8464998)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.198109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.267590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47098be734b14277a4d9a9d6b8464998', 'request_id': 'req-74193c2c-403a-4a02-ba7b-a120a337a8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:27.277087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47098be734b14277a4d9a9d6b8464998', 'request_id': 'req-74193c2c-403a-4a02-ba7b-a120a337a8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:27.288812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47098be734b14277a4d9a9d6b8464998', 'request_id': 'req-74193c2c-403a-4a02-ba7b-a120a337a8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:27.303316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] The token cache is being invalidate because project 47098be734b14277a4d9a9d6b8464998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:36:27.303853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:27.314210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-74193c2c-403a-4a02-ba7b-a120a337a8a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:27.326319 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1633/3248] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:27 2022] DELETE /identity/v3/projects/47098be734b14277a4d9a9d6b8464998 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:27.327218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.327625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.328001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.359811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:27.361889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:27.389120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:27.456458 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1616/3249] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:27.464085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.464373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.464653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.489046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:27.490523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:27.506563 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1634/3250] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:27.506820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.517533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b5c4-3b6d-4c5b-824e-2c84d02521ed None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.522703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.523426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.523815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.524197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.525025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:36:27.526302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.528148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.551234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1617/3251] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:27.557501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.570124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f0e5a-1ca2-4d5c-a72a-30f2ae8a6a54 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.583343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.583970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.584252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.584526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.585217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.587275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.603651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:27.627603 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1635/3252] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:36:27 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:27.628802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.640972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a27a87-ed61-40ca-9443-8f6b3d2fa7cd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.708968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.709593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.709872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.710151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.710787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.713447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.747695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1618/3253] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:36:27 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:27.750956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.766257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e125171-8d45-43b2-834d-6712d84f8a22 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.790256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.790256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.790256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.790256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.791325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.791325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.830856 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1636/3254] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:27.832211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.848604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc0ceb-2c3c-44f3-8a24-c04857c9e88c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.867052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1194a4c-1b90-4b52-8410-4ee66e8707e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.867883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194a4c-1b90-4b52-8410-4ee66e8707e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.868148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194a4c-1b90-4b52-8410-4ee66e8707e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.868425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1194a4c-1b90-4b52-8410-4ee66e8707e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.869493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1194a4c-1b90-4b52-8410-4ee66e8707e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.871098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1194a4c-1b90-4b52-8410-4ee66e8707e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.892047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1619/3255] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:27.895647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:27.908602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20008dc5-7652-414c-adac-e6257f6090f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:27.916980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:27.917775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.918056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.918340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] PATH_INFO: `/v3/projects/24a89b34668a47ecb247ded06342f961/users/2040ec6ce90c4184af3b0ad3c4ba932a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:27.946403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a89b34668a47ecb247ded06342f961, user_id=2040ec6ce90c4184af3b0ad3c4ba932a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:27.950013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:27.974300 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1637/3256] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:36:27 2022] PUT /identity/v3/projects/24a89b34668a47ecb247ded06342f961/users/2040ec6ce90c4184af3b0ad3c4ba932a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:27.990464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:27.990836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:27.991152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:28.042632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] MFA Rules not processed for user `2040ec6ce90c4184af3b0ad3c4ba932a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:28.043879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:28.172248 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1620/3257] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:28.250398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:28.252260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:28.373652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80731a-b4aa-40de-a08a-2faec18c0486 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:28.386505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e28d0b-b1a9-4524-9b43-3264804ca768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:28.386678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28d0b-b1a9-4524-9b43-3264804ca768 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:28.387445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28d0b-b1a9-4524-9b43-3264804ca768 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:28.387783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e28d0b-b1a9-4524-9b43-3264804ca768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:28.398185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e28d0b-b1a9-4524-9b43-3264804ca768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:28.399927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e28d0b-b1a9-4524-9b43-3264804ca768 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:28.422169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1638/3258] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:31.510328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:31.537310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:31.637108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dae18b-ba8f-4873-a003-efeb1065b8b5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:31.654916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:31.655573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:31.655859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:31.656136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] PATH_INFO: `/v3/users/2040ec6ce90c4184af3b0ad3c4ba932a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:31.659512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2040ec6ce90c4184af3b0ad3c4ba932a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:31.661893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:31.733627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2040ec6ce90c4184af3b0ad3c4ba932a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:31.751213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2040ec6ce90c4184af3b0ad3c4ba932a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:31.752475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2040ec6ce90c4184af3b0ad3c4ba932a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:31.765898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2040ec6ce90c4184af3b0ad3c4ba932a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:31.776092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2040ec6ce90c4184af3b0ad3c4ba932a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:31.795160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1621/3259] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:36:31 2022] DELETE /identity/v3/users/2040ec6ce90c4184af3b0ad3c4ba932a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:31.799785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:31.800313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:31.800662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:31.826675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:31.828556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:31.910510 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1639/3260] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:31.921389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:31.923060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:32.015565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925b4fa-5018-4ed2-95ff-18ec13958885 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:32.020598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aeb17-7ab6-4c4c-a28c-8d815ce11aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:32.021994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aeb17-7ab6-4c4c-a28c-8d815ce11aba service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:32.022484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aeb17-7ab6-4c4c-a28c-8d815ce11aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:32.023094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aeb17-7ab6-4c4c-a28c-8d815ce11aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:32.039553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aeb17-7ab6-4c4c-a28c-8d815ce11aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:32.042761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aeb17-7ab6-4c4c-a28c-8d815ce11aba service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:32.057383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1622/3261] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:32.667778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:32.672664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:32.702955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25f8c-87f5-4cb3-84e1-b9153274576f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:32.712298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:32.713628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:32.713911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:32.714186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] PATH_INFO: `/v3/projects/24a89b34668a47ecb247ded06342f961` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:32.718833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a89b34668a47ecb247ded06342f961)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:32.721481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:32.787479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:32.803276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a89b34668a47ecb247ded06342f961', 'request_id': 'req-03911d49-f424-4be4-8c0b-69898ded6517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:32.815058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a89b34668a47ecb247ded06342f961', 'request_id': 'req-03911d49-f424-4be4-8c0b-69898ded6517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:32.850348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a89b34668a47ecb247ded06342f961', 'request_id': 'req-03911d49-f424-4be4-8c0b-69898ded6517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:32.886125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] The token cache is being invalidate because project 24a89b34668a47ecb247ded06342f961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:36:32.886459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:32.887113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03911d49-f424-4be4-8c0b-69898ded6517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:32.892368 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1640/3262] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:32 2022] DELETE /identity/v3/projects/24a89b34668a47ecb247ded06342f961 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:32.893968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:32.894448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:32.894784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:32.930689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:32.933121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:33.052459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:33.093238 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1623/3263] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:36:33.100618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.100925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.101213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.142738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:33.145697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:33.159839 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1641/3264] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:33.163959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:33.180558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d809a5c-4884-4672-951f-2d3c941cde54 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:33.186718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:33.187650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.188921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.189371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.190686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:36:33.191179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:33.205609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:33.240270 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1624/3265] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:33.244503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:33.288766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196df8-e6e9-43ee-b359-a2afb29cedc5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:33.313928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:33.314584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.314875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.315157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.316121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:33.323324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:33.389460 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1642/3266] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:36:33 2022] POST /identity/v3/projects => generated 397 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:33.393371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:33.417926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f95b-a595-4587-a1eb-a58afcf8782c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:33.570630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:33.571482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.573388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.573669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.577240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:33.580355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:33.630078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1625/3267] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:36:33 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:33.630949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:33.670401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d9147-3485-4412-aa0d-6a77c22c7298 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:33.706543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:33.707288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.707577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.713227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.716653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:33.721157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:33.765811 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1643/3268] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:33.767373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:33.778319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64772dd-3e8f-4635-bf9f-8d07d94f48cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:33.802798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ef476-2241-4e32-b7c6-af7157530e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:33.803653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ef476-2241-4e32-b7c6-af7157530e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.803765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ef476-2241-4e32-b7c6-af7157530e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.804014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ef476-2241-4e32-b7c6-af7157530e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.804678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ef476-2241-4e32-b7c6-af7157530e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:33.814619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ef476-2241-4e32-b7c6-af7157530e6e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:33.836619 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1626/3269] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:33.841095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:33.879744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd3d53-1182-4195-97b1-a3b2128fefdd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:33.897508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:33.898194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.898486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.898759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] PATH_INFO: `/v3/projects/f3e80db441474690ae517c0c54e69926/users/0b6f39011b9d4bcba2ac2cd9c44a9de8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:33.941665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e80db441474690ae517c0c54e69926, user_id=0b6f39011b9d4bcba2ac2cd9c44a9de8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:33.944334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:33.978715 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1644/3270] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:36:33 2022] PUT /identity/v3/projects/f3e80db441474690ae517c0c54e69926/users/0b6f39011b9d4bcba2ac2cd9c44a9de8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:33.990166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336a98-8963-4ec8-bbc1-800ada8d6a76 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:33.991102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336a98-8963-4ec8-bbc1-800ada8d6a76 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:33.991595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49336a98-8963-4ec8-bbc1-800ada8d6a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:34.092062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-49336a98-8963-4ec8-bbc1-800ada8d6a76 None None] MFA Rules not processed for user `0b6f39011b9d4bcba2ac2cd9c44a9de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:34.095591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-49336a98-8963-4ec8-bbc1-800ada8d6a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:34.328655 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1627/3271] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:34.576258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:34.578706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:34.809646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4896e2-3a4b-41a7-a3cf-06269bad15b2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:34.841712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:34.842316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:34.842605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:34.842880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:34.862410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:34.866480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:34.912316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1645/3272] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:34.994220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05f0ec-4b42-4e58-9e0c-6eb3d342bb59 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:34.994673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05f0ec-4b42-4e58-9e0c-6eb3d342bb59 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:34.994929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05f0ec-4b42-4e58-9e0c-6eb3d342bb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:35.036815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ac05f0ec-4b42-4e58-9e0c-6eb3d342bb59 None None] MFA Rules not processed for user `0b6f39011b9d4bcba2ac2cd9c44a9de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:35.038064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac05f0ec-4b42-4e58-9e0c-6eb3d342bb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:35.068090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1628/3273] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:35.746264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:35.867015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:35.940657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82effb14-c025-4ca7-8049-a01a6c21abf1 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:35.959491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:35.961755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:35.962200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:35.962676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] PATH_INFO: `/v3/users/0b6f39011b9d4bcba2ac2cd9c44a9de8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:35.969175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6f39011b9d4bcba2ac2cd9c44a9de8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:35.972507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:36.161491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6f39011b9d4bcba2ac2cd9c44a9de8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:36.214287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6f39011b9d4bcba2ac2cd9c44a9de8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:36.215071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6f39011b9d4bcba2ac2cd9c44a9de8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:36.240841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6f39011b9d4bcba2ac2cd9c44a9de8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:36.241499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6f39011b9d4bcba2ac2cd9c44a9de8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:36.275313 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1646/3274] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:36:35 2022] DELETE /identity/v3/users/0b6f39011b9d4bcba2ac2cd9c44a9de8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:36.281774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:36.282277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:36.282355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:36.338954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:36.350848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:36.458155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:36.599043 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1629/3275] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:36.612329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:36.613992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:36.772815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb8db-68f7-47d6-b32b-cc3923e73b2b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:36.782754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8d76e-11a3-453f-a048-682b79393c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:36.783408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d76e-11a3-453f-a048-682b79393c63 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:36.783696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d76e-11a3-453f-a048-682b79393c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:36.783981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8d76e-11a3-453f-a048-682b79393c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:36.814354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8d76e-11a3-453f-a048-682b79393c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:36.822154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8d76e-11a3-453f-a048-682b79393c63 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:36.912811 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1647/3276] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:37.550022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:37.552046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:37.593308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e945b-a461-4bd0-88cf-b00c8db3b3db None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:37.612221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:37.613576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:37.613864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:37.614152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] PATH_INFO: `/v3/projects/f3e80db441474690ae517c0c54e69926` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:37.619779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e80db441474690ae517c0c54e69926)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:37.631238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:37.791637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e80db441474690ae517c0c54e69926', 'request_id': 'req-d5050dab-4cf2-4307-ba45-bfc2be687361'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:37.800730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e80db441474690ae517c0c54e69926', 'request_id': 'req-d5050dab-4cf2-4307-ba45-bfc2be687361'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:37.812362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e80db441474690ae517c0c54e69926', 'request_id': 'req-d5050dab-4cf2-4307-ba45-bfc2be687361'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:37.841583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] The token cache is being invalidate because project f3e80db441474690ae517c0c54e69926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:36:37.842633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:37.843833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:36:37.847665 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1630/3277] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:36:37 2022] DELETE /identity/v3/projects/f3e80db441474690ae517c0c54e69926 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:37.851310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7794-8fbd-4acc-8f74-e50074225b51 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:37.852191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7794-8fbd-4acc-8f74-e50074225b51 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:37.852639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7794-8fbd-4acc-8f74-e50074225b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:37.891794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-608a7794-8fbd-4acc-8f74-e50074225b51 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:37.893969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-608a7794-8fbd-4acc-8f74-e50074225b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:37.967701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:37.969958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:38.024561 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1648/3278] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:38.032085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.033280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.033687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.075612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:38.077039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:38.096865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050dab-4cf2-4307-ba45-bfc2be687361 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.101546 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1649/3279] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:36:38.105559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.106617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.107310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.107662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.108041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.110189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:38.113071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:38.126129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542ed5-a146-4fff-b4b3-4e5eb81f083b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.142789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.143491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.143837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.144173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.144915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:36:38.145287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.147452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.163039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1650/3280] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:36:38.171190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.182886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129e6f6-a158-4a8d-8247-630a35b4029a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.189122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.191402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.191869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.192301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.193128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.195186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.214119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:38.243480 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1651/3281] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:36:38 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:38.249451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.250046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.255397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324be1fd-5035-4103-90f8-a7d101ceca2b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.297061 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1631/3282] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:38.340767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.341078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.341381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.366068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] MFA Rules not processed for user `83a280fd56304b47acca3f0b4061e18a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:38.367424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:38.392493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97d423-18a3-4b34-a4bb-122796d54bb3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.407626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.408260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.408545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.408819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.409493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.419179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.479558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1652/3283] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:36:38 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:36:38.485181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.511716 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1632/3284] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:38.512573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a229a8-6645-4ee1-b52f-5e7207da9e11 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.520864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.521575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.521863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.522141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.524186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.530110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.552051 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1653/3285] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:38.556799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.570660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989b61c-9ca9-42d6-8231-7de184f65b76 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.587492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b227c7-3684-483b-9af8-25dd6663fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.589145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b227c7-3684-483b-9af8-25dd6663fef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.589435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b227c7-3684-483b-9af8-25dd6663fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.589798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b227c7-3684-483b-9af8-25dd6663fef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.595032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b227c7-3684-483b-9af8-25dd6663fef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.595032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b227c7-3684-483b-9af8-25dd6663fef6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.620182 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1633/3286] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:36:38.624420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.638007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f0628-508d-4ff9-9bef-eb6353780e16 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.643916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:38.645039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.645668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.646631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] PATH_INFO: `/v3/projects/16f8146191044043ab43029742153150/users/559ade1b882b43d4a4f095c9214e8167/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.703549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f8146191044043ab43029742153150, user_id=559ade1b882b43d4a4f095c9214e8167, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:38.706977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:38.730041 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1654/3287] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:36:38 2022] PUT /identity/v3/projects/16f8146191044043ab43029742153150/users/559ade1b882b43d4a4f095c9214e8167/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:36:38.735697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:38.736385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:38.736839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:38.792077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:38.793696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:38.897284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:38.898542 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1634/3288] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:36:38.899305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:38.994597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326a2ab-4746-47a6-8481-882d74711288 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:38.999946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:39.001053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:39.001424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:39.001424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:39.014978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:39.018005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:39.060203 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1655/3289] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:36:48.877793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=63 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:49.027004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:36:49.438492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:49.440587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:49.474342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110355b-ed12-4f88-85c6-a295e9b302c6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:49.494356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:49.498735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:49.500141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:49.501245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:49.519462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:49.699787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:49.701714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121d3cd-4937-4dbc-9425-dc2f6879cb05 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:49.720252 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1635/3290] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:36:49.980047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:49.993739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a88a13-8ab6-48c9-815c-a3350c810d3d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:50.004997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:50.005634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:50.005921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:50.006203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:50.014516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:50.076254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:50.077796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b420e-c733-4a3d-bdfd-4dcd0319f641 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:50.124552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1656/3291] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:36:53.373321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:53.373774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:53.373878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:53.437709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] MFA Rules not processed for user `559ade1b882b43d4a4f095c9214e8167`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:53.438934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:53.769333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1636/3292] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:53.771697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b23aa-1a92-4c87-bfa1-44b297f879a0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:53.772161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b23aa-1a92-4c87-bfa1-44b297f879a0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:53.772240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b23aa-1a92-4c87-bfa1-44b297f879a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:53.814451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b38b23aa-1a92-4c87-bfa1-44b297f879a0 None None] MFA Rules not processed for user `559ade1b882b43d4a4f095c9214e8167`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:36:53.815601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b38b23aa-1a92-4c87-bfa1-44b297f879a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:36:53.834455 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1657/3293] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:36:54.800516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:36:54.835736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4d36c-8b31-4540-9c99-46853da39bbb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:36:54.856297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:36:54.857218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:36:54.857506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:36:54.857794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:36:54.886451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:36:54.888152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:36:54.927210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1637/3294] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:36:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:02.851258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ef5c-338d-4711-9788-3bcd95aa7e75 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:02.851787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ef5c-338d-4711-9788-3bcd95aa7e75 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:02.851865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ef5c-338d-4711-9788-3bcd95aa7e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:02.995681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6f35ef5c-338d-4711-9788-3bcd95aa7e75 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:02.999834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6f35ef5c-338d-4711-9788-3bcd95aa7e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:03.139017 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1658/3295] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:03.155144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:03.157296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:03.307183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736720-a023-45df-ac55-69bfd696125c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:03.308203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736720-a023-45df-ac55-69bfd696125c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:03.308624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc736720-a023-45df-ac55-69bfd696125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:03.342537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:03.344046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cc736720-a023-45df-ac55-69bfd696125c None None] MFA Rules not processed for user `e4b5243d9ffe46c4b32033da558d1e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:03.346408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cc736720-a023-45df-ac55-69bfd696125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:03.406794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c183a5d-6bc1-4a68-86f9-f7d9eb30c1bb service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:03.415694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:03.416422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:03.416984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:03.417475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:03.428308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:03.430126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:03.440837 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1638/3296] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:37:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:03.452011 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1659/3297] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:03.841072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:03.852865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf689f-b0cd-4b39-9fd4-bcbd9bdb122d service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:03.857105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:03.857626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:03.857626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:03.857839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:03.859705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:03.877979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:03.879634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:03.889772 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1639/3298] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:04.147968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736720-a023-45df-ac55-69bfd696125c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:04.161207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc736720-a023-45df-ac55-69bfd696125c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:04.167384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:04.168357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:04.169053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:04.169480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:04.172002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:04.189508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:04.191485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90498616-26a0-4de8-8556-55461ce06e42 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:04.209308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1660/3299] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:04.887930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:04.902165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c8c0f-892e-4823-83df-87858bbfa2b0 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:04.909801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:04.911321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:04.911946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:04.912484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:04.915407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:04.943918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:04.945613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:04.963295 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1640/3300] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:05.059404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:05.059940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:05.060576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:05.099967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:05.101491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:05.129782 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1661/3301] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:37:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:05.145782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:05.166892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33946c-6a13-4e1f-9d9b-d918f22b37b2 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:05.193632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:05.197524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:05.198141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:05.198573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:05.222670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:05.227053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:05.250524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1641/3302] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:37:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:06.519210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:06.525299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:06.556359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e7d2-ae69-444f-98ad-84198d172c48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:06.565304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:06.566133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:06.566765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:06.567195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] PATH_INFO: `/v3/users/9f23399a5f1c4af6855a098198ca4ced` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:06.570904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f23399a5f1c4af6855a098198ca4ced)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:06.589931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:06.650193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:06.681669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f23399a5f1c4af6855a098198ca4ced'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:06.715630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f23399a5f1c4af6855a098198ca4ced'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:06.735053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f23399a5f1c4af6855a098198ca4ced'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:06.766859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f23399a5f1c4af6855a098198ca4ced'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:06.768123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53314701-80ef-45a4-859d-4440b2dae534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f23399a5f1c4af6855a098198ca4ced'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:06.796966 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1662/3303] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:06 2022] DELETE /identity/v3/users/9f23399a5f1c4af6855a098198ca4ced => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:07.303874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:07.338923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafb92f-8f32-45e5-95a5-3bc5a7d4be5c service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:07.372846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:07.373187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:07.373469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:07.399869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:07.401729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:07.537600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:07.538130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1663/3304] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:07.538533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:07.538628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:07.538891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] PATH_INFO: `/v3/projects/91e0286f34a549ed90c758652f0d20ae` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:07.540744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e0286f34a549ed90c758652f0d20ae)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:07.542907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:07.556488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:07.558456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:07.658008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e0286f34a549ed90c758652f0d20ae', 'request_id': 'req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:07.668959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e0286f34a549ed90c758652f0d20ae', 'request_id': 'req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:07.681393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e0286f34a549ed90c758652f0d20ae', 'request_id': 'req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:07.728661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] The token cache is being invalidate because project 91e0286f34a549ed90c758652f0d20ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:07.728989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:07.735290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e357384f-6a01-4f1a-8e50-cb6d50ff19eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:07.738966 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1642/3305] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:07 2022] DELETE /identity/v3/projects/91e0286f34a549ed90c758652f0d20ae => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:07.747663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db4d40-2971-4251-8fb5-2f854f1aedda None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:07.747954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db4d40-2971-4251-8fb5-2f854f1aedda None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:07.748232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db4d40-2971-4251-8fb5-2f854f1aedda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:07.755583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e1046-57ec-4ad0-a505-1352890e40eb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:07.817000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b6db4d40-2971-4251-8fb5-2f854f1aedda None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:07.818250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b6db4d40-2971-4251-8fb5-2f854f1aedda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:07.857457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:07.900005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:07.940842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:07.941490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:07.941768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:07.942044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:07.950939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:08.012957 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1643/3306] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:08.027140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.027470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.027754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.078074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:08.079362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:08.104106 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1644/3307] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:08.105075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.122383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b11f-9cb9-4388-a0a7-04cde737dead None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:08.127535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.129280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.137224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:08.137886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.138186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.138514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.139303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:08.139602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.141324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.153765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1664/3308] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:37:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:37:08.169703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.177379 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1645/3309] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:08.193479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13db2ca-efd6-4ac1-933e-1f9eace3ab19 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:08.199941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:08.201465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.202133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.202696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.203355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.205829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.339912 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1665/3310] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:08 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:08.340132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.368795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4570b6-56d8-4e5a-9f96-a1ccf28be9a4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:08.497382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:08.498460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.498948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.499428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.500743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.503239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.558474 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1646/3311] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:08 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:08.563046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.577348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352106-b8c3-4082-b1f5-4ab73796f183 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:08.591957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:08.592783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.593270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.593544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.594667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.596327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.626643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1666/3312] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:08.628313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.653305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14581926-2723-4db9-b9df-5fe3c3371f7a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:08.661096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:08.666287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.681714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.683874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.685573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.689703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.721222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1647/3313] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:08.725996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.740287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1c5b0-3704-4cac-b7f3-bca244543f10 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:08.759401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4294-ba15-42a5-bd3d-6837e7c35264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:08.760344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4294-ba15-42a5-bd3d-6837e7c35264 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.761922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4294-ba15-42a5-bd3d-6837e7c35264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.765086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4294-ba15-42a5-bd3d-6837e7c35264 admin admin] PATH_INFO: `/v3/projects/e6108c7bf10845c797e086b3db7db6bb/users/461700dc15ee4007bf71f4fff983742d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.809463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:08.811344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:08.825320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4294-ba15-42a5-bd3d-6837e7c35264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6108c7bf10845c797e086b3db7db6bb, user_id=461700dc15ee4007bf71f4fff983742d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:08.832640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4294-ba15-42a5-bd3d-6837e7c35264 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:08.868722 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1667/3314] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:08 2022] PUT /identity/v3/projects/e6108c7bf10845c797e086b3db7db6bb/users/461700dc15ee4007bf71f4fff983742d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:08.881123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:08.881337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:08.881751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:08.964277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] MFA Rules not processed for user `461700dc15ee4007bf71f4fff983742d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:08.966980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:09.030794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129edfd-abf9-4d66-9b82-dbf604757b14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:09.101197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:09.150524 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1668/3315] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:09.203004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:09.203413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:09.203696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:09.203971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:09.211454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:09.254240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:09.255821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56047c2c-26fd-4211-9b2f-8f2682ea1fb8 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:09.282669 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1648/3316] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:37:09.747142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:09.749527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:09.772434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b45b2-499c-40a5-b05e-421e11dc688a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:09.784351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:09.785249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:09.785808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:09.786094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:09.795714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:09.798222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:09.810454 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1669/3317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:09.904946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:09.905499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:09.905499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:09.929421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] MFA Rules not processed for user `9e5ffbccdbec4a4bb21a3e48c1f7beaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:09.931246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:10.025222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1649/3318] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:11.654150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:11.655619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:11.684032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:11.795227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2f90-3bca-43a0-bd07-c4407610756e service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:11.805447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:11.806355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:11.806930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:11.807440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:11.809851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:11.826190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:11.828333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19a49f-9e35-4c4c-a0f1-d358f9fdc6d9 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:11.842519 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1670/3319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:12.777536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:12.925776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313e474-8d74-49a1-9e04-cf66862e887e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:12.938131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:12.938800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:12.939086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:12.940649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] PATH_INFO: `/v3/users/461700dc15ee4007bf71f4fff983742d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:12.942544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461700dc15ee4007bf71f4fff983742d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:12.944838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:13.017730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461700dc15ee4007bf71f4fff983742d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.023387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:13.081899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461700dc15ee4007bf71f4fff983742d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.081899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461700dc15ee4007bf71f4fff983742d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.093628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461700dc15ee4007bf71f4fff983742d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.107359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461700dc15ee4007bf71f4fff983742d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.127639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1650/3320] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:12 2022] DELETE /identity/v3/users/461700dc15ee4007bf71f4fff983742d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:13.134920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:13.135435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:13.135656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:13.171937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:13.173394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:13.247645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1671/3321] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:13.254264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:13.256260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:13.331506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484cfb-9652-40e6-9d4c-3ae1219dd230 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:13.335577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06378c-3d64-46c4-ba2e-9ff2e0a11939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:13.336181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06378c-3d64-46c4-ba2e-9ff2e0a11939 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:13.336462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06378c-3d64-46c4-ba2e-9ff2e0a11939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:13.337433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06378c-3d64-46c4-ba2e-9ff2e0a11939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:13.347787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06378c-3d64-46c4-ba2e-9ff2e0a11939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:13.349804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06378c-3d64-46c4-ba2e-9ff2e0a11939 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:13.363538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1651/3322] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:37:13.768725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:13.771630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:13.802397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45212b6f-e4a2-4b75-8843-016d02fcfe77 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:13.812654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:13.814378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:13.815496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:13.815876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] PATH_INFO: `/v3/projects/e6108c7bf10845c797e086b3db7db6bb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:13.817414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6108c7bf10845c797e086b3db7db6bb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:13.819858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:13.874813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6108c7bf10845c797e086b3db7db6bb', 'request_id': 'req-5f37e584-cac8-4be1-8047-dc53094813d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.885922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6108c7bf10845c797e086b3db7db6bb', 'request_id': 'req-5f37e584-cac8-4be1-8047-dc53094813d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.892840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6108c7bf10845c797e086b3db7db6bb', 'request_id': 'req-5f37e584-cac8-4be1-8047-dc53094813d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.905578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] The token cache is being invalidate because project e6108c7bf10845c797e086b3db7db6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:13.905970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.906701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f37e584-cac8-4be1-8047-dc53094813d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:13.908280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1672/3323] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:13 2022] DELETE /identity/v3/projects/e6108c7bf10845c797e086b3db7db6bb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:13.918104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:13.918601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:13.918889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:13.941822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:13.943133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:14.008396 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1652/3324] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:14.016471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.016761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.017089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.037456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:14.038673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:14.052940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1673/3325] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:14.054102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.064012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf240a6-923b-49be-9dbf-c9e107567323 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.068919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.070185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.070185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.070185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.070716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:14.071062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.072995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.088475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1653/3326] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:14.093385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.104402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51c78-6609-4f1f-a7d6-aeed5cfb523e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.118637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.119259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.119546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.119822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.120645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.122806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.142503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:14.161105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1674/3327] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:14 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:14.165732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.175958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252662-9aa8-4b88-9563-39aa0f735881 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.241012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.241784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.242189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.242561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.243900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.246023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.255343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:14.273512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1654/3328] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:14 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:14.277398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.301771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639546-4655-4b3d-8925-91b258150b76 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.307635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.308277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.308825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.309278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.310131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.312164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.324173 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1675/3329] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:14.329838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.344572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bf4b1-253f-4d98-9dc0-6fa9a1395a7d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.356555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.358002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.358462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.359025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.360872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.364195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.386238 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1655/3330] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:14.386714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.402627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef3e51-45fa-41a1-a190-e0484398ab65 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.408269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b64c7-22d1-4083-be26-6663afb583b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.421683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b64c7-22d1-4083-be26-6663afb583b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.421984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b64c7-22d1-4083-be26-6663afb583b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.422273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b64c7-22d1-4083-be26-6663afb583b5 admin admin] PATH_INFO: `/v3/projects/e8e68eddf2544de4a3704a4e2c71e77a/users/aa2ef4545f8849ad9fbcf8ede4aa2e95/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.454511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b64c7-22d1-4083-be26-6663afb583b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e68eddf2544de4a3704a4e2c71e77a, user_id=aa2ef4545f8849ad9fbcf8ede4aa2e95, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.456943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.458925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b64c7-22d1-4083-be26-6663afb583b5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.459313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:14.481051 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1676/3331] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:14 2022] PUT /identity/v3/projects/e8e68eddf2544de4a3704a4e2c71e77a/users/aa2ef4545f8849ad9fbcf8ede4aa2e95/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:14.492293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.492821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.494004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.556543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] MFA Rules not processed for user `aa2ef4545f8849ad9fbcf8ede4aa2e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:14.558810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:14.615430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620907df-e2d3-46c7-a911-031c4ff43914 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.702814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.703728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.704149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.704570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.706926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:14.786994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1677/3332] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:14.792208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.792850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.794834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.808704 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1656/3333] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:14.897238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56830930-e649-4c9d-86d4-63e1b62d088e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:14.904444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:14.905793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:14.905793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:14.905793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:14.906272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:14.910217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:14.957189 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1678/3334] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:14 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:14.961427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:14.979717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac99a-92eb-42eb-99c1-ed5c1327c4e8 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.048286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:15.068135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.069697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.070145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.070852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.071833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.074185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.114703 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1657/3335] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:14 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:15.119942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.132309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90257189-64aa-4078-8961-14e234d4e190 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.141246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.142002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.142804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.143381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.143959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.145692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.158548 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1679/3336] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:15.161679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.174574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de736-90b1-461f-846e-19fd0561f2d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.179283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.180122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.180268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.181121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] PATH_INFO: `/v3/projects/81970a19cc174d6d8d837c3a7bafdfc6/users/a8344eb437b14dd1bd466be6ecf5838d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.217460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81970a19cc174d6d8d837c3a7bafdfc6, user_id=a8344eb437b14dd1bd466be6ecf5838d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.221593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.245115 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1658/3337] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:15 2022] PUT /identity/v3/projects/81970a19cc174d6d8d837c3a7bafdfc6/users/a8344eb437b14dd1bd466be6ecf5838d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:15.249130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.260137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc4303-a7ee-4cd9-92ae-2cd878630180 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.283683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:15.335684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e601-a454-4a66-8b13-a6e680f980a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.336396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e601-a454-4a66-8b13-a6e680f980a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.337361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e601-a454-4a66-8b13-a6e680f980a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.337770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e601-a454-4a66-8b13-a6e680f980a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.338552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e601-a454-4a66-8b13-a6e680f980a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.340272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e601-a454-4a66-8b13-a6e680f980a8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.351588 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1680/3338] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:15.356084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.367415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d921cf1-5a85-4bbc-b4ae-3141a43685d9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.378643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.379481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.379866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.380243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] PATH_INFO: `/v3/projects/81970a19cc174d6d8d837c3a7bafdfc6/users/a8344eb437b14dd1bd466be6ecf5838d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.386037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81970a19cc174d6d8d837c3a7bafdfc6, user_id=a8344eb437b14dd1bd466be6ecf5838d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.391009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.404447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1659/3339] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:15 2022] PUT /identity/v3/projects/81970a19cc174d6d8d837c3a7bafdfc6/users/a8344eb437b14dd1bd466be6ecf5838d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:15.415798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.417643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.417938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.458590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] MFA Rules not processed for user `a8344eb437b14dd1bd466be6ecf5838d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:15.459796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:15.573911 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1681/3340] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:15.579057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.611723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ccf51c-7f42-46d6-a23c-0b25fd207811 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.630660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.631394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.631744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.632097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.632801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.635186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.637913 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.server.flask.common [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 05 02:37:15.701915 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1660/3341] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:15 2022] POST /identity/v3/projects => generated 351 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:15.705658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.717710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0600-ac21-4a51-98a4-98b7b61fd34e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:15.886428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:15.887060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:15.887344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:15.887623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:15.888261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:15.890154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:15.972446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:15.979455 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1682/3342] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:37:15 2022] POST /identity/v3/projects => generated 349 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:15.992572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d026df3-ea8c-4a5b-b73d-be057d714bba tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.131846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.134406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.136701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.137994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/users/aa2ef4545f8849ad9fbcf8ede4aa2e95` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.141261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:get_user(user_id=aa2ef4545f8849ad9fbcf8ede4aa2e95)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.148273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.157582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.170883 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1661/3343] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:37:15 2022] GET /identity/v3/users/aa2ef4545f8849ad9fbcf8ede4aa2e95 => generated 288 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:16.174064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1b11c-4281-4d00-a419-e3a58ba008c5 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.179600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.180229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.181176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.181481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.182280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.184548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.228104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1683/3344] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 5 02:37:16 2022] POST /identity/v3/credentials => generated 429 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:16.234266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.267071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369ba0-ea07-4436-ad54-f19676478af2 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.288602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.289297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.289581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.295999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials/5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.303278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.308333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.316451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.330034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.361427 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1662/3345] 10.222.0.16 () {60 vars in 1358 bytes} [Wed Oct 5 02:37:16 2022] PATCH /identity/v3/credentials/5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7 => generated 436 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:16.363216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.381156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5609ec-d660-4d38-8060-5a4fbc57d55f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.392228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.392932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.393229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.405428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials/5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.408584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.410623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.419487 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1684/3346] 10.222.0.16 () {58 vars in 1335 bytes} [Wed Oct 5 02:37:16 2022] GET /identity/v3/credentials/5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7 => generated 436 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:16.421057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.444945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5a4f1-34b9-46d1-80b5-c8fc3c8061fb tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.457923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.458661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.459148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.459507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials/5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.462102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.464737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.496280 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1663/3347] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Oct 5 02:37:16 2022] DELETE /identity/v3/credentials/5296a168303ebceec9fdf47063443b9cbe764a2efab45c56d6daeda4f0d6b5c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:16.502589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.524541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9049c-3cba-48f7-a88a-32a8afb7dc7a tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.531310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.532290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.532783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.533617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.535773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.538809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.596013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:16.613373 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1685/3348] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 5 02:37:16 2022] POST /identity/v3/credentials => generated 429 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:16.617260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.639258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9fe0-5967-47f2-a26b-cd2801393cc6 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.652596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.653450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.653881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.654264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.655022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.659157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.733735 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1664/3349] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Oct 5 02:37:16 2022] POST /identity/v3/credentials => generated 430 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:16.736509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.757334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43833a-9017-4b96-af8a-30848668769c tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.783973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.791418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.791640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.791927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.792574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.794909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.807749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.810163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.812019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.814229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.819829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1686/3350] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Oct 5 02:37:16 2022] GET /identity/v3/credentials => generated 944 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:16.821940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.838789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb84a3d-7c34-4a9d-b0c3-d2ef18c31f17 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.846512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.847588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.848026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.848691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials/8d676edeff71cfe7764bad2e81bacba3c8355452eb656d7b3a4a4dee9b00d203` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.852763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=8d676edeff71cfe7764bad2e81bacba3c8355452eb656d7b3a4a4dee9b00d203)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.855364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.879344 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1665/3351] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Oct 5 02:37:16 2022] DELETE /identity/v3/credentials/8d676edeff71cfe7764bad2e81bacba3c8355452eb656d7b3a4a4dee9b00d203 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:16.884385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.894854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c7ab4-cea7-48c8-92f3-e4035304ca8f tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:16.924408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:16.925247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:16.925764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:16.926370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/credentials/587eba8ddfa94685eefba5b9a04b24cec0571c34fd3c2240b0687c71406ebf9d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:16.929830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=587eba8ddfa94685eefba5b9a04b24cec0571c34fd3c2240b0687c71406ebf9d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:16.933296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:16.963989 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1687/3352] 10.222.0.16 () {58 vars in 1338 bytes} [Wed Oct 5 02:37:16 2022] DELETE /identity/v3/credentials/587eba8ddfa94685eefba5b9a04b24cec0571c34fd3c2240b0687c71406ebf9d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:16.970167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:16.992024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2cff3-a414-4b13-9893-b56e229f3e29 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:17.008564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:17.013239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:17.021858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:17.022660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/projects/038f2d730dae47e794c605abc8e6dd5f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:17.027086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:delete_project(project_id=038f2d730dae47e794c605abc8e6dd5f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:17.033598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:17.110556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:17.180837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038f2d730dae47e794c605abc8e6dd5f', 'request_id': 'req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.196697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038f2d730dae47e794c605abc8e6dd5f', 'request_id': 'req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.216061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038f2d730dae47e794c605abc8e6dd5f', 'request_id': 'req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.253936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] The token cache is being invalidate because project 038f2d730dae47e794c605abc8e6dd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:17.254230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.255690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.257857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1666/3353] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:16 2022] DELETE /identity/v3/projects/038f2d730dae47e794c605abc8e6dd5f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:17.262527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:17.266101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:17.276995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:17.281876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:17.292270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342b518-57c2-4ff1-af7d-52b23ba4d0fe tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:17.458943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54cb27-4fb0-4b8a-91e6-3532e622fc4b tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:17.459749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8344eb437b14dd1bd466be6ecf5838d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81970a19cc174d6d8d837c3a7bafdfc6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:17.461112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:17.463843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:17.464364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] PATH_INFO: `/v3/projects/8738c7569c8b46d081263bb3afd0c639` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:17.466137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8738c7569c8b46d081263bb3afd0c639)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:17.468377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:17.468655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:17.469105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:17.471166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:17.471487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:17.473910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:17.488558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:17.490209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:17.504199 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1667/3354] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:17.535369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8738c7569c8b46d081263bb3afd0c639', 'request_id': 'req-6b2321f0-bd15-4278-8944-07fb449aaf06'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.547317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8738c7569c8b46d081263bb3afd0c639', 'request_id': 'req-6b2321f0-bd15-4278-8944-07fb449aaf06'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.553680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8738c7569c8b46d081263bb3afd0c639', 'request_id': 'req-6b2321f0-bd15-4278-8944-07fb449aaf06'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.586279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] The token cache is being invalidate because project 8738c7569c8b46d081263bb3afd0c639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:17.586613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.589766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b2321f0-bd15-4278-8944-07fb449aaf06 tempest-CredentialsTestJSON-1669273076 tempest-CredentialsTestJSON-1669273076-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:17.593352 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1688/3355] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:17 2022] DELETE /identity/v3/projects/8738c7569c8b46d081263bb3afd0c639 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:17.597548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:17.599478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:17.750940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321d6c3-779a-4573-9f9f-150066809d78 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:17.883626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:17.955255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:17.955914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:17.956192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:17.956472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] PATH_INFO: `/v3/users/aa2ef4545f8849ad9fbcf8ede4aa2e95` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:17.970531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2ef4545f8849ad9fbcf8ede4aa2e95)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:17.976782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:18.075670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2ef4545f8849ad9fbcf8ede4aa2e95'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:18.104239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2ef4545f8849ad9fbcf8ede4aa2e95'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:18.107564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2ef4545f8849ad9fbcf8ede4aa2e95'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:18.118846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2ef4545f8849ad9fbcf8ede4aa2e95'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:18.119862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2ef4545f8849ad9fbcf8ede4aa2e95'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:18.143814 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1668/3356] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:17 2022] DELETE /identity/v3/users/aa2ef4545f8849ad9fbcf8ede4aa2e95 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:18.150008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:18.150515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:18.150998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:18.201760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:18.212365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:18.328216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1689/3357] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:18.699185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:18.701743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:18.882751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb36fa-f88c-4c92-9997-3d82999ee067 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:18.888433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:18.889277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:18.889562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:18.889836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:18.911770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:18.913428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:18.938423 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1669/3358] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:19.414408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:19.416811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:19.436674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:19.445480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb347-29e7-4f79-bc98-884c4131d8ed None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:19.453883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:19.454838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:19.455334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:19.455775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:19.459712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:19.505955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:19.508198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:19.523171 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1690/3359] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:19.546968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:19.548612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:19.577254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceabe9-45cd-4bff-befd-e0a28979ac9d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:19.588729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:19.589641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:19.589923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:19.590208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] PATH_INFO: `/v3/projects/e8e68eddf2544de4a3704a4e2c71e77a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:19.591388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e68eddf2544de4a3704a4e2c71e77a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:19.594662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:19.686252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e68eddf2544de4a3704a4e2c71e77a', 'request_id': 'req-604e2dd4-27dd-4c13-b3c9-88a850b95dee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.693495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e68eddf2544de4a3704a4e2c71e77a', 'request_id': 'req-604e2dd4-27dd-4c13-b3c9-88a850b95dee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.695396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:19.714076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e68eddf2544de4a3704a4e2c71e77a', 'request_id': 'req-604e2dd4-27dd-4c13-b3c9-88a850b95dee'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.735179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] The token cache is being invalidate because project e8e68eddf2544de4a3704a4e2c71e77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:19.735524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.736864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.743239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:19.759054 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1670/3360] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:19 2022] DELETE /identity/v3/projects/e8e68eddf2544de4a3704a4e2c71e77a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:19.764208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc23b-ef0a-40de-8d4e-39914a8ee384 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:19.845544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:19.846421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:19.846906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:19.847401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] PATH_INFO: `/v3/users/a8344eb437b14dd1bd466be6ecf5838d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:19.849129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8344eb437b14dd1bd466be6ecf5838d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:19.851362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:19.966563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8344eb437b14dd1bd466be6ecf5838d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.999038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8344eb437b14dd1bd466be6ecf5838d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:19.999809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8344eb437b14dd1bd466be6ecf5838d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:20.012273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8344eb437b14dd1bd466be6ecf5838d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:20.012977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29dee109-34ef-4c00-a4d3-70467cb4f525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8344eb437b14dd1bd466be6ecf5838d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:20.037921 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1691/3361] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:19 2022] DELETE /identity/v3/users/a8344eb437b14dd1bd466be6ecf5838d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:20.735841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:20.737656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:20.767632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e2dd4-27dd-4c13-b3c9-88a850b95dee admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:20.883110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:20.884186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:20.884687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:20.885259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] PATH_INFO: `/v3/projects/81970a19cc174d6d8d837c3a7bafdfc6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:20.886714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81970a19cc174d6d8d837c3a7bafdfc6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:20.889149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:20.972306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81970a19cc174d6d8d837c3a7bafdfc6', 'request_id': 'req-16cc369a-768a-4d1f-aff7-35d00ef9b58b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:20.983809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81970a19cc174d6d8d837c3a7bafdfc6', 'request_id': 'req-16cc369a-768a-4d1f-aff7-35d00ef9b58b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:20.992469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81970a19cc174d6d8d837c3a7bafdfc6', 'request_id': 'req-16cc369a-768a-4d1f-aff7-35d00ef9b58b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:21.018199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] The token cache is being invalidate because project 81970a19cc174d6d8d837c3a7bafdfc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:21.018500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:21.021394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16cc369a-768a-4d1f-aff7-35d00ef9b58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:21.026318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1671/3362] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:20 2022] DELETE /identity/v3/projects/81970a19cc174d6d8d837c3a7bafdfc6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:21.031182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.031640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.031751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.052891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:21.054521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:21.130800 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1692/3363] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:21.139417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.139705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.140071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.163490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:21.165301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:21.176426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1672/3364] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:21.178161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.190664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0cafe-bb9e-4333-8fdb-3074423f2d07 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.197047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.197674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.197973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.198252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.198914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:21.199228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.200858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.208756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:21.219019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.219720 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1693/3365] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:37:21.229360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59253d-d809-48a9-8273-542e95a2d810 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.235478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.236105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.236392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.236675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.237356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.239274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.279397 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1673/3366] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:21.283791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.296865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f34677-d7ea-4bcd-beef-05205e2faa24 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.375181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.375181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.375567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.377703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.377703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.380675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.415718 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1694/3367] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:21.419776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.430966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088e3a1-956b-4139-92af-3d6df075d4c7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.436772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.437484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.437785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.438038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.438927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.440554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.452283 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1674/3368] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:21.456064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.466848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431bde0-57a7-4001-973f-13614ed6e75c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.472004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a37ce2-c18e-431c-bc24-532d86170065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.473182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37ce2-c18e-431c-bc24-532d86170065 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.473182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37ce2-c18e-431c-bc24-532d86170065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.473359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a37ce2-c18e-431c-bc24-532d86170065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.473955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a37ce2-c18e-431c-bc24-532d86170065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.475600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a37ce2-c18e-431c-bc24-532d86170065 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.490804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1695/3369] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:21.492024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.504670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d4f5a-3bcc-413d-85db-e49b600cba0c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.512454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.513191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.513483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.513771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] PATH_INFO: `/v3/projects/fb9499b68a00454d89b1d02448465f7b/users/72335020d83f462bba253b0cd5e4c037/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.532270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9499b68a00454d89b1d02448465f7b, user_id=72335020d83f462bba253b0cd5e4c037, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.534987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.561002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1675/3370] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:21 2022] PUT /identity/v3/projects/fb9499b68a00454d89b1d02448465f7b/users/72335020d83f462bba253b0cd5e4c037/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:21.566481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.566885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.567142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.615002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] MFA Rules not processed for user `72335020d83f462bba253b0cd5e4c037`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:21.616301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:21.717953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1696/3371] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:21.725792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.755705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:21.833684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc381c7f-fab7-4591-a48f-f27b109550b9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.839125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.839750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.840652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.840970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.841625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.843589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.875966 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1676/3372] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:21.880209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:21.892519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7232269-913f-4d61-a18d-ee639edfe2ec None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:21.958862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:21.959544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:21.959894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:21.960231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:21.960997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:21.964339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:21.979494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:22.001305 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1697/3373] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:21 2022] POST /identity/v3/users => generated 301 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:22.002516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.025230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a52dc-2ff0-4dbb-a1b0-2cad4f98585a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.033568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.034728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.035891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.037165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.038333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.042364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.076272 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1677/3374] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:22.077682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.090478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd9b68-7aa1-4fce-8ac1-3f71ab8df260 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.107591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.108716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.109040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.109321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] PATH_INFO: `/v3/projects/e68ad1a1f9ea491f8c9e8550db0d99cd/users/abaca816139c410cb8851e9dceee84ff/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.132539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68ad1a1f9ea491f8c9e8550db0d99cd, user_id=abaca816139c410cb8851e9dceee84ff, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.136525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.160734 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1698/3375] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:22 2022] PUT /identity/v3/projects/e68ad1a1f9ea491f8c9e8550db0d99cd/users/abaca816139c410cb8851e9dceee84ff/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:22.164529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.178232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aed6a-3371-4c27-b33b-121b55560f1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.266852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396cea-d67b-4c20-8668-97a93967bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.267621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396cea-d67b-4c20-8668-97a93967bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.267908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396cea-d67b-4c20-8668-97a93967bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.268183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396cea-d67b-4c20-8668-97a93967bd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.269092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8396cea-d67b-4c20-8668-97a93967bd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.271041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8396cea-d67b-4c20-8668-97a93967bd2a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.284946 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1678/3376] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:22.288104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.299480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08894871-02e0-4bcf-a2f8-d031eac96791 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.309044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.309729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.310013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.310294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] PATH_INFO: `/v3/projects/e68ad1a1f9ea491f8c9e8550db0d99cd/users/abaca816139c410cb8851e9dceee84ff/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.312272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68ad1a1f9ea491f8c9e8550db0d99cd, user_id=abaca816139c410cb8851e9dceee84ff, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.315012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.329417 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1699/3377] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:22 2022] PUT /identity/v3/projects/e68ad1a1f9ea491f8c9e8550db0d99cd/users/abaca816139c410cb8851e9dceee84ff/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:22.343368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.343733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.344126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.381965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] MFA Rules not processed for user `abaca816139c410cb8851e9dceee84ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:22.383692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:22.527864 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1679/3378] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:22.529040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.548798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc65e1-0f28-4d4d-b7ef-fecfd2e46651 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.558555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.559646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.560192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.560686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.561757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.563233 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:22.563233 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:22.563233 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:22.565716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.613346 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1700/3379] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:37:22 2022] POST /identity/v3/domains => generated 277 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:22.614830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.628073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ed7fb-4c85-4d69-be11-3a4fcd6d0d56 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.635436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:22.748293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.750373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.750911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.751657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.753156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=cb967cd9e4844213bb59460406235179)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.763036 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:22.763036 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:22.763036 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:22.765523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.843801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.846860 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1680/3380] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:37:22 2022] PUT /identity/v3/domains/cb967cd9e4844213bb59460406235179/config => generated 138 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:22.862955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b615084-4bcf-4230-9758-09baf0733b42 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.876473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.877425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.877591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.880419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.881976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cb967cd9e4844213bb59460406235179, group=identity)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.883206 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:22.883206 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:22.883206 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:22.885897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.898448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.908462 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1701/3381] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:37:22 2022] GET /identity/v3/domains/cb967cd9e4844213bb59460406235179/config/identity => generated 45 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:22.911162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e104a-9c20-415e-8716-96b012421fde tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.929612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.933135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.933932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.933932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config/identity/driver` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.935923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cb967cd9e4844213bb59460406235179, group=identity, option=driver)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.937816 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:22.937816 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:22.937816 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:22.940535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.954959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:22.955626 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1681/3382] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 5 02:37:22 2022] GET /identity/v3/domains/cb967cd9e4844213bb59460406235179/config/identity/driver => generated 31 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:22.967683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afa1a1-ae9f-4868-a9a8-4d97e89b6592 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:22.973351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:22.975040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:22.975751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:22.976115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config/ldap` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:22.978113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cb967cd9e4844213bb59460406235179, group=ldap)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:22.979882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:22.990007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.000157 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1702/3383] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:37:22 2022] GET /identity/v3/domains/cb967cd9e4844213bb59460406235179/config/ldap => generated 106 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:23.002806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3aa98-1ffa-4d16-9bc8-71f10780c2f6 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:23.008105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:23.010128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:23.010415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:23.010695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config/ldap/url` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:23.012160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cb967cd9e4844213bb59460406235179, group=ldap, option=url)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:23.014082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:23.021880 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1682/3384] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:37:22 2022] GET /identity/v3/domains/cb967cd9e4844213bb59460406235179/config/ldap/url => generated 46 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:23.026375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.041666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6454e-69af-45f6-9858-7eb7a27fd4f4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:23.067888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:23.068581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:23.068872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:23.070104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config/ldap/user_tree_dn` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:23.074408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=cb967cd9e4844213bb59460406235179, group=ldap, option=user_tree_dn)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:23.079314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:23.109703 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1703/3385] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Oct 5 02:37:23 2022] GET /identity/v3/domains/cb967cd9e4844213bb59460406235179/config/ldap/user_tree_dn => generated 63 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:23.110938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.139329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a30ad-fb2e-439c-87e8-71637d498253 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:23.144616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:23.145521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:23.145521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:23.145831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179/config` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:23.146424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=cb967cd9e4844213bb59460406235179)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:23.147438 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:23.147438 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:23.147438 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:23.148329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:23.163394 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1683/3386] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:23 2022] DELETE /identity/v3/domains/cb967cd9e4844213bb59460406235179/config => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:23.168332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.189922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd60ae2-28d4-487d-969b-feddcfaec539 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:23.198711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:23.199992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:23.200324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:23.200611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:23.202176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cb967cd9e4844213bb59460406235179)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:23.203203 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:23.203203 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:23.203203 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:23.204097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:23.238458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cb967cd9e4844213bb59460406235179'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.239239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cb967cd9e4844213bb59460406235179'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.285952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cb967cd9e4844213bb59460406235179'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.287098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cb967cd9e4844213bb59460406235179'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.291473 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1704/3387] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:23 2022] PATCH /identity/v3/domains/cb967cd9e4844213bb59460406235179 => generated 278 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:37:23.295598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.298501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:23.315644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b8258-f204-4174-a8de-e2fe2c6bdd2f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:23.416060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:23.417219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:23.417219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:23.417441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:23.432101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cb967cd9e4844213bb59460406235179)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:23.433279 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:23.433279 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:23.433279 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:23.434271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:23.468545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cb967cd9e4844213bb59460406235179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.475705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cb967cd9e4844213bb59460406235179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.517699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:23.558189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb967cd9e4844213bb59460406235179', 'request_id': 'req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.565465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb967cd9e4844213bb59460406235179', 'request_id': 'req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.576614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb967cd9e4844213bb59460406235179', 'request_id': 'req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.592765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] The token cache is being invalidate because project cb967cd9e4844213bb59460406235179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:23.593183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.593937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.606601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cb967cd9e4844213bb59460406235179', 'request_id': 'req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.607713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cb967cd9e4844213bb59460406235179', 'request_id': 'req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.613328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cb967cd9e4844213bb59460406235179', 'request_id': 'req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:23.621441 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1684/3388] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:23 2022] DELETE /identity/v3/domains/cb967cd9e4844213bb59460406235179 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:23.634236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.661931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5f064-f1e3-43ed-abab-c2730c33a1c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:23.816155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:23.817832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:23.818318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:23.822841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:23.824954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:23.832923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:23.879945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1705/3389] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:37:23 2022] POST /identity/v3/domains => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:23.885851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:23.887632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:23.922059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b72fc-3ed4-4325-bd93-e6c0fb290eef tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.010616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.011106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.011508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.011863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3/config` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.012945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.014871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.072253 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1685/3390] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:37:23 2022] PUT /identity/v3/domains/a92e610398c443fd934affdd0cddeea3/config => generated 138 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:24.074002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.087365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0a7cb-b44d-484f-8489-a9d10bc615a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.093333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.094023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.094313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.094599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3/config` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.095311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.096359 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:24.096359 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:24.096359 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:24.097667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.144379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:24.156810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.161970 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1706/3391] 10.222.0.16 () {60 vars in 1271 bytes} [Wed Oct 5 02:37:24 2022] PATCH /identity/v3/domains/a92e610398c443fd934affdd0cddeea3/config => generated 142 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:24.174726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5bb2-a7cd-42c8-b982-bf5146e637f1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.185081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.187743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.188685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.189237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3/config` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.190926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.195466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.216823 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1686/3392] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:24 2022] GET /identity/v3/domains/a92e610398c443fd934affdd0cddeea3/config => generated 142 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:24.218319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.233468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb46362-cb99-4be9-8f3c-51cb819dc835 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.238664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.239337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.239625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.239907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3/config` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.240575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.241654 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:24.241654 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:24.241654 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:24.242672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.257222 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1707/3393] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:24 2022] DELETE /identity/v3/domains/a92e610398c443fd934affdd0cddeea3/config => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:24.262768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.278494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21d7d3-be8c-4156-9b2d-feca2ae55086 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.284393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.285383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.285745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.286103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3/config` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.287437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.290691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Could not find any options in domain configuration for domain a92e610398c443fd934affdd0cddeea3.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a92e610398c443fd934affdd0cddeea3. Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 05 02:37:24.301757 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain a92e610398c443fd934affdd0cddeea3. Oct 05 02:37:24.302731 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:24.311007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.322614 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1687/3394] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:24 2022] GET /identity/v3/domains/a92e610398c443fd934affdd0cddeea3/config => generated 151 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:24.324205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c045-80e4-4d1f-b52f-99412b4e7e9f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.342994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.343694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.343988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.344595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3/config` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.344891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.346582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.390958 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1708/3395] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:24 2022] DELETE /identity/v3/domains/a92e610398c443fd934affdd0cddeea3/config => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:24.402962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.425495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8916ca1-5403-497e-87d0-184eb902291c tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.439954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.440603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.440888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.441185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.442691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.451213 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:24.451213 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:24.451213 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:24.452147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.513107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a92e610398c443fd934affdd0cddeea3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:24.513407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a92e610398c443fd934affdd0cddeea3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:24.575611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a92e610398c443fd934affdd0cddeea3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:24.581371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a92e610398c443fd934affdd0cddeea3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:24.584302 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1688/3396] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:24 2022] PATCH /identity/v3/domains/a92e610398c443fd934affdd0cddeea3 => generated 276 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:37:24.589331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:24.591128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:24.614357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaba5a-8df0-408b-b7cd-35d88b1b17b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:24.755393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:24.755885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:24.756170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:24.756448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:24.783944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a92e610398c443fd934affdd0cddeea3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:24.784957 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:24.784957 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:24.784957 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:24.786308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:24.842141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a92e610398c443fd934affdd0cddeea3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:24.859065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a92e610398c443fd934affdd0cddeea3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:24.995991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92e610398c443fd934affdd0cddeea3', 'request_id': 'req-4df86b56-be24-40dc-a94e-8de866a267c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.021343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92e610398c443fd934affdd0cddeea3', 'request_id': 'req-4df86b56-be24-40dc-a94e-8de866a267c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.030029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92e610398c443fd934affdd0cddeea3', 'request_id': 'req-4df86b56-be24-40dc-a94e-8de866a267c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.056618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] The token cache is being invalidate because project a92e610398c443fd934affdd0cddeea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:25.056930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.057734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.082325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a92e610398c443fd934affdd0cddeea3', 'request_id': 'req-4df86b56-be24-40dc-a94e-8de866a267c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.083500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a92e610398c443fd934affdd0cddeea3', 'request_id': 'req-4df86b56-be24-40dc-a94e-8de866a267c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.088933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a92e610398c443fd934affdd0cddeea3', 'request_id': 'req-4df86b56-be24-40dc-a94e-8de866a267c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:25.102464 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1709/3397] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:24 2022] DELETE /identity/v3/domains/a92e610398c443fd934affdd0cddeea3 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:25.108098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:25.113446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:25.128941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4be29-be06-4748-8df5-a210c10713bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:25.249291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:25.252498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:25.252791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:25.254275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:25.255221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:25.256997 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:25.256997 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:25.256997 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:25.259655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:25.289831 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1689/3398] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:37:25 2022] POST /identity/v3/domains => generated 276 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:25.293456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:25.296062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:25.321640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df86b56-be24-40dc-a94e-8de866a267c0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:25.363892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:25.467205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:25.468611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:25.469168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:25.469628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:25.470934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=964962569bfb4f929f3d870d791c353c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:25.472873 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:25.472873 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:25.472873 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:25.474219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:25.554043 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1710/3399] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:37:25 2022] PUT /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config => generated 138 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:25.559111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:25.583302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ae7e9-5839-4bf8-a666-5141c52131ae tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:25.604847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:25.610481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:25.615104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:25.615692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:25.621959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=964962569bfb4f929f3d870d791c353c, group=identity)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:25.624406 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:25.624406 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:25.624406 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:25.630392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:25.828763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1690/3400] 10.222.0.16 () {60 vars in 1297 bytes} [Wed Oct 5 02:37:25 2022] PATCH /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity => generated 177 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:25.829936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:25.851180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1320-c217-48e0-b5d7-5dd0c3d6d9e1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:25.892619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:25.895093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:25.897073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:25.898042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity/driver` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:25.908465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=964962569bfb4f929f3d870d791c353c, group=identity, option=driver)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:25.917534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.004961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1711/3401] 10.222.0.16 () {60 vars in 1318 bytes} [Wed Oct 5 02:37:25 2022] PATCH /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity/driver => generated 176 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:26.009056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.028419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd14d1d-a832-43f3-a339-4629e622b239 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.041776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.042573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.042959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.043454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity/driver` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.044123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=964962569bfb4f929f3d870d791c353c, group=identity, option=driver)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.048430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.095743 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1691/3402] 10.222.0.16 () {58 vars in 1299 bytes} [Wed Oct 5 02:37:26 2022] DELETE /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity/driver => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:26.097845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.135144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eebb6d-f943-4275-9806-a092e65ab390 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.143404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.144106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.144396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.144680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity/driver` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.146029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=964962569bfb4f929f3d870d791c353c, group=identity, option=driver)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.147662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Could not find option driver in group identity in domain configuration for domain 964962569bfb4f929f3d870d791c353c.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:26.161692 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:26.162650 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:26.174432 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1712/3403] 10.222.0.16 () {58 vars in 1296 bytes} [Wed Oct 5 02:37:26 2022] GET /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity/driver => generated 171 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:26.176122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.187404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b38541-adb7-4e6b-b8bd-bb0de89c0fe3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.194309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.195128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.195549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.196627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.197504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=964962569bfb4f929f3d870d791c353c, group=identity)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.199507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.236616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.237261 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1692/3404] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 02:37:26 2022] DELETE /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:26.252261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875a36b-0692-4374-ad65-5b91ba624abb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.260651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.261677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.262048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.263228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.264045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=964962569bfb4f929f3d870d791c353c, group=identity)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.267125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Could not find group identity in domain configuration for domain 964962569bfb4f929f3d870d791c353c.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:26.292394 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:26.293908 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:26.298547 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1713/3405] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Oct 5 02:37:26 2022] GET /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config/identity => generated 154 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:26.304614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.325843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584879-0080-476e-bfd0-167046ee7a5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.332820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.334123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.334700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.335435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c/config` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.337411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=964962569bfb4f929f3d870d791c353c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.339686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.353582 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1693/3406] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:26 2022] DELETE /identity/v3/domains/964962569bfb4f929f3d870d791c353c/config => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:26.358937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.388858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3f486-c7a5-4fa0-85e3-14a92693829a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.401462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.402265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.402653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.403053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.404535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=964962569bfb4f929f3d870d791c353c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.408935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.433385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '964962569bfb4f929f3d870d791c353c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:26.434372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '964962569bfb4f929f3d870d791c353c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:26.500284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.502773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:26.508003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '964962569bfb4f929f3d870d791c353c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:26.510128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '964962569bfb4f929f3d870d791c353c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:26.522726 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1714/3407] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:26 2022] PATCH /identity/v3/domains/964962569bfb4f929f3d870d791c353c => generated 277 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:37:26.528991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.530783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:26.706542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd11bc-91ca-4721-8669-2a30f9ae2816 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.730294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aad53-c194-4338-935e-b6d69712e7b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:26.742475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.743811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.744100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.744374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.752703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:26.757515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:26.770563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=964962569bfb4f929f3d870d791c353c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.786528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.888009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '964962569bfb4f929f3d870d791c353c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:26.896252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '964962569bfb4f929f3d870d791c353c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:26.914793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:26.915699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:26.916054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:26.916398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:26.918930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:26.950350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:26.953701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:26.985511 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1694/3408] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:26.989631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:26.995170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:27.012487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964962569bfb4f929f3d870d791c353c', 'request_id': 'req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.036516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964962569bfb4f929f3d870d791c353c', 'request_id': 'req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.044011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964962569bfb4f929f3d870d791c353c', 'request_id': 'req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.065002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] The token cache is being invalidate because project 964962569bfb4f929f3d870d791c353c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:27.066540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.066540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.076761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '964962569bfb4f929f3d870d791c353c', 'request_id': 'req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.077743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '964962569bfb4f929f3d870d791c353c', 'request_id': 'req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.081835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '964962569bfb4f929f3d870d791c353c', 'request_id': 'req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.094349 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1715/3409] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:26 2022] DELETE /identity/v3/domains/964962569bfb4f929f3d870d791c353c => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:27.097777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.099578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:27.129212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7a9a-692a-4638-9c8d-7d581a5d5cc3 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.195197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3c4c3-cbf3-48d8-8a33-98aaef567e80 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.212634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.213660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.214044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.214417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] PATH_INFO: `/v3/users/83a280fd56304b47acca3f0b4061e18a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.215992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a280fd56304b47acca3f0b4061e18a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.219633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.220302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.220733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.221221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.222095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.223576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.224934 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:27.224934 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:27.224934 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:27.226373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.234228 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1716/3410] 10.222.0.16 () {58 vars in 1173 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:27.239137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.254512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f97-7a2d-476a-acae-3d4bb3ef0e5f tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.259859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.260506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.260986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.261384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.262391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.264848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.266584 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1717/3411] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:27.272056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.307089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8561e-9469-42ff-8cc4-30cd96884d45 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.320359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:27.322823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.324883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.325534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.327016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.329697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a280fd56304b47acca3f0b4061e18a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.330490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.332667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.339516 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1718/3412] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:27.340946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.359359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945b6ca-968a-401e-9753-88a7b6ca3ac2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.374273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.375265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.375861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.376360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.377191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.379448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.387066 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1719/3413] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:27.388743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a280fd56304b47acca3f0b4061e18a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.390084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a280fd56304b47acca3f0b4061e18a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.391139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.393505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:27.425628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdbbcb-1cee-4a30-8f62-f3be8969ce11 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.432076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a280fd56304b47acca3f0b4061e18a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.433469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f62457b8-2c6a-4937-8b67-939f69e713e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a280fd56304b47acca3f0b4061e18a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:27.450267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.452379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.453031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.453454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.455738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.465288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.467025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1720/3414] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:27.471424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.507960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96213-91c8-40c1-8d52-fa2e088d70d3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.520638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.521555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.521911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.522687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.526742 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1695/3415] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:26 2022] DELETE /identity/v3/users/83a280fd56304b47acca3f0b4061e18a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:27.529990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.534676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.534962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.535138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.535519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.543476 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1721/3416] 10.222.0.16 () {58 vars in 1200 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:27.544623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.581983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dea35b-221d-4ea1-acfc-25eadb9f92e0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.635691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:27.639378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:27.665814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:27.766443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.767129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.767415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.767695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.768306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.773648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.774981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1722/3417] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:27.780081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.808166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5477f-7afa-4a00-808c-b67be50d7516 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.820495 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1696/3418] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:27.825081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.826072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.826509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.826877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.827702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.829602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.835096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.835276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1723/3419] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:27.847152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7b470-2b93-4ffd-a153-67e3e6ea6aea None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.853916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.854738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.855121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.855493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.856361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.857759 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:27.857759 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:27.857759 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:27.858958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.863379 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1697/3420] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:27.864272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.876850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.881071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f220b6-3474-40fd-9eac-219bcad40a26 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.883883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:27.892923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.895803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.896193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.896565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.898000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.905039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.911151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1724/3421] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:27.914062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.936892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28415b3c-6745-464c-b6ed-cbf3ab5496e2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.949260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:27.950158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:27.950537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:27.951171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:27.952526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:27.957498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:27.963233 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1725/3422] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:27.968523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:27.989722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73585a-8339-4c26-ad28-01c29099f4c1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:27.998906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.000366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.000834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.001635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.002915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.004805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.010876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1726/3423] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.011887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.024953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431ba9-b831-41ac-b0fa-815169d854be tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.034159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.034934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.035403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.035796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.036500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.037548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec1cb-36be-47ac-bb96-7b1f686af1d1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.039291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.042403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.043406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.044468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.044605 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1727/3424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.045239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.046061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.060617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4fb25-f91f-4688-bd8c-7efd60a1ab54 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.070514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.072744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.072877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.073387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.074015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.074692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.075403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.078126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.082979 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1728/3425] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.084856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.091793 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1698/3426] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:28.097327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e465563-1937-4698-80cd-87b9251f92f8 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.104581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.107024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.107884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.108432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.109326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.111143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.118275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1729/3427] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.119331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.140311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838db42d-b783-4f8f-b10a-3807af0e9e70 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.151407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.152830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.157161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.157741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.158897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.160738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.167620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.180876 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1699/3428] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.185516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f8503-3531-403f-9c06-dffd5c9e54cb tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.193458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.194117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.194457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.194738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.195330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.198029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.203831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.212381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1730/3429] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.226812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942836-7e45-499b-8650-f824c048fd03 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.232001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.232994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.233414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.233588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.234390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.236519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.261322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1700/3430] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.264321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.291826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16a9a6-0190-4796-acf2-096dcd066c57 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.306904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.308847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.312445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.312445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.312445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.315976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.318380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1731/3431] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.324662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.340755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816a3a1-a0e0-40e6-a9ec-22ea518495bc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.348292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.349093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.350089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.350473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.351617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.354089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.365649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1701/3432] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.368117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.379969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ceadc-eeab-4b74-a2c1-17ee87ca25c5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.386023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c4408-39ed-49ba-ac63-78f6103c7448 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.386953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c4408-39ed-49ba-ac63-78f6103c7448 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.387330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c4408-39ed-49ba-ac63-78f6103c7448 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.387784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c4408-39ed-49ba-ac63-78f6103c7448 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.389053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c4408-39ed-49ba-ac63-78f6103c7448 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.390728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c4408-39ed-49ba-ac63-78f6103c7448 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.395922 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1732/3433] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.400832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.400939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62064f15-78dc-478d-b755-eb41becaedae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.400939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62064f15-78dc-478d-b755-eb41becaedae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.400939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62064f15-78dc-478d-b755-eb41becaedae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.421132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870b8e3-f93a-496e-bc0b-a3589e5719f9 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.444242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.444931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.445284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.445600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.448631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.450652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-62064f15-78dc-478d-b755-eb41becaedae None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:28.452081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62064f15-78dc-478d-b755-eb41becaedae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:28.452658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.459965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1702/3434] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.463142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.493701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e508-811d-400f-8b72-a6e1cd0d5158 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.510675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.511657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.511948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.512229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.512821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.515621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.517031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1703/3435] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.521041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.546881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9839c6-e3b1-44b2-99d8-f37a0cc440bd tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.563193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.563857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.564570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.564865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.565523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.568636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.576890 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1704/3436] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.577865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.605354 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1733/3437] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:28.611009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de3bbd-8f3d-4480-9151-ddd22e66b934 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.639447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.642667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.642667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.643373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62064f15-78dc-478d-b755-eb41becaedae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.645234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-62064f15-78dc-478d-b755-eb41becaedae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:28.648335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.656183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.658483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.670464 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1705/3438] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:28.670464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.677902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:28.731776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d87651-1a78-4162-a801-bcc518c4695b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.738612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.739072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.739370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.739616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] PATH_INFO: `/v3/projects/eccc732cf08749648be251ca96d18cd1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.741032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccc732cf08749648be251ca96d18cd1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.747271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.798490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62064f15-78dc-478d-b755-eb41becaedae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.806262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:28.806574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:28.806853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:28.807117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:28.818533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:28.820500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:28.824512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:28.834863 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1734/3439] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:37:28.836038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.862338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0a93-61be-4182-998a-86987b51a3d3 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:28.870631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccc732cf08749648be251ca96d18cd1', 'request_id': 'req-ff68dd3c-38d1-4fe5-930f-420a55cabc16'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:28.885689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccc732cf08749648be251ca96d18cd1', 'request_id': 'req-ff68dd3c-38d1-4fe5-930f-420a55cabc16'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:28.888335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:28.905360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccc732cf08749648be251ca96d18cd1', 'request_id': 'req-ff68dd3c-38d1-4fe5-930f-420a55cabc16'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:28.940273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] The token cache is being invalidate because project eccc732cf08749648be251ca96d18cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:28.940689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:28.941413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:28.943084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1706/3440] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:28 2022] DELETE /identity/v3/projects/eccc732cf08749648be251ca96d18cd1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:28.947987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:28.950933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:29.026519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.027200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.027516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.028165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.028776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.046555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.051065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1735/3441] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:37:28 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.054243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.073126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:29.119662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff29382-6c75-445d-b040-266197aee395 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.143642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.144323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.145744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.146028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.146703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.148268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.152279 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1736/3442] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:29.157069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.163820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68dd3c-38d1-4fe5-930f-420a55cabc16 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.179864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.182689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.183225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.183340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] PATH_INFO: `/v3/users/5f174aa8d19d4073a57d9c60fb11c10c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.189034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f174aa8d19d4073a57d9c60fb11c10c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.192049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f477ce-13af-4ace-ac35-44fb22c42fc5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.194587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.208509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7916db-3455-45e1-80af-ad856f3eb24b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.209273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7916db-3455-45e1-80af-ad856f3eb24b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.209518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7916db-3455-45e1-80af-ad856f3eb24b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.209851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7916db-3455-45e1-80af-ad856f3eb24b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.210388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7916db-3455-45e1-80af-ad856f3eb24b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.212125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7916db-3455-45e1-80af-ad856f3eb24b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.220949 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1737/3443] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.222309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.226110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.226425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.282728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:29.287616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:29.319081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f174aa8d19d4073a57d9c60fb11c10c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:29.342885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f174aa8d19d4073a57d9c60fb11c10c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:29.344363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f174aa8d19d4073a57d9c60fb11c10c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:29.369865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f174aa8d19d4073a57d9c60fb11c10c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:29.370946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f174aa8d19d4073a57d9c60fb11c10c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:29.398398 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1707/3444] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:28 2022] DELETE /identity/v3/users/5f174aa8d19d4073a57d9c60fb11c10c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:29.399628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.401092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:29.418636 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1738/3445] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:29.440959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.442631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:29.467563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:29.512099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421680e-4f32-4368-848b-ad370a77d2dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.517834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.518501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.518793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.519204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.519811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.521601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.526439 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1708/3446] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.527388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.538539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980557-fc8f-46a7-bc84-12400370fef4 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.544423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.545300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.546014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.546156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.546807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.549063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.553650 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1709/3447] 10.222.0.16 () {58 vars in 1308 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.554906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.561313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423d5a-ac4f-464c-9cc1-e09649b5ab42 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.566902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e2876-f168-4958-baae-983eeab03532 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.578764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.579387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.580227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.580599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.581162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.583870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.590349 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1710/3448] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.591820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.604235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a7b7c-bdfe-4c89-ab4f-4676f5723f07 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.610656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.611343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.611628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.611906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.612510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.614434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.620061 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1711/3449] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.620844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.633114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cfc5b-1408-4bd3-bd95-0d3486815520 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.641873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.642673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.642959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.643243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.644248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.646424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.647774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1712/3450] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.652625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.662409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:29.672845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5e9d-1f07-42c0-9bb9-afc9239237c2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.678508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.679150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.679435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.679712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.680175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.680322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.681074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.681535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.681910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.682358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.687343 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1713/3451] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.688418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.700428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1297a1-07ae-4817-9029-7614da24db36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.705529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.706184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.706468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.707042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.707898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.710217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.715301 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1714/3452] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.716189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.728782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9852c3-5719-4a47-b953-ef3614c57037 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.736799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.737489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.738164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.739085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.739724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.741454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.743243 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1715/3453] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.747639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.760586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2785c-5ccb-4849-a84b-89d03fdb3c08 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.765957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.766624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.766746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.766904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.767185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.768306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.768888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.769855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.775051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1716/3454] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.776191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.791272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f0003-0f84-4fcb-ab2e-7459bef8d0b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.796891 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1739/3455] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:29.799029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.799605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.800064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.800348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.800968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.802571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.808558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.809414 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1717/3456] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.831091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcec188-c3e2-4593-8e1e-e25a118e03be service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.836261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.838184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.838660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.839070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.839958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.841721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.846124 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1740/3457] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:29.847424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.861644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a46581-60dc-4b3a-91cf-cba9698eedd2 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.887435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.888133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.888421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.888711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.890130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.893001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.894754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1718/3458] 10.222.0.16 () {58 vars in 1257 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.898742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.918731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1fc6-cddb-4e88-bcc1-327d0754c757 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.927726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43c00a-bf6a-4023-94eb-f1bb809c1a36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.940453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43c00a-bf6a-4023-94eb-f1bb809c1a36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.941024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43c00a-bf6a-4023-94eb-f1bb809c1a36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.941547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43c00a-bf6a-4023-94eb-f1bb809c1a36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.952659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43c00a-bf6a-4023-94eb-f1bb809c1a36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.957667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43c00a-bf6a-4023-94eb-f1bb809c1a36 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.959658 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1741/3459] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:29.964754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:29.976082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef51a7-85c2-45e2-b1e4-edcb990df801 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:29.983372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:29.984228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.984615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.985373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.986335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:29.989102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:29.990864 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1719/3460] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:29.994338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:29.994657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:29.994936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:29.998146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.012828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd831-e1b2-4230-be0a-b661cc56a192 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.016268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:30.017753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.019414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.020639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.021025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.021408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.022231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.024273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.027303 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1742/3461] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:30.030799 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1720/3462] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:29 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.042858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.043289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.064728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1de654-8330-4bcd-ad69-918c03f0d014 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.068328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e88b2-aff8-491c-9b9d-23d37ed54ed9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.076455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.077104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.077389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.077668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.078838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.079486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.079766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.080036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.080634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.082282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.083548 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1743/3463] 10.222.0.16 () {58 vars in 1212 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.088996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.108146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.108647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb7d0a-347a-493e-accf-1419f905d4b0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.110090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.120007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.121617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.122121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.123452 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1721/3464] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:37:30.129992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.130812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.132600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.146171 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1744/3465] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.150642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.163555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a77d2a-369e-4c0b-be35-dcde1e8b4bd9 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.170412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.171302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.171800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.172405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.173035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.175315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.175964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.177864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.181054 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1722/3466] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.182666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.226084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a4d26-646c-4601-b7d4-84ce65653eba tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.249831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.251713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.253197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.253986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.255400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.257994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.261387 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1723/3467] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.270336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.290730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e054cb-8d7d-4199-a4a3-a93c9dc1750b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.299005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.300431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.300925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.301385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.302826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.306345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.309196 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1724/3468] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.314573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.333713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ba5ce-23ad-4482-a22c-07e8c73115a3 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.341570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.343070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.345957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.346498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.347327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.348613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653f3f1-191b-4e7a-a5ce-9fc2820639b1 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.349512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.353400 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1725/3469] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 05 02:37:30.354579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.355477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.356459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.356743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.357167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] PATH_INFO: `/v3/projects/071483f03fe14dc58fbd18ee9f167372` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.358188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.358870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] RBAC: Authorizing `identity:delete_project(project_id=071483f03fe14dc58fbd18ee9f167372)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.361177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.377568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bf207-4707-4e40-ad6d-9f6d24050680 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.385359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.386477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.386943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.387402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] PATH_INFO: `/v3/users/f551e15d65a34daaac2b4d4f5963c522` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.389227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f551e15d65a34daaac2b4d4f5963c522)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.391413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.438252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071483f03fe14dc58fbd18ee9f167372', 'request_id': 'req-923cbfac-30ed-4e04-a153-67dd6f7d384c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.451117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071483f03fe14dc58fbd18ee9f167372', 'request_id': 'req-923cbfac-30ed-4e04-a153-67dd6f7d384c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.459626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071483f03fe14dc58fbd18ee9f167372', 'request_id': 'req-923cbfac-30ed-4e04-a153-67dd6f7d384c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.469739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f551e15d65a34daaac2b4d4f5963c522'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.475242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] The token cache is being invalidate because project 071483f03fe14dc58fbd18ee9f167372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:30.475544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.476651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.478626 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1745/3470] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:30 2022] DELETE /identity/v3/projects/071483f03fe14dc58fbd18ee9f167372 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:30.479321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.480867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.487976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:30.499031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f551e15d65a34daaac2b4d4f5963c522'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.500160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f551e15d65a34daaac2b4d4f5963c522'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.513176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f551e15d65a34daaac2b4d4f5963c522'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.514143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b87213b4-b70f-4573-9939-71284d46a612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f551e15d65a34daaac2b4d4f5963c522'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:30.535489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1726/3471] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:30 2022] DELETE /identity/v3/users/f551e15d65a34daaac2b4d4f5963c522 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:30.538333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.539060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.540525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.570206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:30.572412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.587390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cbfac-30ed-4e04-a153-67dd6f7d384c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.601624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:30.684344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3deb9d-0a42-4907-ab47-7312c0c780dc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.685739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3deb9d-0a42-4907-ab47-7312c0c780dc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.686217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3deb9d-0a42-4907-ab47-7312c0c780dc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.686681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3deb9d-0a42-4907-ab47-7312c0c780dc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.687626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3deb9d-0a42-4907-ab47-7312c0c780dc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.689639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3deb9d-0a42-4907-ab47-7312c0c780dc tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.691231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1746/3472] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.692960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94253c13-3733-4e0e-a7d1-b956ffe2905d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.693408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94253c13-3733-4e0e-a7d1-b956ffe2905d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.693834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94253c13-3733-4e0e-a7d1-b956ffe2905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.703075 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1727/3473] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:30.704195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.707380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.723041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-94253c13-3733-4e0e-a7d1-b956ffe2905d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:30.724695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94253c13-3733-4e0e-a7d1-b956ffe2905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.727838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eda347-b609-432b-95b2-a3fc2bef80ee None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.734446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.735461 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1747/3474] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:30.737701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.738126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.738535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.738909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.739469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.739864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.740608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.744665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.749729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1728/3475] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.752269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.765842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:30.767125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.769101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cde93f-618f-453d-b5c3-34d832fdf518 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.775567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.779443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.779578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1748/3476] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:30.779702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.779702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.779866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.779952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.780038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:30.780209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.781911 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1729/3477] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.786327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.829467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81817687-0fcf-4651-8638-70d93d0cd688 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.836282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.838605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.839016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.839572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.840372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:30.840814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.843966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.866961 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1730/3478] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:30.866961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.884146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6eb176-e2a8-4858-98ad-f3952fc87561 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.894543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.895977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.896536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.897075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.897793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.900863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.905092 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1731/3479] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:30.906967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.915616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603dfe-199b-4193-a989-0b362090d2c2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.927882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.928578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.928866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.930660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.931329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40495-30d8-46e2-bbfd-d1e3ca56bc5a tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.942859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.943624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.943910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.944789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.945471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.949434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.951078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.954327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:30.970623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1749/3480] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:30.971520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:30.988360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcdb25-0fb5-4c28-a45c-2905c975a225 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:30.995796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:30.996558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:30.996845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:30.997417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:30.998026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:30.999822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.004356 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1750/3481] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 02:37:30 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 02:37:31.005209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1732/3482] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:30 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:31.009675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.010131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.028734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd40e-7410-4e18-8527-8556e62419b5 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.083974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820f2c-f7bd-4bb3-9353-82fe49fb097a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.093293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:31.094453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.095217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.095217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.095513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/964962569bfb4f929f3d870d791c353c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.114049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Could not find domain: 964962569bfb4f929f3d870d791c353c.: keystone.exception.DomainNotFound: Could not find domain: 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:31.124735 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:31.125953 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:37:31.127121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 964962569bfb4f929f3d870d791c353c. Oct 05 02:37:31.128265 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.128265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1733/3483] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:31 2022] PATCH /identity/v3/domains/964962569bfb4f929f3d870d791c353c => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:31.131280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.139210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.141684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.142425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.142863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.144268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.144411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4956b-f240-4587-b3e1-f0b1b2af74a0 tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.147569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.151853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.152245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.152537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.152870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/a92e610398c443fd934affdd0cddeea3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.161973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Could not find domain: a92e610398c443fd934affdd0cddeea3.: keystone.exception.DomainNotFound: Could not find domain: a92e610398c443fd934affdd0cddeea3. Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a92e610398c443fd934affdd0cddeea3. Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:31.168729 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:31.169975 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:37:31.171064 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a92e610398c443fd934affdd0cddeea3. Oct 05 02:37:31.172343 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.173875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1734/3484] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:31 2022] PATCH /identity/v3/domains/a92e610398c443fd934affdd0cddeea3 => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:31.174992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.185367 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1751/3485] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:31 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:31.190192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.190371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5c776-f3bf-42cf-8ee5-4052dc2bc0db tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.200584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abaca816139c410cb8851e9dceee84ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.202392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.202392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.202620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] PATH_INFO: `/v3/domains/cb967cd9e4844213bb59460406235179` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.210982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ea589-2c38-4aec-bab6-ddac979bed26 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.213193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:37:31.217166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.217988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.218428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.218903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.219707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Could not find domain: cb967cd9e4844213bb59460406235179.: keystone.exception.DomainNotFound: Could not find domain: cb967cd9e4844213bb59460406235179. Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cb967cd9e4844213bb59460406235179. Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:31.219857 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:31.220895 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:37:31.221894 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cb967cd9e4844213bb59460406235179. Oct 05 02:37:31.223019 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:31.225569 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1735/3486] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:31 2022] PATCH /identity/v3/domains/cb967cd9e4844213bb59460406235179 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:31.225911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.226567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.229487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:31.239690 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1752/3487] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:31.243806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.247692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f068c-06d6-49c0-b247-8305ccfc259b tempest-DomainConfigurationTestJSON-793922851 tempest-DomainConfigurationTestJSON-793922851-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.253833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.254992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.254992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.255322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] PATH_INFO: `/v3/users/72335020d83f462bba253b0cd5e4c037` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.256869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] RBAC: Authorizing `identity:delete_user(user_id=72335020d83f462bba253b0cd5e4c037)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.260967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.261496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22458623-7635-4753-8ed5-023070dd46cf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.271061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.271909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.272378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.272812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.274226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.277106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.293226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1753/3488] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:31.297943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.311861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660393-80ce-4f69-8876-85a22cfb24ea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.317754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3eea3-58d9-4b1a-8da8-229a9ce8858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.319180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3eea3-58d9-4b1a-8da8-229a9ce8858f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.319310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3eea3-58d9-4b1a-8da8-229a9ce8858f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.319531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3eea3-58d9-4b1a-8da8-229a9ce8858f admin admin] PATH_INFO: `/v3/projects/f5a44c2cd99949c2a30ab83bdede01e6/users/b86e3b7d1c9a4b2c8f2914beefa74cc1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.341242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3eea3-58d9-4b1a-8da8-229a9ce8858f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a44c2cd99949c2a30ab83bdede01e6, user_id=b86e3b7d1c9a4b2c8f2914beefa74cc1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.341846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72335020d83f462bba253b0cd5e4c037'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:31.344369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3eea3-58d9-4b1a-8da8-229a9ce8858f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.347815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:31.363277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72335020d83f462bba253b0cd5e4c037'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:31.364355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72335020d83f462bba253b0cd5e4c037'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:31.371248 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1754/3489] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:31 2022] PUT /identity/v3/projects/f5a44c2cd99949c2a30ab83bdede01e6/users/b86e3b7d1c9a4b2c8f2914beefa74cc1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:31.383003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.383504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.383864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.423235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:31.424528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72335020d83f462bba253b0cd5e4c037'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:31.425049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:31.426786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef97eea-326d-432e-be49-6887b6ff430d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72335020d83f462bba253b0cd5e4c037'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:31.469807 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1736/3490] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:31 2022] DELETE /identity/v3/users/72335020d83f462bba253b0cd5e4c037 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:31.473250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.473832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.475140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.501850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:31.504441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:31.561058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1755/3491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:31.572964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.585715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:31.612468 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1737/3492] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:31.655480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.657340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:31.754282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9aa48-0f5c-4a3e-ba9f-36e71fa1b26a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.765655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.767453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.768405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.769399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.772005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.780744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.787070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50422b-2cb4-415e-8dd9-9755052e88b1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.794761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.795593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.796003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.796465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.809465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.812613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.823828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:31.828477 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1738/3493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:37:31.843153 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1756/3494] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:31 2022] POST /identity/v3/projects => generated 383 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:31.846845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.860308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:31.861321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb80a8-ad65-485c-86b5-0d122f8aef32 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.863162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:31.959793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.960428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.960717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.961037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.962035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.964826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:31.970091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c88d8-3a53-45fd-892c-a0482f6c9668 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:31.976237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:31.977225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:31.977671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:31.978753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] PATH_INFO: `/v3/projects/7719a3153f66484c8758bb0999719851` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:31.980613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7719a3153f66484c8758bb0999719851)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:31.984667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.002767 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1739/3495] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:31 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:32.007768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.015074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:32.024592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1f24-5cd1-4859-8d21-845cb00d4ab1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.031779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.032747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.035190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.036199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.037066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.039772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.059946 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1740/3496] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:32.061342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.078464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393915f-1538-489b-9dfd-512bc69e4089 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.087603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7719a3153f66484c8758bb0999719851', 'request_id': 'req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:32.100733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7719a3153f66484c8758bb0999719851', 'request_id': 'req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:32.110685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7719a3153f66484c8758bb0999719851', 'request_id': 'req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:32.149868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] The token cache is being invalidate because project 7719a3153f66484c8758bb0999719851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:32.150514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:32.151958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c86abcf2-3fb6-4640-ac66-f9ff1100c31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:32.153544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.154553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.154975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.155381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] PATH_INFO: `/v3/projects/0fb37758af6f4e1c8f9c988a708959d1/users/18a998ab5b9f4076a1279dc31a6e77f7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.158573 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1757/3497] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:31 2022] DELETE /identity/v3/projects/7719a3153f66484c8758bb0999719851 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:32.160801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed8eb8-8708-4e10-ad12-6002b0373a8b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.161780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed8eb8-8708-4e10-ad12-6002b0373a8b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.162272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed8eb8-8708-4e10-ad12-6002b0373a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.175734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb37758af6f4e1c8f9c988a708959d1, user_id=18a998ab5b9f4076a1279dc31a6e77f7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.178764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.188468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-46ed8eb8-8708-4e10-ad12-6002b0373a8b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:32.191631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46ed8eb8-8708-4e10-ad12-6002b0373a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:32.197018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1741/3498] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:32 2022] PUT /identity/v3/projects/0fb37758af6f4e1c8f9c988a708959d1/users/18a998ab5b9f4076a1279dc31a6e77f7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:32.201787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.203786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:32.283644 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1758/3499] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:32.287079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189609a-b8a6-4c67-827e-083707fd8ffc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.293984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.294307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.294684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.295292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.296028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.296391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.296672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.297452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.299568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.318360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:32.319740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:32.320242 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1742/3500] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:32.326092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.339244 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1759/3501] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:32.340441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.346411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25965a52-b8ae-42a7-ad03-55362ffeba97 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.354727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75833-5548-4b7e-ac69-a89772173f2d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.360767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.361120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb200-55cb-4bfe-a64b-46078e0e9f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.361532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.361915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.362288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.362472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb200-55cb-4bfe-a64b-46078e0e9f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.363135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:32.363434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb200-55cb-4bfe-a64b-46078e0e9f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.363630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.364022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb200-55cb-4bfe-a64b-46078e0e9f8d admin admin] PATH_INFO: `/v3/projects/0fb37758af6f4e1c8f9c988a708959d1/users/18a998ab5b9f4076a1279dc31a6e77f7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.365939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.367090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb200-55cb-4bfe-a64b-46078e0e9f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb37758af6f4e1c8f9c988a708959d1, user_id=18a998ab5b9f4076a1279dc31a6e77f7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.374052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb200-55cb-4bfe-a64b-46078e0e9f8d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.384590 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1760/3502] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:32.386417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.399429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08c7ee-58d2-47d2-989a-5d68238c631d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.413745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1743/3503] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:32 2022] PUT /identity/v3/projects/0fb37758af6f4e1c8f9c988a708959d1/users/18a998ab5b9f4076a1279dc31a6e77f7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:32.417438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:32.424601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f248c-e701-44a4-8c8a-3777a5114876 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.424894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f248c-e701-44a4-8c8a-3777a5114876 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.425370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f248c-e701-44a4-8c8a-3777a5114876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.504040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-261f248c-e701-44a4-8c8a-3777a5114876 None None] MFA Rules not processed for user `18a998ab5b9f4076a1279dc31a6e77f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:32.506988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-261f248c-e701-44a4-8c8a-3777a5114876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:32.513388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.514095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.514454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.514790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.515638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.517742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.566728 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1761/3504] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:32 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:32.570244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.582967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:32.634468 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1744/3505] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:32.638091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.638488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.638873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.682529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:32.683824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:32.730897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c4a17-ac34-4b93-8e82-a25c0b756c7a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.744661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.745847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.745847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.746200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.746944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.749045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.776853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1745/3506] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:32.783137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1762/3507] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:32 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:32.790183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.792787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.813767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:32.860659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8bec7-ee93-4b30-ab0b-42fb452c51b1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.869351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.869975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.870257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.870532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.871193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.872834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.893989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1746/3508] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:32.899457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.924940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058ff5-d623-4fda-aff2-0005baf4ee4d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:32.939568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:32.940118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:32.940401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:32.940680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:32.941367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:32.942971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:32.966770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1747/3509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:32.967705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:32.993571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00cf-53f4-4b22-97e1-6ed9e019a06c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:33.002531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b76217-afff-43a2-8efd-6c28e6907997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:33.003340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76217-afff-43a2-8efd-6c28e6907997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:33.003530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76217-afff-43a2-8efd-6c28e6907997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:33.017475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b76217-afff-43a2-8efd-6c28e6907997 admin admin] PATH_INFO: `/v3/projects/ac90529b26a946639ee5e929829e0731/users/de05fb29ac4e4b099f689ccd9bd5f9e6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:33.045806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d08340-e8c4-4ce9-9957-0d584a55c455 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:33.055159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b76217-afff-43a2-8efd-6c28e6907997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac90529b26a946639ee5e929829e0731, user_id=de05fb29ac4e4b099f689ccd9bd5f9e6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:33.058385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b76217-afff-43a2-8efd-6c28e6907997 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:33.074494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:33.080500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:33.082533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:33.085338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:33.087455 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1748/3510] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:32 2022] PUT /identity/v3/projects/ac90529b26a946639ee5e929829e0731/users/de05fb29ac4e4b099f689ccd9bd5f9e6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:33.088809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:33.098960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:33.099249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:33.099531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:33.124882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:33.126541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:33.138843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] MFA Rules not processed for user `de05fb29ac4e4b099f689ccd9bd5f9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:33.140227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:33.150648 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1763/3511] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:33.167455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:33.175731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:33.239599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56c03-69fa-4a1c-a772-fb7903fd2699 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:33.255123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:33.308667 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1749/3512] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:33.320225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:33.323392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:33.367217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:33.368497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:33.368639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:33.369112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:33.369506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] PATH_INFO: `/v3/projects/fb9499b68a00454d89b1d02448465f7b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:33.371244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9499b68a00454d89b1d02448465f7b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:33.374685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:33.429023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590da5b-e923-40b3-af20-4db8b87bdb4f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:33.447039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9499b68a00454d89b1d02448465f7b', 'request_id': 'req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.457730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9499b68a00454d89b1d02448465f7b', 'request_id': 'req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.465790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9499b68a00454d89b1d02448465f7b', 'request_id': 'req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.484043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] The token cache is being invalidate because project fb9499b68a00454d89b1d02448465f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:33.484492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.485274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.487268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1764/3513] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:33 2022] DELETE /identity/v3/projects/fb9499b68a00454d89b1d02448465f7b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:33.490943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:33.493293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:33.587813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:33.588809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:33.589153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:33.589433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:33.592315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:33.643473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0038-0ce1-47d4-b1e4-8b1a6a06c996 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:33.665218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:33.666217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:33.666499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:33.666776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] PATH_INFO: `/v3/users/abaca816139c410cb8851e9dceee84ff` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:33.670878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abaca816139c410cb8851e9dceee84ff)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:33.672864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:33.690911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:33.693219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:33.710460 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1750/3514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:33.748721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:33.801880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abaca816139c410cb8851e9dceee84ff'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.905228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abaca816139c410cb8851e9dceee84ff'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.905907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abaca816139c410cb8851e9dceee84ff'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.926891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abaca816139c410cb8851e9dceee84ff'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.930325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a5673590-a2ee-4e4c-95d5-150d019bbfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abaca816139c410cb8851e9dceee84ff'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:33.981801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1765/3515] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:33 2022] DELETE /identity/v3/users/abaca816139c410cb8851e9dceee84ff => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:34.549645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:34.551192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:34.578836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e0199-7f3e-4a82-9498-2386f48a5b15 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:34.718250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:34.718903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:34.719184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:34.719455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] PATH_INFO: `/v3/users/de05fb29ac4e4b099f689ccd9bd5f9e6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:34.721443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de05fb29ac4e4b099f689ccd9bd5f9e6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:34.726389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:34.735290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:34.837832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de05fb29ac4e4b099f689ccd9bd5f9e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:34.890693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de05fb29ac4e4b099f689ccd9bd5f9e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:34.891473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de05fb29ac4e4b099f689ccd9bd5f9e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:34.915153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de05fb29ac4e4b099f689ccd9bd5f9e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:34.915953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de05fb29ac4e4b099f689ccd9bd5f9e6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:34.947176 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1751/3516] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:34 2022] DELETE /identity/v3/users/de05fb29ac4e4b099f689ccd9bd5f9e6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:34.949123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:34.949656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:34.949656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:35.019423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:35.020676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:35.220497 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1766/3517] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:35.290776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:35.292596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:35.434333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd8f5-0c27-48e4-8eba-c35c6de5093f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:35.441535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d30c35-a8b8-4c2e-acf8-77273137802d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:35.442255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30c35-a8b8-4c2e-acf8-77273137802d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:35.442549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30c35-a8b8-4c2e-acf8-77273137802d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:35.442865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d30c35-a8b8-4c2e-acf8-77273137802d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:35.458090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30c35-a8b8-4c2e-acf8-77273137802d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:35.460295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d30c35-a8b8-4c2e-acf8-77273137802d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:35.504639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1752/3518] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:36.628582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:36.630412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:36.659621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e9ed0-077d-4102-98bc-ef80d413a900 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:36.672782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:36.673734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:36.674765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:36.675322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] PATH_INFO: `/v3/projects/e68ad1a1f9ea491f8c9e8550db0d99cd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:36.677284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68ad1a1f9ea491f8c9e8550db0d99cd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:36.683347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:36.802620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'request_id': 'req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:36.831725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'request_id': 'req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:36.849449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68ad1a1f9ea491f8c9e8550db0d99cd', 'request_id': 'req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:36.875913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] The token cache is being invalidate because project e68ad1a1f9ea491f8c9e8550db0d99cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:36.876215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:36.877579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-660ae61c-6f96-4ebd-9370-0c141fcf1d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:36.880312 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1767/3519] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:36 2022] DELETE /identity/v3/projects/e68ad1a1f9ea491f8c9e8550db0d99cd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:36.885767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:36.886296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:36.886398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:36.936395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:36.940202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:37.093843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.094208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.094503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.111358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1753/3520] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:37.137155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:37.140710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:37.169215 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1768/3521] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:37.174713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:37.203637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0469c-8512-4609-9697-518068dd39d5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:37.248580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:37.252341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.253164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.253164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.254005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:37.260167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:37.261957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:37.293376 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1754/3522] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:37.297573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:37.312106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879dbad-cfc9-4d3c-b7af-a842e5a3fb94 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:37.319187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:37.320167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.321370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.321936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.323365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:37.325670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:37.369814 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1769/3523] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:37 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:37.374076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:37.384839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c6018-225d-47b9-8be4-5f77fdf8e76e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:37.402283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:37.470537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:37.471297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.471642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.471981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.474265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:37.476724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:37.518762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1755/3524] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:37 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:37.519241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:37.531915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c189ae-063c-4e59-976e-ba7c1857bcce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:37.548973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:37.549679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.550030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.550372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.551106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:37.552825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:37.566171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:37.582129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1770/3525] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:37.587665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:37.609846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff684-6f79-4436-b2ce-da594f62dc33 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:37.644128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174abff2-810d-46d6-ba62-eef6ea0f07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:37.646713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174abff2-810d-46d6-ba62-eef6ea0f07e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.648024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174abff2-810d-46d6-ba62-eef6ea0f07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.674110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174abff2-810d-46d6-ba62-eef6ea0f07e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.676025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174abff2-810d-46d6-ba62-eef6ea0f07e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:37.679761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174abff2-810d-46d6-ba62-eef6ea0f07e1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:37.707057 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1756/3526] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:37.711615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:37.724770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df71c-9ec6-4ed5-bf4f-eef3c97afd4d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:37.739380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:37.740662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.741118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.741408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] PATH_INFO: `/v3/projects/d32c2ded821847eaa676b4a27951dc70/users/eeea3ed59ded4ea09512edadca166186/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.772835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32c2ded821847eaa676b4a27951dc70, user_id=eeea3ed59ded4ea09512edadca166186, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:37.777300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:37.795408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1771/3527] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:37 2022] PUT /identity/v3/projects/d32c2ded821847eaa676b4a27951dc70/users/eeea3ed59ded4ea09512edadca166186/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:37.806623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:37.806924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:37.807558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:37.878726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] MFA Rules not processed for user `eeea3ed59ded4ea09512edadca166186`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:37.880028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:38.044205 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1757/3528] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:38.045593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.142055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055b056-f03f-4353-ab3e-492c8357e7e0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.153484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.155232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.155649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.155938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.157683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.160116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.203953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1772/3529] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:38 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:38.208120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.221508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4552c-88f1-4c1a-b108-2d579c5e0b02 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.228174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.234140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:38.311601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.312239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.312519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.312794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.313490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.315433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.369230 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1758/3530] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:38 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:38.374090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.386320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd944c1a-2084-416e-bd39-15a3cf24a77c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.394151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.396608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.397609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.397904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.398623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.402896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.420824 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1759/3531] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:38.425285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.426155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2f3af-3f52-4c02-946c-1da1742a3813 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.441874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:38.444327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.445022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.445302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.445626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] PATH_INFO: `/v3/projects/ac90529b26a946639ee5e929829e0731` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.447515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac90529b26a946639ee5e929829e0731)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.450155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.450728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b08c-d0fd-4414-931c-03f588adf6c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.459441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.460328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.460638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.460887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] PATH_INFO: `/v3/projects/8d12b23487f649f8b6875e060ba4bb90/users/b2bb1da4c2724908aa788d0c06ea6528/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.484727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d12b23487f649f8b6875e060ba4bb90, user_id=b2bb1da4c2724908aa788d0c06ea6528, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.495222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.512027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1760/3532] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:38 2022] PUT /identity/v3/projects/8d12b23487f649f8b6875e060ba4bb90/users/b2bb1da4c2724908aa788d0c06ea6528/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:38.516853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.565779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac90529b26a946639ee5e929829e0731', 'request_id': 'req-4470cc99-77f7-4e50-843e-4f988696d12b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:38.589410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac90529b26a946639ee5e929829e0731', 'request_id': 'req-4470cc99-77f7-4e50-843e-4f988696d12b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:38.595614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:38.597787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac90529b26a946639ee5e929829e0731', 'request_id': 'req-4470cc99-77f7-4e50-843e-4f988696d12b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:38.621751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] The token cache is being invalidate because project ac90529b26a946639ee5e929829e0731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:38.622327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:38.623381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4470cc99-77f7-4e50-843e-4f988696d12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:38.638567 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1773/3533] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:38 2022] DELETE /identity/v3/projects/ac90529b26a946639ee5e929829e0731 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:38.643627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1367a4-12b5-47fb-bdca-0c19726f09d7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.643918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1367a4-12b5-47fb-bdca-0c19726f09d7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.644197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1367a4-12b5-47fb-bdca-0c19726f09d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.658435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644e06c-8576-4b34-a955-3c04e05a97c2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.703180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fd1367a4-12b5-47fb-bdca-0c19726f09d7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:38.705128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fd1367a4-12b5-47fb-bdca-0c19726f09d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:38.776351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.777379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.777875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.778356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.781916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.797203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.817494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1761/3534] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:38.821160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:38.824348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:38.843761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700e65a-5252-4350-a347-ecbb55b88976 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:38.852431 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1774/3535] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:38.854113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.854414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.854696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.858633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d706-3bfc-4e71-89c8-583957492145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:38.859601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d706-3bfc-4e71-89c8-583957492145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.861339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d706-3bfc-4e71-89c8-583957492145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.862322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d706-3bfc-4e71-89c8-583957492145 admin admin] PATH_INFO: `/v3/projects/8d12b23487f649f8b6875e060ba4bb90/users/b2bb1da4c2724908aa788d0c06ea6528/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.867081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62d706-3bfc-4e71-89c8-583957492145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d12b23487f649f8b6875e060ba4bb90, user_id=b2bb1da4c2724908aa788d0c06ea6528, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:38.872442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62d706-3bfc-4e71-89c8-583957492145 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:38.905476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:38.906731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:38.926255 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1762/3536] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:38 2022] PUT /identity/v3/projects/8d12b23487f649f8b6875e060ba4bb90/users/b2bb1da4c2724908aa788d0c06ea6528/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:38.928635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:38.929103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:38.930285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:38.987368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] MFA Rules not processed for user `b2bb1da4c2724908aa788d0c06ea6528`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:38.989892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:39.041820 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1775/3537] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:39.047020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.079767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6f642-c141-4d2c-b072-f6c608f0d065 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.084748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.085401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.085685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.085958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.086655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:39.086963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.088577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.119739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:39.125666 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1776/3538] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:39.132643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.139816 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1763/3539] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:39.151980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.153705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030f8f-2cd8-4a68-9378-975d6c4bcae7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.159270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.160736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.161434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.161898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.162735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.165894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.178337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ddc0a-30ab-4791-9818-07adbcaf4f4f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.193959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.194989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.195855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.196468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.197339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.210554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.272409 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1764/3540] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:37:39 2022] POST /identity/v3/domains => generated 277 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:39.272725 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1777/3541] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:39 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:39.275789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.277175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.485247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a4485-afbd-45b1-ad1a-ef924cc2f325 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.495445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.496352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.496827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.497323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.498168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.501382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.516199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:39.525313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702e848-75d0-4d9b-9ee0-6a73763d9b90 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.541761 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1765/3542] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:39 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:39.545582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.567608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311d1c0-5e49-4cd3-94a1-335dbbf7c56c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.578791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.582557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.582557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.582960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.583737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.585873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.607385 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1766/3543] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:39.611326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.624205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c647a-9eb5-44e8-a427-2ee1e539a662 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.630079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.630876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.631250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.631640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.633757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.640527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.672602 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1767/3544] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:37:39.677022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.690505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff804c-00d3-405e-a153-599d668739e8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.697886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.698335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.698621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.698905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.699666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.710207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.714072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5857f-baff-4fbd-8382-cf965e99f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.714755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5857f-baff-4fbd-8382-cf965e99f815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.715037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5857f-baff-4fbd-8382-cf965e99f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.715574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5857f-baff-4fbd-8382-cf965e99f815 admin admin] PATH_INFO: `/v3/projects/c12abbf1b7de4f89892a3055408559aa/users/1710aadd8eb1479588ef3ed2b4cfc11a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.747381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5857f-baff-4fbd-8382-cf965e99f815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12abbf1b7de4f89892a3055408559aa, user_id=1710aadd8eb1479588ef3ed2b4cfc11a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:39.750149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5857f-baff-4fbd-8382-cf965e99f815 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:39.784209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1768/3545] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:39 2022] PUT /identity/v3/projects/c12abbf1b7de4f89892a3055408559aa/users/1710aadd8eb1479588ef3ed2b4cfc11a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:39.797799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.798091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.798374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:39.803957 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1778/3546] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:39 2022] POST /identity/v3/users => generated 348 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:39.806135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:39.828490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ebea-2b1c-430a-a93c-ec9a1d434407 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:39.874432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] MFA Rules not processed for user `1710aadd8eb1479588ef3ed2b4cfc11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:39.875749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:39.997787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:39.998426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:39.998713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:39.998995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.000118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.008938 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1769/3547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:40.011452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.012577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.018105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:40.047861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:40.082891 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1779/3548] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:39 2022] POST /identity/v3/users => generated 323 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:40.084411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.112699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826a52-a2af-4a97-a16c-20e2fbabe881 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.125329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.126178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.126462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.126740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users/c7ad2ada878a494f9a6bc81c266ad2c9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.174935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:get_user(user_id=c7ad2ada878a494f9a6bc81c266ad2c9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.177492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.184373 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1780/3549] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/users/c7ad2ada878a494f9a6bc81c266ad2c9 => generated 348 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:40.185868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.193748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf37e-9a26-4f70-8a78-fbf29e94f466 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.200565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284669c6-7153-4768-a56f-f0a38aa5fcac tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.208354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.209188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.209596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.210019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.211026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.211801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.212201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.212544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.213475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Adding query filter params (domain_id=3b783564bc9a46cb90eaf188dfae015b) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:40.214498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.222915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.225375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.226182 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:40.226182 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:40.226182 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:40.230024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.241471 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1770/3550] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:40.256145 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1781/3551] 10.222.0.16 () {58 vars in 1207 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/users?domain_id=3b783564bc9a46cb90eaf188dfae015b => generated 485 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:40.261827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.280214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99014d-833f-4643-9e92-0c38433ef223 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.289912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.290608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.290958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.291308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.292615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.293824 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:40.293824 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:37:40.293824 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:37:40.295501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.311261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.313899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:40.387314 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1771/3552] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/users => generated 9164 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:40.389739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.414126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:40.484065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf349e-1d5c-40fe-b3ec-0d005a74df25 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.497874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.499432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.499869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.504693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.507307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:40.529722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.532469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.538081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee64a-f6b4-4361-8510-5a7883d10117 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.543360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.544003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.544281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.544552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] PATH_INFO: `/v3/users/1710aadd8eb1479588ef3ed2b4cfc11a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.546331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1710aadd8eb1479588ef3ed2b4cfc11a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.548453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.567113 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1782/3553] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:40.568656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.603254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb786d4-6827-4a26-a856-8f0bb69ee791 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.620317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.621151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.621648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.621952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.622726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Adding query filter params (name=tempest-test_user-2129679936) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:40.623286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.625995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.664144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1710aadd8eb1479588ef3ed2b4cfc11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.676573 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1783/3554] 10.222.0.16 () {58 vars in 1189 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/users?name=tempest-test_user-2129679936 => generated 476 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:40.680802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.689494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:40.694971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1710aadd8eb1479588ef3ed2b4cfc11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.696550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1710aadd8eb1479588ef3ed2b4cfc11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.715708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c75e9-d1c0-4e0a-a33e-0dae2165fbe0 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.717201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1710aadd8eb1479588ef3ed2b4cfc11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.718178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1710aadd8eb1479588ef3ed2b4cfc11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.722672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.723425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.723700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.723976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] PATH_INFO: `/v3/users/559ade1b882b43d4a4f095c9214e8167` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.725837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=559ade1b882b43d4a4f095c9214e8167)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.730177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.752247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1772/3555] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:40 2022] DELETE /identity/v3/users/1710aadd8eb1479588ef3ed2b4cfc11a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:40.752247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.752247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:40.766384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:40.874462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559ade1b882b43d4a4f095c9214e8167'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.889442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559ade1b882b43d4a4f095c9214e8167'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.890387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559ade1b882b43d4a4f095c9214e8167'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.894370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8995a3-b7fc-4d85-83c2-56e7268002f9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:40.904681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:40.905534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.906142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.906654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.907611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559ade1b882b43d4a4f095c9214e8167'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.907891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:40.908528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d7f6d356-dac5-4ae0-9cfc-964536b29c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559ade1b882b43d4a4f095c9214e8167'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:40.909476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:40.912863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:40.947943 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1784/3556] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:40 2022] DELETE /identity/v3/users/559ade1b882b43d4a4f095c9214e8167 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:40.953717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:40.954014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:40.954307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:40.975691 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1773/3557] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Oct 5 02:37:40 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:40.981195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:40.989071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:41.010462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:41.012101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:41.030779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221f19e-2a8f-4bf2-9688-0bf706e8a63d tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:41.201616 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1785/3558] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:41.218763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:41.220539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:41.256022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:41.259210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:41.259645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:41.263079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users/d5d3730a3c484fcc9456bba1ba90b272` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:41.304037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d5d3730a3c484fcc9456bba1ba90b272)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:41.312199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:41.335081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:41.393862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b044f8-c40b-41e3-86ab-676d84d2a6e2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:41.422137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:41.425360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:41.427048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:41.427336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:41.467962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:41.470824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:41.473491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d3730a3c484fcc9456bba1ba90b272'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.497979 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1786/3559] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:41.502431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d3730a3c484fcc9456bba1ba90b272'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.503339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d3730a3c484fcc9456bba1ba90b272'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.518095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d3730a3c484fcc9456bba1ba90b272'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.518774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d3730a3c484fcc9456bba1ba90b272'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.562828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1774/3560] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:40 2022] DELETE /identity/v3/users/d5d3730a3c484fcc9456bba1ba90b272 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:41.566763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:41.583304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3223-bc36-422f-b257-2d5c3fd77030 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:41.763696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:41.764377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:41.764668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:41.764972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/users/c7ad2ada878a494f9a6bc81c266ad2c9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:41.768329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c7ad2ada878a494f9a6bc81c266ad2c9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:41.770365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:41.891884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ad2ada878a494f9a6bc81c266ad2c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.932656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ad2ada878a494f9a6bc81c266ad2c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.933936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ad2ada878a494f9a6bc81c266ad2c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.953046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ad2ada878a494f9a6bc81c266ad2c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.953917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ad2ada878a494f9a6bc81c266ad2c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:41.981365 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1787/3561] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:41 2022] DELETE /identity/v3/users/c7ad2ada878a494f9a6bc81c266ad2c9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:41.986068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:41.987661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:42.009213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c63a07-e418-49ce-99a3-520244a42567 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:42.029079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:42.105472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:42.106257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.106658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.107038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/domains/3b783564bc9a46cb90eaf188dfae015b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.111884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:42.113721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:42.126977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3b783564bc9a46cb90eaf188dfae015b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:42.138904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:42.233845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.236734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.264387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:42.290704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9781e0f-070d-4844-bb6d-8435a019f316 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:42.295824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.299924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.307823 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1775/3562] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:37:41 2022] PATCH /identity/v3/domains/3b783564bc9a46cb90eaf188dfae015b => generated 278 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:42.310102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:42.313098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:42.397232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:42.398885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.399338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.400387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] PATH_INFO: `/v3/users/6c889d2c39af44c693a3c15b5ba4bca9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.402175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c889d2c39af44c693a3c15b5ba4bca9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:42.404486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:42.475435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74a054-6e07-4150-87c6-d556de7f0ea9 tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:42.484976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:42.487411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.487411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.487411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] PATH_INFO: `/v3/projects/16f8146191044043ab43029742153150` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.487755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f8146191044043ab43029742153150)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:42.490056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:42.534714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c889d2c39af44c693a3c15b5ba4bca9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.562495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c889d2c39af44c693a3c15b5ba4bca9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.563641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c889d2c39af44c693a3c15b5ba4bca9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.564781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f8146191044043ab43029742153150', 'request_id': 'req-2dfcd140-2039-40aa-ba1f-6bde0f440516'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.576202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f8146191044043ab43029742153150', 'request_id': 'req-2dfcd140-2039-40aa-ba1f-6bde0f440516'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.582325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c889d2c39af44c693a3c15b5ba4bca9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.583198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd28fefb-01d7-4935-88cf-75dc8a7b03f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c889d2c39af44c693a3c15b5ba4bca9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.586803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f8146191044043ab43029742153150', 'request_id': 'req-2dfcd140-2039-40aa-ba1f-6bde0f440516'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.611667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] The token cache is being invalidate because project 16f8146191044043ab43029742153150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:42.612020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.612770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.615682 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1776/3563] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:42 2022] DELETE /identity/v3/projects/16f8146191044043ab43029742153150 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:42.616521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:42.617903 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1788/3564] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:42 2022] DELETE /identity/v3/users/6c889d2c39af44c693a3c15b5ba4bca9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:42.619012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:42.631508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:42.637187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05078-82e2-49d1-929a-56b711bcfdca None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.637556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05078-82e2-49d1-929a-56b711bcfdca None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.637880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e05078-82e2-49d1-929a-56b711bcfdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.668732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c4e05078-82e2-49d1-929a-56b711bcfdca None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:42.670024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c4e05078-82e2-49d1-929a-56b711bcfdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:42.724027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd140-2039-40aa-ba1f-6bde0f440516 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:42.783601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1789/3565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:42.794534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.795835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.796125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.821740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:42.823273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:42.846790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1790/3566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:42.848637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:42.860883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2bb1da4c2724908aa788d0c06ea6528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d12b23487f649f8b6875e060ba4bb90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:42.861614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.861894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.862240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] PATH_INFO: `/v3/domains/3b783564bc9a46cb90eaf188dfae015b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.868382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5cd2d-d2e2-4ad6-9d77-c08389a9c744 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:42.876430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3b783564bc9a46cb90eaf188dfae015b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:42.878228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:42.878367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:42.879208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.879781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.880230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.881138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:42.881663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:42.884130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:42.904958 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1791/3567] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:42.908003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:42.915814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:42.916001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.921538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:42.923724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb98c83-bf81-4150-b70e-dbc86e65e48c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:42.931186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:42.932608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:42.933318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:42.933943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:42.935438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:42.938260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.001370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b', 'request_id': 'req-4dbb62e8-fe96-4474-8add-1ba562fd4abc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.007703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b', 'request_id': 'req-4dbb62e8-fe96-4474-8add-1ba562fd4abc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.013582 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1792/3568] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:42 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:43.014924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.017377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.019677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b', 'request_id': 'req-4dbb62e8-fe96-4474-8add-1ba562fd4abc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.035113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] The token cache is being invalidate because project 3b783564bc9a46cb90eaf188dfae015b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:43.035394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.035937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.049626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:43.051377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b', 'request_id': 'req-4dbb62e8-fe96-4474-8add-1ba562fd4abc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.053199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b', 'request_id': 'req-4dbb62e8-fe96-4474-8add-1ba562fd4abc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.059896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3b783564bc9a46cb90eaf188dfae015b', 'request_id': 'req-4dbb62e8-fe96-4474-8add-1ba562fd4abc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.067748 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1777/3569] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:37:42 2022] DELETE /identity/v3/domains/3b783564bc9a46cb90eaf188dfae015b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:43.068626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.070036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.156778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb62e8-fe96-4474-8add-1ba562fd4abc tempest-UsersV3TestJSON-2039515502 tempest-UsersV3TestJSON-2039515502-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.162430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a634-fed8-4ba9-bd16-66603d1494fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.168327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.169183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.169844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.169959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.170158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.170508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] PATH_INFO: `/v3/projects/d4276a8be8c541159a4d1d575995dcc6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.171939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.172119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4276a8be8c541159a4d1d575995dcc6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.172442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] PATH_INFO: `/v3/projects/c12abbf1b7de4f89892a3055408559aa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.174026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12abbf1b7de4f89892a3055408559aa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.175221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.176599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.251852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12abbf1b7de4f89892a3055408559aa', 'request_id': 'req-0d8969b5-3c74-41bc-a431-27961dce094d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.260781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4276a8be8c541159a4d1d575995dcc6', 'request_id': 'req-27a6be13-82d1-422e-8e99-569923bbb764'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.265750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12abbf1b7de4f89892a3055408559aa', 'request_id': 'req-0d8969b5-3c74-41bc-a431-27961dce094d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.268757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4276a8be8c541159a4d1d575995dcc6', 'request_id': 'req-27a6be13-82d1-422e-8e99-569923bbb764'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.275015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12abbf1b7de4f89892a3055408559aa', 'request_id': 'req-0d8969b5-3c74-41bc-a431-27961dce094d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.275912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4276a8be8c541159a4d1d575995dcc6', 'request_id': 'req-27a6be13-82d1-422e-8e99-569923bbb764'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.290467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] The token cache is being invalidate because project d4276a8be8c541159a4d1d575995dcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:43.290761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.291512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.293176 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1793/3570] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:43 2022] DELETE /identity/v3/projects/d4276a8be8c541159a4d1d575995dcc6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:43.293977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] The token cache is being invalidate because project c12abbf1b7de4f89892a3055408559aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:43.294354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.295307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.296559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.297446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1778/3571] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:43 2022] DELETE /identity/v3/projects/c12abbf1b7de4f89892a3055408559aa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:43.298240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.299828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.302747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.371916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8969b5-3c74-41bc-a431-27961dce094d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.374749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6be13-82d1-422e-8e99-569923bbb764 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.376924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.377554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.377840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.378115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] PATH_INFO: `/v3/users/eeea3ed59ded4ea09512edadca166186` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.379245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeea3ed59ded4ea09512edadca166186)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.379365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.379969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.380253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.380529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.381184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.381290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.383746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.406613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:43.408047 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1794/3572] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:43 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:43.409121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.410863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.420653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:43.426276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77c30c-96ce-4057-94b1-b856a43586c7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.433285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.434401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.435100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.435458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] PATH_INFO: `/v3/users/118c1425677b45b98689befb0eb55cce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.437728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=118c1425677b45b98689befb0eb55cce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.440032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.458948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeea3ed59ded4ea09512edadca166186'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.475968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeea3ed59ded4ea09512edadca166186'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.477413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeea3ed59ded4ea09512edadca166186'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.486397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeea3ed59ded4ea09512edadca166186'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.487718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeea3ed59ded4ea09512edadca166186'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.502215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118c1425677b45b98689befb0eb55cce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.503024 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1779/3573] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:43 2022] DELETE /identity/v3/users/eeea3ed59ded4ea09512edadca166186 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:43.503930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.505291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.518828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118c1425677b45b98689befb0eb55cce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.519542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118c1425677b45b98689befb0eb55cce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.527842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118c1425677b45b98689befb0eb55cce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.528615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-652d3352-c143-4968-b2d8-fdec0fadb44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118c1425677b45b98689befb0eb55cce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.545730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1795/3574] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:43 2022] DELETE /identity/v3/users/118c1425677b45b98689befb0eb55cce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:43.546806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.547507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.547828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.570844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:43.572355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.580164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71bd08-5aab-48b2-8c56-0b39a751e103 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.692367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.693200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.693321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.693579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] PATH_INFO: `/v3/users/0f6f5c78d11f4ecf9ff99a95df8e1a00` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.694919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6f5c78d11f4ecf9ff99a95df8e1a00)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.697180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.715883 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1796/3575] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:43.715883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.716609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.738451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f21f6-66ff-4d0e-a2f0-a8251daa5c4a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.751823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cddb1-ca73-4225-89f4-7c0b6b7cda5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.752415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cddb1-ca73-4225-89f4-7c0b6b7cda5f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.752711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cddb1-ca73-4225-89f4-7c0b6b7cda5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.753034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cddb1-ca73-4225-89f4-7c0b6b7cda5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.754048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cddb1-ca73-4225-89f4-7c0b6b7cda5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.755832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cddb1-ca73-4225-89f4-7c0b6b7cda5f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.770965 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1797/3576] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:43.772112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58ab1-1324-4ee5-9a9b-6ae5440249da None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.772412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58ab1-1324-4ee5-9a9b-6ae5440249da None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.772692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58ab1-1324-4ee5-9a9b-6ae5440249da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.785411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6f5c78d11f4ecf9ff99a95df8e1a00'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.787832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:43.802105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-84d58ab1-1324-4ee5-9a9b-6ae5440249da None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:43.803343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84d58ab1-1324-4ee5-9a9b-6ae5440249da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.807231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6f5c78d11f4ecf9ff99a95df8e1a00'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.809697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6f5c78d11f4ecf9ff99a95df8e1a00'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.812940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1798/3577] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:43.814992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.815321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.815972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.821172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6f5c78d11f4ecf9ff99a95df8e1a00'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.822430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6f5c78d11f4ecf9ff99a95df8e1a00'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:43.843010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:43.844217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.845310 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1780/3578] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:43 2022] DELETE /identity/v3/users/0f6f5c78d11f4ecf9ff99a95df8e1a00 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:43.849415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.851083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.916729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:43.931274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5b368-675b-4e88-b3e1-1d259ed3c6ba admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.936435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.937340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.937654 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1799/3579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:43.937829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.938176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.938827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.938936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.940618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:43.940874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.951449 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1781/3580] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:43.952340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:43.955577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:43.957536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610319d8-567d-4ad7-a87c-5a0bc58dab0b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:43.963872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:43.964497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:43.964781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:43.965108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] PATH_INFO: `/v3/projects/6652917123e14c2797cafacc4e31f75a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:43.966524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6652917123e14c2797cafacc4e31f75a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:43.968473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.027284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08255-d9a5-44af-bfd0-6d1efd5fc8d5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.034006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6652917123e14c2797cafacc4e31f75a', 'request_id': 'req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.047078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6652917123e14c2797cafacc4e31f75a', 'request_id': 'req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.063803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6652917123e14c2797cafacc4e31f75a', 'request_id': 'req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.082754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] The token cache is being invalidate because project 6652917123e14c2797cafacc4e31f75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:44.083184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.084048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.086625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1800/3581] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:43 2022] DELETE /identity/v3/projects/6652917123e14c2797cafacc4e31f75a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:44.087851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.089654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.101361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.103034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.103315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.103588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.105445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.146245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:44.171945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930ae2-dc47-448d-ac71-1e3cf86b7df5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.177743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.178475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.178856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.179224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.180656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:44.180943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.182642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.185078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.187068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.199624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1801/3582] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:44.199624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.200401 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1782/3583] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:44.201413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.202732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.202893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.216810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01999-4adf-4d5e-a4b3-99e7884fdd98 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.219526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c654916-c811-4f1a-8922-8fe9a2bd2084 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.237157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.237157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.237157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.237157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] PATH_INFO: `/v3/projects/5271c4a34ba547dfa6cb40a569394ef7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.237552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5271c4a34ba547dfa6cb40a569394ef7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.237645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.237645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.237645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.237645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] PATH_INFO: `/v3/projects/25663d1b71554c84998a009e9e41e7f0/users/2b8d63e7d05849e28cc54624771c60e1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.237978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.245160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25663d1b71554c84998a009e9e41e7f0, user_id=2b8d63e7d05849e28cc54624771c60e1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.248767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.270171 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1802/3584] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:44 2022] PUT /identity/v3/projects/25663d1b71554c84998a009e9e41e7f0/users/2b8d63e7d05849e28cc54624771c60e1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:44.271035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.276931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.315742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5271c4a34ba547dfa6cb40a569394ef7', 'request_id': 'req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.324405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5271c4a34ba547dfa6cb40a569394ef7', 'request_id': 'req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.331743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5271c4a34ba547dfa6cb40a569394ef7', 'request_id': 'req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.350768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:44.353597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] The token cache is being invalidate because project 5271c4a34ba547dfa6cb40a569394ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:44.353982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.354691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.360187 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1783/3585] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:44 2022] DELETE /identity/v3/projects/5271c4a34ba547dfa6cb40a569394ef7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:44.360795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.362474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.376920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137c208-b2a3-48c9-8d32-803bd180e315 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.474062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.474657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.474940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.475544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] PATH_INFO: `/v3/users/fcdc71ae3bc5416291dc710b283ddfab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.476660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcdc71ae3bc5416291dc710b283ddfab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.479645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.488333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4c68d-a2eb-4ff2-8ee9-a9a7204c090c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.494811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26731c21-0909-4334-ba2d-20b23812d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.495442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731c21-0909-4334-ba2d-20b23812d59e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.496125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731c21-0909-4334-ba2d-20b23812d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.496414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26731c21-0909-4334-ba2d-20b23812d59e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.498205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26731c21-0909-4334-ba2d-20b23812d59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.501047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26731c21-0909-4334-ba2d-20b23812d59e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.540937 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1784/3586] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:44 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:44.542556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.543025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.543309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.546371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcdc71ae3bc5416291dc710b283ddfab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.559990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcdc71ae3bc5416291dc710b283ddfab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.560767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcdc71ae3bc5416291dc710b283ddfab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.565584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:44.567801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.571277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcdc71ae3bc5416291dc710b283ddfab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.572424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-66138a69-bde8-442b-9985-93797cbce929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcdc71ae3bc5416291dc710b283ddfab'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.593698 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1803/3587] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:44 2022] DELETE /identity/v3/users/fcdc71ae3bc5416291dc710b283ddfab => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:44.594962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.595269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.595515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.630875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:44.632360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.637822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:44.714241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1785/3588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:44.714241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.715612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.731670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c6f03-d894-483f-a713-fc35f5bc0772 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.732004 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1804/3589] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:44.733571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.735630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.742028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.743832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.744508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.744508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.745243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.747293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.751191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34d075-9b96-4c60-8534-4faea8d49d69 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.757690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.759675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.759967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.760837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] PATH_INFO: `/v3/projects/d32c2ded821847eaa676b4a27951dc70` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.762457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32c2ded821847eaa676b4a27951dc70)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.764721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:44.773102 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1786/3590] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:44 2022] POST /identity/v3/users => generated 282 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:44.775598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.777484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.781615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:44.833556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32c2ded821847eaa676b4a27951dc70', 'request_id': 'req-52da90b3-d840-4c77-8195-ac1d420f15e3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.843405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32c2ded821847eaa676b4a27951dc70', 'request_id': 'req-52da90b3-d840-4c77-8195-ac1d420f15e3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.850955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32c2ded821847eaa676b4a27951dc70', 'request_id': 'req-52da90b3-d840-4c77-8195-ac1d420f15e3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.863198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636ad42-1c18-4210-bf3b-fcfc793eca01 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.870314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] The token cache is being invalidate because project d32c2ded821847eaa676b4a27951dc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:44.870843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.871613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-52da90b3-d840-4c77-8195-ac1d420f15e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:44.873700 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1805/3591] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:44 2022] DELETE /identity/v3/projects/d32c2ded821847eaa676b4a27951dc70 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:44.875075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.875418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.875629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.902440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:44.903743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.924703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.925408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.925698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.925966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.927837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.970916 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1806/3592] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:44.973125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:44.973238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:44.986724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b5165-521b-4852-abb4-d8d1219c2d40 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:44.993785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:44.994598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:44.994884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:44.995285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:44.995941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:44.997832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.006001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.007462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.011358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1807/3593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:45.013134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.016185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.018740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1787/3594] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:45.019507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.020776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.032643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48f01a-878d-4e38-b1b4-26de2c70b514 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.034121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ef3b9-6929-4066-8a3f-8a85d34032a3 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.038527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.039644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.040616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.040616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.040841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.040966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] PATH_INFO: `/v3/projects/fda6f066ee8e40c98791ff3534e7eb3d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.041059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.041147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] PATH_INFO: `/v3/users/b2bb1da4c2724908aa788d0c06ea6528` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.041775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda6f066ee8e40c98791ff3534e7eb3d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.042415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2bb1da4c2724908aa788d0c06ea6528)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.043695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.044945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.069356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:45.104814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2bb1da4c2724908aa788d0c06ea6528'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.121455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda6f066ee8e40c98791ff3534e7eb3d', 'request_id': 'req-86b17313-4c10-4134-9f7f-c1fe6e34c648'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.124614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2bb1da4c2724908aa788d0c06ea6528'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.125436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2bb1da4c2724908aa788d0c06ea6528'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.139765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda6f066ee8e40c98791ff3534e7eb3d', 'request_id': 'req-86b17313-4c10-4134-9f7f-c1fe6e34c648'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.140465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda6f066ee8e40c98791ff3534e7eb3d', 'request_id': 'req-86b17313-4c10-4134-9f7f-c1fe6e34c648'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.144989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2bb1da4c2724908aa788d0c06ea6528'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.145891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2bb1da4c2724908aa788d0c06ea6528'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.157648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] The token cache is being invalidate because project fda6f066ee8e40c98791ff3534e7eb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:45.157648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.158090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:45.163021 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1808/3595] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:45 2022] DELETE /identity/v3/projects/fda6f066ee8e40c98791ff3534e7eb3d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:45.163021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.163021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.173186 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1788/3596] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:45 2022] DELETE /identity/v3/users/b2bb1da4c2724908aa788d0c06ea6528 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:45.173186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.173186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.183037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:45.261544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b17313-4c10-4134-9f7f-c1fe6e34c648 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.266845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.267830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.268201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.268713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.269530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:45.269934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.271610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af0770-0904-4e39-88db-60fa75c1bdbf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.277205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9db1d0-18dd-475c-b18d-735d3710b44a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.287989 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1809/3597] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:45.290620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.291923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.292271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.292773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.293961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.294098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.294523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.294934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.297090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.321620 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1789/3598] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:45.321620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.331476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:45.332851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.333069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f12783-cd2f-44eb-9dfe-4a1d6a1b89ff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.342352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda787e-11d6-4996-8888-b5512b74186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.343156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda787e-11d6-4996-8888-b5512b74186c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.344315 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1810/3599] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:45.345409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.346922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.349106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda787e-11d6-4996-8888-b5512b74186c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.350728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda787e-11d6-4996-8888-b5512b74186c admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.354923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda787e-11d6-4996-8888-b5512b74186c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.358321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda787e-11d6-4996-8888-b5512b74186c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.360510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be613c-bcfb-4013-98f3-efc40e38d204 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.368662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.369953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.370177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.370462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] PATH_INFO: `/v3/projects/d69def5e64d945428d420e737fecd987/users/110ebcc38ef34dfea40fe14ab2ad1b3d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.390194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69def5e64d945428d420e737fecd987, user_id=110ebcc38ef34dfea40fe14ab2ad1b3d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.394767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.405444 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1790/3600] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/projects => generated 395 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:45.408546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143694a-a436-4f7b-862c-9a4a5add9698 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.409247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143694a-a436-4f7b-862c-9a4a5add9698 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.409955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143694a-a436-4f7b-862c-9a4a5add9698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.423166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1811/3601] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:45 2022] PUT /identity/v3/projects/d69def5e64d945428d420e737fecd987/users/110ebcc38ef34dfea40fe14ab2ad1b3d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:45.424636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.446742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2143694a-a436-4f7b-862c-9a4a5add9698 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:45.449109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2143694a-a436-4f7b-862c-9a4a5add9698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.515952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944ac94-7e54-47e7-bd72-008c0780cb25 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.521303 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1791/3602] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:45.522180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.522944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.523304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.524333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.525254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.527287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.527287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.527287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.527661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.551381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:45.552708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.556653 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1812/3603] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:45.557669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.562913 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1792/3604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:45.563681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.579685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2644-892a-4ce3-9230-aa48690e590f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.585264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.588332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.588637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.588934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.589051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139e73b-0739-45dd-80c2-50afcc8e12b2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.590270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:45.590682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.593576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.595175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.595738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.596271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.596552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.597247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.599593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.601312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:45.624052 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1813/3605] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:45.624052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.624052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.644121 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1793/3606] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:45.644121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.683045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b3a4-5fbe-4f91-b37c-8d1b7b382c59 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.698512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.699143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.699426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.699702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.700353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.702329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.715785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6f10-f429-4d0c-9c47-c64674398fe3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.723259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.723791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.724211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.724588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.745297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:45.751619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.754227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.767595 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1814/3607] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:45.768463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.785780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f940391-7639-4643-b721-1e141e013602 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.795583 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1794/3608] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:45.796751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.800800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:45.801567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.802191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.802517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.802898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.804201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.808186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.838671 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1815/3609] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:45.840194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:45.858213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c34aa-6ce5-48b0-9ddb-a7d69873c7ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.930330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7bece-7522-46e5-8a7b-414b7eedf817 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:45.937376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.938921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.939356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.939838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] PATH_INFO: `/v3/projects/8d12b23487f649f8b6875e060ba4bb90` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.941609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d12b23487f649f8b6875e060ba4bb90)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.943900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:45.960351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:45.961663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:45.961951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:45.962284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:45.963283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:45.965849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.000210 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1816/3610] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:45 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:46.001233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.019048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c86ee0-4c4a-4fcb-8e73-d03edcd8a13f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.024578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d12b23487f649f8b6875e060ba4bb90', 'request_id': 'req-7c378932-33cd-412f-8cfb-b4d81cdf1e90'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:46.033447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d12b23487f649f8b6875e060ba4bb90', 'request_id': 'req-7c378932-33cd-412f-8cfb-b4d81cdf1e90'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:46.050061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d12b23487f649f8b6875e060ba4bb90', 'request_id': 'req-7c378932-33cd-412f-8cfb-b4d81cdf1e90'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:46.079281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] The token cache is being invalidate because project 8d12b23487f649f8b6875e060ba4bb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:46.080281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:46.081173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:46.084026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1795/3611] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:45 2022] DELETE /identity/v3/projects/8d12b23487f649f8b6875e060ba4bb90 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:46.085181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.091423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:46.114325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad54f6f-c5d8-41d7-b68a-cd89615faedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.115095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54f6f-c5d8-41d7-b68a-cd89615faedb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.115592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54f6f-c5d8-41d7-b68a-cd89615faedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.115845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad54f6f-c5d8-41d7-b68a-cd89615faedb admin admin] PATH_INFO: `/v3/projects/d00fdea8d5904c159056f45061e065ee/users/625efde54cb74e3cb4879333d41835d9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.138660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54f6f-c5d8-41d7-b68a-cd89615faedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00fdea8d5904c159056f45061e065ee, user_id=625efde54cb74e3cb4879333d41835d9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.142012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad54f6f-c5d8-41d7-b68a-cd89615faedb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.162455 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1817/3612] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:46 2022] PUT /identity/v3/projects/d00fdea8d5904c159056f45061e065ee/users/625efde54cb74e3cb4879333d41835d9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:46.166358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8701f40-302c-4cfc-be23-e7c53324e1d0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.166840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8701f40-302c-4cfc-be23-e7c53324e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.167321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8701f40-302c-4cfc-be23-e7c53324e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.192444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e8701f40-302c-4cfc-be23-e7c53324e1d0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:46.193891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8701f40-302c-4cfc-be23-e7c53324e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:46.245601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378932-33cd-412f-8cfb-b4d81cdf1e90 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.257207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:46.304044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:46.328123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1818/3613] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:46.340359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.341602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.344004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.388272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134b845-667a-4744-af47-245c1dbf1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.390651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b845-667a-4744-af47-245c1dbf1a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.391640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b845-667a-4744-af47-245c1dbf1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.394261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b845-667a-4744-af47-245c1dbf1a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.395411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134b845-667a-4744-af47-245c1dbf1a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.401640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134b845-667a-4744-af47-245c1dbf1a84 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.426036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] MFA Rules not processed for user `625efde54cb74e3cb4879333d41835d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:46.427876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:46.429359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1796/3614] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:46.431562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.431896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.432177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.475413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:46.477836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:46.499344 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1797/3615] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:46.502683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.520134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b02d3-1c08-4b64-8cad-20253c252d63 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.526054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.526682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.526964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.527245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.527909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.530036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.539185 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1819/3616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:46.540880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.552536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1ee41-1362-4394-934b-a7f64debd19c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.557717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.571492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1798/3617] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:46.571492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.573296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:46.574677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.574677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.575073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.576151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:46.576558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.579489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.598330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1820/3618] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:46.599541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.612713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86355f47-cfb0-4f47-ac51-90b777382c8a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.625436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.626445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.626445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.626660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] PATH_INFO: `/v3/projects/446a33968038476fbc98fc0b6b1795c0/users/1b4b5f0c43074932a8963727adfee38a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.645963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] RBAC: Authorizing `identity:create_grant(project_id=446a33968038476fbc98fc0b6b1795c0, user_id=1b4b5f0c43074932a8963727adfee38a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.649517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.688536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1821/3619] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:46 2022] PUT /identity/v3/projects/446a33968038476fbc98fc0b6b1795c0/users/1b4b5f0c43074932a8963727adfee38a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:46.688536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:46.713195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a83aa-f7f2-4530-a223-244c723145dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.847103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df238fb-2c78-474c-9a35-96158734008b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:46.849858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.850690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.851180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.852579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aabb3-ae9d-4b58-b0e0-230d38abdfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:46.853134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.853463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aabb3-ae9d-4b58-b0e0-230d38abdfce admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.854073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aabb3-ae9d-4b58-b0e0-230d38abdfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.854073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aabb3-ae9d-4b58-b0e0-230d38abdfce admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.854896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aabb3-ae9d-4b58-b0e0-230d38abdfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.856951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00aabb3-ae9d-4b58-b0e0-230d38abdfce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.901206 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1822/3620] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:46 2022] POST /identity/v3/projects => generated 395 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:46.902769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:46.903152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:46.903549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:46.915989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:46.942544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] MFA Rules not processed for user `1b4b5f0c43074932a8963727adfee38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:46.944699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:46.978932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:46.980890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:46.987426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:46.992049 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1799/3621] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:46 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:46.994601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.006540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0be40c-5fc1-4e37-9b15-fb8107c622c1 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.073457 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1823/3622] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:47.078715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.126443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.126443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.126443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.126443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.127107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.127107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.168099 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1800/3623] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:46 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:47.173064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.188554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9de72-4412-43b6-b0b2-ae17a34edfa8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.196515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.197356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.197729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.198042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.199372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.201169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.215751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1801/3624] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:47.217199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.245476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b04f25-824e-4d06-a136-c6a79bc83cf5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.251852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.252481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.252830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.253191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.253859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.255470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.275696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1802/3625] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:47.277274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.298584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c01602-e300-4c2b-b679-07c5920b8693 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.309179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d42250-7867-47fa-a5be-d5f1abf5d80b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.323470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.324391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.324625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.324716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.325694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.325819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.326301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.326500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.326986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] PATH_INFO: `/v3/projects/72eb879daa1d4330a8ac929f5b981164/users/393dca0630ba4170bafdbd0954276835/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.329104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.380316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=72eb879daa1d4330a8ac929f5b981164, user_id=393dca0630ba4170bafdbd0954276835, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.386038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.396724 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1824/3626] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:47 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:47.402152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.406111 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1803/3627] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:47 2022] PUT /identity/v3/projects/72eb879daa1d4330a8ac929f5b981164/users/393dca0630ba4170bafdbd0954276835/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:47.406586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:47.407847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.568819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36023bd-261d-44b0-a91e-854935d6fc7b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.575381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.576031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.576390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54511057-a391-4e1b-bfb5-be00317c43fe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.576774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.577100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] PATH_INFO: `/v3/users/625efde54cb74e3cb4879333d41835d9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.578689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=625efde54cb74e3cb4879333d41835d9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.580738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.588968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e469e-bbd4-4f00-bb50-348835a4b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.590545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e469e-bbd4-4f00-bb50-348835a4b52a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.590545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e469e-bbd4-4f00-bb50-348835a4b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.590545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e469e-bbd4-4f00-bb50-348835a4b52a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.591721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e469e-bbd4-4f00-bb50-348835a4b52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.595923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e469e-bbd4-4f00-bb50-348835a4b52a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.634512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:47.649670 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1804/3628] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:47 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:47.651369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de86ac-8b35-4a69-aec9-34a18252f080 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.652062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de86ac-8b35-4a69-aec9-34a18252f080 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.652471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de86ac-8b35-4a69-aec9-34a18252f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.683671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625efde54cb74e3cb4879333d41835d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:47.693413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:47.704822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-17de86ac-8b35-4a69-aec9-34a18252f080 None None] MFA Rules not processed for user `393dca0630ba4170bafdbd0954276835`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:47.707722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-17de86ac-8b35-4a69-aec9-34a18252f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:47.711495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625efde54cb74e3cb4879333d41835d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:47.713510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625efde54cb74e3cb4879333d41835d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:47.733384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625efde54cb74e3cb4879333d41835d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:47.734407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625efde54cb74e3cb4879333d41835d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:47.756620 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1825/3629] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:47 2022] DELETE /identity/v3/users/625efde54cb74e3cb4879333d41835d9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:47.760256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.763780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:47.856952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1805/3630] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:47.858007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.858358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.858640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.887121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190f0d6-c7eb-4911-b4d5-2cb1daae9d4b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.896030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:47.897347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.897809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:47.897981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.898264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.898587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.899226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.905662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.908772 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1806/3631] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:47.910827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.913045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:47.933493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1826/3632] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:47.937914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:47.942288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45665c-fb85-4f24-908b-9afb4754adef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.952476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.953465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.953754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.954032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:47.954730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:47.957143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:47.957507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe45b3-916c-45e1-bfdc-011407cf33d9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:47.969880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:47.970570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:47.970854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:47.971178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] PATH_INFO: `/v3/projects/f42e21e5ff8247d2b2fc27a30b7a4fd9/users/5bda07d8c2fa4f64b27d6eff9c821472/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.002138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42e21e5ff8247d2b2fc27a30b7a4fd9, user_id=5bda07d8c2fa4f64b27d6eff9c821472, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.006482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.014569 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1807/3633] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:47 2022] POST /identity/v3/projects => generated 397 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:48.015431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.019061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:48.035345 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1827/3634] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:47 2022] PUT /identity/v3/projects/f42e21e5ff8247d2b2fc27a30b7a4fd9/users/5bda07d8c2fa4f64b27d6eff9c821472/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:48.037301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.155346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2ac0-4e1c-440a-b7aa-54f560fdfe63 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.184856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83664028-7977-40a4-b0b0-ec6fd47324ac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.199045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.199766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.200642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.201877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.203099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.208390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.256073 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1828/3635] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:48 2022] POST /identity/v3/users => generated 305 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:48.257303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.269545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.271271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.272956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.273263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.282038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed81b6-f8c2-497e-b190-dc5cc3702094 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.294462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.295630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.296153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.296498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.297184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.308943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.309187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.309187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.322063 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1808/3636] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:48.324271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.327329 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1829/3637] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:48.331440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.344960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc46e6-861e-48c1-ab59-82378cc6253d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.352435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9478b-8b6a-4a08-a53f-d8170e7e231a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.356605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.357584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.359134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.359910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.361150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.363161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c78be-e665-4e06-9bb6-ee8eb7ae3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.364978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c78be-e665-4e06-9bb6-ee8eb7ae3fad admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.365369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.365713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c78be-e665-4e06-9bb6-ee8eb7ae3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.366865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c78be-e665-4e06-9bb6-ee8eb7ae3fad admin admin] PATH_INFO: `/v3/projects/f42e21e5ff8247d2b2fc27a30b7a4fd9/users/5bda07d8c2fa4f64b27d6eff9c821472/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.371169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c78be-e665-4e06-9bb6-ee8eb7ae3fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42e21e5ff8247d2b2fc27a30b7a4fd9, user_id=5bda07d8c2fa4f64b27d6eff9c821472, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.377908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c78be-e665-4e06-9bb6-ee8eb7ae3fad admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.389534 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1809/3638] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:48.392710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.409741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e1ff-2311-4d77-9d83-65ee55973d54 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.425240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:48.441184 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1830/3639] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:48 2022] PUT /identity/v3/projects/f42e21e5ff8247d2b2fc27a30b7a4fd9/users/5bda07d8c2fa4f64b27d6eff9c821472/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:48.443123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4864-076e-44f7-8de9-21e978593e12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.443123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4864-076e-44f7-8de9-21e978593e12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.443321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4864-076e-44f7-8de9-21e978593e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.459582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:48.481505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2e8b4864-076e-44f7-8de9-21e978593e12 None None] MFA Rules not processed for user `5bda07d8c2fa4f64b27d6eff9c821472`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:48.484128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e8b4864-076e-44f7-8de9-21e978593e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:48.572394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.573440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.579702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.580385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] PATH_INFO: `/v3/projects/890f81c86b0d4309b5abf44775ae00a9/users/bfc1cc43b8e84e4aaa4d7ba6c84ac006/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.628052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=890f81c86b0d4309b5abf44775ae00a9, user_id=bfc1cc43b8e84e4aaa4d7ba6c84ac006, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.635730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.637468 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1831/3640] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:48.648173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.648565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.649061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.662935 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1810/3641] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:48 2022] PUT /identity/v3/projects/890f81c86b0d4309b5abf44775ae00a9/users/bfc1cc43b8e84e4aaa4d7ba6c84ac006/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:48.667031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.685768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] MFA Rules not processed for user `1b4b5f0c43074932a8963727adfee38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:48.687026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:48.799309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1832/3642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:48.800318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.801235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a0b7b-d60d-4904-a6be-9a320c8a97cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.801820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:48.807933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.809054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.809336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.809613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.810358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.812679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.828491 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1811/3643] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:48.830353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:48.844954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170ce5c-e986-45ff-a8b3-2c4999f68b8a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:48.853053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d6055-0297-4796-956f-b0e9f70463dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:48.853993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6055-0297-4796-956f-b0e9f70463dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.854401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6055-0297-4796-956f-b0e9f70463dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.854726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d6055-0297-4796-956f-b0e9f70463dd admin admin] PATH_INFO: `/v3/projects/890f81c86b0d4309b5abf44775ae00a9/users/bfc1cc43b8e84e4aaa4d7ba6c84ac006/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.858585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6055-0297-4796-956f-b0e9f70463dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=890f81c86b0d4309b5abf44775ae00a9, user_id=bfc1cc43b8e84e4aaa4d7ba6c84ac006, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:48.862775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d6055-0297-4796-956f-b0e9f70463dd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:48.890745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1812/3644] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:48 2022] PUT /identity/v3/projects/890f81c86b0d4309b5abf44775ae00a9/users/bfc1cc43b8e84e4aaa4d7ba6c84ac006/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:48.893093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:48.893867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:48.894221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:48.964562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] MFA Rules not processed for user `bfc1cc43b8e84e4aaa4d7ba6c84ac006`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:48.966301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:48.973395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da415a-2fc1-4cff-98ed-e63a219622d1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.053677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:49.106762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:49.119161 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1813/3645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:49.124240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.148299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.149515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.149741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.153266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.160662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:49.315230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e252b9-fcbb-4d86-a754-3705c095df1a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.349207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '393dca0630ba4170bafdbd0954276835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72eb879daa1d4330a8ac929f5b981164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.350234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.353627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.354397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.358782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 05 02:37:49.388358 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 05 02:37:49.389401 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.403077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.403077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:49.403705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1814/3646] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:37:49 2022] POST /identity/v3/projects => generated 136 bytes in 279 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:49.406189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.441672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5638f-be1c-4206-8366-ec9ce875e2cb tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.456878 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1833/3647] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:49.480842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890f81c86b0d4309b5abf44775ae00a9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.481502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.484026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.484026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.484026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.485476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invalid input for field 'name': '' is too short Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: On instance['name']: Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: On instance['name']: Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: '' Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise error Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application '' Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.525567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:37:49.527360 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application '' Oct 05 02:37:49.528517 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.532214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.533312 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1815/3648] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:37:49 2022] POST /identity/v3/projects => generated 283 bytes in 126 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:37:49.570932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49ef35-eddc-47f5-b729-9e0190986e9c service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.589321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890f81c86b0d4309b5abf44775ae00a9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.590260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.590738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.591443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.592396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.594869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: On instance['name']: Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: On instance['name']: Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise error Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:37:49.604947 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:49.606325 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:37:49.607613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.611706 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1834/3649] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:37:49 2022] POST /identity/v3/projects => generated 412 bytes in 80 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:37:49.616564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.627778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381eae-e452-4197-a300-79310ffbef17 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.636010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890f81c86b0d4309b5abf44775ae00a9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.636663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.636985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.637267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] PATH_INFO: `/v3/projects/24387019fce74adcb6b5f7afa4f1f33a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.651171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24387019fce74adcb6b5f7afa4f1f33a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.653552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Could not find project: 24387019fce74adcb6b5f7afa4f1f33a.: keystone.exception.ProjectNotFound: Could not find project: 24387019fce74adcb6b5f7afa4f1f33a. Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 05 02:37:49.668241 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 24387019fce74adcb6b5f7afa4f1f33a. Oct 05 02:37:49.669394 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:37:49.671723 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1816/3650] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:49 2022] DELETE /identity/v3/projects/24387019fce74adcb6b5f7afa4f1f33a => generated 113 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:49.676402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.694375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cb1de-6f1e-4c36-9dfc-b9beb805ef77 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.703384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '393dca0630ba4170bafdbd0954276835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72eb879daa1d4330a8ac929f5b981164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.704123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.705156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.706361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.707162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.714400 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:37:49.714400 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:37:49.714400 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 05 02:37:49.723117 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._list_projects() Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 05 02:37:49.724190 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.729676 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1835/3651] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 02:37:49 2022] GET /identity/v3/projects => generated 135 bytes in 52 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:49.732300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.747218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2a1c-d8c0-413a-bd6f-4ea4673c1d09 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.758477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890f81c86b0d4309b5abf44775ae00a9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.759352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.760261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.760570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.762974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.767685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:49.843568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:49.849535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1817/3652] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:49 2022] POST /identity/v3/projects => generated 356 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:49.856263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaca1f-51f0-4571-a3d4-9f358b15505d tempest-ProjectsNegativeStaticTestJSON-292877883 tempest-ProjectsNegativeStaticTestJSON-292877883-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:49.948547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890f81c86b0d4309b5abf44775ae00a9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:49.949435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:49.949825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:49.950254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:49.951033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:49.953467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:49.979275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.sql.core [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-189340285' for key 'project.ixu_project_name_domain_id'") Oct 05 02:37:49.979275 n-d-858272-3 devstack@keystone.service[81827]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 02:37:49.979275 n-d-858272-3 devstack@keystone.service[81827]: [parameters: {'id': '8a773097c5d442faae9ead7c3fa1d48f', 'name': 'tempest-project-dup-189340285', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 05 02:37:49.979275 n-d-858272-3 devstack@keystone.service[81827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-189340285, project id 8a773097c5d442faae9ead7c3fa1d48f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-189340285, project id 8a773097c5d442faae9ead7c3fa1d48f. Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:37:49.987522 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-189340285' for key 'project.ixu_project_name_domain_id'") Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 02:37:49.988582 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application yield resource Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise self.value Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 02:37:49.989973 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application session.commit() Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.flush() Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application compat.raise_( Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 02:37:49.991400 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 02:37:49.993504 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:37:49.998231 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-189340285' for key 'project.ixu_project_name_domain_id'") Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [parameters: {'id': '8a773097c5d442faae9ead7c3fa1d48f', 'name': 'tempest-project-dup-189340285', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:49.999412 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-189340285 at domain ID default. Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:50.000497 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-189340285, project id 8a773097c5d442faae9ead7c3fa1d48f. Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:50.003796 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1836/3653] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:37:49 2022] POST /identity/v3/projects => generated 284 bytes in 152 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:37:50.004561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:50.027067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071900b-485f-4203-89ef-4cbc6861cbeb tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:50.042717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890f81c86b0d4309b5abf44775ae00a9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:50.043406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:50.043700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:50.043990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] PATH_INFO: `/v3/projects/a4a802895e6f48149b5cf4d6ff219f78` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:50.045263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4a802895e6f48149b5cf4d6ff219f78)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:50.047444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:50.157249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a802895e6f48149b5cf4d6ff219f78', 'request_id': 'req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.166855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a802895e6f48149b5cf4d6ff219f78', 'request_id': 'req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.184881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a802895e6f48149b5cf4d6ff219f78', 'request_id': 'req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.206779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] The token cache is being invalidate because project a4a802895e6f48149b5cf4d6ff219f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:50.207326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.208389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.214422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1818/3654] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:50 2022] DELETE /identity/v3/projects/a4a802895e6f48149b5cf4d6ff219f78 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:50.216083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:50.219579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:50.347948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:50.373779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249bd3-1eb3-4347-85ca-11bab6e3711b tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:50.468272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:50.469481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:50.472253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:50.472253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] PATH_INFO: `/v3/users/393dca0630ba4170bafdbd0954276835` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:50.474381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393dca0630ba4170bafdbd0954276835)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:50.479475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:50.581646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393dca0630ba4170bafdbd0954276835'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.601999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393dca0630ba4170bafdbd0954276835'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.603823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393dca0630ba4170bafdbd0954276835'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.624701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393dca0630ba4170bafdbd0954276835'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.625703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61307b8f-4889-452b-9b22-223213dc7c97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393dca0630ba4170bafdbd0954276835'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:50.639331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:50.641705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:50.661406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b04a6-22f5-4d74-91e1-9774d0b4d8b4 tempest-ProjectsNegativeStaticTestJSON-1450829498 tempest-ProjectsNegativeStaticTestJSON-1450829498-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:50.664495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1837/3655] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:50 2022] DELETE /identity/v3/users/393dca0630ba4170bafdbd0954276835 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:50.670554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:50.671011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:50.671505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:50.715035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:50.716598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:50.858060 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1838/3656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:50.863407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:50.887695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:50.889881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:50.905305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:50.906395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:50.907153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:50.907650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] PATH_INFO: `/v3/projects/d00fdea8d5904c159056f45061e065ee` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:50.909100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00fdea8d5904c159056f45061e065ee)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:50.911652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:50.943419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:51.041269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00fdea8d5904c159056f45061e065ee', 'request_id': 'req-6ab98951-7e5f-419f-9495-dff68e9d1bd1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:51.043301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140b65-3e29-4e2c-845d-e9ac07a8a761 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:51.068204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00fdea8d5904c159056f45061e065ee', 'request_id': 'req-6ab98951-7e5f-419f-9495-dff68e9d1bd1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:51.080578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00fdea8d5904c159056f45061e065ee', 'request_id': 'req-6ab98951-7e5f-419f-9495-dff68e9d1bd1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:51.116512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] The token cache is being invalidate because project d00fdea8d5904c159056f45061e065ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:51.116850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:51.119964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ab98951-7e5f-419f-9495-dff68e9d1bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:51.125387 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1819/3657] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:50 2022] DELETE /identity/v3/projects/d00fdea8d5904c159056f45061e065ee => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:51.130514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7254266-e1ce-430f-8e38-668f668ca9fc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:51.130825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7254266-e1ce-430f-8e38-668f668ca9fc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:51.131112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7254266-e1ce-430f-8e38-668f668ca9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:51.222112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b7254266-e1ce-430f-8e38-668f668ca9fc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:51.226339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b7254266-e1ce-430f-8e38-668f668ca9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:51.236149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:51.238293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:51.238521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:51.242974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:51.251251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:51.427142 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1820/3658] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:51.434258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:51.434599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:51.434882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:51.500685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:51.503162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:51.521877 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1839/3659] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:51.529439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:51.533166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:51.553952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1821/3660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:51.558604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:51.572747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13df1-e8c8-43d5-89dc-cb043205467b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:51.583721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:51.584424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:51.585109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:51.586649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:51.589123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:51.589413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:51.604706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:51.675921 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1840/3661] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:51.679108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:51.694357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e9e02-fb6d-4cbc-bd07-424ad987baa6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:51.705751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:51.708608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:51.708920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:51.709626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:51.709881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:51.717106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:51.807037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1822/3662] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:51 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:37:51.810977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:51.822617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4da47-b5c9-4655-a7d3-79963372454e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:51.978487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:51.983837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:51.984137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:51.984411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:51.986352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:51.996392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:52.049471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1841/3663] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:51 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:52.053647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:52.065932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51de7c6-09b9-43ab-bfa9-9768fb588262 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:52.080340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:52.081066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:52.081382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:52.081659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:52.082364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:52.084138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:52.114117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:52.114738 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1823/3664] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:52.122135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:52.138023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c90b-82f0-4698-a748-dc28a51d01da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:52.150951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d542-a21d-42c3-a973-b303f69ad430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:52.154080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d542-a21d-42c3-a973-b303f69ad430 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:52.155991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d542-a21d-42c3-a973-b303f69ad430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:52.156277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d542-a21d-42c3-a973-b303f69ad430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:52.157111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3d542-a21d-42c3-a973-b303f69ad430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:52.160352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3d542-a21d-42c3-a973-b303f69ad430 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:52.197020 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1842/3665] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:52.201470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:52.214301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195a9c-30f4-46ae-9f46-4dc1fd88f975 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:52.228882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:52.231197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:52.232241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:52.233500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] PATH_INFO: `/v3/projects/be31ec89b1354d608d7de438f5cf519d/users/2d55412129f24e90b1caa99b3aea8c61/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:52.304215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be31ec89b1354d608d7de438f5cf519d, user_id=2d55412129f24e90b1caa99b3aea8c61, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:52.307943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:52.342711 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1824/3666] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:52 2022] PUT /identity/v3/projects/be31ec89b1354d608d7de438f5cf519d/users/2d55412129f24e90b1caa99b3aea8c61/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:52.355059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c5a0-f752-4d77-8d67-6f80516c4d7d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:52.355666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c5a0-f752-4d77-8d67-6f80516c4d7d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:52.356133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2c5a0-f752-4d77-8d67-6f80516c4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:52.442682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-83c2c5a0-f752-4d77-8d67-6f80516c4d7d None None] MFA Rules not processed for user `2d55412129f24e90b1caa99b3aea8c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:52.453103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83c2c5a0-f752-4d77-8d67-6f80516c4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:52.608245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:52.614254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:52.629258 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1843/3667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:52.639803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:52.640126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:52.640359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:52.675435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:52.708504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] MFA Rules not processed for user `2d55412129f24e90b1caa99b3aea8c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:52.715090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:52.748535 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1844/3668] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:52.788389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:52.790659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:52.810763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd4d6-0e75-4cdb-a852-b221518f5e14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:52.819840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:52.821006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:52.821307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:52.821550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] PATH_INFO: `/v3/projects/72eb879daa1d4330a8ac929f5b981164` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:52.823381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72eb879daa1d4330a8ac929f5b981164)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:52.825679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:52.950970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72eb879daa1d4330a8ac929f5b981164', 'request_id': 'req-7cf9c0e5-b9f3-4128-8220-197ad58b0736'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:52.972353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72eb879daa1d4330a8ac929f5b981164', 'request_id': 'req-7cf9c0e5-b9f3-4128-8220-197ad58b0736'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:52.994795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72eb879daa1d4330a8ac929f5b981164', 'request_id': 'req-7cf9c0e5-b9f3-4128-8220-197ad58b0736'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.033577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] The token cache is being invalidate because project 72eb879daa1d4330a8ac929f5b981164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:53.033836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.042101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.044530 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1825/3669] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:52 2022] DELETE /identity/v3/projects/72eb879daa1d4330a8ac929f5b981164 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:53.047935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:53.049529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:53.075463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35928-c486-4b4b-bed4-9a29ab874550 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:53.220157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:53.222160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:53.222539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:53.236328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:53.240037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9c0e5-b9f3-4128-8220-197ad58b0736 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:53.241870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:53.259931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:53.263709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:53.264572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:53.265490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] PATH_INFO: `/v3/users/bfc1cc43b8e84e4aaa4d7ba6c84ac006` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:53.269092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc1cc43b8e84e4aaa4d7ba6c84ac006)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:53.272992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:53.280028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:53.393627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.396035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:53.429296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:53.435117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:53.446940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.448613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.466878 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1845/3670] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:37:53.473936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.474869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-855e5919-88c8-4f85-bb78-b04eb743da83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc1cc43b8e84e4aaa4d7ba6c84ac006'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:53.508836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1826/3671] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:53 2022] DELETE /identity/v3/users/bfc1cc43b8e84e4aaa4d7ba6c84ac006 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:37:55.184207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:55.210990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9936c-dca5-4964-9835-4ff9c0aac94e service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:55.479569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:55.481429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:55.481652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:55.481928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] PATH_INFO: `/v3/projects/890f81c86b0d4309b5abf44775ae00a9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:55.486804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890f81c86b0d4309b5abf44775ae00a9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:55.491674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:55.636072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890f81c86b0d4309b5abf44775ae00a9', 'request_id': 'req-1df5d639-5a7e-4af2-873b-87d972453d84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:55.657146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890f81c86b0d4309b5abf44775ae00a9', 'request_id': 'req-1df5d639-5a7e-4af2-873b-87d972453d84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:55.677204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890f81c86b0d4309b5abf44775ae00a9', 'request_id': 'req-1df5d639-5a7e-4af2-873b-87d972453d84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:55.720991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] The token cache is being invalidate because project 890f81c86b0d4309b5abf44775ae00a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:55.722385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:55.725166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1df5d639-5a7e-4af2-873b-87d972453d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:55.735530 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1846/3672] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:55 2022] DELETE /identity/v3/projects/890f81c86b0d4309b5abf44775ae00a9 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:55.737290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:55.738102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:55.738269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:55.799863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:55.801672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:55.919514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:55.919777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:55.920052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:55.921098 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1827/3673] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:55.958977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:55.962841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:55.999427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1847/3674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:56.003697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:56.015995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a82ea5-b07e-4987-944b-f311bfb80ce9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:56.029655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:56.030287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.030571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.030850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.031509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:37:56.031815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:56.033463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:56.068616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1828/3675] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:37:56.075209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:56.104461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9272b87-9e5f-43f7-8292-1e82f3c0841c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:56.130732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae876207-64d5-43ee-a800-4614c401eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:56.131540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876207-64d5-43ee-a800-4614c401eaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.131827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876207-64d5-43ee-a800-4614c401eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.132213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876207-64d5-43ee-a800-4614c401eaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.134524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae876207-64d5-43ee-a800-4614c401eaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:56.144068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae876207-64d5-43ee-a800-4614c401eaf9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:56.189460 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1848/3676] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:56 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:56.193205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:56.215620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c12bc8-514b-40ab-b56a-8a68a8e5afbe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:56.393512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:56.410255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.410405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.410716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.411304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:56.420884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:56.434734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c3456-9ba3-4307-ba7a-c0a830f7fd47 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.435032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c3456-9ba3-4307-ba7a-c0a830f7fd47 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.435314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c3456-9ba3-4307-ba7a-c0a830f7fd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.485035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:56.514290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bb2c3456-9ba3-4307-ba7a-c0a830f7fd47 None None] MFA Rules not processed for user `110ebcc38ef34dfea40fe14ab2ad1b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:56.516720 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1829/3677] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:56 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:56.517239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bb2c3456-9ba3-4307-ba7a-c0a830f7fd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:56.521372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:56.539517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e7708-9f72-4f98-b7e7-c5a6b712bf41 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:56.544810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:56.547717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.547996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.548585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.549108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:56.551331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:56.569695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1830/3678] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:56.574903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:56.597034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24d4b2-f328-4494-b4e4-2eda14bcc1cd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:56.611444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:56.612082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.612406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.612673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.613394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:56.615847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:56.641030 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1831/3679] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:56.645298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:56.689458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49803b13-a20d-47dc-a81c-4e45e6f92b00 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:56.702525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:56.703210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.703572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.704092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] PATH_INFO: `/v3/projects/026309082df14b2da6143ecd94976f05/users/4c2adb2cf22747079bd9fe0abd458c7f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.739507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=026309082df14b2da6143ecd94976f05, user_id=4c2adb2cf22747079bd9fe0abd458c7f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:56.740066 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1849/3680] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:56.742502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:56.759322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:56.803369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1832/3681] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:56 2022] PUT /identity/v3/projects/026309082df14b2da6143ecd94976f05/users/4c2adb2cf22747079bd9fe0abd458c7f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:56.812714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:56.813957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:56.814418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:56.892507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] MFA Rules not processed for user `4c2adb2cf22747079bd9fe0abd458c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:56.897430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:57.054226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1850/3682] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:57.061284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:57.181700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:57.183660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:57.234570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e180dcf-43d2-4bf2-90b1-34caa4b50e9e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:57.240222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:57.240843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:57.241166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:57.241449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:57.243051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:57.251068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:57.305768 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1833/3683] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:57 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:57.310239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:57.467245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cf90e-942c-4857-a895-4a440611510b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:57.483612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b221b-0cc3-4524-a873-f5ed7039c246 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:57.484474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:57.488342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:57.488719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:57.489077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:57.489699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:57.491674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:57.544949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1834/3684] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:37:57 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:57.549976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:57.571701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5865e5b-84e7-4534-8f89-b851b0f48cf5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:57.572700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:57.595126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:57.597644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:57.598463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:57.599029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:57.599853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:57.601976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:57.636694 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1835/3685] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:57.641328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:57.648786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:57.690087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:57.691271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:57.691553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:57.691831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:57.694130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:57.781037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:57.834620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:57.835766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78ce0-38ad-4078-a5a6-e42369248dc2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:57.836306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:57.884164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:57.890149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:57.890766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:57.891926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:57.904254 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1851/3686] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:57.905127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:57.931004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873f0b5-fc7e-4227-a275-76804905d4e8 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:57.951336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:57.952020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:57.952302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:57.952580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] PATH_INFO: `/v3/projects/ffbf2dc6dc0a4bd08b6c6fced2dcdd9e/users/ac806e7453f44af48535a65c19d14316/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:58.009847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbf2dc6dc0a4bd08b6c6fced2dcdd9e, user_id=ac806e7453f44af48535a65c19d14316, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:58.012856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:58.046767 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1852/3687] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:57 2022] PUT /identity/v3/projects/ffbf2dc6dc0a4bd08b6c6fced2dcdd9e/users/ac806e7453f44af48535a65c19d14316/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:58.051501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:58.057335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:58.071805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:58.085021 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1836/3688] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:37:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:37:58.214704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5bdbd-69fc-4042-a773-f859283f094a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:58.227516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d745-007f-4b4b-a268-f507c4813e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:58.228458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d745-007f-4b4b-a268-f507c4813e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:58.232567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d745-007f-4b4b-a268-f507c4813e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:58.233209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d745-007f-4b4b-a268-f507c4813e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:58.235650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d745-007f-4b4b-a268-f507c4813e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:58.239775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d745-007f-4b4b-a268-f507c4813e2a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:58.267132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:58.267700 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1853/3689] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:37:58.315518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315de28-4c22-4aa6-adef-d03abe9c2a01 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:58.349512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:58.350204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:58.350485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:58.350757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] PATH_INFO: `/v3/projects/ffbf2dc6dc0a4bd08b6c6fced2dcdd9e/users/ac806e7453f44af48535a65c19d14316/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:58.364140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbf2dc6dc0a4bd08b6c6fced2dcdd9e, user_id=ac806e7453f44af48535a65c19d14316, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:58.368434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:58.409255 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1837/3690] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:37:58 2022] PUT /identity/v3/projects/ffbf2dc6dc0a4bd08b6c6fced2dcdd9e/users/ac806e7453f44af48535a65c19d14316/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:58.410694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:58.411110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:58.411565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:58.472178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] MFA Rules not processed for user `ac806e7453f44af48535a65c19d14316`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:58.474132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:58.507530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:58.611072 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1854/3691] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:37:58.615953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:58.633769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e903-4cf4-44a8-9a11-244f1f217f13 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:58.646026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab0262-e2b6-45e1-8b3f-8c68237d538f tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac806e7453f44af48535a65c19d14316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffbf2dc6dc0a4bd08b6c6fced2dcdd9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:58.648313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0262-e2b6-45e1-8b3f-8c68237d538f tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:58.649104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0262-e2b6-45e1-8b3f-8c68237d538f tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:58.649333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab0262-e2b6-45e1-8b3f-8c68237d538f tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:58.650853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab0262-e2b6-45e1-8b3f-8c68237d538f tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:58.655050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab0262-e2b6-45e1-8b3f-8c68237d538f tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:58.761813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1838/3692] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:37:58 2022] POST /identity/v3/projects => generated 360 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:37:58.764570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:58.960496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727e945-7042-441e-aa04-a5710c662a65 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:59.009183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:59.010033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:59.010476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:59.045871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:37:59.056863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:37:59.136365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c2adb2cf22747079bd9fe0abd458c7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026309082df14b2da6143ecd94976f05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:59.137063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:59.137354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:59.137636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] PATH_INFO: `/v3/projects/c8a974e4bdd14b4f8cff711c6230d503` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:59.138829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] RBAC: Authorizing `identity:delete_project(project_id=c8a974e4bdd14b4f8cff711c6230d503)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 05 02:37:59.145993 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:37:59.147984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1855/3693] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:58 2022] DELETE /identity/v3/projects/c8a974e4bdd14b4f8cff711c6230d503 => generated 136 bytes in 384 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:37:59.154352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:59.191288 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1839/3694] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:37:59.270923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98d066-709c-48df-a9a4-bf0d7386976c tempest-ProjectsNegativeTestJSON-1406553385 tempest-ProjectsNegativeTestJSON-1406553385-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:59.284422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac806e7453f44af48535a65c19d14316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffbf2dc6dc0a4bd08b6c6fced2dcdd9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:59.286206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:59.286794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:59.287257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] PATH_INFO: `/v3/projects/c8a974e4bdd14b4f8cff711c6230d503` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:59.288670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c8a974e4bdd14b4f8cff711c6230d503)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:59.294828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:59.345144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:59.408699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a974e4bdd14b4f8cff711c6230d503', 'request_id': 'req-845836d4-9062-445d-b58e-07298c5b86eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.425068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a974e4bdd14b4f8cff711c6230d503', 'request_id': 'req-845836d4-9062-445d-b58e-07298c5b86eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.439154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a974e4bdd14b4f8cff711c6230d503', 'request_id': 'req-845836d4-9062-445d-b58e-07298c5b86eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.456284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] The token cache is being invalidate because project c8a974e4bdd14b4f8cff711c6230d503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:37:59.456535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.457376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-845836d4-9062-445d-b58e-07298c5b86eb tempest-ProjectsNegativeTestJSON-1692783659 tempest-ProjectsNegativeTestJSON-1692783659-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.459370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1856/3695] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:37:59 2022] DELETE /identity/v3/projects/c8a974e4bdd14b4f8cff711c6230d503 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:59.466492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:37:59.585069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85bbe2-e589-4d6d-adb6-70012bafeeee None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:37:59.610633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:37:59.717030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:37:59.718008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:59.718545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:59.719585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] PATH_INFO: `/v3/users/4c2adb2cf22747079bd9fe0abd458c7f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:37:59.721081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2adb2cf22747079bd9fe0abd458c7f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:37:59.723807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:37:59.831839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2adb2cf22747079bd9fe0abd458c7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.886295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2adb2cf22747079bd9fe0abd458c7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.890213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2adb2cf22747079bd9fe0abd458c7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.927153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2adb2cf22747079bd9fe0abd458c7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.928071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2adb2cf22747079bd9fe0abd458c7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:37:59.960381 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1840/3696] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:37:59 2022] DELETE /identity/v3/users/4c2adb2cf22747079bd9fe0abd458c7f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:37:59.966560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:37:59.967812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:37:59.969311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:00.023004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:00.025509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:00.136336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1857/3697] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:38:00.204099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:00.210640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:00.389478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815a85c-c62a-40ef-84ee-38e718731792 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:00.397827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:00.398893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:00.399215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:00.399754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:00.427466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:00.428457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:00.462302 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1841/3698] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:02.145588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:02.151346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:02.174189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2a1d5-ffc7-43ff-9095-da42f563761a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:02.181806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:02.183956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:02.184484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:02.185003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] PATH_INFO: `/v3/projects/026309082df14b2da6143ecd94976f05` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:02.186797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026309082df14b2da6143ecd94976f05)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:02.189622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:02.296851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026309082df14b2da6143ecd94976f05', 'request_id': 'req-d606789b-f3c5-4ea5-9045-9e9dba4be722'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.308918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026309082df14b2da6143ecd94976f05', 'request_id': 'req-d606789b-f3c5-4ea5-9045-9e9dba4be722'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.330326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026309082df14b2da6143ecd94976f05', 'request_id': 'req-d606789b-f3c5-4ea5-9045-9e9dba4be722'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.346120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] The token cache is being invalidate because project 026309082df14b2da6143ecd94976f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:02.346420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.347560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d606789b-f3c5-4ea5-9045-9e9dba4be722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.353567 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1858/3699] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:02 2022] DELETE /identity/v3/projects/026309082df14b2da6143ecd94976f05 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:02.354846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:02.370666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2dc4a-de6e-46cb-8b4b-f95352f83221 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:02.463879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:02.576496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:02.577275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:02.577564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:02.582174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] PATH_INFO: `/v3/users/ac806e7453f44af48535a65c19d14316` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:02.587236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac806e7453f44af48535a65c19d14316)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:02.592249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:02.765468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac806e7453f44af48535a65c19d14316'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.853017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac806e7453f44af48535a65c19d14316'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.853865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac806e7453f44af48535a65c19d14316'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.869252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac806e7453f44af48535a65c19d14316'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.871266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d49fd53-c7ff-4762-ba87-a6c49df23841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac806e7453f44af48535a65c19d14316'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:02.921258 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1842/3700] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:02 2022] DELETE /identity/v3/users/ac806e7453f44af48535a65c19d14316 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:03.112533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:03.113268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:03.113268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:03.187147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] MFA Rules not processed for user `2b8d63e7d05849e28cc54624771c60e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:03.197463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:03.252192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:03.435622 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1859/3701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:03.437032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:03.437842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:03.438278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:03.499221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] MFA Rules not processed for user `2b8d63e7d05849e28cc54624771c60e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:03.504971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:03.521585 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1843/3702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:38:03.743195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:03.744959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:03.814716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:03.816367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:03.894927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6712c36-cfdf-40e3-a228-31cd9a6a59eb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:03.912195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb94dd6-0c17-45af-8164-552f16bc3361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:03.913489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb94dd6-0c17-45af-8164-552f16bc3361 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:03.914720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb94dd6-0c17-45af-8164-552f16bc3361 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:03.915106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb94dd6-0c17-45af-8164-552f16bc3361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:03.934540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb94dd6-0c17-45af-8164-552f16bc3361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:03.959040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb94dd6-0c17-45af-8164-552f16bc3361 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.001849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c649de9-4a4f-4a88-8fb9-6dd7c868e439 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.017097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1860/3703] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:04.018673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.019523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.019814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.020133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] PATH_INFO: `/v3/projects/ffbf2dc6dc0a4bd08b6c6fced2dcdd9e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.021691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbf2dc6dc0a4bd08b6c6fced2dcdd9e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.031960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.170840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbf2dc6dc0a4bd08b6c6fced2dcdd9e', 'request_id': 'req-030f3248-c2be-40f2-8d09-557190bbbbed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:04.172500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:04.208517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2317b-558d-4823-b231-66d0e4c7607b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.209032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2317b-558d-4823-b231-66d0e4c7607b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.209247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2317b-558d-4823-b231-66d0e4c7607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.212882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbf2dc6dc0a4bd08b6c6fced2dcdd9e', 'request_id': 'req-030f3248-c2be-40f2-8d09-557190bbbbed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:04.245132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbf2dc6dc0a4bd08b6c6fced2dcdd9e', 'request_id': 'req-030f3248-c2be-40f2-8d09-557190bbbbed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:04.245919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dbe2317b-558d-4823-b231-66d0e4c7607b None None] MFA Rules not processed for user `110ebcc38ef34dfea40fe14ab2ad1b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:04.248117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dbe2317b-558d-4823-b231-66d0e4c7607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:04.287885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] The token cache is being invalidate because project ffbf2dc6dc0a4bd08b6c6fced2dcdd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:04.288187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:04.289473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-030f3248-c2be-40f2-8d09-557190bbbbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:04.293610 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1844/3704] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:03 2022] DELETE /identity/v3/projects/ffbf2dc6dc0a4bd08b6c6fced2dcdd9e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:38:04.298949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.299240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.299523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.343666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:04.345500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:04.364085 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1861/3705] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:38:04.439443 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1845/3706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:04.448959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.449430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.449916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.496829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:04.498299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:04.514034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:04.517964 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1862/3707] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:04.524704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ad36-8cf9-4001-a814-80a02f5e56a6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.535952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.536888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.537439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.538093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.539964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:38:04.540482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.542939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.560997 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1846/3708] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:38:04.565605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:04.577767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1435df-1090-4a8e-ade0-9c99c26ef6ac None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.587167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.588805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.589524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.592522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.593658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.596076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.639415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1863/3709] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:04 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:04.643411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:04.665068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ba623-601d-4c76-87dc-be1b74632407 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.734318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.734939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.735221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.735495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.736140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.738095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.768267 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1847/3710] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:04 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:04.770081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:04.781075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5519d-1194-41ac-9364-29cebb2126da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.786441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.787078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.787372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.787699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.788357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.790669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.807765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1864/3711] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:04.825177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:04.840501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb44d5d-49ec-4bc5-bd08-9176fc253101 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.847137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395da5b-35cc-470e-854c-a6b533b3f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.847719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395da5b-35cc-470e-854c-a6b533b3f380 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.848009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395da5b-35cc-470e-854c-a6b533b3f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.848283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395da5b-35cc-470e-854c-a6b533b3f380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.848994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395da5b-35cc-470e-854c-a6b533b3f380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.850644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395da5b-35cc-470e-854c-a6b533b3f380 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.878096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1848/3712] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:04.881738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:04.897085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f4f54-2717-406b-8368-2eb00dffca08 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:04.906987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:04.908142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.908142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.908569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] PATH_INFO: `/v3/projects/bc7ce0879c1b4cbeb98c8ad08df9fd61/users/15e27cc14919493fb6cc5a983594a830/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:04.922532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:04.932623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7ce0879c1b4cbeb98c8ad08df9fd61, user_id=15e27cc14919493fb6cc5a983594a830, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:04.937551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:04.955012 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1865/3713] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:04 2022] PUT /identity/v3/projects/bc7ce0879c1b4cbeb98c8ad08df9fd61/users/15e27cc14919493fb6cc5a983594a830/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:04.966943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:04.967205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:04.967482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.000471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] MFA Rules not processed for user `15e27cc14919493fb6cc5a983594a830`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:05.001857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:05.038759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:05.113184 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1849/3714] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:05.113780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:05.292397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ffc4-beda-4821-8621-8a57ad36feed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:05.302180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:05.302800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.303082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.304233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.307056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:05.325339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:05.388279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:05.393925 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1866/3715] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:05 2022] POST /identity/v3/projects => generated 371 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:38:05.400338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bc0a1-3b2d-4029-aae6-fda8f27657ff None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:05.559497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:05.560245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.560631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.561113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.562276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:05.564336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:05.594100 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1850/3716] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:05 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:05.597925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:05.609488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d79d3b-dde9-44b3-8d74-9618d994037d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:05.614284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:05.615113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.615563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.615987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.616776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:05.618579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:05.630792 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1867/3717] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:05.634902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:05.652931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d1c57-05b0-4d35-a1e5-e94cb6a28fa2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:05.668698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:05.669483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.669765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.670042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] PATH_INFO: `/v3/projects/b0cefcb2ae80486b8ab24a10aab9b17a/users/f441880f4a464766bd93af4080997298/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.693582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cefcb2ae80486b8ab24a10aab9b17a, user_id=f441880f4a464766bd93af4080997298, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:05.697556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:05.714667 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1851/3718] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:05 2022] PUT /identity/v3/projects/b0cefcb2ae80486b8ab24a10aab9b17a/users/f441880f4a464766bd93af4080997298/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:05.718538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:05.729365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e95d7b-17da-4bbb-8d57-5812e279a256 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:05.842442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf2ec5-7a8d-46de-b776-c3287e408ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:05.843079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2ec5-7a8d-46de-b776-c3287e408ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.843366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2ec5-7a8d-46de-b776-c3287e408ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.843648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf2ec5-7a8d-46de-b776-c3287e408ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.844304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2ec5-7a8d-46de-b776-c3287e408ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:05.846059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf2ec5-7a8d-46de-b776-c3287e408ab5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:05.857309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1868/3719] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:38:05.862961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:05.891444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bb863-b97d-44e7-a72f-4b3ea56aa4a6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:05.901616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:05.902429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.902770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.903111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] PATH_INFO: `/v3/projects/b0cefcb2ae80486b8ab24a10aab9b17a/users/f441880f4a464766bd93af4080997298/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.905213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cefcb2ae80486b8ab24a10aab9b17a, user_id=f441880f4a464766bd93af4080997298, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:05.909392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:05.922469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1852/3720] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:05 2022] PUT /identity/v3/projects/b0cefcb2ae80486b8ab24a10aab9b17a/users/f441880f4a464766bd93af4080997298/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:05.933348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:05.933742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:05.934023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:05.970130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] MFA Rules not processed for user `f441880f4a464766bd93af4080997298`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:05.971508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:06.025875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:06.055947 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1869/3721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:06.062134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.075627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752970e-8858-438e-8fb0-78589b69eb30 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:06.080597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:06.081327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.081915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.082273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.082994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:06.084875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:06.123663 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1853/3722] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:06 2022] POST /identity/v3/projects => generated 360 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:06.127990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.137850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd928-b3dd-4dde-a9b6-5c1fec93d03e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:06.209113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:06.209997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.210131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.210352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.211088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:06.213162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:06.263097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1870/3723] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:06 2022] POST /identity/v3/users => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:38:06.264144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.276654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586610f4-f6cd-4d88-8a9f-ad1e2b9ce9bc tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:06.300407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:06.301074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.301360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.301647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.302535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:38:06.302847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:06.305273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e6095-3fdc-4363-98ef-18dbaf436408 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:06.348796 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1854/3724] 10.222.0.16 () {58 vars in 1157 bytes} [Wed Oct 5 02:38:06 2022] GET /identity/v3/users?domain_id=default => generated 8298 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:06.353176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.368212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2841d26-6ed3-42dd-aec1-1f23c4937160 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:06.374459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:06.375141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.375429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.375706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/users/bbb841a3d4fb4bbaa0706d31b3d74505` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.394525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:update_user(user_id=bbb841a3d4fb4bbaa0706d31b3d74505)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:06.396323 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:38:06.396323 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:38:06.396323 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:38:06.398133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:06.439000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bbb841a3d4fb4bbaa0706d31b3d74505'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.454265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invalidating the token cache because user bbb841a3d4fb4bbaa0706d31b3d74505 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:06.455409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.456106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.462673 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1871/3725] 10.222.0.16 () {60 vars in 1244 bytes} [Wed Oct 5 02:38:06 2022] PATCH /identity/v3/users/bbb841a3d4fb4bbaa0706d31b3d74505 => generated 485 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:38:06.466536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.466920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.467209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.487061 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.auth.plugins.core [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] User is disabled: bbb841a3d4fb4bbaa0706d31b3d74505: AssertionError: User is disabled: bbb841a3d4fb4bbaa0706d31b3d74505 Oct 05 02:38:06.499049 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.server.flask.application [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 05 02:38:06.500975 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1855/3726] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:06 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 37 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 05 02:38:06.504659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.508623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:06.530573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845fc9f-dd13-4b1d-a1a6-5f5875224569 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:06.540705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:06.541691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.541863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.542488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/users/bbb841a3d4fb4bbaa0706d31b3d74505` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.567069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbb841a3d4fb4bbaa0706d31b3d74505)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:06.569613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:06.638349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb841a3d4fb4bbaa0706d31b3d74505'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.662332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb841a3d4fb4bbaa0706d31b3d74505'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.663403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb841a3d4fb4bbaa0706d31b3d74505'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.674312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb841a3d4fb4bbaa0706d31b3d74505'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.675325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb841a3d4fb4bbaa0706d31b3d74505'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.683178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:06.700175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1872/3727] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:06 2022] DELETE /identity/v3/users/bbb841a3d4fb4bbaa0706d31b3d74505 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:06.701705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.704507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:06.788440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:06.822987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2076eb-e86a-41ce-97e3-c3840c33fe17 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:06.828695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:06.829369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:06.829654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:06.830605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/projects/7c5cf66b757b497683beb4b87ceb562c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:06.837115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c5cf66b757b497683beb4b87ceb562c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:06.837115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:06.912958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5cf66b757b497683beb4b87ceb562c', 'request_id': 'req-4523e83c-e82d-46b0-aec0-33fc9c7f8072'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.921232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5cf66b757b497683beb4b87ceb562c', 'request_id': 'req-4523e83c-e82d-46b0-aec0-33fc9c7f8072'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.930675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5cf66b757b497683beb4b87ceb562c', 'request_id': 'req-4523e83c-e82d-46b0-aec0-33fc9c7f8072'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.951761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] The token cache is being invalidate because project 7c5cf66b757b497683beb4b87ceb562c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:06.952221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.953224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:06.955908 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1856/3728] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:06 2022] DELETE /identity/v3/projects/7c5cf66b757b497683beb4b87ceb562c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:06.962165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:06.982960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b0d5f-b53d-4446-9093-983898a8ac91 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:07.075779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f441880f4a464766bd93af4080997298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:07.076685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:07.077094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:07.077555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:07.078317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:07.080556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-5dd0d4b9-7591-4e61-b6c3-7caf60ab569e tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Could not find domain: f19207b6bf04410c8bbe2d98d057de0e.: keystone.exception.DomainNotFound: Could not find domain: f19207b6bf04410c8bbe2d98d057de0e. Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f19207b6bf04410c8bbe2d98d057de0e. Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:38:07.098558 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:38:07.099791 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:38:07.104847 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:38:07.106099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:38:07.106099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:38:07.106099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f19207b6bf04410c8bbe2d98d057de0e. Oct 05 02:38:07.106099 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:38:07.106099 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1873/3729] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:06 2022] POST /identity/v3/users => generated 112 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:38:07.107313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:07.108327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:07.231924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523e83c-e82d-46b0-aec0-33fc9c7f8072 tempest-UsersNegativeTest-1980282701 tempest-UsersNegativeTest-1980282701-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:07.247579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:07.248308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:07.248599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:07.248873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] PATH_INFO: `/v3/users/15e27cc14919493fb6cc5a983594a830` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:07.251064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e27cc14919493fb6cc5a983594a830)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:07.253007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:07.392404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e27cc14919493fb6cc5a983594a830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:07.422974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e27cc14919493fb6cc5a983594a830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:07.424462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e27cc14919493fb6cc5a983594a830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:07.438698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e27cc14919493fb6cc5a983594a830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:07.439488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e27cc14919493fb6cc5a983594a830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:07.449364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:07.476835 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1857/3730] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:07 2022] DELETE /identity/v3/users/15e27cc14919493fb6cc5a983594a830 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:38:07.478408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:07.478866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:07.479939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:07.524491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:07.526225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:07.668058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1874/3731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:07.669139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:07.671192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:07.774591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1270cf-9492-4d34-8d75-260be8cbd1d4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:07.779410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:07.780519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:07.780648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:07.781058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:07.792711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:07.794530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:07.809439 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1858/3732] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:08.653756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:08.655412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:08.688383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b252650-ab43-4593-9ed0-d1af90a13753 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:08.714220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:08.717176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:08.719312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:08.719818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] PATH_INFO: `/v3/projects/bc7ce0879c1b4cbeb98c8ad08df9fd61` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:08.724869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7ce0879c1b4cbeb98c8ad08df9fd61)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:08.734730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:08.833727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7ce0879c1b4cbeb98c8ad08df9fd61', 'request_id': 'req-be4c00e3-2fa6-4726-befb-3a20a7790007'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:08.842422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7ce0879c1b4cbeb98c8ad08df9fd61', 'request_id': 'req-be4c00e3-2fa6-4726-befb-3a20a7790007'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:08.850072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7ce0879c1b4cbeb98c8ad08df9fd61', 'request_id': 'req-be4c00e3-2fa6-4726-befb-3a20a7790007'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:08.907534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] The token cache is being invalidate because project bc7ce0879c1b4cbeb98c8ad08df9fd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:08.908171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:08.909206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:08.911421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1875/3733] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:08 2022] DELETE /identity/v3/projects/bc7ce0879c1b4cbeb98c8ad08df9fd61 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:08.916137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:08.930617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fa15c-f28f-4bde-a654-792727c5edea service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:09.035654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:09.036683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:09.037003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:09.037280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] PATH_INFO: `/v3/users/f441880f4a464766bd93af4080997298` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:09.038459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f441880f4a464766bd93af4080997298)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:09.041954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:09.094357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f441880f4a464766bd93af4080997298'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.119168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f441880f4a464766bd93af4080997298'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.120113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f441880f4a464766bd93af4080997298'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.133433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f441880f4a464766bd93af4080997298'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.134141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5fb45cbc-3978-44b4-a438-c7dcf0ddf416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f441880f4a464766bd93af4080997298'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.148230 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1859/3734] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:08 2022] DELETE /identity/v3/users/f441880f4a464766bd93af4080997298 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:38:09.455683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:09.457570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:09.473414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c00e3-2fa6-4726-befb-3a20a7790007 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:09.495346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:09.553547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:09.554177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:09.555234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:09.556303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] PATH_INFO: `/v3/projects/b0cefcb2ae80486b8ab24a10aab9b17a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:09.557234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cefcb2ae80486b8ab24a10aab9b17a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:09.559240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:09.620913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'request_id': 'req-9ffed606-a402-405a-96df-ac53553f9db5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.629878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'request_id': 'req-9ffed606-a402-405a-96df-ac53553f9db5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.639557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cefcb2ae80486b8ab24a10aab9b17a', 'request_id': 'req-9ffed606-a402-405a-96df-ac53553f9db5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.656556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] The token cache is being invalidate because project b0cefcb2ae80486b8ab24a10aab9b17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:09.657250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.657851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ffed606-a402-405a-96df-ac53553f9db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:09.659475 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1876/3735] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:09 2022] DELETE /identity/v3/projects/b0cefcb2ae80486b8ab24a10aab9b17a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:38:09.667520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:09.667850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:09.668134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:09.689567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:09.690393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:09.729736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:09.814906 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1860/3736] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:09.825516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:09.825816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:09.826612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:09.866096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:09.869409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:09.880823 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1877/3737] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:09.885030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:09.897289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126230d-d540-4b6a-9434-0007479fa17a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:09.918668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:09.921842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:09.922135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:09.922422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:09.923108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:38:09.923684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:09.925559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:09.941770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1861/3738] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:38:09.947048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:09.959402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063dae4-e80d-4743-93bf-a9c76c83744e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:09.966915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:09.967534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:09.967826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:09.968124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:09.968755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:09.970844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:10.025046 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1878/3739] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:09 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:38:10.029113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:10.045099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05647b-ee0a-49f7-a5ba-fb0915c6b836 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:10.150757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:10.151467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:10.151972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:10.152323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:10.153070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:10.155052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:10.186992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1862/3740] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:10 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:10.192045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:10.206550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793161e-c853-4d3e-a065-415aded2e4b0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:10.215151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:10.220419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:10.221903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:10.223581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:10.228028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:10.236887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:10.270488 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1879/3741] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:10.279972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:10.298765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb84f-d686-4183-a896-a9445ae9ce45 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:10.312331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:10.313430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:10.313811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:10.316881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] PATH_INFO: `/v3/projects/062c2ca737964436b4742f60e0ad9b31/users/4d3436d9da5d4a15a11b46ff067c04f9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:10.361686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=062c2ca737964436b4742f60e0ad9b31, user_id=4d3436d9da5d4a15a11b46ff067c04f9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:10.365029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:10.389848 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1863/3742] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:10 2022] PUT /identity/v3/projects/062c2ca737964436b4742f60e0ad9b31/users/4d3436d9da5d4a15a11b46ff067c04f9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:10.394039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:10.406611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7342bf-eb14-4bb1-b719-25dc0e70475e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:10.563432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc315db-89a6-487d-a683-05bff1686983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:10.564113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc315db-89a6-487d-a683-05bff1686983 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:10.564396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc315db-89a6-487d-a683-05bff1686983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:10.565161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc315db-89a6-487d-a683-05bff1686983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:10.566044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc315db-89a6-487d-a683-05bff1686983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:10.567715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc315db-89a6-487d-a683-05bff1686983 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:10.624435 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1880/3743] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:10.631063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:10.645510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba600a7-8ba5-4aec-8560-26495cb1f86e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:10.665452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:10.666635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:10.667278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:10.667752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] PATH_INFO: `/v3/projects/062c2ca737964436b4742f60e0ad9b31/users/4d3436d9da5d4a15a11b46ff067c04f9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:10.671406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062c2ca737964436b4742f60e0ad9b31, user_id=4d3436d9da5d4a15a11b46ff067c04f9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:10.677850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:10.709656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1864/3744] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:10 2022] PUT /identity/v3/projects/062c2ca737964436b4742f60e0ad9b31/users/4d3436d9da5d4a15a11b46ff067c04f9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:10.719752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15329664-471d-47de-a46e-683436f13d9e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:10.720269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15329664-471d-47de-a46e-683436f13d9e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:10.720386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15329664-471d-47de-a46e-683436f13d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:10.729653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:10.775878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-15329664-471d-47de-a46e-683436f13d9e None None] MFA Rules not processed for user `4d3436d9da5d4a15a11b46ff067c04f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:10.777645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15329664-471d-47de-a46e-683436f13d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:10.885877 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1881/3745] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:10.890046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:11.071261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:11.082272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce910-ca95-478f-858d-50d650db31e7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:11.136766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:11.139966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:11.142909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:11.143952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:11.149636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:11.161669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:11.276393 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1865/3746] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:10 2022] POST /identity/v3/projects => generated 379 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:11.278187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15329664-471d-47de-a46e-683436f13d9e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:11.294587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15329664-471d-47de-a46e-683436f13d9e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:11.432045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:11.434107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:11.435034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:11.435550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:11.436186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:11.438928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:11.511283 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1882/3747] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:11 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:11.515451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:11.531833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0b58-aad1-4612-9f97-0b5a9a94d792 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:11.549354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:11.550260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:11.550726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:11.551322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:11.554013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:11.565750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:11.609188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:11.610149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1866/3748] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:11.626861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0e54-a21d-4281-bee2-a7e03b383247 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:11.652145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc06df-d199-4a5c-9211-949acefd1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:11.652888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc06df-d199-4a5c-9211-949acefd1741 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:11.656183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc06df-d199-4a5c-9211-949acefd1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:11.656183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc06df-d199-4a5c-9211-949acefd1741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:11.656183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc06df-d199-4a5c-9211-949acefd1741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:11.666825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc06df-d199-4a5c-9211-949acefd1741 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:11.705344 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1883/3749] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:38:11.709845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:11.729267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c184dc-f494-4c0c-803d-83d443324c14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:11.745494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:11.746478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:11.746991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:11.748157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] PATH_INFO: `/v3/projects/1d85c87a9a2b4da3b06fbc2b53ddf14e/users/a3a89a09b57c45e99ba773b9b99b8111/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:11.787151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d85c87a9a2b4da3b06fbc2b53ddf14e, user_id=a3a89a09b57c45e99ba773b9b99b8111, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:11.790821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:11.817023 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1867/3750] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:11 2022] PUT /identity/v3/projects/1d85c87a9a2b4da3b06fbc2b53ddf14e/users/a3a89a09b57c45e99ba773b9b99b8111/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:11.824890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:11.825418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:11.825501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:11.906124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] MFA Rules not processed for user `a3a89a09b57c45e99ba773b9b99b8111`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:11.907356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:12.025497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:12.041945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1884/3751] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:12.058725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:12.061435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:12.252213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520494a3-0772-4f28-85ea-3e36b2857f3a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:12.261835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6587a2-df4d-4adc-acdf-771c58042444 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:12.262503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6587a2-df4d-4adc-acdf-771c58042444 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:12.262885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6587a2-df4d-4adc-acdf-771c58042444 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:12.263067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6587a2-df4d-4adc-acdf-771c58042444 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:12.364066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6587a2-df4d-4adc-acdf-771c58042444 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:12.366867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6587a2-df4d-4adc-acdf-771c58042444 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:12.381002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1868/3752] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:13.368760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:13.588547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff2104-66db-459d-ae6b-24f7e3e9e2ad None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:13.596006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:13.597000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:13.597375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:13.597712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] PATH_INFO: `/v3/users/4d3436d9da5d4a15a11b46ff067c04f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:13.598938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3436d9da5d4a15a11b46ff067c04f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:13.601264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:13.672194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3436d9da5d4a15a11b46ff067c04f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:13.686106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3436d9da5d4a15a11b46ff067c04f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:13.686839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3436d9da5d4a15a11b46ff067c04f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:13.699867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3436d9da5d4a15a11b46ff067c04f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:13.700592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3436d9da5d4a15a11b46ff067c04f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:13.725939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1885/3753] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:13 2022] DELETE /identity/v3/users/4d3436d9da5d4a15a11b46ff067c04f9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:13.730447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:13.730983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:13.730983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:13.752252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:13.753685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:13.805098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:13.845715 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1869/3754] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:13.868589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:13.873905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:13.999781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee842a-828b-4031-894b-2b9f064499d0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:14.004767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:14.005466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:14.005813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:14.006066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:14.017976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:14.019174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:14.033081 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1886/3755] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:14.774288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:14.776022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:14.802443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8780b-07b6-404e-ac6e-148cf439d781 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:14.818204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:14.819047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:14.819513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:14.820005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] PATH_INFO: `/v3/projects/062c2ca737964436b4742f60e0ad9b31` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:14.823453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062c2ca737964436b4742f60e0ad9b31)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:14.825425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:14.842394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:14.844042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:14.870349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:14.903077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062c2ca737964436b4742f60e0ad9b31', 'request_id': 'req-ea502122-3f04-45e3-a3f8-909ba159f530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:14.909923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062c2ca737964436b4742f60e0ad9b31', 'request_id': 'req-ea502122-3f04-45e3-a3f8-909ba159f530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:14.917055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062c2ca737964436b4742f60e0ad9b31', 'request_id': 'req-ea502122-3f04-45e3-a3f8-909ba159f530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:14.934199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] The token cache is being invalidate because project 062c2ca737964436b4742f60e0ad9b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:14.934751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:14.935376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:14.937607 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1870/3756] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:14 2022] DELETE /identity/v3/projects/062c2ca737964436b4742f60e0ad9b31 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:14.941300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:14.942779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:14.949439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941a1d2-1b09-429e-b78c-3f209040d656 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:15.027309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea502122-3f04-45e3-a3f8-909ba159f530 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:15.032873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:15.033661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.034025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.034305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] PATH_INFO: `/v3/users/a3a89a09b57c45e99ba773b9b99b8111` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.035488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a89a09b57c45e99ba773b9b99b8111)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:15.037243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:15.037853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.038030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:15.039396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.039686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.042235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:15.098550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a89a09b57c45e99ba773b9b99b8111'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.115157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:15.115600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:15.116990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:15.117124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a89a09b57c45e99ba773b9b99b8111'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.118653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a89a09b57c45e99ba773b9b99b8111'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.128170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1887/3757] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:15.134583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a89a09b57c45e99ba773b9b99b8111'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.137376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88954455-57a3-4aa9-bfe3-31887a4aca5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a89a09b57c45e99ba773b9b99b8111'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.164528 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1871/3758] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:14 2022] DELETE /identity/v3/users/a3a89a09b57c45e99ba773b9b99b8111 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:38:15.468775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:15.482066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd0491-73d5-40b8-9fa7-e118d0a233be service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:15.562289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:15.579050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:15.579050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.580249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.581785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] PATH_INFO: `/v3/projects/1d85c87a9a2b4da3b06fbc2b53ddf14e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.583180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d85c87a9a2b4da3b06fbc2b53ddf14e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:15.586245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:15.680245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d85c87a9a2b4da3b06fbc2b53ddf14e', 'request_id': 'req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.690946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d85c87a9a2b4da3b06fbc2b53ddf14e', 'request_id': 'req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.697903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d85c87a9a2b4da3b06fbc2b53ddf14e', 'request_id': 'req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.710197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] The token cache is being invalidate because project 1d85c87a9a2b4da3b06fbc2b53ddf14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:15.711161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.711844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ba00cc93-5c31-4b28-a6d0-5ec737f8663d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:15.713417 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1888/3759] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:15 2022] DELETE /identity/v3/projects/1d85c87a9a2b4da3b06fbc2b53ddf14e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:15.718516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.719009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.719345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.741954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:15.743298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:15.807337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1872/3760] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:15.815361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.815657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.815940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.839938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:15.841262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:15.852549 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1889/3761] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:15.854928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:15.867347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec64b3-a81e-43f7-822b-27476bab9459 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:15.872329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:15.873039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.873312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.873948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.874580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:38:15.875195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:15.876504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:15.892942 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1873/3762] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:38:15.895592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:15.905923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ad143-52c9-44ae-a8d9-7fb79c153346 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:15.911560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:15.912180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:15.912464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:15.912741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:15.913878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:15.915932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:15.945942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1890/3763] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:15 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:38:15.950218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:15.961156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082626f-5624-4c13-8b79-8377ba7b31a8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:16.025364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:16.025985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:16.026272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:16.026549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:16.027195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:16.029143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:16.052246 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1874/3764] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:15 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:16.056603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:16.069702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8caa9-5aaf-4e8b-a78c-b50809956f39 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:16.075712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:16.076327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:16.076632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:16.076887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:16.077566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:16.079998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:16.094347 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1891/3765] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:16.098211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:16.109143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd1b40-dd32-43a0-b349-004985e3da6c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:16.113927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c07f01-1468-496f-ace5-65d4d6e29563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:16.114532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07f01-1468-496f-ace5-65d4d6e29563 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:16.114818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07f01-1468-496f-ace5-65d4d6e29563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:16.115098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c07f01-1468-496f-ace5-65d4d6e29563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:16.115776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c07f01-1468-496f-ace5-65d4d6e29563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:16.118052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c07f01-1468-496f-ace5-65d4d6e29563 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:16.134519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1875/3766] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:16.136194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:16.148381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6731-007d-43ae-8637-f9206a1de639 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:16.153204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:16.154049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:16.154146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:16.154394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] PATH_INFO: `/v3/projects/f9b0f0016bda4737956b75928ce4a494/users/8d8e854ba13b45bfb97d1cb635bf9129/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:16.177502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b0f0016bda4737956b75928ce4a494, user_id=8d8e854ba13b45bfb97d1cb635bf9129, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:16.181380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:16.202063 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1892/3767] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:16 2022] PUT /identity/v3/projects/f9b0f0016bda4737956b75928ce4a494/users/8d8e854ba13b45bfb97d1cb635bf9129/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:16.213318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:16.213705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:16.214001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:16.293667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] MFA Rules not processed for user `8d8e854ba13b45bfb97d1cb635bf9129`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:16.297620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:16.381138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:16.426614 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1876/3768] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:16.493243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:16.497005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:16.670021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460d1e-a67b-45b5-adb9-fc8d5439ccf7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:16.688049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:16.688693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:16.689004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:16.689284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:16.719976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:16.722327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:16.774127 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1893/3769] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:17.465963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:17.467839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:17.553256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79584-4990-4d99-8575-66089dc57be7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:17.561037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:17.561667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:17.562300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:17.562856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:17.566056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:17.579932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:17.582012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:17.594375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1877/3770] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:18.106810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:18.109657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:18.135680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:18.203975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d008f-c38e-4e13-9e27-c653e391d55b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:18.238819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:18.239486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:18.239867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:18.240159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] PATH_INFO: `/v3/users/9e5ffbccdbec4a4bb21a3e48c1f7beaf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:18.241825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5ffbccdbec4a4bb21a3e48c1f7beaf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:18.245114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:18.294850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:18.296302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:18.316924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081773-bfd4-43f3-8017-7be7572c4c85 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:18.328578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:18.329275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:18.329563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:18.329844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:18.331721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:18.343834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5ffbccdbec4a4bb21a3e48c1f7beaf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:18.360494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:18.363321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300df058-84a2-42c7-a593-c6a93c040ea7 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:18.377954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5ffbccdbec4a4bb21a3e48c1f7beaf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:18.379155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5ffbccdbec4a4bb21a3e48c1f7beaf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:18.394577 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1878/3771] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:38:18.398526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5ffbccdbec4a4bb21a3e48c1f7beaf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:18.399723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f12c2468-7eba-4c78-aa43-252f3f50636a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5ffbccdbec4a4bb21a3e48c1f7beaf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:18.455306 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1894/3772] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:18 2022] DELETE /identity/v3/users/9e5ffbccdbec4a4bb21a3e48c1f7beaf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:18.640153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5115b5-38b5-4c72-aace-c47f7f7bbc00 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:18.640763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5115b5-38b5-4c72-aace-c47f7f7bbc00 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:18.640763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5115b5-38b5-4c72-aace-c47f7f7bbc00 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:18.642313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1879/3773] 10.222.0.16 () {54 vars in 921 bytes} [Wed Oct 5 02:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:38:18.649555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:18.649869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:18.650127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:18.706148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:18.709518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:18.811651 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1895/3774] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 02:38:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:18.826403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5115b5-38b5-4c72-aace-c47f7f7bbc00 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:18.828849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df5115b5-38b5-4c72-aace-c47f7f7bbc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:18.909791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5115b5-38b5-4c72-aace-c47f7f7bbc00 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:18.914532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade9237-852d-4f7f-a0b9-88f8c6bc3bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:18.928930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade9237-852d-4f7f-a0b9-88f8c6bc3bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:18.930977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade9237-852d-4f7f-a0b9-88f8c6bc3bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:18.931471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade9237-852d-4f7f-a0b9-88f8c6bc3bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:18.945890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade9237-852d-4f7f-a0b9-88f8c6bc3bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:18.947366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade9237-852d-4f7f-a0b9-88f8c6bc3bcf service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:18.961418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1880/3775] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:19.463463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:19.465701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:19.496522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:19.591623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba0f81-d4ed-4712-a8c7-ba1e456286aa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:19.597986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:19.598719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:19.599679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:19.600057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] PATH_INFO: `/v3/projects/fc3fd0eb45ed4080af876031348f367a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:19.603099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3fd0eb45ed4080af876031348f367a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:19.606860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:19.691514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3fd0eb45ed4080af876031348f367a', 'request_id': 'req-68236edc-a652-4948-8876-87befa5044e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:19.701951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3fd0eb45ed4080af876031348f367a', 'request_id': 'req-68236edc-a652-4948-8876-87befa5044e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:19.714126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3fd0eb45ed4080af876031348f367a', 'request_id': 'req-68236edc-a652-4948-8876-87befa5044e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:19.734882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] The token cache is being invalidate because project fc3fd0eb45ed4080af876031348f367a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:19.735183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:19.735885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-68236edc-a652-4948-8876-87befa5044e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:19.741105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1896/3776] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:19 2022] DELETE /identity/v3/projects/fc3fd0eb45ed4080af876031348f367a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:19.743008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:19.743816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:19.744374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:19.769943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:19.771154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:19.834412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:19.853227 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1881/3777] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:19.862199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:19.862596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:19.862790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:19.896240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:19.898297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:19.911235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1897/3778] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:38:19.918865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:19.937921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73970b-f2f5-4610-81b4-38d28e2b23ab None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:19.953581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:19.954675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:19.955047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:19.955575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:19.956449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:38:19.959576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:19.963306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:19.998680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:20.004646 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1882/3779] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:38:20.012288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f9c9f-c11c-4614-8960-3a2b0289d250 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:20.021538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:20.022156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.022440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.024931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.025632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:20.032577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:20.089015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1898/3780] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:19 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:38:20.091180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:20.105019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb98c0-54da-4bb4-83ff-522d1a071095 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:20.269077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:20.269702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.269987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.270442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.271144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:20.275177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:20.314822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1883/3781] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:20 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:20.316218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:20.332077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b1cc-0270-4444-adeb-c1e733af0dd8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:20.347598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:20.348823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.349133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.351539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.352230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:20.362332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:20.395541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1899/3782] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:20.402049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:20.433907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d017-134b-4ab7-b08d-a4b41e28ce19 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:20.440914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea860-a481-4917-88af-9f4132175331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:20.441692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea860-a481-4917-88af-9f4132175331 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.442031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea860-a481-4917-88af-9f4132175331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.442319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea860-a481-4917-88af-9f4132175331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.443182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea860-a481-4917-88af-9f4132175331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:20.449178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ea860-a481-4917-88af-9f4132175331 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:20.471166 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1884/3783] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:20.475557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:20.490471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445537de-7d5e-49a3-a80e-8e5b96825a7d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:20.497363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582b74-cf7e-4291-8474-b8d8c993a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:20.498462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582b74-cf7e-4291-8474-b8d8c993a976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.498986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582b74-cf7e-4291-8474-b8d8c993a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.499652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582b74-cf7e-4291-8474-b8d8c993a976 admin admin] PATH_INFO: `/v3/projects/25750c409a734a778294ca66299d4616/users/172b2bb2caeb439f858fc7b0eb04f3bf/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.525591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6582b74-cf7e-4291-8474-b8d8c993a976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25750c409a734a778294ca66299d4616, user_id=172b2bb2caeb439f858fc7b0eb04f3bf, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:20.528371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6582b74-cf7e-4291-8474-b8d8c993a976 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:20.547069 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1900/3784] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:20 2022] PUT /identity/v3/projects/25750c409a734a778294ca66299d4616/users/172b2bb2caeb439f858fc7b0eb04f3bf/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:20.558083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.558377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.558655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.591604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] MFA Rules not processed for user `172b2bb2caeb439f858fc7b0eb04f3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:20.593197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:20.729531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1885/3785] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:20.731530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b2e-9771-4628-829a-e5f5f1fe84c1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:20.734272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b2e-9771-4628-829a-e5f5f1fe84c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:20.734272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b2e-9771-4628-829a-e5f5f1fe84c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:20.783706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5be92b2e-9771-4628-829a-e5f5f1fe84c1 None None] MFA Rules not processed for user `172b2bb2caeb439f858fc7b0eb04f3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:20.787293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5be92b2e-9771-4628-829a-e5f5f1fe84c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:20.802231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1901/3786] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:21.116182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:21.118066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:21.240351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:21.275988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3075bf-a103-4bef-b86c-c8ad89849e70 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:21.282271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:21.283262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:21.283749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:21.284200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:21.299067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:21.302007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:21.317484 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1886/3787] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:30.751761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:30.968127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8a4f-d6a6-4249-8eee-41140e848278 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:30.968378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8a4f-d6a6-4249-8eee-41140e848278 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:30.968986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8a4f-d6a6-4249-8eee-41140e848278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:31.006139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-715c8a4f-d6a6-4249-8eee-41140e848278 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:31.008148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-715c8a4f-d6a6-4249-8eee-41140e848278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:31.095797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1902/3788] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:31.187810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:31.189943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:31.273418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea92ab-2300-4f5c-bad5-7e711f8c6b2d service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:31.279410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:31.280035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:31.280317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:31.280588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:31.290723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:31.292530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:31.302330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1887/3789] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:38:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:41.087704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=25 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:41.299070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=43 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:41.334687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614834d-4628-4300-a348-ea14d8b7ace8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:41.335543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614834d-4628-4300-a348-ea14d8b7ace8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:41.335943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614834d-4628-4300-a348-ea14d8b7ace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:41.388462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d614834d-4628-4300-a348-ea14d8b7ace8 None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:41.390238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d614834d-4628-4300-a348-ea14d8b7ace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:41.589952 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1903/3790] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:47.270140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:47.435546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4df2-5dfd-4b76-a892-41a24471f140 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:47.447712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:47.449110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:47.449970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:47.450613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] PATH_INFO: `/v3/users/172b2bb2caeb439f858fc7b0eb04f3bf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:47.452116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=172b2bb2caeb439f858fc7b0eb04f3bf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:47.456163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:47.556843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '172b2bb2caeb439f858fc7b0eb04f3bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:47.584062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '172b2bb2caeb439f858fc7b0eb04f3bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:47.589443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '172b2bb2caeb439f858fc7b0eb04f3bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:47.618867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '172b2bb2caeb439f858fc7b0eb04f3bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:47.618867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '172b2bb2caeb439f858fc7b0eb04f3bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:47.645538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:47.646068 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1888/3791] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:38:47 2022] DELETE /identity/v3/users/172b2bb2caeb439f858fc7b0eb04f3bf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:47.646563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:47.647055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:47.671811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:47.673438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:47.805232 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1904/3792] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:47.815545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:47.817660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:47.910314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9730a-cf64-4732-b655-e786367119f2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:47.916610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860b07f-c4f1-4470-99a1-6cbbbe460e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:47.917334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860b07f-c4f1-4470-99a1-6cbbbe460e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:47.917659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860b07f-c4f1-4470-99a1-6cbbbe460e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:47.918005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860b07f-c4f1-4470-99a1-6cbbbe460e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:47.940541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860b07f-c4f1-4470-99a1-6cbbbe460e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:47.943348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860b07f-c4f1-4470-99a1-6cbbbe460e7d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:47.955948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1889/3793] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:48.467667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:48.472086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:48.525730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c9488-e628-4bc3-ac0e-6bc077161e9e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:48.541411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:48.542226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:48.542578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:48.543804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] PATH_INFO: `/v3/projects/25750c409a734a778294ca66299d4616` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:48.547010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25750c409a734a778294ca66299d4616)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:48.567100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:48.722022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25750c409a734a778294ca66299d4616', 'request_id': 'req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:48.742801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25750c409a734a778294ca66299d4616', 'request_id': 'req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:48.758376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25750c409a734a778294ca66299d4616', 'request_id': 'req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:48.787480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] The token cache is being invalidate because project 25750c409a734a778294ca66299d4616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:38:48.788739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:48.789642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de824ec8-6dfb-4e23-8b70-ee2da0ebf738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:38:48.791369 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1905/3794] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:38:48 2022] DELETE /identity/v3/projects/25750c409a734a778294ca66299d4616 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:48.802688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:48.803673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:48.804673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:48.855440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:48.856927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:48.883753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:49.000594 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1890/3795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:49.009287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.009575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.009855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.081787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:49.088325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:49.120282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1906/3796] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:49.121634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:49.141324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932b7f7-bd87-4310-bd7d-786b74ad43d9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:49.158556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:49.159196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.159482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.159760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.160425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:38:49.160732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:49.162389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:49.206611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1891/3797] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:38:49.217499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:49.238085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615c55c-5fa5-49df-a20a-92468082d602 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:49.257900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:49.268073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.268618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.269263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.270788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:49.277108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:49.357364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:49.372755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:49.380640 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1907/3798] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:38:49 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:49.389397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab226-c70b-4284-98aa-fa0fb44d8143 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:49.528039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:49.529251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.529251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.529691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.530441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:49.532502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:49.582749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1892/3799] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:38:49 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:38:49.588232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:49.603117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26bdb0-b140-47b9-ae3b-289ac5649023 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:49.617047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:49.617819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.618203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.618637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.619515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:49.621190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:49.680805 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1908/3800] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:49.684754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:49.704292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317adcd-c01e-49f7-a9d8-a7914d7fad47 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:49.731218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36cef7-4f35-4e39-9166-0c1a9f74ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:49.731776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36cef7-4f35-4e39-9166-0c1a9f74ec14 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.732058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36cef7-4f35-4e39-9166-0c1a9f74ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.732338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36cef7-4f35-4e39-9166-0c1a9f74ec14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.733029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36cef7-4f35-4e39-9166-0c1a9f74ec14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:49.734940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36cef7-4f35-4e39-9166-0c1a9f74ec14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:49.773002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1893/3801] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:38:49.773282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:49.798444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff8d3a-d7b0-4e4c-a0c4-765b7054b739 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:49.817088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:49.821404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.821736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.823246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] PATH_INFO: `/v3/projects/e7cf219232d24bd0adae8ac00e570010/users/b58f274a86f44352820c63496788f9db/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.865585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cf219232d24bd0adae8ac00e570010, user_id=b58f274a86f44352820c63496788f9db, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:49.876340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:49.920812 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1909/3802] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:38:49 2022] PUT /identity/v3/projects/e7cf219232d24bd0adae8ac00e570010/users/b58f274a86f44352820c63496788f9db/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:38:49.923001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d212477-3796-4527-9da2-6b36f0fe514a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:49.923455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d212477-3796-4527-9da2-6b36f0fe514a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:49.923571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d212477-3796-4527-9da2-6b36f0fe514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:49.994085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5d212477-3796-4527-9da2-6b36f0fe514a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:49.996552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5d212477-3796-4527-9da2-6b36f0fe514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:50.220846 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1894/3803] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:50.370677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:50.372622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:50.474894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e40df-84a6-42dc-92d6-6439ea402bc1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:50.487998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:50.488553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:50.488835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:50.489140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:50.513021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:50.514412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:50.535869 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1910/3804] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:38:52.531592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7bd33-57c2-4890-a16f-d9bcacfdb327 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:52.532462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7bd33-57c2-4890-a16f-d9bcacfdb327 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:52.532925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7bd33-57c2-4890-a16f-d9bcacfdb327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:52.557353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-07d7bd33-57c2-4890-a16f-d9bcacfdb327 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:52.558800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-07d7bd33-57c2-4890-a16f-d9bcacfdb327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:52.604458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:38:52.675119 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1895/3805] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:38:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:38:52.690208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:38:52.692381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:52.896129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aedfc-20bd-4712-b341-55c0804808a1 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:38:52.907979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2148823-6d04-475f-ad59-fc6baf1d2036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:38:52.908978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148823-6d04-475f-ad59-fc6baf1d2036 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:52.910671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148823-6d04-475f-ad59-fc6baf1d2036 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:52.911132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2148823-6d04-475f-ad59-fc6baf1d2036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:52.938035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2148823-6d04-475f-ad59-fc6baf1d2036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:38:52.941085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2148823-6d04-475f-ad59-fc6baf1d2036 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:38:52.958633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1911/3806] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:38:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:38:59.855598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:38:59.856119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:38:59.856119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:38:59.891979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] MFA Rules not processed for user `b58f274a86f44352820c63496788f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:38:59.893605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:38:59.996951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1896/3807] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:38:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:00.002523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:00.003030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:00.003146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:00.029272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] MFA Rules not processed for user `b58f274a86f44352820c63496788f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:00.030797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:00.045128 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1912/3808] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:00.897869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:00.900090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:01.035332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae42b3-b10a-44b4-8737-df97e50b78af None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:01.049670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a1784-240c-4229-9331-dca3900df669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:01.050716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1784-240c-4229-9331-dca3900df669 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:01.052382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1784-240c-4229-9331-dca3900df669 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:01.052847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a1784-240c-4229-9331-dca3900df669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:01.065518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1784-240c-4229-9331-dca3900df669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:01.068532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a1784-240c-4229-9331-dca3900df669 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:01.081707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1897/3809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:02.653246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:02.656519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:02.683951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19871bad-4655-4b5c-8c92-0c2e956ad604 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:02.690174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:02.691259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:02.691768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:02.692257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:02.696051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:02.724196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:02.726177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:02.743495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1913/3810] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:09.878816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07826-c44b-43b8-b22b-ff17bf86016e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:09.879363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07826-c44b-43b8-b22b-ff17bf86016e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:09.879363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07826-c44b-43b8-b22b-ff17bf86016e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:09.938072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54f07826-c44b-43b8-b22b-ff17bf86016e None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:09.939585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54f07826-c44b-43b8-b22b-ff17bf86016e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:09.966780 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1898/3811] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:39:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:09.981447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:10.017394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ee4c7-d1ca-4565-aa1f-589d7a5611e4 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:10.032128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:10.038627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:10.040649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:10.042278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:10.061474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:10.082264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:10.121424 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1914/3812] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:39:12.079432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe42cb-3174-45c6-9650-085c16af166f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:12.079929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe42cb-3174-45c6-9650-085c16af166f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:12.080014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe42cb-3174-45c6-9650-085c16af166f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:12.140155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5cbe42cb-3174-45c6-9650-085c16af166f None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:12.141639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5cbe42cb-3174-45c6-9650-085c16af166f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:12.165198 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1899/3813] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:12.177562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:12.198269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f85823-3360-4a2f-b9cb-d91bae3c8cfb service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:12.215088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:12.215975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:12.223145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:12.224438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:12.249965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:12.251864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:12.280310 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1915/3814] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:39:16.681954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:16.684796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:16.686174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:16.728847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] MFA Rules not processed for user `1b4b5f0c43074932a8963727adfee38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:16.731949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:16.829976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:16.970856 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1900/3815] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:20.999048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:21.000767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:21.013019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:21.026265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51bcc-3d37-4617-9df9-55a040e8a3a4 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:21.046528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:21.047334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:21.047726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:21.048108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] PATH_INFO: `/v3/users/2b8d63e7d05849e28cc54624771c60e1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:21.052300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8d63e7d05849e28cc54624771c60e1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:21.059363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:21.184228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8d63e7d05849e28cc54624771c60e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:21.222355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8d63e7d05849e28cc54624771c60e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:21.223533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8d63e7d05849e28cc54624771c60e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:21.244757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8d63e7d05849e28cc54624771c60e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:21.245772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d1636b7-060e-4069-9eb4-726283dfd56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8d63e7d05849e28cc54624771c60e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:21.278489 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1916/3816] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:39:20 2022] DELETE /identity/v3/users/2b8d63e7d05849e28cc54624771c60e1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:21.804956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:21.823525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b8c2c-961c-4c64-8351-c4a1cf7c0696 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:22.001959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:22.009389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:22.009999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:22.011351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] PATH_INFO: `/v3/projects/25663d1b71554c84998a009e9e41e7f0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:22.015738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25663d1b71554c84998a009e9e41e7f0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:22.023258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:22.201604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25663d1b71554c84998a009e9e41e7f0', 'request_id': 'req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:22.217889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25663d1b71554c84998a009e9e41e7f0', 'request_id': 'req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:22.236344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25663d1b71554c84998a009e9e41e7f0', 'request_id': 'req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:22.268342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] The token cache is being invalidate because project 25663d1b71554c84998a009e9e41e7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:39:22.269259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:22.270771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7cd5dabd-7261-42ea-a2fd-2277f39b8e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:22.280004 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1901/3817] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:21 2022] DELETE /identity/v3/projects/25663d1b71554c84998a009e9e41e7f0 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:22.281784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:22.282618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:22.283062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:22.329999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:22.332544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:22.497838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1917/3818] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:22.508454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:22.508745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:22.509106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:22.569723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:22.571331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:22.601993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:22.612858 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1902/3819] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:22.621027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947c729-a86f-4d96-b16d-e8dbddd389b0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:22.636217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:22.638062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:22.638504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:22.638932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:22.639752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:39:22.640321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:22.644089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:22.708810 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1918/3820] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:39:22.713022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:22.722786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b0c26-9b13-42ed-83a5-14caa7e0b3fa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:22.737769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:22.739105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:22.739105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:22.739105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:22.739617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:22.741842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:22.806508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1903/3821] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:39:22 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:39:22.808226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:22.824744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac2c75-1110-4c07-b619-f3e2b887a2b0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:23.001091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:23.002423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:23.002852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:23.003534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:23.004190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:23.007085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:23.018782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:23.047595 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1919/3822] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:39:22 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:39:23.048197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:23.064247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc9437-cc6e-4778-9b37-a9af81439c10 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:23.079056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:23.080089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:23.081461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:23.082956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:23.083863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:23.091093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:23.129106 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1904/3823] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:39:23.132724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:23.155703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ff211-5a4d-410b-808b-f3895b7229f1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:23.172568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eabfa-74c8-41d8-9dcb-bc8277e04857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:23.174246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eabfa-74c8-41d8-9dcb-bc8277e04857 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:23.174561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eabfa-74c8-41d8-9dcb-bc8277e04857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:23.175878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eabfa-74c8-41d8-9dcb-bc8277e04857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:23.177214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eabfa-74c8-41d8-9dcb-bc8277e04857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:23.180792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15eabfa-74c8-41d8-9dcb-bc8277e04857 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:23.227831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:23.230333 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1920/3824] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:39:23.251047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb231dc1-028a-40db-91d1-0b5b1964dae6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:23.262185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:23.262868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:23.263152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:23.265443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] PATH_INFO: `/v3/projects/9160b32c651a43f784bbe95a0e49059c/users/dbe30121065f4906b43c3c48888d88a8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:23.327686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9160b32c651a43f784bbe95a0e49059c, user_id=dbe30121065f4906b43c3c48888d88a8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:23.330974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:23.380358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1905/3825] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:39:23 2022] PUT /identity/v3/projects/9160b32c651a43f784bbe95a0e49059c/users/dbe30121065f4906b43c3c48888d88a8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:23.386966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d804a1-6d15-423f-a618-2f1f2d7e9fa1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:23.387559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d804a1-6d15-423f-a618-2f1f2d7e9fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:23.387735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d804a1-6d15-423f-a618-2f1f2d7e9fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:23.420402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f3d804a1-6d15-423f-a618-2f1f2d7e9fa1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:23.466104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f3d804a1-6d15-423f-a618-2f1f2d7e9fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:23.611274 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1921/3826] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:23.616639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:23.618506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:23.643257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:23.818195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1617-6ec9-4d1b-8c71-22f09a042fc7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:23.832403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:23.833544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:23.833911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:23.834720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:23.861195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:23.863072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:23.896115 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1906/3827] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:33.580506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:SELECT=34 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:33.821251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0feb-7601-487b-99fa-5f8a47a62b6e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:33.821760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0feb-7601-487b-99fa-5f8a47a62b6e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:33.827650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a0feb-7601-487b-99fa-5f8a47a62b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:33.870722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-086a0feb-7601-487b-99fa-5f8a47a62b6e None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:33.872176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-086a0feb-7601-487b-99fa-5f8a47a62b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:33.875109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=23 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:34.012529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1922/3828] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:39:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:34.023390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:34.025138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:34.162583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7142796-6344-4564-852a-c684176470c2 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:34.171125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa1545-befd-48dc-bb3e-dd0494a5bcff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:34.172925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1545-befd-48dc-bb3e-dd0494a5bcff service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:34.173667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1545-befd-48dc-bb3e-dd0494a5bcff service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:34.174113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa1545-befd-48dc-bb3e-dd0494a5bcff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:34.191299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa1545-befd-48dc-bb3e-dd0494a5bcff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:34.194046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa1545-befd-48dc-bb3e-dd0494a5bcff service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:34.206114 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1907/3829] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:39:35.278145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:35.279105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:35.279670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:35.343699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] MFA Rules not processed for user `dbe30121065f4906b43c3c48888d88a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:35.345136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:35.430746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1923/3830] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:35.444078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6206e-8b94-43bd-b4e0-318e72fac0d3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:35.444617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6206e-8b94-43bd-b4e0-318e72fac0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:35.444839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6206e-8b94-43bd-b4e0-318e72fac0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:35.487973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6bc6206e-8b94-43bd-b4e0-318e72fac0d3 None None] MFA Rules not processed for user `dbe30121065f4906b43c3c48888d88a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:35.489520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6bc6206e-8b94-43bd-b4e0-318e72fac0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:35.513456 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1908/3831] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:35.939809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:35.941618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:36.068356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00f1b4-3b51-4d38-b1fa-c367894b9369 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:36.075336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:36.076044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:36.076409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:36.076795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:36.087159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:36.088995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:36.105402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1924/3832] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:36.791861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:36.792383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:36.792383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:36.814534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:36.815936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:36.917985 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1909/3833] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:42.993152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:42.995349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:43.057648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:43.155137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04335739-8fd6-43e2-8ba8-0985a50a5396 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:43.160336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:43.166412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:43.167485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:43.168382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:43.171496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:43.190331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:43.192228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:43.207560 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1925/3834] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:44.201755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:44.221442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c3cc-ff97-47af-ae8c-0325e86c3f84 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:44.227204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:44.229538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:44.230026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:44.230865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:44.233158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:44.250946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:44.252965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:44.269108 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1910/3835] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:44.494757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:44.510564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6603a66-646e-447b-b18d-1bb30c0bfbc7 service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:44.521789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:44.523650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:44.524152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:44.525916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:44.533431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:44.600935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:44.602483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684300c-9c22-4793-9688-df1658ab8868 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:44.625019 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1926/3836] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:44.809995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:44.809995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:44.836713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044250-8540-4499-9d9a-61370f2af8c2 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:44.846506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:44.848340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:44.849452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:44.849903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] PATH_INFO: `/v3/users/2d55412129f24e90b1caa99b3aea8c61` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:44.853140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d55412129f24e90b1caa99b3aea8c61)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:44.859346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:45.009703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d55412129f24e90b1caa99b3aea8c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:45.046733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d55412129f24e90b1caa99b3aea8c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:45.047816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d55412129f24e90b1caa99b3aea8c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:45.056774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:45.071084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d55412129f24e90b1caa99b3aea8c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:45.071940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d55412129f24e90b1caa99b3aea8c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:45.099215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1911/3837] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:39:44 2022] DELETE /identity/v3/users/2d55412129f24e90b1caa99b3aea8c61 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:45.100985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:45.101287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:45.101570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:45.142603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:45.143864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:45.266990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1927/3838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:45.305646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:45.307827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:45.403352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dce89f-ecc7-4640-baf9-c9d8225523c9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:45.407957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3d671-4ae2-4122-ab44-92421683cea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:45.408690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3d671-4ae2-4122-ab44-92421683cea8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:45.409278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3d671-4ae2-4122-ab44-92421683cea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:45.409662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3d671-4ae2-4122-ab44-92421683cea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:45.453390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3d671-4ae2-4122-ab44-92421683cea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:45.456001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3d671-4ae2-4122-ab44-92421683cea8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:45.477946 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1912/3839] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:46.486777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:46.488358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:46.507170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c48f0-9a04-4729-9297-29b730a3460c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:46.515755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:46.517015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:46.517554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:46.518313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] PATH_INFO: `/v3/projects/be31ec89b1354d608d7de438f5cf519d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:46.520372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be31ec89b1354d608d7de438f5cf519d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:46.523896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:46.596707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be31ec89b1354d608d7de438f5cf519d', 'request_id': 'req-bd232d50-673f-4fff-a983-3afc42194763'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:46.610566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be31ec89b1354d608d7de438f5cf519d', 'request_id': 'req-bd232d50-673f-4fff-a983-3afc42194763'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:46.620042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be31ec89b1354d608d7de438f5cf519d', 'request_id': 'req-bd232d50-673f-4fff-a983-3afc42194763'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:46.632668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] The token cache is being invalidate because project be31ec89b1354d608d7de438f5cf519d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:39:46.632997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:46.633912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd232d50-673f-4fff-a983-3afc42194763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:46.635988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1928/3840] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:46 2022] DELETE /identity/v3/projects/be31ec89b1354d608d7de438f5cf519d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:46.641882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:46.642424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:46.642424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:46.673525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:46.674742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:46.796355 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1913/3841] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:46.822656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:46.823192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:46.827380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:46.856807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:46.859296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:46.871918 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1929/3842] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:46.873327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:46.885060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e7e98-f7c2-4254-a720-6cf122d5fe04 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:46.889653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:46.890303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:46.890560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:46.890834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:46.891651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:39:46.891958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:46.893678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:46.915708 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1914/3843] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:39:46.916625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:46.927706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46209168-d58a-4505-b4a0-1d922dbb652c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:46.933552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:46.934269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:46.934610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:46.934951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:46.935760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:46.937972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:46.972301 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1930/3844] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:39:46 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:39:46.978573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:46.993278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426916-2fbe-4fc9-91ed-f6ba08ba0d8f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:47.081420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:47.082159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:47.082384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:47.082668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:47.089169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:47.092078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:47.125658 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1915/3845] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:39:46 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:39:47.126816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:47.146530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:47.157333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564a6e6-412f-482f-a73b-b8411ff17d5e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:47.165101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:47.166098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:47.166596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:47.167126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:47.168002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:47.169981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:47.196929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1931/3846] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:39:47.198233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:47.213280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646cbfe8-042c-4837-908c-8ad50f1fbc7e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:47.223396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb577932-4850-462a-8e9b-43ae14d60357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:47.225227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb577932-4850-462a-8e9b-43ae14d60357 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:47.225227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb577932-4850-462a-8e9b-43ae14d60357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:47.227099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb577932-4850-462a-8e9b-43ae14d60357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:47.227890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb577932-4850-462a-8e9b-43ae14d60357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:47.233319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb577932-4850-462a-8e9b-43ae14d60357 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:47.236183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:47.273859 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1916/3847] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:39:47.278066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:47.302554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e47431-639d-4018-adfc-763c4472b4d5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:47.313261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:47.314128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:47.315660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:47.315963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] PATH_INFO: `/v3/projects/6fb5662ea05340d28c0cb6a096579815/users/bec99928d4b54fe6a6275a01b1267c83/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:47.341615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb5662ea05340d28c0cb6a096579815, user_id=bec99928d4b54fe6a6275a01b1267c83, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:47.345114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:47.372730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1932/3848] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:39:47 2022] PUT /identity/v3/projects/6fb5662ea05340d28c0cb6a096579815/users/bec99928d4b54fe6a6275a01b1267c83/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:47.374733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b0561-4edb-4a6e-923c-e5dc52042773 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:47.375287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b0561-4edb-4a6e-923c-e5dc52042773 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:47.375570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b0561-4edb-4a6e-923c-e5dc52042773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:47.408867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-545b0561-4edb-4a6e-923c-e5dc52042773 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:47.411004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-545b0561-4edb-4a6e-923c-e5dc52042773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:47.540010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1917/3849] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:39:47.563076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:47.566753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:47.669327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029874-6054-4514-963f-6ab75c1d5758 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:47.676546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:47.677385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:47.677910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:47.678350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:47.693314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:47.695383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:47.707531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1933/3850] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:39:52.925996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:52.926478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:52.926565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:52.956495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:52.957607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:53.026601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1918/3851] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:39:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:53.043834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:53.045487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:53.213175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7155-3ac3-4b2b-ac2d-b833e7e671fb service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:53.223779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:53.225798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:53.226308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:53.226796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:53.238014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:53.241133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:53.273826 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1934/3852] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:39:54.425164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:54.428123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:54.464122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20532a72-51cf-47c7-8849-edbab3f484a9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:54.482511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:54.483605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:54.489285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:54.492591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] PATH_INFO: `/v3/users/b58f274a86f44352820c63496788f9db` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:54.494280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58f274a86f44352820c63496788f9db)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:54.498704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:54.621498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58f274a86f44352820c63496788f9db'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:54.657712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58f274a86f44352820c63496788f9db'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:54.668242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58f274a86f44352820c63496788f9db'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:54.695674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58f274a86f44352820c63496788f9db'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:54.696605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8d3a5df7-8566-4c79-8e74-ec7390708bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58f274a86f44352820c63496788f9db'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:54.728610 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1919/3853] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:39:54 2022] DELETE /identity/v3/users/b58f274a86f44352820c63496788f9db => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:57.692009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:57.716634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926f18e-e1bf-4f59-a49f-77a1709e3965 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:57.875359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:57.876228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:57.876680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:57.877146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] PATH_INFO: `/v3/projects/e7cf219232d24bd0adae8ac00e570010` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:57.879150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cf219232d24bd0adae8ac00e570010)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:57.882464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:57.906610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:58.029463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cf219232d24bd0adae8ac00e570010', 'request_id': 'req-10eb1bef-71b3-4210-b31d-895eb590c38a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:58.057517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cf219232d24bd0adae8ac00e570010', 'request_id': 'req-10eb1bef-71b3-4210-b31d-895eb590c38a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:58.072544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cf219232d24bd0adae8ac00e570010', 'request_id': 'req-10eb1bef-71b3-4210-b31d-895eb590c38a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:58.100421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] The token cache is being invalidate because project e7cf219232d24bd0adae8ac00e570010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:39:58.100819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:58.101445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eb1bef-71b3-4210-b31d-895eb590c38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:39:58.109898 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1935/3854] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:39:57 2022] DELETE /identity/v3/projects/e7cf219232d24bd0adae8ac00e570010 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:58.112344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:58.112344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:58.112344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:58.165737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:58.166989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:58.179919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:39:58.296162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1920/3855] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:58.304522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:58.305101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:58.305574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:58.341922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:58.365316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:58.419278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:58.429724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9bc60-42e6-4613-8cb6-56993044f096 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:58.430077 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1936/3856] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:39:58.447994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:58.448935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:58.449456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:58.449963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:58.453728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:39:58.454324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:58.456170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:58.494525 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1921/3857] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:39:58.499028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:58.529686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793b98-82f5-48b9-9bbd-944b31e0f8a6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:58.577175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:58.579964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:58.580547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:58.584352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:58.584352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:58.591398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:58.701980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1937/3858] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:39:58 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:39:58.704974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:58.722849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f7456-0880-44d4-bc5f-8aefbfcf2129 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:59.001953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:59.003453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:59.003453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:59.003453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:59.004340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:59.010473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:59.107167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1922/3859] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:39:58 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:39:59.111521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:59.130769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6e396-acc6-43a7-89dd-9f038932dbb5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:59.181256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:59.181810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:59.182091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:59.182365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:59.183287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:59.202267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:59.247090 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1938/3860] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:39:59.248347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:59.265705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a33191-f187-46e2-b650-cb7055f3bc51 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:59.288475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97985f6f-da41-4a7d-a6bb-01225d5c3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:59.289459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985f6f-da41-4a7d-a6bb-01225d5c3a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:59.289924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985f6f-da41-4a7d-a6bb-01225d5c3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:59.290371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97985f6f-da41-4a7d-a6bb-01225d5c3a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:59.291215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985f6f-da41-4a7d-a6bb-01225d5c3a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:59.314407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97985f6f-da41-4a7d-a6bb-01225d5c3a79 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:59.339111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:59.354887 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1923/3861] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:39:59.367354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75414114-f24b-4d5a-9ac5-f623b1c447ca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:59.393744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:59.394627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:59.396086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:59.396577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] PATH_INFO: `/v3/projects/710bfe7468884ce496c4018a7ca415f9/users/63af9816dece4f44a46ce6b3660127e3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:59.451524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710bfe7468884ce496c4018a7ca415f9, user_id=63af9816dece4f44a46ce6b3660127e3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:59.454959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:39:59.509374 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1939/3862] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:39:59 2022] PUT /identity/v3/projects/710bfe7468884ce496c4018a7ca415f9/users/63af9816dece4f44a46ce6b3660127e3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:39:59.510597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:59.510898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:59.511179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:59.562238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:39:59.568872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:59.735894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1924/3863] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:39:59.803950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:39:59.807830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:39:59.936466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd849e-d422-4a15-b4b5-fe5fd77bb460 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:39:59.950271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4691e0e-c286-4632-9a92-08897b783ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:39:59.954371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4691e0e-c286-4632-9a92-08897b783ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:39:59.957843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4691e0e-c286-4632-9a92-08897b783ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:39:59.957843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4691e0e-c286-4632-9a92-08897b783ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:39:59.989203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4691e0e-c286-4632-9a92-08897b783ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:39:59.994661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4691e0e-c286-4632-9a92-08897b783ebf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:00.039331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1940/3864] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:02.065369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:02.067049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:02.151070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:02.306432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1935ded-6746-4ae7-96fa-a174f6259362 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:02.327614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:02.328280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:02.328556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:02.328833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:02.334889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:02.366394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:02.368096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:02.389138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1925/3865] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:09.029807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe749de6-831d-48a7-a1d4-1675e46b62bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:09.030331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe749de6-831d-48a7-a1d4-1675e46b62bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:09.030331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe749de6-831d-48a7-a1d4-1675e46b62bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:09.084511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fe749de6-831d-48a7-a1d4-1675e46b62bc None None] MFA Rules not processed for user `bec99928d4b54fe6a6275a01b1267c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:09.085807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fe749de6-831d-48a7-a1d4-1675e46b62bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:09.125952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:09.244935 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1941/3866] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:09.259781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:09.261652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:09.477090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f306073-56e0-427d-9752-aa8b72240c51 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:09.498462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:09.500649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:09.501584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:09.502696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:09.532128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:09.538982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:09.564178 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1926/3867] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:12.050314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:12.050823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:12.051109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:12.087854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] MFA Rules not processed for user `dbe30121065f4906b43c3c48888d88a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:12.089268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:12.230199 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1942/3868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:13.361030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:13.368025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:13.401687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674215cd-59de-4631-8f11-bf60315e67b8 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:13.417280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:13.417958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:13.418252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:13.418540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:13.426441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:13.504046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:13.509890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8691f9-a146-46f3-9416-afd876badee0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:13.529153 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1927/3869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:16.652699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:16.657103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:16.700481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200e39e-739d-4f58-8e07-04e95ce304ac None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:16.724190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:16.726955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:16.727731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:16.730709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:16.735413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:16.778577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:16.785601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25886841-9abb-4c47-8629-4f8b51e138fc service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:16.812534 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1943/3870] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:19.230797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:19.231267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:19.231386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:19.367173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] MFA Rules not processed for user `63af9816dece4f44a46ce6b3660127e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:19.369072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:19.502048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1928/3871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:20.055404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e767-8d6e-4ec8-8857-72c98b78d24b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:20.056304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e767-8d6e-4ec8-8857-72c98b78d24b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:20.056735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e767-8d6e-4ec8-8857-72c98b78d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:20.126207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c090e767-8d6e-4ec8-8857-72c98b78d24b None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:20.127498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c090e767-8d6e-4ec8-8857-72c98b78d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:20.267884 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1944/3872] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:22.574191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:22.575939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:22.600703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743979-13b0-42b3-86d8-ffa3fc4a8b29 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:22.611471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:22.613113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:22.613401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:22.613677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] PATH_INFO: `/v3/users/110ebcc38ef34dfea40fe14ab2ad1b3d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:22.617225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=110ebcc38ef34dfea40fe14ab2ad1b3d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:22.622684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:22.635128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:22.736576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110ebcc38ef34dfea40fe14ab2ad1b3d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:22.773376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110ebcc38ef34dfea40fe14ab2ad1b3d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:22.775952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110ebcc38ef34dfea40fe14ab2ad1b3d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:22.794512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110ebcc38ef34dfea40fe14ab2ad1b3d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:22.795733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110ebcc38ef34dfea40fe14ab2ad1b3d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:22.826958 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1929/3873] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:40:22 2022] DELETE /identity/v3/users/110ebcc38ef34dfea40fe14ab2ad1b3d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:23.677893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:23.678390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:23.678668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:23.701065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:23.703263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:23.786655 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1945/3874] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:40:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:23.812294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:23.814541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:23.881855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:23.884670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:23.893084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:24.023275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9072fb-41bc-421a-aa81-f9bbed340f2c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:24.037325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46711f58-bab7-42b4-994e-ed486c83b0ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:24.038847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711f58-bab7-42b4-994e-ed486c83b0ca service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:24.039904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711f58-bab7-42b4-994e-ed486c83b0ca service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:24.040930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46711f58-bab7-42b4-994e-ed486c83b0ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:24.055823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46711f58-bab7-42b4-994e-ed486c83b0ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:24.058021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46711f58-bab7-42b4-994e-ed486c83b0ca service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:24.070490 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1930/3875] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:40:24.150706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a18f-5301-483e-86fd-3ac526db8d7e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:24.190114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:24.190867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:24.191062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:24.191340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] PATH_INFO: `/v3/projects/d69def5e64d945428d420e737fecd987` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:24.193611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69def5e64d945428d420e737fecd987)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:24.199559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:24.439093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69def5e64d945428d420e737fecd987', 'request_id': 'req-1a796fa2-734d-4fda-8dcb-5c885a180389'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:24.455627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69def5e64d945428d420e737fecd987', 'request_id': 'req-1a796fa2-734d-4fda-8dcb-5c885a180389'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:24.497958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69def5e64d945428d420e737fecd987', 'request_id': 'req-1a796fa2-734d-4fda-8dcb-5c885a180389'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:24.541312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] The token cache is being invalidate because project d69def5e64d945428d420e737fecd987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:40:24.542180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:24.544309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a796fa2-734d-4fda-8dcb-5c885a180389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:24.552510 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1946/3876] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:40:23 2022] DELETE /identity/v3/projects/d69def5e64d945428d420e737fecd987 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:24.554663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:24.555003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:24.555288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:24.601874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:24.603119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:24.765547 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1931/3877] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:24.777510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:24.777510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:24.777510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:24.823690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:24.825242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:24.839739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1947/3878] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:24.844510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:24.876491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21911171-c467-43a5-affe-a1c943cd8a83 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:24.885167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:24.885812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:24.886435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:24.886724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:24.887455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:40:24.887772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:24.890253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:24.905128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:24.914787 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1932/3879] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:40:24.919237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:24.957355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbab9-e760-41b1-a07f-c340f70532a5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:24.997033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:24.998528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:24.999173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.002382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.003337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:25.012169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:25.086794 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1948/3880] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:40:24 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:40:25.091786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:25.105626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367a6b7-2590-4647-ad06-cd7506bb8186 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:25.193213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:25.194353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:25.194785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.195211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.196052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:25.198317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:25.258911 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1933/3881] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:40:25 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:25.262961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:25.279600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e20bd-e1e0-4919-876c-871725eb38f4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:25.287110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:25.288605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:25.289028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.289775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.290534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:25.292197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:25.306735 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1949/3882] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:40:25.310859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:25.326756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec458d-d2c7-44a3-8b33-37927da0b3e0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:25.338916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8acdb9-6271-4148-b5e8-6dc13f30700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:25.339794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8acdb9-6271-4148-b5e8-6dc13f30700e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:25.340179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8acdb9-6271-4148-b5e8-6dc13f30700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.340601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8acdb9-6271-4148-b5e8-6dc13f30700e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.341663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8acdb9-6271-4148-b5e8-6dc13f30700e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:25.343720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8acdb9-6271-4148-b5e8-6dc13f30700e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:25.358948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1934/3883] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:25.363029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:25.383212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0582d1-a13e-41bf-b86f-5fb1504f476e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:25.394469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:25.395757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:25.396268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.396782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] PATH_INFO: `/v3/projects/58c3c2b9910b4ba48a52cb1e3f1ef254/users/9211cfded73b4747b3cb63bcfb3c3ff8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.437162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c3c2b9910b4ba48a52cb1e3f1ef254, user_id=9211cfded73b4747b3cb63bcfb3c3ff8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:25.441128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:25.459059 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1950/3884] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:40:25 2022] PUT /identity/v3/projects/58c3c2b9910b4ba48a52cb1e3f1ef254/users/9211cfded73b4747b3cb63bcfb3c3ff8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:25.464033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:25.464324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.464963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.492530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:25.494258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:25.581367 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1935/3885] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:25.620001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:25.622471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:25.660202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:25.699724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ebcd9-bca3-4711-99e9-275551e665e5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:25.704327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:25.706249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:25.706538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:25.706822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:25.720249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:25.721829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:25.732706 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1951/3886] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:33.149826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:33.152095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:33.185417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c4ed-d3b0-453a-b4a1-2ccfed4ccb75 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:33.190326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:33.190967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:33.191250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:33.191528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] PATH_INFO: `/v3/users/63af9816dece4f44a46ce6b3660127e3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:33.205944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63af9816dece4f44a46ce6b3660127e3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:33.212434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:33.283361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63af9816dece4f44a46ce6b3660127e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:33.298700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63af9816dece4f44a46ce6b3660127e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:33.299630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63af9816dece4f44a46ce6b3660127e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:33.314323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63af9816dece4f44a46ce6b3660127e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:33.315525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d03e900-2eb6-4560-82ff-4d3e5f5dbfc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63af9816dece4f44a46ce6b3660127e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:33.320617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:33.337019 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1936/3887] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:40:33 2022] DELETE /identity/v3/users/63af9816dece4f44a46ce6b3660127e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:33.921310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:33.941470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236aef43-0b98-4fc1-9d1a-80868f3337bb service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.040125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.040875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.041419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.041909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] PATH_INFO: `/v3/projects/710bfe7468884ce496c4018a7ca415f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.043561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710bfe7468884ce496c4018a7ca415f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.045724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.122629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710bfe7468884ce496c4018a7ca415f9', 'request_id': 'req-c477b803-5674-4d66-9977-5e54671b4643'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:34.136186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710bfe7468884ce496c4018a7ca415f9', 'request_id': 'req-c477b803-5674-4d66-9977-5e54671b4643'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:34.148113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710bfe7468884ce496c4018a7ca415f9', 'request_id': 'req-c477b803-5674-4d66-9977-5e54671b4643'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:34.172697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] The token cache is being invalidate because project 710bfe7468884ce496c4018a7ca415f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:40:34.173026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:34.177460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c477b803-5674-4d66-9977-5e54671b4643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:34.183079 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1952/3888] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:40:33 2022] DELETE /identity/v3/projects/710bfe7468884ce496c4018a7ca415f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:34.184742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.185242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.185345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.209301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:34.210778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:34.287076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1937/3889] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:34.382488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.382849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.383048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.410313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:34.411822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:34.425934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:34.427199 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1953/3890] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:40:34.438616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3108-2c3b-4612-bb0b-463afac63956 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.444317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.445216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.445795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.446230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.447045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:40:34.447982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.449796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.464546 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1938/3891] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:40:34.469648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:34.484177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361638-9b4d-4287-b825-b7ed7ffa2d6b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.495838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.497471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.498684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.499253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.502251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.506273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.604843 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1954/3892] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:40:34 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:34.605200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:34.621289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd1980-d57e-4c9a-89be-6d69d89a923d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.727601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.730514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.731011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.731462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.732272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.735434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.794094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1939/3893] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:40:34 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:34.798453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:34.813448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eaab4-3d14-48fa-a6b4-e2632465d0a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.821413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.822672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.823072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.823421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.824235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.826934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.854534 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1955/3894] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:34.855807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:34.874104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465f148-ef05-476c-b834-66a788fa075d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.885675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4c98-ea81-4289-8a2a-52a5c994c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.886813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4c98-ea81-4289-8a2a-52a5c994c419 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.887405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4c98-ea81-4289-8a2a-52a5c994c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.888135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4c98-ea81-4289-8a2a-52a5c994c419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.889122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a4c98-ea81-4289-8a2a-52a5c994c419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.892304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a4c98-ea81-4289-8a2a-52a5c994c419 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.915642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:34.916938 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1940/3895] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:34.928512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1e772-7d17-4ee5-ad18-6eba885fbe40 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:34.944064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:34.944745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.945271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.945701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] PATH_INFO: `/v3/projects/b407480584dc43b3a1f7f10553402be0/users/140c65df4d98406eab2de00436cdb0e4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:34.966143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b407480584dc43b3a1f7f10553402be0, user_id=140c65df4d98406eab2de00436cdb0e4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:34.969166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:34.982827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:34.992505 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1956/3896] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:40:34 2022] PUT /identity/v3/projects/b407480584dc43b3a1f7f10553402be0/users/140c65df4d98406eab2de00436cdb0e4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:40:34.998168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4186f1-06d5-439e-8cd6-7281b5ee096e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:34.998508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4186f1-06d5-439e-8cd6-7281b5ee096e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:34.998791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4186f1-06d5-439e-8cd6-7281b5ee096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:35.026991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e4186f1-06d5-439e-8cd6-7281b5ee096e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:35.028362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e4186f1-06d5-439e-8cd6-7281b5ee096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:35.162927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:35.210780 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1941/3897] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:35.274627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:35.276673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:35.355135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670448a4-f3c9-48a0-9228-78ad31994eac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:35.359585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919394f-a17e-428a-9275-8417ad8ab4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:35.360280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919394f-a17e-428a-9275-8417ad8ab4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:35.361343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919394f-a17e-428a-9275-8417ad8ab4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:35.361343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919394f-a17e-428a-9275-8417ad8ab4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:35.373915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919394f-a17e-428a-9275-8417ad8ab4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:35.374934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919394f-a17e-428a-9275-8417ad8ab4a1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:35.388596 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1957/3898] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:36.396098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:36.396722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:36.396722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:36.441052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] MFA Rules not processed for user `140c65df4d98406eab2de00436cdb0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:36.444329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:36.569415 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1942/3899] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:36.570160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef37c69-5a70-4c80-9730-b9cfbcb6899a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:36.570609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef37c69-5a70-4c80-9730-b9cfbcb6899a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:36.570733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef37c69-5a70-4c80-9730-b9cfbcb6899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:36.601391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ef37c69-5a70-4c80-9730-b9cfbcb6899a None None] MFA Rules not processed for user `140c65df4d98406eab2de00436cdb0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:36.603527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ef37c69-5a70-4c80-9730-b9cfbcb6899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:36.620623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1958/3900] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:36.751947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:36.753764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:36.926255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3658a05-e752-4b82-9057-4c3153530caa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:36.965043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac6b46-e057-4c4f-8db5-e3a56e199800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:36.965676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6b46-e057-4c4f-8db5-e3a56e199800 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:36.965966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6b46-e057-4c4f-8db5-e3a56e199800 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:36.966242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6b46-e057-4c4f-8db5-e3a56e199800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:36.993795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6b46-e057-4c4f-8db5-e3a56e199800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:36.995513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6b46-e057-4c4f-8db5-e3a56e199800 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:37.016226 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1943/3901] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:40:38.325204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:38.325685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:38.325793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:38.415737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] MFA Rules not processed for user `9211cfded73b4747b3cb63bcfb3c3ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:38.417555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:38.574423 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1959/3902] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:38.575594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:38.576087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:38.576188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:38.613208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] MFA Rules not processed for user `9211cfded73b4747b3cb63bcfb3c3ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:38.615775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:38.628948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1944/3903] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:40:39.115951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:39.118980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:39.148040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a955-8230-47c9-9c18-8c133c165402 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:39.154354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:39.155067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:39.155426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:39.157622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:39.170098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:39.173230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:39.201136 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1960/3904] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:39.839032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:39.855512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd0cda-d890-4e3b-8fb3-918a8321cec4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:39.869637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:39.870303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:39.870582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:39.871062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] PATH_INFO: `/v3/users/140c65df4d98406eab2de00436cdb0e4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:39.872396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=140c65df4d98406eab2de00436cdb0e4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:39.874607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:39.987364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140c65df4d98406eab2de00436cdb0e4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.000825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:40.004253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140c65df4d98406eab2de00436cdb0e4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.006389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140c65df4d98406eab2de00436cdb0e4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.017372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140c65df4d98406eab2de00436cdb0e4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.018738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9e8e376f-58fc-4e82-84ab-3b53ad2a1a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140c65df4d98406eab2de00436cdb0e4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.061008 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1945/3905] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:40:39 2022] DELETE /identity/v3/users/140c65df4d98406eab2de00436cdb0e4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:40.531216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:40.543716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd72506-9717-45b3-ad4e-c844e12eaddc service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:40.608294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:40.608853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:40.609171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:40.609452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] PATH_INFO: `/v3/projects/b407480584dc43b3a1f7f10553402be0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:40.610625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b407480584dc43b3a1f7f10553402be0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:40.612822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:40.625855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:40.673776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b407480584dc43b3a1f7f10553402be0', 'request_id': 'req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.682556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b407480584dc43b3a1f7f10553402be0', 'request_id': 'req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.690511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b407480584dc43b3a1f7f10553402be0', 'request_id': 'req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.705832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] The token cache is being invalidate because project b407480584dc43b3a1f7f10553402be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:40:40.706222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.706814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e7edbc6b-be8b-465c-9ae1-ea9465c4b2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:40.712787 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1961/3906] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:40:40 2022] DELETE /identity/v3/projects/b407480584dc43b3a1f7f10553402be0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:40.714490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:40.714778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:40.715061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:40.737652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:40.738944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:40.804423 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1946/3907] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:40:40.813067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:40.813354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:40.813638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:40.839381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:40.840720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:40.851762 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1962/3908] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:40.856070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:40.866969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52356c-aa41-4ab8-9b9b-1a4fc3345f8a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:40.873377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:40.874115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:40.874502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:40.874880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:40.875649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:40:40.876056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:40.877804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:40.897217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:40.900989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1947/3909] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:40:40.906825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bc301-bc1c-486c-ab0c-7d4a2367a587 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:40.914453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:40.914763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:40.915195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:40.915984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:40.916486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:40.918901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:40.964425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1963/3910] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:40:40 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:40.971021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:40.984338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb0ad-bb11-49b3-80d2-566167c63370 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:41.053401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:41.054394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:41.054904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:41.055640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:41.056495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:41.059393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:41.104629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:41.104876 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1948/3911] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:40:40 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:41.116321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63e43a-c17c-46f3-87e7-01d021382a6f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:41.130352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:41.133180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:41.133580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:41.134110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:41.134938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:41.141306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:41.173770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:41.183710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1964/3912] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:41.199296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97403d6-ae90-407d-bb08-1db38712ca18 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:41.220873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619e8de-047d-499b-902f-6599f9441cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:41.224755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e8de-047d-499b-902f-6599f9441cff admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:41.225055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e8de-047d-499b-902f-6599f9441cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:41.225331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619e8de-047d-499b-902f-6599f9441cff admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:41.226139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619e8de-047d-499b-902f-6599f9441cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:41.227931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619e8de-047d-499b-902f-6599f9441cff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:41.282322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1949/3913] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:41.285296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:41.358540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0392ba4-46c1-4d0a-8a8f-5527073220f1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:41.385282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:41.389177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:41.390158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:41.395694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] PATH_INFO: `/v3/projects/20891ecf732b4c4597e3bfa0d96585a7/users/4c2aedcc40d84bb6a287c2bac019ed4e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:41.444333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20891ecf732b4c4597e3bfa0d96585a7, user_id=4c2aedcc40d84bb6a287c2bac019ed4e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:41.447399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:41.488303 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1965/3914] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:40:41 2022] PUT /identity/v3/projects/20891ecf732b4c4597e3bfa0d96585a7/users/4c2aedcc40d84bb6a287c2bac019ed4e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:41.490596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7a3a-9def-40d4-ae5a-81803f0db7bc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:41.490963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7a3a-9def-40d4-ae5a-81803f0db7bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:41.491320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7a3a-9def-40d4-ae5a-81803f0db7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:41.530092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-99df7a3a-9def-40d4-ae5a-81803f0db7bc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:41.531460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99df7a3a-9def-40d4-ae5a-81803f0db7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:41.688372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:41.791918 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1950/3915] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:41.835059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:41.842502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:41.958617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb071162-86b5-4a58-9e40-688ca5549366 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:41.971932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:41.972584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:41.973037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:41.974338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:41.995537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:41.997741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:42.034784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1966/3916] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:40:48.635318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:48.635826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:48.635927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:48.679904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] MFA Rules not processed for user `b86e3b7d1c9a4b2c8f2914beefa74cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:48.682317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:48.815939 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1951/3917] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:52.015754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:52.799558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:52.801166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:52.827855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e184c-ebbe-4871-a4cb-0ea59c963f2c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:52.833928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:52.835143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:52.835644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:52.836133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] PATH_INFO: `/v3/users/bec99928d4b54fe6a6275a01b1267c83` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:52.837537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec99928d4b54fe6a6275a01b1267c83)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:52.840063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:52.916425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec99928d4b54fe6a6275a01b1267c83'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:52.982624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec99928d4b54fe6a6275a01b1267c83'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:52.983767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec99928d4b54fe6a6275a01b1267c83'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:52.999616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec99928d4b54fe6a6275a01b1267c83'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.000842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51d52aad-1635-469c-ba68-104fe659db15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec99928d4b54fe6a6275a01b1267c83'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.022490 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1967/3918] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:40:52 2022] DELETE /identity/v3/users/bec99928d4b54fe6a6275a01b1267c83 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:53.673442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:53.688881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971bcd-e083-44f0-a0a7-288523fd5b05 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:53.854568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:53.855662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:53.856146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:53.856618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] PATH_INFO: `/v3/projects/6fb5662ea05340d28c0cb6a096579815` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:53.858034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb5662ea05340d28c0cb6a096579815)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:53.860235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:53.937881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb5662ea05340d28c0cb6a096579815', 'request_id': 'req-9ce9067b-7de5-47dc-962a-3ef954e678b3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.946325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb5662ea05340d28c0cb6a096579815', 'request_id': 'req-9ce9067b-7de5-47dc-962a-3ef954e678b3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.955860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb5662ea05340d28c0cb6a096579815', 'request_id': 'req-9ce9067b-7de5-47dc-962a-3ef954e678b3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.978107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] The token cache is being invalidate because project 6fb5662ea05340d28c0cb6a096579815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:40:53.978586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.979689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9ce9067b-7de5-47dc-962a-3ef954e678b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:40:53.987808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1952/3919] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:40:53 2022] DELETE /identity/v3/projects/6fb5662ea05340d28c0cb6a096579815 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:53.989675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:53.989967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:53.990431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.024720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:54.026005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:54.111115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1968/3920] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:54.119690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.120014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.120860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.169780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:54.171646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:54.184502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1953/3921] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:54.188893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.200934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9d358-0929-4259-9ef0-8032eb14c7be None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:54.208141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:54.209411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.209990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.210506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.211663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:40:54.212586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:54.214625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:54.236635 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1969/3922] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:40:54.237640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.247632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e82df-0ed0-4c67-9d7e-883a612d5626 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:54.256225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:54.257362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.257903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.258517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.260075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:54.263008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:54.279688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:54.331005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.337199 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1954/3923] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:40:54 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:54.371693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11283223-7973-433c-a07d-d5ead9fef707 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:54.491217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:54.492078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.492377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.492729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.493555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:54.496755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:54.513110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:40:54.570591 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1970/3924] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:40:54 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:40:54.575352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.588728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f46bd-4973-4523-9188-91816e384535 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:54.594694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:54.595334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.595610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.596171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.597280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:54.600427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:54.620050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.620381 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1955/3925] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:54.636078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6370ae-492d-48b7-bf90-f93ddcca69fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:54.648994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4f85a-d118-4d68-8c3d-af46549794d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:54.649509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f85a-d118-4d68-8c3d-af46549794d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.649792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f85a-d118-4d68-8c3d-af46549794d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.650068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f85a-d118-4d68-8c3d-af46549794d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.650732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4f85a-d118-4d68-8c3d-af46549794d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:54.652387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4f85a-d118-4d68-8c3d-af46549794d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:54.682334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.683546 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1971/3926] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:40:54.693990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468621c-c331-46cc-b6e7-7175c67b59d8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:54.700983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:54.702262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.702262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.702511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] PATH_INFO: `/v3/projects/2ced783ca2614e7996ccac3bc9ad97c7/users/6746153a53d94c4a9b8d1167a7fa7c4a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.723461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ced783ca2614e7996ccac3bc9ad97c7, user_id=6746153a53d94c4a9b8d1167a7fa7c4a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:54.726282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:54.761453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1956/3927] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:40:54 2022] PUT /identity/v3/projects/2ced783ca2614e7996ccac3bc9ad97c7/users/6746153a53d94c4a9b8d1167a7fa7c4a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:40:54.763373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32769c8-313d-4a64-a91b-c0a7df8fd12a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:54.763902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32769c8-313d-4a64-a91b-c0a7df8fd12a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:54.764402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32769c8-313d-4a64-a91b-c0a7df8fd12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:54.795073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e32769c8-313d-4a64-a91b-c0a7df8fd12a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:54.797014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e32769c8-313d-4a64-a91b-c0a7df8fd12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:54.898934 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1972/3928] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:54.929770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:54.932486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:55.052426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c74ba4-3f1e-4cf8-803e-518fbd951161 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:55.061658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:55.062289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:55.062573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:55.062852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:55.105492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:55.107041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:55.128470 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1957/3929] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:40:57.744257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615985a4-49ec-42aa-96c7-7fee845fd890 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:57.744785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615985a4-49ec-42aa-96c7-7fee845fd890 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:57.745136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615985a4-49ec-42aa-96c7-7fee845fd890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:57.811098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-615985a4-49ec-42aa-96c7-7fee845fd890 None None] MFA Rules not processed for user `4c2aedcc40d84bb6a287c2bac019ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:40:57.816054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-615985a4-49ec-42aa-96c7-7fee845fd890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:57.981620 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1973/3930] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:40:57.997521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:40:57.998977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:40:58.089273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d586-4e3f-4130-ae3d-3022be819b2c service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:40:58.097011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d89b93-4fa5-471d-80d1-09520fac66d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:40:58.097925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89b93-4fa5-471d-80d1-09520fac66d9 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:40:58.098365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89b93-4fa5-471d-80d1-09520fac66d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:40:58.098840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89b93-4fa5-471d-80d1-09520fac66d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:40:58.109337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89b93-4fa5-471d-80d1-09520fac66d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:40:58.111238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89b93-4fa5-471d-80d1-09520fac66d9 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:40:58.125338 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1958/3931] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:40:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:02.733598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:02.734139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:02.734139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:02.767371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] MFA Rules not processed for user `4c2aedcc40d84bb6a287c2bac019ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:02.769342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:02.787866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1974/3932] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:04.407118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:04.407705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:04.407705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:04.504881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] MFA Rules not processed for user `6746153a53d94c4a9b8d1167a7fa7c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:04.505557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:04.579375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:04.696441 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1959/3933] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:05.709177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:05.711130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:05.752066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9191c9-7dd4-4f7b-990e-a86c280292cf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:05.768603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:05.770957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:05.775751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:05.776604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:05.803730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:05.810947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:05.844298 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1975/3934] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:07.121700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:07.123171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:07.153946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863ab33-b293-40c3-9829-2fc91621cf6f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:07.165784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:07.166500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:07.166853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:07.167137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] PATH_INFO: `/v3/users/dbe30121065f4906b43c3c48888d88a8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:07.168798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe30121065f4906b43c3c48888d88a8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:07.171418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:07.293205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe30121065f4906b43c3c48888d88a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:07.351403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe30121065f4906b43c3c48888d88a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:07.352599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe30121065f4906b43c3c48888d88a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:07.396356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe30121065f4906b43c3c48888d88a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:07.399571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-977982b5-825f-44b3-bcbb-157d69450b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe30121065f4906b43c3c48888d88a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:07.463625 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1960/3935] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:41:07 2022] DELETE /identity/v3/users/dbe30121065f4906b43c3c48888d88a8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:41:08.944325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:08.959273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c077a3f-efb6-499e-a0ab-f8cef8e0869f service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:09.030862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:09.053017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:09.054092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:09.054616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:09.055198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] PATH_INFO: `/v3/projects/9160b32c651a43f784bbe95a0e49059c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:09.058597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9160b32c651a43f784bbe95a0e49059c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:09.064764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:09.164516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9160b32c651a43f784bbe95a0e49059c', 'request_id': 'req-79f66b36-8edf-4512-b33b-3adaed7f4085'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:09.186730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9160b32c651a43f784bbe95a0e49059c', 'request_id': 'req-79f66b36-8edf-4512-b33b-3adaed7f4085'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:09.206793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9160b32c651a43f784bbe95a0e49059c', 'request_id': 'req-79f66b36-8edf-4512-b33b-3adaed7f4085'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:09.224637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] The token cache is being invalidate because project 9160b32c651a43f784bbe95a0e49059c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:41:09.225833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:09.226730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-79f66b36-8edf-4512-b33b-3adaed7f4085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:09.233244 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1976/3936] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:41:08 2022] DELETE /identity/v3/projects/9160b32c651a43f784bbe95a0e49059c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:09.235798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:09.236261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:09.237065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:09.282588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:09.284201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:09.520666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1961/3937] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:09.528764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:09.529381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:09.529381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:09.567468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:09.569223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:09.580095 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1977/3938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:09.585755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:09.613251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84e67-f949-452b-88f9-631ab5cd7581 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:09.620840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:09.621491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:09.621982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:09.622441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:09.624036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:41:09.624776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:09.626628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:09.649004 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1962/3939] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:41:09.650938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:09.669822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54664-1b62-4954-ac4c-82ab07f79d3f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:09.678642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:09.679293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:09.679582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:09.680073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:09.680851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:09.683806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:09.730996 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1978/3940] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:41:09 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:41:09.734991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:09.748213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3739d-82dd-40b8-974c-06c7fe3ed222 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:09.835557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:09.930422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:09.931169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:09.931551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:09.931927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:09.932669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:09.934827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:10.004839 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1963/3941] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:41:09 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:41:10.006773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:10.028395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126af3a-b595-4d56-b025-9164b70be32d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:10.034171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:10.034850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:10.035215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:10.035498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:10.036353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:10.039398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:10.062703 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1979/3942] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:41:10.066281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:10.099086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c39787-bc6b-41cb-b5c2-0b10d638fc62 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:10.114711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365736-58f0-47dd-82f4-5ca89f38d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:10.116168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365736-58f0-47dd-82f4-5ca89f38d19b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:10.116551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365736-58f0-47dd-82f4-5ca89f38d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:10.116947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365736-58f0-47dd-82f4-5ca89f38d19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:10.117740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365736-58f0-47dd-82f4-5ca89f38d19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:10.123568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365736-58f0-47dd-82f4-5ca89f38d19b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:10.148057 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1964/3943] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:41:10.152317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:10.167776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc7350-55d8-4d23-8c61-a4d59c3289cf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:10.181660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:10.182660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:10.183112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:10.183545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] PATH_INFO: `/v3/projects/1ff63adf9571439d8f8bf9b0fa6c63f9/users/728544ca5e164540b3c5395534542955/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:10.217808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff63adf9571439d8f8bf9b0fa6c63f9, user_id=728544ca5e164540b3c5395534542955, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:10.220713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:10.247406 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1980/3944] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:41:10 2022] PUT /identity/v3/projects/1ff63adf9571439d8f8bf9b0fa6c63f9/users/728544ca5e164540b3c5395534542955/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:10.252525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c733e-e0ea-4e19-9ebd-016137d54563 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:10.253021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c733e-e0ea-4e19-9ebd-016137d54563 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:10.253304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c733e-e0ea-4e19-9ebd-016137d54563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:10.293602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f48c733e-e0ea-4e19-9ebd-016137d54563 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:10.294954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f48c733e-e0ea-4e19-9ebd-016137d54563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:10.436617 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1965/3945] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:10.458658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:10.461018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:10.618444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dde113-0f67-4e17-b627-7076cdf9ad58 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:10.631666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5765-3079-47a6-9706-dfd290bea54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:10.632304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5765-3079-47a6-9706-dfd290bea54a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:10.632591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5765-3079-47a6-9706-dfd290bea54a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:10.632866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5765-3079-47a6-9706-dfd290bea54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:10.652317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd5765-3079-47a6-9706-dfd290bea54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:10.654065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd5765-3079-47a6-9706-dfd290bea54a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:10.675860 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1981/3946] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:41:15.414664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acf697-21c5-421f-97cd-4146e53d9921 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:15.415141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acf697-21c5-421f-97cd-4146e53d9921 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:15.417576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acf697-21c5-421f-97cd-4146e53d9921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:15.446658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-19acf697-21c5-421f-97cd-4146e53d9921 None None] MFA Rules not processed for user `1b4b5f0c43074932a8963727adfee38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:15.448159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19acf697-21c5-421f-97cd-4146e53d9921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:15.524676 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1966/3947] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:16.716613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:16.717245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:16.717655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:16.778593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] MFA Rules not processed for user `6746153a53d94c4a9b8d1167a7fa7c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:16.779881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:16.816975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:16.950076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1982/3948] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:22.883091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4947-941d-415f-8abb-55b3be501ad9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:22.883579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4947-941d-415f-8abb-55b3be501ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:22.883687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4947-941d-415f-8abb-55b3be501ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:22.963929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-276f4947-941d-415f-8abb-55b3be501ad9 None None] MFA Rules not processed for user `728544ca5e164540b3c5395534542955`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:22.966540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-276f4947-941d-415f-8abb-55b3be501ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:23.094919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:23.146538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1967/3949] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:23.154421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:23.156585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:23.364217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69809-54b3-4c3c-a7b5-062a8fd21853 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:23.378247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:23.379614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:23.379900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:23.380175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:23.404563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:23.408619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:23.427756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1983/3950] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:29.203639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16742638-e7fd-413f-be5d-4423f0abd463 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:29.204232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16742638-e7fd-413f-be5d-4423f0abd463 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:29.204232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16742638-e7fd-413f-be5d-4423f0abd463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:29.231584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-16742638-e7fd-413f-be5d-4423f0abd463 None None] MFA Rules not processed for user `728544ca5e164540b3c5395534542955`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:29.232803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-16742638-e7fd-413f-be5d-4423f0abd463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:29.267160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1968/3951] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:33.419651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=51 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:39.225096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=9 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:48.414269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:48.424376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:48.461657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3bdc-851b-4d28-b255-1961eff59558 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:48.469415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:48.471437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:48.472007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:48.473011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] PATH_INFO: `/v3/users/8d8e854ba13b45bfb97d1cb635bf9129` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:48.475618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8e854ba13b45bfb97d1cb635bf9129)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:48.477965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:48.569548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8e854ba13b45bfb97d1cb635bf9129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:48.604561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8e854ba13b45bfb97d1cb635bf9129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:48.606839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8e854ba13b45bfb97d1cb635bf9129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:48.627696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8e854ba13b45bfb97d1cb635bf9129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:48.629735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8e854ba13b45bfb97d1cb635bf9129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:48.670003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1984/3952] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:41:48 2022] DELETE /identity/v3/users/8d8e854ba13b45bfb97d1cb635bf9129 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:48.672502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:48.674621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:48.675429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:48.729061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:48.730319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:48.890418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1969/3953] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:48.901586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:48.903425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:48.987073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74c068-c60a-4d34-a83d-d102afd06c5f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:48.992066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348d3d-c34d-4ee3-8a48-8c85e223e93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:48.993034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348d3d-c34d-4ee3-8a48-8c85e223e93c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:48.993563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348d3d-c34d-4ee3-8a48-8c85e223e93c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:48.993995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348d3d-c34d-4ee3-8a48-8c85e223e93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.005696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348d3d-c34d-4ee3-8a48-8c85e223e93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:49.007830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0348d3d-c34d-4ee3-8a48-8c85e223e93c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:49.020341 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1985/3954] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:49.292936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:49.295403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:49.317024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde0651-f8ee-46e8-866b-4f88177a8318 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:49.323494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:49.324279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:49.324664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:49.325089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] PATH_INFO: `/v3/projects/f9b0f0016bda4737956b75928ce4a494` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.326337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b0f0016bda4737956b75928ce4a494)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:49.328539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:49.402722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b0f0016bda4737956b75928ce4a494', 'request_id': 'req-3465517f-b844-438f-80d3-d19b9aab5058'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:49.418642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b0f0016bda4737956b75928ce4a494', 'request_id': 'req-3465517f-b844-438f-80d3-d19b9aab5058'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:49.427686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b0f0016bda4737956b75928ce4a494', 'request_id': 'req-3465517f-b844-438f-80d3-d19b9aab5058'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:49.447896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] The token cache is being invalidate because project f9b0f0016bda4737956b75928ce4a494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:41:49.448247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:49.449535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3465517f-b844-438f-80d3-d19b9aab5058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:49.451666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1970/3955] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:41:49 2022] DELETE /identity/v3/projects/f9b0f0016bda4737956b75928ce4a494 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:49.456877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:49.457869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:49.458297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.491357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:49.493504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:49.609388 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1986/3956] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:49.618620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:49.619003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:49.619359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.647389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:49.648871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:49.681420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:49.694501 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1971/3957] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:49.697813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b35e-05b2-4041-89aa-ad94e74b2008 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:49.703173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:49.704002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:49.704442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:49.704994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.706105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:41:49.707059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:49.708833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:49.718794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:49.724918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:49.736958 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1987/3958] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:41:49.747104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:49.761993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:49.782509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b9e66-7bc1-4f17-9d7c-1bf528f32be3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:49.796032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:49.796799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:49.797672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:49.798055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.798954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:49.814755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:49.838982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c44f-262a-4491-84c4-6a036d4b9a37 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:49.843483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:49.846159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:49.846658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:49.847570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:49.855118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:49.928188 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1988/3959] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:41:49 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:41:49.931969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:49.935217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:50.026537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.031706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.043164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67639160-1ef0-414e-a7cd-30533e6270b0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:50.051457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:50.052370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.053155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.053874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.055502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.064400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.069426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1972/3960] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:50.100480 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1989/3961] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:41:49 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:41:50.105645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:50.124895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce1e0c-fed3-49bc-a644-52c526fb351b service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:50.132942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:50.133607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.134021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.134390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.135212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.137380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.151611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1973/3962] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:41:50.155973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:50.185866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eac66f-c5c6-4b72-95a5-ee9671d7493a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:50.191458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b6981-9f05-4dde-94a8-c3b61f1cb4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:50.192403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6981-9f05-4dde-94a8-c3b61f1cb4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.192779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6981-9f05-4dde-94a8-c3b61f1cb4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.193298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b6981-9f05-4dde-94a8-c3b61f1cb4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.194207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6981-9f05-4dde-94a8-c3b61f1cb4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.195890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b6981-9f05-4dde-94a8-c3b61f1cb4ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.256499 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1990/3963] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:41:50.258840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:50.273338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4db327-b1bc-46ce-ac08-745f1e5fcddf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:50.283836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:50.287053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.290520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.290891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] PATH_INFO: `/v3/projects/000a0af2510042e3be012a235028f3f9/users/f92f113cd42443e2a6e61f89caaf9a75/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.341137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000a0af2510042e3be012a235028f3f9, user_id=f92f113cd42443e2a6e61f89caaf9a75, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.349563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.379733 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1974/3964] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:41:50 2022] PUT /identity/v3/projects/000a0af2510042e3be012a235028f3f9/users/f92f113cd42443e2a6e61f89caaf9a75/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:50.392732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.393137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.393918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.437361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] MFA Rules not processed for user `f92f113cd42443e2a6e61f89caaf9a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:50.439495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:50.576996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:50.577646 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1991/3965] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:50.610454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:50.681928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9b2db-30de-4a5b-b321-a3600be4b034 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:50.687269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:50.689341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.689694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.690342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.693399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:50.729318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:50.746645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ca0a-b64b-4247-b2f2-2b26e1b0962e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:50.752544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:50.754227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:50.754612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:50.754981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:50.766789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.768347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.783173 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1992/3966] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:50.808676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:50.810280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f80e-f7a7-4e24-b43c-3ab21d925c75 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:50.826888 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1975/3967] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:51.714325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:51.858723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4d50-9749-4a23-b7b6-2826c77cb6bc service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:51.874082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:51.874725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:51.875010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:51.875290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] PATH_INFO: `/v3/users/f92f113cd42443e2a6e61f89caaf9a75` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:51.877545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92f113cd42443e2a6e61f89caaf9a75)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:51.880360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:51.975906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92f113cd42443e2a6e61f89caaf9a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:52.034384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92f113cd42443e2a6e61f89caaf9a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:52.039199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92f113cd42443e2a6e61f89caaf9a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:52.068227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92f113cd42443e2a6e61f89caaf9a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:52.069190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92f113cd42443e2a6e61f89caaf9a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:52.102195 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1993/3968] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:41:51 2022] DELETE /identity/v3/users/f92f113cd42443e2a6e61f89caaf9a75 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:52.106641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:52.107139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:52.107265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:52.149408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:52.150622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:52.186078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:52.265089 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1976/3969] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:41:52.267349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:52.269965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:52.388023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abad14-7342-4cf1-9ba1-54a2380bd1aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:52.395499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a780cd-0782-4eca-a209-1a1eb15c4941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:52.395499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a780cd-0782-4eca-a209-1a1eb15c4941 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:52.395499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a780cd-0782-4eca-a209-1a1eb15c4941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:52.395499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a780cd-0782-4eca-a209-1a1eb15c4941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:52.408696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a780cd-0782-4eca-a209-1a1eb15c4941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:52.411180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a780cd-0782-4eca-a209-1a1eb15c4941 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:52.427338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1994/3970] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:41:52.981787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:52.984311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:52.997680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe12c6-9356-4da6-9826-792c5bf7fe91 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.034716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.034716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.034716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.034716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] PATH_INFO: `/v3/projects/000a0af2510042e3be012a235028f3f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.035040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000a0af2510042e3be012a235028f3f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.035040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.091853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000a0af2510042e3be012a235028f3f9', 'request_id': 'req-503678ad-9d20-4270-ab92-eec04e363cd4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:53.098278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000a0af2510042e3be012a235028f3f9', 'request_id': 'req-503678ad-9d20-4270-ab92-eec04e363cd4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:53.104430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000a0af2510042e3be012a235028f3f9', 'request_id': 'req-503678ad-9d20-4270-ab92-eec04e363cd4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:53.117662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] The token cache is being invalidate because project 000a0af2510042e3be012a235028f3f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:41:53.118297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:53.118581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-503678ad-9d20-4270-ab92-eec04e363cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:41:53.120067 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1977/3971] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:41:52 2022] DELETE /identity/v3/projects/000a0af2510042e3be012a235028f3f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:53.124927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.125359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.125509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.146608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:53.147850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:53.157669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:53.225137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1995/3972] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:53.232824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.233186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.233528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.259726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.261625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:53.264368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:53.265609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:53.275427 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1978/3973] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:53.279992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.290725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764f8d0-ac12-4e7f-ad50-8d064aad1d8d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.296150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.297169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.297614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.298082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.298919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:41:53.300351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.303679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.324439 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1979/3974] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:41:53.330032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.348589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7e1e-c21d-4004-85e5-52ff2b3ad646 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.353483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6114f-0cbf-409d-8f5a-c9b44c618003 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.362170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.363328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.364136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.364968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.365435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.365872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.366311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.367838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.368603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.371170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.374865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:53.402477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.404554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.424011 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1980/3975] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:41:53 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:41:53.429242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.436017 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1996/3976] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:41:53.515217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d5ccd-66f9-43d8-ad51-2eadea0763f8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.520698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.521352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.521637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.521920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.522554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.524612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.536648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:41:53.556709 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1981/3977] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:41:53 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:41:53.556936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.567826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dac8c1-c1bb-4344-8d67-92b470739a58 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.572566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.573214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.573500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.573775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.574411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.575994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.590464 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1997/3978] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:41:53.591663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.603170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922237-1611-40f0-95ce-bfa9137f75ae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.608942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468b6a5-04a1-443c-b74e-95a7bf7d9c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.609606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b6a5-04a1-443c-b74e-95a7bf7d9c63 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.610155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b6a5-04a1-443c-b74e-95a7bf7d9c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.610303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468b6a5-04a1-443c-b74e-95a7bf7d9c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.610970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b6a5-04a1-443c-b74e-95a7bf7d9c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.613670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468b6a5-04a1-443c-b74e-95a7bf7d9c63 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.648878 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1982/3979] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:41:53.655212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.677152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043f54-eaed-436b-8c11-ddfe3546eff7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.687913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.688748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.689151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.689522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] PATH_INFO: `/v3/projects/56cf51a980f34ba1bb12b6cb86c9dead/users/1e0a55a968f44b9e997e2d25f39d0932/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.711731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cf51a980f34ba1bb12b6cb86c9dead, user_id=1e0a55a968f44b9e997e2d25f39d0932, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.714588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.732310 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1998/3980] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:41:53 2022] PUT /identity/v3/projects/56cf51a980f34ba1bb12b6cb86c9dead/users/1e0a55a968f44b9e997e2d25f39d0932/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:41:53.742918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db2d8-e339-4010-9448-e69ee3a154e5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.743212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db2d8-e339-4010-9448-e69ee3a154e5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.743498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597db2d8-e339-4010-9448-e69ee3a154e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.774175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-597db2d8-e339-4010-9448-e69ee3a154e5 None None] MFA Rules not processed for user `1e0a55a968f44b9e997e2d25f39d0932`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:41:53.775702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-597db2d8-e339-4010-9448-e69ee3a154e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:53.873013 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1983/3981] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:41:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:41:53.884484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:41:53.886343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:41:53.969819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f907-631c-4f4f-a40f-dbe88c2079ea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:41:53.974618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:41:53.975286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:41:53.975573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:41:53.975991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:41:53.985922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:41:53.988730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:41:53.998937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 1999/3982] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:41:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:01.847319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:01.847888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:01.848226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:01.891665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] MFA Rules not processed for user `9211cfded73b4747b3cb63bcfb3c3ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:01.895500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:02.022976 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1984/3983] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:03.192406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:03.205139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989115-4700-493c-86c1-9e90eed2a51e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:03.215964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:03.218590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:03.218888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:03.219175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:03.225302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:03.242772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:03.244534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:03.271752 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2000/3984] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:03.863963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:03.865459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:04.000402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3289e-5a6c-4c23-8179-332a13dc22a2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:04.018344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:04.020086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:04.020650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:04.021696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] PATH_INFO: `/v3/users/e4b5243d9ffe46c4b32033da558d1e2c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:04.039094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b5243d9ffe46c4b32033da558d1e2c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:04.041627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:04.054297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:04.109868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b5243d9ffe46c4b32033da558d1e2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.173798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b5243d9ffe46c4b32033da558d1e2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.175260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b5243d9ffe46c4b32033da558d1e2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.185982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b5243d9ffe46c4b32033da558d1e2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.186817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bc182dc-f172-4e6f-b592-109db1434184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b5243d9ffe46c4b32033da558d1e2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.210988 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1985/3985] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:03 2022] DELETE /identity/v3/users/e4b5243d9ffe46c4b32033da558d1e2c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:04.407914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:04.427713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f9817-6da6-4c66-bac0-94ec0d543c0c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:04.464838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:04.540126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:04.540931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:04.541348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:04.541572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] PATH_INFO: `/v3/projects/3b649132448b44278c6dd55cdb6ff3de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:04.561442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b649132448b44278c6dd55cdb6ff3de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:04.563323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:04.668751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b649132448b44278c6dd55cdb6ff3de', 'request_id': 'req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.680282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b649132448b44278c6dd55cdb6ff3de', 'request_id': 'req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.688014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b649132448b44278c6dd55cdb6ff3de', 'request_id': 'req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.706015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] The token cache is being invalidate because project 3b649132448b44278c6dd55cdb6ff3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:04.706924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.707829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:04.714082 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2001/3986] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:04 2022] DELETE /identity/v3/projects/3b649132448b44278c6dd55cdb6ff3de => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:04.714610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42781a71-e8c4-4832-9dce-d815e1a67533 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:04.714908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42781a71-e8c4-4832-9dce-d815e1a67533 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:04.715192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42781a71-e8c4-4832-9dce-d815e1a67533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:04.738208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:04.741448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-42781a71-e8c4-4832-9dce-d815e1a67533 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:04.742653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42781a71-e8c4-4832-9dce-d815e1a67533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:04.745204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:04.894383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53a25-35c3-49ac-af1e-a1c3a8d28b90 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:04.901696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:04.902556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:04.902668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:04.902942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:04.905019 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1986/3987] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:04.913582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:04.920015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:04.922945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:04.926167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:04.933934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:04.940983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:04.966003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:04.967872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:04.975493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2002/3988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:04.977840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:04.982105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:04.985042 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1987/3989] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:04.990184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.007921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3c58e-4db7-4c46-b7bf-e3d630ba8a0c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.029624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.030574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.030927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.031333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.032547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:05.032930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.038042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.055591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1988/3990] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:05.059804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.060178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172a3f-1d52-4f6f-b9a2-636da6b201ba service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.065918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.066713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.067088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.067319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] PATH_INFO: `/v3/users/1e0a55a968f44b9e997e2d25f39d0932` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.069438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0a55a968f44b9e997e2d25f39d0932)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.071488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.088562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70da38-c3ed-41a9-b83d-69fabd23f4cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.095162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.096466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.097570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.097941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.098691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.101380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.107880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:05.161094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1989/3991] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:05 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:05.166012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.184001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0a55a968f44b9e997e2d25f39d0932'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:05.208407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0a55a968f44b9e997e2d25f39d0932'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:05.209267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0a55a968f44b9e997e2d25f39d0932'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:05.247608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0a55a968f44b9e997e2d25f39d0932'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:05.248287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33838130-5526-45c7-992d-fcd1886578fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0a55a968f44b9e997e2d25f39d0932'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:05.282573 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2003/3992] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:04 2022] DELETE /identity/v3/users/1e0a55a968f44b9e997e2d25f39d0932 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:05.288848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.289172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.289479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.332650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:05.361004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:05.364661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0a913-f8f3-443e-b08f-e96ae59dc96f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.366947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:05.458886 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2004/3993] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:05.461388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.462233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.462735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.463204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.464085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.466381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.485548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.487203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:05.500326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1990/3994] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:05 2022] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:05.505321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.511689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:05.528149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09887d83-f7f4-47e5-bba6-75808a548b09 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.535220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.537099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.537885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.538365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.539529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.541413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.570080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1991/3995] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:05.571357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.585818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3713e3-be07-43e5-9da1-198796afa436 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.590139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.590900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.591229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.591600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.597876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9227a-3667-4131-9768-e53187aa1a0d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.606572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.607461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.614181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86694006-bcad-4aba-b66f-5969ec67eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.614954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86694006-bcad-4aba-b66f-5969ec67eccd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.615337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86694006-bcad-4aba-b66f-5969ec67eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.615713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86694006-bcad-4aba-b66f-5969ec67eccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.616472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86694006-bcad-4aba-b66f-5969ec67eccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.618383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86694006-bcad-4aba-b66f-5969ec67eccd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.638547 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2005/3996] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:05.654359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1992/3997] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:05.657059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.680385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bcd16-0b5d-4902-98f4-0987b5733947 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:05.686866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:05.688163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.688700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.689124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] PATH_INFO: `/v3/projects/fd7c8d5cae8b44c4b3f1b79787b0dad9/users/dde6d228151a43be8b5ac3a6bbe4e038/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.711079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7c8d5cae8b44c4b3f1b79787b0dad9, user_id=dde6d228151a43be8b5ac3a6bbe4e038, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:05.714046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:05.736110 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2006/3998] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:05 2022] PUT /identity/v3/projects/fd7c8d5cae8b44c4b3f1b79787b0dad9/users/dde6d228151a43be8b5ac3a6bbe4e038/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:05.746962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:05.747357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:05.747741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:05.780100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] MFA Rules not processed for user `dde6d228151a43be8b5ac3a6bbe4e038`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:05.781368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:05.905564 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1993/3999] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:05.926058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:05.926258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:05.943981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:06.008080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b10a6-30a3-44a8-b551-bca22af5943e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.013053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.014382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.014382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.014958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] PATH_INFO: `/v3/projects/56cf51a980f34ba1bb12b6cb86c9dead` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.023418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cf51a980f34ba1bb12b6cb86c9dead)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.024659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.026379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:06.026861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.097406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cf51a980f34ba1bb12b6cb86c9dead', 'request_id': 'req-767d7a99-9d23-4052-a364-a6b6d47c58be'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:06.110064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cf51a980f34ba1bb12b6cb86c9dead', 'request_id': 'req-767d7a99-9d23-4052-a364-a6b6d47c58be'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:06.111743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:06.123683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cf51a980f34ba1bb12b6cb86c9dead', 'request_id': 'req-767d7a99-9d23-4052-a364-a6b6d47c58be'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:06.137818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] The token cache is being invalidate because project 56cf51a980f34ba1bb12b6cb86c9dead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:06.138488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:06.139034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-767d7a99-9d23-4052-a364-a6b6d47c58be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:06.141702 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2007/4000] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:05 2022] DELETE /identity/v3/projects/56cf51a980f34ba1bb12b6cb86c9dead => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:06.146289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8415405-d36d-4c83-959d-abaf1d0bb49a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.146616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8415405-d36d-4c83-959d-abaf1d0bb49a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.146930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8415405-d36d-4c83-959d-abaf1d0bb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.156724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ba976-86ed-41ff-bab4-f8bf55e509c8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.181176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c8415405-d36d-4c83-959d-abaf1d0bb49a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:06.183179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8415405-d36d-4c83-959d-abaf1d0bb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:06.255257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.255916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.256225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.256507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.258375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:06.262886 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2008/4001] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:06.273022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.274094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.274703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.311842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:06.313330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:06.324028 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2009/4002] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:06.329024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.347585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.348696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc46f4e-b1fc-4fd2-902e-2769efb5b806 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.350054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.356382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.357303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.357559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.357841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.358806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:06.359117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.361052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.373351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1994/4003] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:42:06.377619 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2010/4004] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:06.382567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.399580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808875d-bd6c-4d73-a264-784c88b4aed5 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.404260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.405010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.405299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.405558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.406187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.408103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.446032 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1995/4005] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:06 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:06.450230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.462259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e774ac4-d672-41f8-a87b-ccd39f850d36 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.486804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:06.556534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.557842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.558882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.558882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.559672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.562803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.602785 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2011/4006] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:06 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:06.603916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.631930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c78429-bf48-40e7-8ea4-bcc5237f14ea admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.643137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.645627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.645919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.646203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.647871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.649899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.672668 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1996/4007] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:06.674053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.691921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28071-91dd-42cd-b866-35c30fc3a45e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.698278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758eaf-e95c-4e2a-bac8-db91bb70752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.698913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758eaf-e95c-4e2a-bac8-db91bb70752a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.699222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758eaf-e95c-4e2a-bac8-db91bb70752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.699464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758eaf-e95c-4e2a-bac8-db91bb70752a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.700299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758eaf-e95c-4e2a-bac8-db91bb70752a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.702332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758eaf-e95c-4e2a-bac8-db91bb70752a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.719287 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2012/4008] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:06.721019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:06.732825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed0823-9fe0-4dff-aa9e-771c9ca3817d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:06.738576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:06.739265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.739547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.739882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] PATH_INFO: `/v3/projects/b3209598b23748a09ea01f6c2c8a4598/users/2cb1d2d693984e73b9e9b000be8e5b11/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.787010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3209598b23748a09ea01f6c2c8a4598, user_id=2cb1d2d693984e73b9e9b000be8e5b11, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:06.789805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:06.820601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1997/4009] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:06 2022] PUT /identity/v3/projects/b3209598b23748a09ea01f6c2c8a4598/users/2cb1d2d693984e73b9e9b000be8e5b11/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:06.831231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:06.831528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:06.831812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:06.878428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] MFA Rules not processed for user `2cb1d2d693984e73b9e9b000be8e5b11`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:06.879685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:07.130314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2013/4010] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:07.141419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:07.146477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:07.218062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:07.257279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781e97-3a19-440c-a449-a5f997ac521e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:07.262512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:07.263331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:07.264537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:07.265020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:07.276770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:07.278619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:07.304989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1998/4011] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:08.118531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:08.131707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a481a3-d31d-493f-bc50-49a1a5f09e44 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:08.136446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:08.137235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:08.137519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:08.137954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:08.140568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:08.158729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:08.161259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:08.171936 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2014/4012] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:09.402644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:09.403988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:09.529765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2817034-1938-4f26-a2ec-8d088f531c12 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:09.534969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:09.535891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:09.535891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:09.536121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] PATH_INFO: `/v3/users/b86e3b7d1c9a4b2c8f2914beefa74cc1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:09.537380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86e3b7d1c9a4b2c8f2914beefa74cc1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:09.539964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:09.620485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86e3b7d1c9a4b2c8f2914beefa74cc1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:09.655358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86e3b7d1c9a4b2c8f2914beefa74cc1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:09.657485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86e3b7d1c9a4b2c8f2914beefa74cc1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:09.680723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:09.681952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86e3b7d1c9a4b2c8f2914beefa74cc1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:09.682927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3226f86-1482-428d-98c9-6854b86bb796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86e3b7d1c9a4b2c8f2914beefa74cc1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:09.683134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:09.712128 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 1999/4013] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:09 2022] DELETE /identity/v3/users/b86e3b7d1c9a4b2c8f2914beefa74cc1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:09.716829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:09.717158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:09.717516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:09.799742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:09.803217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:09.805640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469c46a-58d5-4ba6-804f-8237deec6894 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:09.822829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:09.922808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:09.923510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:09.923798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:09.924070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:09.929119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:09.958743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:09.961100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:09.986604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:09.988709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2015/4014] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:10.024358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2000/4015] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:10.079992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:10.082819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:10.183246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d692a-104c-4633-aa06-1947426527c0 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:10.193536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:10.194167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:10.196335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:10.198187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:10.218265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:10.220027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:10.232296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2016/4016] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:10.692506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:10.694088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:10.725288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b946e9-ed14-4b6c-bc30-ea2ff47cd06f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:10.732449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:10.748736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:10.752571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:10.755794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] PATH_INFO: `/v3/projects/f5a44c2cd99949c2a30ab83bdede01e6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:10.757673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a44c2cd99949c2a30ab83bdede01e6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:10.763526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:10.842438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a44c2cd99949c2a30ab83bdede01e6', 'request_id': 'req-f3576dd8-3611-4be6-bd1e-c440d2f674ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:10.850113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a44c2cd99949c2a30ab83bdede01e6', 'request_id': 'req-f3576dd8-3611-4be6-bd1e-c440d2f674ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:10.857878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a44c2cd99949c2a30ab83bdede01e6', 'request_id': 'req-f3576dd8-3611-4be6-bd1e-c440d2f674ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:10.875223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] The token cache is being invalidate because project f5a44c2cd99949c2a30ab83bdede01e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:10.875969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:10.876966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:10.882828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2001/4017] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:10 2022] DELETE /identity/v3/projects/f5a44c2cd99949c2a30ab83bdede01e6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:10.885148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:10.898880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ec0a-1815-4bea-b963-979e3bf443c6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:10.966799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:10.967720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:10.968250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:10.968739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] PATH_INFO: `/v3/users/18a998ab5b9f4076a1279dc31a6e77f7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:10.970575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a998ab5b9f4076a1279dc31a6e77f7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:10.972671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:11.033200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a998ab5b9f4076a1279dc31a6e77f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:11.035690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:11.055268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a998ab5b9f4076a1279dc31a6e77f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:11.056226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a998ab5b9f4076a1279dc31a6e77f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:11.081296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a998ab5b9f4076a1279dc31a6e77f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:11.082532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6e20105-fe10-49cf-9c6a-6bf1bbfdc96b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a998ab5b9f4076a1279dc31a6e77f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:11.114061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2017/4018] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:10 2022] DELETE /identity/v3/users/18a998ab5b9f4076a1279dc31a6e77f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:12.129131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:12.130889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:12.143762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576dd8-3611-4be6-bd1e-c440d2f674ad admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:12.243192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:12.243840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:12.244120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:12.244393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] PATH_INFO: `/v3/projects/0fb37758af6f4e1c8f9c988a708959d1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:12.245713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb37758af6f4e1c8f9c988a708959d1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:12.254683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:12.537434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb37758af6f4e1c8f9c988a708959d1', 'request_id': 'req-43341b65-8799-49b8-86be-0056347fa7cc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:12.545177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb37758af6f4e1c8f9c988a708959d1', 'request_id': 'req-43341b65-8799-49b8-86be-0056347fa7cc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:12.562087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb37758af6f4e1c8f9c988a708959d1', 'request_id': 'req-43341b65-8799-49b8-86be-0056347fa7cc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:12.585265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] The token cache is being invalidate because project 0fb37758af6f4e1c8f9c988a708959d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:12.585673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:12.587076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-43341b65-8799-49b8-86be-0056347fa7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:12.589748 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2002/4019] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:12 2022] DELETE /identity/v3/projects/0fb37758af6f4e1c8f9c988a708959d1 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:12.594419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:12.594952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:12.594952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:12.626876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:12.629054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:12.712270 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2018/4020] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:12.720262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:12.721866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:12.722532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:12.736438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:12.753338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:12.768879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:12.781149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2003/4021] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:12.785970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:12.798153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bc87-04a3-40b1-ad08-deca8476f4d9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:12.804948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:12.805803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:12.806251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:12.807156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:12.808040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:12.808509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:12.810723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:12.827765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2019/4022] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:12.833105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:12.842868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e214c-cda6-43e1-9985-2c041630bee6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:12.847950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:12.848629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:12.850724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:12.850724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:12.850724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:12.852800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:12.897930 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2004/4023] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:12 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:12.898479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:12.911442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c63d1-0bb0-4834-9967-53daae27252f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.026656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.027610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.028491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.028845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.029734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.033601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.073056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.073898 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2020/4024] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:12 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:13.088329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832c20d-dd27-414b-89f4-09c3d77bfad6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.094602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.095347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.095859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.097829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.099272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.101494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.121775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.129039 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2005/4025] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:13.133172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8f96-cead-4ad8-95fc-986f6e663002 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.138835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fbf96-6aa9-44d5-8bd4-bdb03788dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.139502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fbf96-6aa9-44d5-8bd4-bdb03788dec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.139785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fbf96-6aa9-44d5-8bd4-bdb03788dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.140062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fbf96-6aa9-44d5-8bd4-bdb03788dec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.141165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fbf96-6aa9-44d5-8bd4-bdb03788dec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.142768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fbf96-6aa9-44d5-8bd4-bdb03788dec2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.155500 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2021/4026] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:13.159574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.171779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ab584-739c-48ac-9f6d-0b2e6c4a296f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.178475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.179155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.179435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.179711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] PATH_INFO: `/v3/projects/53c0d3a590cd4154999aa75e3009cfd1/users/cc626f587b9541ce82f7d52f426b129d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.214691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c0d3a590cd4154999aa75e3009cfd1, user_id=cc626f587b9541ce82f7d52f426b129d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.218294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.250470 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2006/4027] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:13 2022] PUT /identity/v3/projects/53c0d3a590cd4154999aa75e3009cfd1/users/cc626f587b9541ce82f7d52f426b129d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:13.262119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.263175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.264346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.324652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] MFA Rules not processed for user `cc626f587b9541ce82f7d52f426b129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:13.326009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:13.354742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:13.421031 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2022/4028] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:13.423711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.516766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64cb1-6be5-4f8c-b4cc-66f622e6a7c9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.522053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.522814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.523206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.523870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.524449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.526507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.557893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2007/4029] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:13 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:13.561012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.574300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8d980-8321-4105-9be3-ae7edc664ade None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.642891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.644444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.644829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.645230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.646150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.649511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.686858 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2023/4030] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:13 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:13.688137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.703655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62246c93-d44c-4d34-b59d-eaf181ecef81 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.715458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.716317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.716695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.717104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.717956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.719977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.735463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2008/4031] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:13.737063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.748397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a4f5-c3e3-4781-bafd-98747fb34859 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.755731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.756399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.756800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.757203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] PATH_INFO: `/v3/projects/4a2500b400b848e585c6c20d0e5053fb/users/026fb3f61b59467a9e652a6dafbaf548/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.773746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2500b400b848e585c6c20d0e5053fb, user_id=026fb3f61b59467a9e652a6dafbaf548, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.776412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.796022 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2024/4032] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:13 2022] PUT /identity/v3/projects/4a2500b400b848e585c6c20d0e5053fb/users/026fb3f61b59467a9e652a6dafbaf548/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:13.797259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.808254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621f00c-775e-413f-817a-c3d7273dd271 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.901280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87508ff-e9c6-46ad-a05f-2f3807e02c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.902050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87508ff-e9c6-46ad-a05f-2f3807e02c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.903853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87508ff-e9c6-46ad-a05f-2f3807e02c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.904471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87508ff-e9c6-46ad-a05f-2f3807e02c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.904975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87508ff-e9c6-46ad-a05f-2f3807e02c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.906743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87508ff-e9c6-46ad-a05f-2f3807e02c9c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:13.919956 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2009/4033] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:13.930369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:13.949294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2eb24-93f3-49c6-9d38-bc866220d8e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:13.963709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e90553-1d3b-44ff-b0e7-26937c411f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:13.964573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90553-1d3b-44ff-b0e7-26937c411f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:13.964857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90553-1d3b-44ff-b0e7-26937c411f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:13.965185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90553-1d3b-44ff-b0e7-26937c411f16 admin admin] PATH_INFO: `/v3/projects/4a2500b400b848e585c6c20d0e5053fb/users/026fb3f61b59467a9e652a6dafbaf548/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:13.967399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e90553-1d3b-44ff-b0e7-26937c411f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2500b400b848e585c6c20d0e5053fb, user_id=026fb3f61b59467a9e652a6dafbaf548, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:13.978037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e90553-1d3b-44ff-b0e7-26937c411f16 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:14.005990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2025/4034] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:13 2022] PUT /identity/v3/projects/4a2500b400b848e585c6c20d0e5053fb/users/026fb3f61b59467a9e652a6dafbaf548/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:14.018708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:14.019251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:14.019630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:14.051797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:14.070698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] MFA Rules not processed for user `026fb3f61b59467a9e652a6dafbaf548`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:14.073789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:14.168290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2010/4035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:14.180536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:14.181139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:14.181250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:14.205314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] MFA Rules not processed for user `cc626f587b9541ce82f7d52f426b129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:14.206788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:14.309657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2026/4036] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:14.569874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:14.573610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:14.666217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911bbef-6a2d-466e-8bb6-264aefdbdb31 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:14.675221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:14.676831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:14.677156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:14.677591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:14.686396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:14.688053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:14.698325 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2011/4037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:14.970811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:14.977465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:15.016584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:15.092380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12babdb-a7b6-4450-b4fd-701adbcf3edd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:15.098318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:15.098946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:15.099230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:15.099508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:15.101283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:15.114854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:15.116470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705cacc-7b90-46e7-a7a9-13e5bce51150 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:15.128771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2027/4038] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:42:17.838537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:17.838537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:17.921624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770345-fa90-4a82-be86-a6acfe2c6fbc service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:17.927124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:17.927778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:17.928088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:17.928339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] PATH_INFO: `/v3/users/dde6d228151a43be8b5ac3a6bbe4e038` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:17.929509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde6d228151a43be8b5ac3a6bbe4e038)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:17.931438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:17.960592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:17.998823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde6d228151a43be8b5ac3a6bbe4e038'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:18.021223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde6d228151a43be8b5ac3a6bbe4e038'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:18.023648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde6d228151a43be8b5ac3a6bbe4e038'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:18.037009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde6d228151a43be8b5ac3a6bbe4e038'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:18.039360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde6d228151a43be8b5ac3a6bbe4e038'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:18.063899 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2012/4039] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:17 2022] DELETE /identity/v3/users/dde6d228151a43be8b5ac3a6bbe4e038 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:18.068830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:18.069407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:18.069407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:18.110066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:18.111771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:18.213739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2028/4040] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:18.227310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:18.229094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:18.373911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30accaa2-9b9d-411d-965d-872c7392a6ac admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:18.379864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdadc7-e82a-44da-bebe-d32562c218b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:18.380921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdadc7-e82a-44da-bebe-d32562c218b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:18.381407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdadc7-e82a-44da-bebe-d32562c218b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:18.381970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdadc7-e82a-44da-bebe-d32562c218b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:18.392811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdadc7-e82a-44da-bebe-d32562c218b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:18.395502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdadc7-e82a-44da-bebe-d32562c218b2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:18.409598 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2013/4041] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:19.131313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.132945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:19.153832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80f1fb-7396-43be-950d-728bcd410254 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.162307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.163446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.164748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.166141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] PATH_INFO: `/v3/projects/fd7c8d5cae8b44c4b3f1b79787b0dad9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.168105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7c8d5cae8b44c4b3f1b79787b0dad9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.179509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.291582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7c8d5cae8b44c4b3f1b79787b0dad9', 'request_id': 'req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:19.302933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7c8d5cae8b44c4b3f1b79787b0dad9', 'request_id': 'req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:19.310963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7c8d5cae8b44c4b3f1b79787b0dad9', 'request_id': 'req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:19.326577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] The token cache is being invalidate because project fd7c8d5cae8b44c4b3f1b79787b0dad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:19.326876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:19.327538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a1b7e0a-39c0-4e8f-88da-c2e2528317fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:19.329153 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2029/4042] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:19 2022] DELETE /identity/v3/projects/fd7c8d5cae8b44c4b3f1b79787b0dad9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:19.335013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.335518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.335679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.357716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:19.359315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:19.430531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2014/4043] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:19.438322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.438627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.438927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.470262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:19.471965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:19.480967 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2030/4044] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:19.488602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.501467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178075e2-1cb9-40e5-a15d-65816c6a503c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.506892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.507508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.507790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.508067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.508720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:19.509061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.511302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.524579 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2015/4045] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:19.529034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.542307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2232e-a00a-4249-95bb-8ee74daf62c9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.549808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.551218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.551508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.551795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.552448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.559200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.606963 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2031/4046] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:19 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:19.608347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.619923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41558ecd-e971-4906-8c2f-2301d5afc388 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.693926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:19.730692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.731352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.731636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.731909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.732617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.737296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.776833 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2016/4047] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:19 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:19.781737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.788851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:19.798223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eee0c8-8cb1-4a9a-ae3c-dc2468b5ead7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.809041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.809669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.810674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.811433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.812162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.814527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.830157 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2032/4048] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:19.835857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.849537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7119-4564-4652-b991-b659f176cf44 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.855656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0f7d-f65f-44b7-814e-89d6f13c4ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.856484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0f7d-f65f-44b7-814e-89d6f13c4ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.856984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0f7d-f65f-44b7-814e-89d6f13c4ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.857474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0f7d-f65f-44b7-814e-89d6f13c4ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.858145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0f7d-f65f-44b7-814e-89d6f13c4ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.859792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef0f7d-f65f-44b7-814e-89d6f13c4ee1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.876112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:19.877117 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2017/4049] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:19.887604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345af77a-e5f0-4b74-bffc-04146a1fd4c4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:19.905281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:19.905968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.906284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.906699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] PATH_INFO: `/v3/projects/df4947898613404696306d225928646a/users/f21e8a5fbfa84bd9a1986b9072ffb7cb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:19.929147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4947898613404696306d225928646a, user_id=f21e8a5fbfa84bd9a1986b9072ffb7cb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:19.934014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:19.970874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:19.971156 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2033/4050] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:19 2022] PUT /identity/v3/projects/df4947898613404696306d225928646a/users/f21e8a5fbfa84bd9a1986b9072ffb7cb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:19.972172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:19.972637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:20.023728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] MFA Rules not processed for user `f21e8a5fbfa84bd9a1986b9072ffb7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:20.025213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:20.146595 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2018/4051] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:20.155001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:20.157156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:20.277209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a0df5-4f01-4440-8289-f32b99ade004 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:20.299266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24101-00cf-4c6b-87df-ce3caa283205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:20.299901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24101-00cf-4c6b-87df-ce3caa283205 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:20.300181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24101-00cf-4c6b-87df-ce3caa283205 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:20.300641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24101-00cf-4c6b-87df-ce3caa283205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:20.312025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24101-00cf-4c6b-87df-ce3caa283205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:20.313804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24101-00cf-4c6b-87df-ce3caa283205 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:20.325513 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2034/4052] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:23.323426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:23.324863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:23.436873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b771d-26d3-4dc8-985c-0fff4439e792 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:23.447729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:23.448744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:23.449345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:23.449842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] PATH_INFO: `/v3/users/2cb1d2d693984e73b9e9b000be8e5b11` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:23.451379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb1d2d693984e73b9e9b000be8e5b11)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:23.453582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:23.539767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:23.542245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb1d2d693984e73b9e9b000be8e5b11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:23.559627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb1d2d693984e73b9e9b000be8e5b11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:23.560452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb1d2d693984e73b9e9b000be8e5b11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:23.570551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb1d2d693984e73b9e9b000be8e5b11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:23.571575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb1d2d693984e73b9e9b000be8e5b11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:23.586726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2019/4053] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:23 2022] DELETE /identity/v3/users/2cb1d2d693984e73b9e9b000be8e5b11 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:23.591284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:23.591799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:23.591906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:23.613527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:23.615283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:23.712888 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2035/4054] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:23.754301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:23.755922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:23.857125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e69d-f1d2-4aa6-be52-cfe0706182e3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:23.861634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:23.862294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:23.862609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:23.863156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:23.881831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:23.889643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:23.909643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2020/4055] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:24.132513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:24.147546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:24.269174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:24.283564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:24.285877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:24.303595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d666a2-35d5-42d9-b1e1-9e3346388855 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:24.309465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e92f-b97d-422d-9b3a-2b3c59f5388f service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:24.315008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:24.315928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:24.316208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:24.316483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] PATH_INFO: `/v3/projects/b3209598b23748a09ea01f6c2c8a4598` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:24.317656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3209598b23748a09ea01f6c2c8a4598)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:24.317804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:24.318283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:24.318754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:24.319319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:24.319799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:24.321532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:24.407816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3209598b23748a09ea01f6c2c8a4598', 'request_id': 'req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:24.421322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3209598b23748a09ea01f6c2c8a4598', 'request_id': 'req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:24.434296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3209598b23748a09ea01f6c2c8a4598', 'request_id': 'req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:24.444218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:24.446076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1005b3f-59c9-46a6-8646-2f9c61c38d01 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:24.480590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] The token cache is being invalidate because project b3209598b23748a09ea01f6c2c8a4598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:24.480959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:24.481642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc3c7a20-5d8d-4355-badd-c6c85eafa30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:24.484656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2021/4056] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:24 2022] DELETE /identity/v3/projects/b3209598b23748a09ea01f6c2c8a4598 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:24.485414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2036/4057] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:24.490828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:24.492764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:24.493061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:24.535006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:24.536501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:24.649767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:24.691037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2022/4058] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:24.698277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:24.698861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:24.698861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:24.739668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:24.741100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:24.751400 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2037/4059] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:24.756199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:24.768450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dbc9c-973a-4249-82d6-3898dbfac243 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:24.781922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:24.782552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:24.782831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:24.783111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:24.784325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:24.784931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:24.786681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:24.802585 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2023/4060] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:24.807660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:24.840324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879e9be-306e-4f2a-b961-0e4335bf69c7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:24.849519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:24.850128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:24.850667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:24.851141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:24.852298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:24.857212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:24.913011 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2038/4061] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:24 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:24.916777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:24.939378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877737b0-6cc0-4976-9659-7d100fc82a18 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:25.032602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:25.033644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.034383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.034885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.035789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:25.038192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:25.070702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2024/4062] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:24 2022] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:25.074711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:25.086601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff083-71fc-4f24-a70f-73d1b6f52cc4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:25.091656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:25.093210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.093705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.094859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.096421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:25.098720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:25.117600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:25.123632 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2039/4063] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:25.131348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e67fa5-234e-4984-9557-231253319e67 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:25.136716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36524e-c261-4e60-9682-4ef1e526b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:25.138163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36524e-c261-4e60-9682-4ef1e526b391 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.138687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36524e-c261-4e60-9682-4ef1e526b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.139182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36524e-c261-4e60-9682-4ef1e526b391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.140185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36524e-c261-4e60-9682-4ef1e526b391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:25.142082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36524e-c261-4e60-9682-4ef1e526b391 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:25.166393 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2025/4064] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:25.170920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:25.186648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27593a11-3b82-4f33-aead-fabadb7da58a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:25.194540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:25.195538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.196062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.196790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] PATH_INFO: `/v3/projects/4c648282a2fa410fb5a1645f953e9d0e/users/685ca76cf1164f8f9a013b3195c9ee94/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.232189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c648282a2fa410fb5a1645f953e9d0e, user_id=685ca76cf1164f8f9a013b3195c9ee94, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:25.238970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:25.269012 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2040/4065] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:25 2022] PUT /identity/v3/projects/4c648282a2fa410fb5a1645f953e9d0e/users/685ca76cf1164f8f9a013b3195c9ee94/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:25.270583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.270917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.271220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.342162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] MFA Rules not processed for user `685ca76cf1164f8f9a013b3195c9ee94`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:25.343510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:25.439774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2026/4066] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:25.450720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:25.452530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:25.522100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e5542-3acd-4a3f-ab0a-a2d038bc3fe4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:25.527078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467dfa8-5c55-40ef-a1ef-13302f9639df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:25.528235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467dfa8-5c55-40ef-a1ef-13302f9639df service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.528845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467dfa8-5c55-40ef-a1ef-13302f9639df service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.529540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467dfa8-5c55-40ef-a1ef-13302f9639df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.543246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467dfa8-5c55-40ef-a1ef-13302f9639df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:25.544676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467dfa8-5c55-40ef-a1ef-13302f9639df service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:25.555527 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2041/4067] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:25.754433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:25.757088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:25.823694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:25.857751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a5e0-ef85-4fd1-a5a8-cda838115f1c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:25.864378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:25.866229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.867053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.867567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] PATH_INFO: `/v3/users/f21e8a5fbfa84bd9a1986b9072ffb7cb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:25.869459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21e8a5fbfa84bd9a1986b9072ffb7cb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:25.872602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:25.945351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21e8a5fbfa84bd9a1986b9072ffb7cb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:25.959799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21e8a5fbfa84bd9a1986b9072ffb7cb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:25.960596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21e8a5fbfa84bd9a1986b9072ffb7cb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:25.970476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21e8a5fbfa84bd9a1986b9072ffb7cb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:25.971230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21e8a5fbfa84bd9a1986b9072ffb7cb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:25.989455 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2027/4068] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:25 2022] DELETE /identity/v3/users/f21e8a5fbfa84bd9a1986b9072ffb7cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:25.993496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:25.994013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:25.994137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:26.019929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:26.021772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:26.057637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:26.112213 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2042/4069] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:26.124047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:26.125639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:26.202221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447bbb0-11cb-4210-8938-b20fdf1ad788 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:26.205952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a943670-eed8-438b-8c2d-8901cfa42c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:26.206650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a943670-eed8-438b-8c2d-8901cfa42c9f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:26.206946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a943670-eed8-438b-8c2d-8901cfa42c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:26.207272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a943670-eed8-438b-8c2d-8901cfa42c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:26.219695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a943670-eed8-438b-8c2d-8901cfa42c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:26.222405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a943670-eed8-438b-8c2d-8901cfa42c9f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:26.253873 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2028/4070] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:27.156292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.159943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:27.173027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db784-9d17-46c8-afc1-7280fbeab555 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.178409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:27.179230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.179675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.180130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] PATH_INFO: `/v3/projects/df4947898613404696306d225928646a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.182180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4947898613404696306d225928646a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:27.184764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:27.263607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4947898613404696306d225928646a', 'request_id': 'req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:27.275145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4947898613404696306d225928646a', 'request_id': 'req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:27.282469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4947898613404696306d225928646a', 'request_id': 'req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:27.296050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] The token cache is being invalidate because project df4947898613404696306d225928646a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:27.296778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:27.298125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47c3f7eb-b8bd-4e00-94e4-d0ba08d55c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:27.305014 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2043/4071] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:27 2022] DELETE /identity/v3/projects/df4947898613404696306d225928646a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:27.309244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.309244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.309244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.331600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:27.333560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:27.445203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.445869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.446317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.473257 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2029/4072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:27.519504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:27.520743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:27.558452 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2044/4073] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:27.559664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.565650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:27.580096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b0d42-71f5-4d2c-8614-3b911a403155 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.597824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:27.598467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.598752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.599032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.599708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:27.600017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:27.601880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:27.625597 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2030/4074] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:27.627120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.642619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29e9cf-fdf7-4b7f-8f06-a56aa42cd14c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.650652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:27.651215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.651500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.651778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.652415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:27.655049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:27.714917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2045/4075] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:27 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:27.719210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.735705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928db0-065d-43c5-ac76-bcbaae574ca4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.849857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:27.850513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.850846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.851052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.851958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:27.854174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:27.903679 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2031/4076] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:27 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:27.905105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.915916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677bed9-08d3-41d1-8b73-ec125e2edff2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.921052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:27.922097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.922097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.922346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.923084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:27.924826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:27.935998 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2046/4077] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:27.940400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.950671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bba2b-cfd6-48c9-8735-cead73eb13e9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.958225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13321d-c3b4-4536-a437-59f94e3b3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:27.958972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13321d-c3b4-4536-a437-59f94e3b3673 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:27.959258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13321d-c3b4-4536-a437-59f94e3b3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:27.959579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13321d-c3b4-4536-a437-59f94e3b3673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:27.960235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13321d-c3b4-4536-a437-59f94e3b3673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:27.962100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13321d-c3b4-4536-a437-59f94e3b3673 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:27.980079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:27.980535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2032/4078] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:27.992693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cd80d-246e-477f-a474-242adcaf4686 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:27.999744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.000493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.000694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.001019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] PATH_INFO: `/v3/projects/2a1e69ba449b4bf7b260ca48a7a5980c/users/efc8d14a96d34d4fa7a0dc1f5797f111/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.025256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1e69ba449b4bf7b260ca48a7a5980c, user_id=efc8d14a96d34d4fa7a0dc1f5797f111, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.029812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.056148 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2047/4079] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:27 2022] PUT /identity/v3/projects/2a1e69ba449b4bf7b260ca48a7a5980c/users/efc8d14a96d34d4fa7a0dc1f5797f111/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:28.065885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.067673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.067975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.118890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] MFA Rules not processed for user `efc8d14a96d34d4fa7a0dc1f5797f111`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:28.120160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:28.153965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.159757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:28.282157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:28.283305 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2033/4080] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:28.287579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.338649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b46997-c9f4-481d-9216-b7a1910db42f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.344450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.345126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.345625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.346825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.349732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:28.364088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.365997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.379328 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2048/4081] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:42:28.408132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:28.416540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be14a3-9702-4038-8b4f-7c678f46ba4a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.442001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.442583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.442871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.443200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.443876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.445755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.514827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.520794 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2034/4082] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:28 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:28.530227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8e7f-3af6-4f15-a8dc-68675790a769 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.645141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.645934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.646348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.646729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.647723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.650102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.689500 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2049/4083] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:28 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:28.689728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.704732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88cb1c-ee1f-4d90-a79e-edfb04517e96 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.714552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.715620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.716687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.717174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.718559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.724698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.748311 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2035/4084] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:28.749694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.764402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7cddf-afcb-4a52-9792-ffbf5f7f0831 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.770247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.771432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.771712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.771991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] PATH_INFO: `/v3/projects/d8f936e10a5642a5a502e8adccf8788f/users/79808253be8b4572b8a27c87b52a427c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.793901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f936e10a5642a5a502e8adccf8788f, user_id=79808253be8b4572b8a27c87b52a427c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.796684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.832372 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2050/4085] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:28 2022] PUT /identity/v3/projects/d8f936e10a5642a5a502e8adccf8788f/users/79808253be8b4572b8a27c87b52a427c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:28.833570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.844504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807acc95-af77-45b8-851c-70e78d49c944 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.925134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021e873-70ce-4f1e-8546-6890a12502ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.925907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e873-70ce-4f1e-8546-6890a12502ce admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.926235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e873-70ce-4f1e-8546-6890a12502ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.926511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e873-70ce-4f1e-8546-6890a12502ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.927160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021e873-70ce-4f1e-8546-6890a12502ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.928754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2021e873-70ce-4f1e-8546-6890a12502ce admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:28.938831 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2036/4086] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:28.943758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:28.958544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72617bf-d650-4935-aadd-3f235861d308 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:28.963783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:28.964456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:28.964738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:28.965148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] PATH_INFO: `/v3/projects/d8f936e10a5642a5a502e8adccf8788f/users/79808253be8b4572b8a27c87b52a427c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:28.967209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f936e10a5642a5a502e8adccf8788f, user_id=79808253be8b4572b8a27c87b52a427c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:28.969880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.027061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2051/4087] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:28 2022] PUT /identity/v3/projects/d8f936e10a5642a5a502e8adccf8788f/users/79808253be8b4572b8a27c87b52a427c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:29.038661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.039355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.039687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.080754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] MFA Rules not processed for user `79808253be8b4572b8a27c87b52a427c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:29.082034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:29.190916 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2037/4088] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:29.195175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.210703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9983-cc5a-43ba-b2ea-1611ecedbbb0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.224009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.224800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.225481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.225878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.226583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:29.228437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invalid input for field 'name': '' is too short Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: On instance['name']: Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: On instance['name']: Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: '' Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise error Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application '' Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.237888 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:42:29.240181 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application '' Oct 05 02:42:29.241537 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.246186 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2052/4089] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:29 2022] POST /identity/v3/domains => generated 283 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:42:29.250221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.264679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb56b27-532d-4906-a344-8ba4c97847f5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.282640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.283537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.283908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.284359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.285454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:29.288289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: On instance['name']: Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: On instance['name']: Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise error Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.297441 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 05 02:42:29.299127 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['name']: Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.301138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2038/4090] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:29 2022] POST /identity/v3/domains => generated 412 bytes in 51 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:42:29.305540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.319577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7ad2-35eb-405a-af4a-20e597d5658a tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.331518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.332282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.332594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.332894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.333733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:29.335601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.371551 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2053/4091] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:29 2022] POST /identity/v3/domains => generated 276 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:29.375705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.389569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b086245-b92b-42b2-b856-65b725716bb2 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.442659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:29.458577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.459161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.459451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.459728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.470634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1c1de8c33d64ff8933f0beed8dd8321)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:29.472295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 05 02:42:29.488438 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:29.489883 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2039/4092] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:29 2022] DELETE /identity/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321 => generated 120 bytes in 114 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:29.494010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.506260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a8612-08e6-4631-9dc9-774bec0c2fd6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.511086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.511814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.512150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.512497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.513987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f1c1de8c33d64ff8933f0beed8dd8321)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:29.515727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.569329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.570183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.615005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.616095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.623429 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2054/4093] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:29 2022] PATCH /identity/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321 => generated 277 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:29.624419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.626310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:29.642024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81356862-e13c-4b74-b35d-685f04cdd3b3 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.719505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.720344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.720725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.721831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.734673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1c1de8c33d64ff8933f0beed8dd8321)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:29.736498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:29.759725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.763371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.839247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321', 'request_id': 'req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.847224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321', 'request_id': 'req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.855640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321', 'request_id': 'req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.872738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] The token cache is being invalidate because project f1c1de8c33d64ff8933f0beed8dd8321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:29.873151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.873926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.883804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321', 'request_id': 'req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.884618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321', 'request_id': 'req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.888530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f1c1de8c33d64ff8933f0beed8dd8321', 'request_id': 'req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:29.896462 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2040/4094] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:29 2022] DELETE /identity/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:29.901484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.914736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b6ac0-f357-42a7-9dbd-1d17d736d79b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:29.934250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:29.976875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:29.977541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:29.977825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:29.978102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/ae9417612fee4b82be88dff9a7c4ab2d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:29.985576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Could not find domain: ae9417612fee4b82be88dff9a7c4ab2d.: keystone.exception.DomainNotFound: Could not find domain: ae9417612fee4b82be88dff9a7c4ab2d. Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ae9417612fee4b82be88dff9a7c4ab2d. Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:29.992288 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:29.993663 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:42:29.994988 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ae9417612fee4b82be88dff9a7c4ab2d. Oct 05 02:42:29.996433 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:29.996433 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2055/4095] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:29 2022] DELETE /identity/v3/domains/ae9417612fee4b82be88dff9a7c4ab2d => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:29.998442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:29.999910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:30.013740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b78c3-70c3-4a06-bf66-9ab0848f1d7d tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:30.019706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:30.020312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.020600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.020882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.021584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:30.023215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:30.033588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:30.043178 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2041/4096] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:29 2022] POST /identity/v3/domains => generated 252 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:30.046817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:30.058848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25b67-1527-4885-9fc0-f85184280274 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:30.128381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:30.129183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.129470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.129752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.130430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:30.132023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:30.140051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.sql.core [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-707573959' for key 'project.ixu_project_name_domain_id'") Oct 05 02:42:30.140051 n-d-858272-3 devstack@keystone.service[81827]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 02:42:30.140051 n-d-858272-3 devstack@keystone.service[81827]: [parameters: {'id': '48fd9a7153344c8489bb2ea9686010a3', 'name': 'tempest-domain-dup-707573959', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 05 02:42:30.140051 n-d-858272-3 devstack@keystone.service[81827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-707573959.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-707573959. Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:42:30.149046 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-707573959' for key 'project.ixu_project_name_domain_id'") Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 05 02:42:30.150220 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application yield resource Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise self.value Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application session.commit() Oct 05 02:42:30.151712 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.session.flush() Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application compat.raise_( Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:42:30.153164 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 05 02:42:30.154601 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result = self._query(query) Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application conn.query(q) Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application result.read() Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 02:42:30.156319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-707573959' for key 'project.ixu_project_name_domain_id'") Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [parameters: {'id': '48fd9a7153344c8489bb2ea9686010a3', 'name': 'tempest-domain-dup-707573959', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.157944 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-707573959. Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:30.159989 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-707573959. Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:30.162645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2056/4097] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:30 2022] POST /identity/v3/domains => generated 211 bytes in 104 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:42:30.164025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:30.166322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9d34f-cfaf-47ec-8c3c-559f1a34eec6 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:30.173660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:30.175042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.175373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.175750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/fff7f30b162d46ee89332b72f0acdf82` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.187587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fff7f30b162d46ee89332b72f0acdf82)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:30.189332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:30.210952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.211676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.240057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.240683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.243450 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2042/4098] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:30 2022] PATCH /identity/v3/domains/fff7f30b162d46ee89332b72f0acdf82 => generated 253 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:30.247308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:30.249771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:30.262780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047ed04-96fc-4ca6-b77f-2449bb2bea8b tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:30.321818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:30.322472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.322763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.323510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/fff7f30b162d46ee89332b72f0acdf82` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.335159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fff7f30b162d46ee89332b72f0acdf82)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:30.336778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:30.360267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.365369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.399501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:30.420088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82', 'request_id': 'req-2e891f34-a617-4641-8cdf-fc3939eb4a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.430000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82', 'request_id': 'req-2e891f34-a617-4641-8cdf-fc3939eb4a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.436476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82', 'request_id': 'req-2e891f34-a617-4641-8cdf-fc3939eb4a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.449073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] The token cache is being invalidate because project fff7f30b162d46ee89332b72f0acdf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:30.449391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.450081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.461699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82', 'request_id': 'req-2e891f34-a617-4641-8cdf-fc3939eb4a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.462438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82', 'request_id': 'req-2e891f34-a617-4641-8cdf-fc3939eb4a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.466039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fff7f30b162d46ee89332b72f0acdf82', 'request_id': 'req-2e891f34-a617-4641-8cdf-fc3939eb4a75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.471929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2057/4099] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:30 2022] DELETE /identity/v3/domains/fff7f30b162d46ee89332b72f0acdf82 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:30.477008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:30.489167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b43e-9354-4689-958d-f5c6e203b8ff tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:30.559380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fecbb6-e56c-4d66-9bc9-4cb9d349fc70 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79808253be8b4572b8a27c87b52a427c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f936e10a5642a5a502e8adccf8788f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:30.560478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fecbb6-e56c-4d66-9bc9-4cb9d349fc70 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.560583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fecbb6-e56c-4d66-9bc9-4cb9d349fc70 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.560816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fecbb6-e56c-4d66-9bc9-4cb9d349fc70 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] PATH_INFO: `/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.570643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fecbb6-e56c-4d66-9bc9-4cb9d349fc70 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a1fecbb6-e56c-4d66-9bc9-4cb9d349fc70 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Could not find domain: f1c1de8c33d64ff8933f0beed8dd8321.: keystone.exception.DomainNotFound: Could not find domain: f1c1de8c33d64ff8933f0beed8dd8321. Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f1c1de8c33d64ff8933f0beed8dd8321. Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:30.576249 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:30.577398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:42:30.578685 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f1c1de8c33d64ff8933f0beed8dd8321. Oct 05 02:42:30.579933 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:30.581888 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2043/4100] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:30 2022] PATCH /identity/v3/domains/f1c1de8c33d64ff8933f0beed8dd8321 => generated 112 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 05 02:42:30.582082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:30.583423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:30.660438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e891f34-a617-4641-8cdf-fc3939eb4a75 tempest-DomainsNegativeTestJSON-510154364 tempest-DomainsNegativeTestJSON-510154364-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:30.670310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:30.671177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.671666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.672129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] PATH_INFO: `/v3/users/efc8d14a96d34d4fa7a0dc1f5797f111` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.673515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc8d14a96d34d4fa7a0dc1f5797f111)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:30.676809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:30.742093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc8d14a96d34d4fa7a0dc1f5797f111'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.765539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc8d14a96d34d4fa7a0dc1f5797f111'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.766443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc8d14a96d34d4fa7a0dc1f5797f111'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.779909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc8d14a96d34d4fa7a0dc1f5797f111'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.780583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc8d14a96d34d4fa7a0dc1f5797f111'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:30.797354 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2058/4101] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:30 2022] DELETE /identity/v3/users/efc8d14a96d34d4fa7a0dc1f5797f111 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:30.802812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670650ff-45af-4262-824d-283564d82896 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:30.803639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670650ff-45af-4262-824d-283564d82896 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:30.803639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670650ff-45af-4262-824d-283564d82896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:30.829363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-670650ff-45af-4262-824d-283564d82896 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:30.830656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-670650ff-45af-4262-824d-283564d82896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:30.928670 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2044/4102] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:30.937945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:30.939408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:30.965670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:31.019180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947070a4-3512-4f57-8c2f-dabad05b9247 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:31.023419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:31.024061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:31.024339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:31.024748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:31.035463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:31.036932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:31.048838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2059/4103] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:31.596929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670650ff-45af-4262-824d-283564d82896 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:31.598738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-670650ff-45af-4262-824d-283564d82896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:31.617722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670650ff-45af-4262-824d-283564d82896 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:31.652297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:31.653666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:31.654733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:31.654733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] PATH_INFO: `/v3/projects/2a1e69ba449b4bf7b260ca48a7a5980c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:31.661099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1e69ba449b4bf7b260ca48a7a5980c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:31.664591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:31.781015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:31.795197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1e69ba449b4bf7b260ca48a7a5980c', 'request_id': 'req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:31.815796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1e69ba449b4bf7b260ca48a7a5980c', 'request_id': 'req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:31.828548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1e69ba449b4bf7b260ca48a7a5980c', 'request_id': 'req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:31.854941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] The token cache is being invalidate because project 2a1e69ba449b4bf7b260ca48a7a5980c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:31.855237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:31.856019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:31.859130 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2045/4104] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:31 2022] DELETE /identity/v3/projects/2a1e69ba449b4bf7b260ca48a7a5980c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:31.864130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:31.881864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54494f8-fbee-44e8-bd47-4d192de59a5e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:32.014873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:32.015805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:32.016132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:32.016446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] PATH_INFO: `/v3/users/79808253be8b4572b8a27c87b52a427c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:32.023577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=79808253be8b4572b8a27c87b52a427c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:32.026954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:32.176547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79808253be8b4572b8a27c87b52a427c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:32.200840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79808253be8b4572b8a27c87b52a427c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:32.201775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79808253be8b4572b8a27c87b52a427c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:32.216634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79808253be8b4572b8a27c87b52a427c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:32.217592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b8dc34fa-36bf-41d2-a90d-60ea26af22ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79808253be8b4572b8a27c87b52a427c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:32.259331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2060/4105] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:31 2022] DELETE /identity/v3/users/79808253be8b4572b8a27c87b52a427c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:32.981365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:32.985235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:33.011949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d71f-b05f-44e0-8f65-e2fd8bf5763c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.090145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.090987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.091357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.091854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] PATH_INFO: `/v3/projects/d8f936e10a5642a5a502e8adccf8788f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.097739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f936e10a5642a5a502e8adccf8788f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.100047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.176429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f936e10a5642a5a502e8adccf8788f', 'request_id': 'req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:33.182415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f936e10a5642a5a502e8adccf8788f', 'request_id': 'req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:33.189133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f936e10a5642a5a502e8adccf8788f', 'request_id': 'req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:33.213100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] The token cache is being invalidate because project d8f936e10a5642a5a502e8adccf8788f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:33.213756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:33.215041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5ac48ff4-8dd8-4ea5-9ce5-623ab1604bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:33.217125 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2046/4106] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:32 2022] DELETE /identity/v3/projects/d8f936e10a5642a5a502e8adccf8788f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:33.222049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.222902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.223347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.259583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:33.262883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:33.326296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:33.368773 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2061/4107] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:33.377142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.378071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.378573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.401636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:33.402873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:33.416967 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2047/4108] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:33.418132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:33.432842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03654c84-5390-468d-9188-ef2f5c5c0d7e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.437779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.438436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.438663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.438936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.439584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:33.439956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.441968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.454649 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2062/4109] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:33.459192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:33.469862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6d0c8-46ac-45fb-b3ef-e048a3959bc7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.475664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.476269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.476551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.476970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.477626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.479530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.516133 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2048/4110] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:33 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:33.520182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:33.532140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1bc36-dd9c-45dc-9585-8e9defd08132 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.606460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.607081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.607365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.607639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.608280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.610260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.647421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2063/4111] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:33 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:33.650721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:33.670400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2190d61-d81c-4536-b9ae-7c0ce8c507c6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.677389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.678153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.678798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.679196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.679924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.681943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.699555 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2049/4112] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:33.703319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:33.716625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c20ad-9904-47fd-83b8-639bb1b895d4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.722901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34800d6-5727-4162-832b-52c5967f5ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.723340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34800d6-5727-4162-832b-52c5967f5ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.723641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34800d6-5727-4162-832b-52c5967f5ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.724024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34800d6-5727-4162-832b-52c5967f5ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.724683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34800d6-5727-4162-832b-52c5967f5ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.726852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34800d6-5727-4162-832b-52c5967f5ea5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.741358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2064/4113] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:33.745895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:33.758709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615fd1e-1899-47f7-89e9-b955dce6ac4e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:33.767830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:33.768871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.769336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.769770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] PATH_INFO: `/v3/projects/d66df97f62864542b8d0ba4fab135541/users/23e7a8347927445385162c28829824c0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.790351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66df97f62864542b8d0ba4fab135541, user_id=23e7a8347927445385162c28829824c0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:33.796152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:33.800998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:33.823899 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2050/4114] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:33 2022] PUT /identity/v3/projects/d66df97f62864542b8d0ba4fab135541/users/23e7a8347927445385162c28829824c0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:33.841748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:33.843125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:33.843951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:33.878834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] MFA Rules not processed for user `23e7a8347927445385162c28829824c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:33.880041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:33.996946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2065/4115] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:34.000396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.082458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde394b-4c04-4975-a24f-a507c94b7cc3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.088617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.089450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.089881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.090036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.090662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:34.092606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:34.130699 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2051/4116] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:33 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:34.134813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.151715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201c122-7523-4a17-b009-ee5cdd8e883a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.193071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:34.269038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019f239-7137-467c-b71d-451fecb7f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.269704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019f239-7137-467c-b71d-451fecb7f561 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.269977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019f239-7137-467c-b71d-451fecb7f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.270266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019f239-7137-467c-b71d-451fecb7f561 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.271538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019f239-7137-467c-b71d-451fecb7f561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:34.278513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019f239-7137-467c-b71d-451fecb7f561 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:34.320187 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2066/4117] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:34 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:34.325694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.339686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed0bd1-ad35-4ce1-ab9f-9600eba2a50e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.344765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.345578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.345866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.346750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.354357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:34.354357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:34.374742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.375148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.375459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.382611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2052/4118] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:34.387173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.401304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0b114-0c4f-40c3-bc0f-b20db40586d8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.428261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.428868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] MFA Rules not processed for user `1b4b5f0c43074932a8963727adfee38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:34.429138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.429486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.429960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] PATH_INFO: `/v3/projects/81aec64fa9b84c308c116ebd03b9e80d/users/12076d806e3642098260a50ab7e65530/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.430256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:34.448074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81aec64fa9b84c308c116ebd03b9e80d, user_id=12076d806e3642098260a50ab7e65530, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:34.451450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:34.481251 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2053/4119] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:34 2022] PUT /identity/v3/projects/81aec64fa9b84c308c116ebd03b9e80d/users/12076d806e3642098260a50ab7e65530/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:34.489485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.535763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2067/4120] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:34.607526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bb51f-1b78-44fa-8cc8-a380cf56df68 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.614683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735b2c-55a1-452a-9b36-ee393ad1937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.615414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735b2c-55a1-452a-9b36-ee393ad1937d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.615947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735b2c-55a1-452a-9b36-ee393ad1937d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.616181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735b2c-55a1-452a-9b36-ee393ad1937d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.617307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735b2c-55a1-452a-9b36-ee393ad1937d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:34.619102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735b2c-55a1-452a-9b36-ee393ad1937d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:34.639341 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2054/4121] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:34.643177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.661886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c14b3-5fb1-41d6-875b-2acc218af393 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.667425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.668084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.668366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.668702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] PATH_INFO: `/v3/projects/81aec64fa9b84c308c116ebd03b9e80d/users/12076d806e3642098260a50ab7e65530/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.671053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81aec64fa9b84c308c116ebd03b9e80d, user_id=12076d806e3642098260a50ab7e65530, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:34.673859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:34.705903 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2068/4122] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:34 2022] PUT /identity/v3/projects/81aec64fa9b84c308c116ebd03b9e80d/users/12076d806e3642098260a50ab7e65530/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:34.777778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.778119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.778543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.788570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:34.792960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:34.841792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] MFA Rules not processed for user `12076d806e3642098260a50ab7e65530`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:34.843190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:34.930720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:34.957397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a235-6ad4-4f47-bdf8-bc0a319985b4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:34.972644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:34.975825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:34.976351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:34.976788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:34.986692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:35.017389 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2055/4123] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:35.019525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.019766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.021250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.034339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcdad5-67fe-4ae0-a51e-b626692f21b6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.039044 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2069/4124] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:35.055220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.057950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.057950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.058198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.061112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.063031 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:35.063031 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:35.063031 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:35.064341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.099315 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2056/4125] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/roles => generated 235 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.099987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.111559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2518c-ea58-4cce-875b-e3a77f773f30 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.117163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.117789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.118079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.118362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.119041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.120064 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:35.120064 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:35.120064 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:35.121360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.173048 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2070/4126] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/roles => generated 234 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:35.176833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.199823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e50800-f7a0-4540-a961-bf525b256515 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.225800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.226439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.226881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.227167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.227867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.230001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.260327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2057/4127] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/roles => generated 235 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.261565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.288920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1240b3-9035-44c8-a67f-30df8f6afb1a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.297892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.300112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.301100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.301968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.302928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.305624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.329866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2071/4128] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/domains => generated 276 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.334189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.349304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783f145-a17c-479d-a828-e13d74166e30 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.457821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.459094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.459094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.459094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.459839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.466176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.537384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2058/4129] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/projects => generated 400 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:35.541169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.558649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12ff9a-f090-4990-a542-89042d013995 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.574922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:35.689292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.690240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.690794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.690794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.691352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.692783 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:35.692783 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:35.692783 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:35.694403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.719358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2072/4130] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/groups => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.724010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.755307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7122152-35ad-4e2b-8911-0f59faff1988 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.777827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.778483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.778779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.779068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.779965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.781432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.831619 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2059/4131] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/roles => generated 235 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.835375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.852850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972915a1-bf98-4a3b-b7a1-2bc7ef8a4ee4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.866093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.869403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.869763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.870183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.870869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.873907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.908185 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2073/4132] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/users => generated 442 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.912830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.924772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4feb0-032b-44d6-8a27-642bdaf2a150 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.929964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.930600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.931399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.931530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:35.932165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:35.933229 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:35.933229 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:35.933229 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:35.934127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:35.954713 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2060/4133] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:35 2022] POST /identity/v3/roles => generated 269 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:35.959348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:35.974039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bfb4b-7140-43e1-a742-5d4bb8fa8ab1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:35.979578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:35.980276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:35.980580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:35.980837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/9db65c5ebfdb49f8a8f6f3820e50c515` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.008625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=9db65c5ebfdb49f8a8f6f3820e50c515)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.011614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:36.025824 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2074/4134] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:35 2022] PUT /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/9db65c5ebfdb49f8a8f6f3820e50c515 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:36.030172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:36.042063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a3bbf-d874-48c8-a19a-118a6fe5a225 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:36.098800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:36.112654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:36.113560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:36.114187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:36.114748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.115680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Adding query filter params (scope.project.id=6676c083a8ae45648b11ceb36697daca, user.id=053fd348556248559e288c43749fa28a) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:36.116165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.118127 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:36.118127 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:36.118127 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:36.119855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:36.183714 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2061/4135] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:42:36 2022] GET /identity/v3/role_assignments?scope.project.id=6676c083a8ae45648b11ceb36697daca&user.id=053fd348556248559e288c43749fa28a&effective => generated 228 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:36.188198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:36.203540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe0b6-c8a2-4899-9bf6-d041eed5ca52 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:36.212114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:36.222399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:36.222779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:36.223233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/9db65c5ebfdb49f8a8f6f3820e50c515` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.227332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=9db65c5ebfdb49f8a8f6f3820e50c515)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.228479 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:36.228479 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:36.228479 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:36.230604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:36.240763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 9db65c5ebfdb49f8a8f6f3820e50c515 was removed from user 053fd348556248559e288c43749fa28a on project 6676c083a8ae45648b11ceb36697daca. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:36.241147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:36.241964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:36.260938 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2075/4136] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:36 2022] DELETE /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/9db65c5ebfdb49f8a8f6f3820e50c515 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:36.262949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:36.264982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:36.280981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f94358-5900-4e5b-8c11-e8dd6c42efe8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:36.349746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:36.350494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:36.350846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:36.351194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/9db65c5ebfdb49f8a8f6f3820e50c515` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.352442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9db65c5ebfdb49f8a8f6f3820e50c515)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.353582 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:36.353582 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:36.353582 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:36.354660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:36.401072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 9db65c5ebfdb49f8a8f6f3820e50c515 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:36.401512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:36.402284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:36.404418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2062/4137] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:36 2022] DELETE /identity/v3/roles/9db65c5ebfdb49f8a8f6f3820e50c515 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:36.409968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:36.420299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee1d40-3346-4cff-9168-8d0fdda98363 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:36.507766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:36.508712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:36.509246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:36.510328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/4c17e89f32ab43449c1704f89cc77e81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.525828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=4c17e89f32ab43449c1704f89cc77e81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.533946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:36.567416 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2076/4138] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:36 2022] PUT /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/4c17e89f32ab43449c1704f89cc77e81 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:36.571549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:36.573038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:36.586416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4cf03-fc11-4835-813b-e17c8c23bb79 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:36.675304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:36.676057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:36.676482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:36.676858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.678750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.680036 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:36.680036 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:36.680036 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:36.681120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:36.708596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:36.727976 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2063/4139] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:36 2022] PUT /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 520 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:36.729312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:36.743252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04047f80-ef89-45e9-9503-5f9552390623 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:36.801831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:36.828722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:36.831994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:36.834659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:36.839079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:36.839948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Adding query filter params (scope.project.id=6676c083a8ae45648b11ceb36697daca, user.id=053fd348556248559e288c43749fa28a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:36.840891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:36.843033 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:36.843033 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:36.843033 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:36.847878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.073288 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2077/4140] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:42:36 2022] GET /identity/v3/role_assignments?scope.project.id=6676c083a8ae45648b11ceb36697daca&user.id=053fd348556248559e288c43749fa28a&effective => generated 1061 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:37.077201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.091058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8e2ac-78e7-488f-b38b-38747f54050b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.108166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.108845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.109155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.109444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.115919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.117085 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:37.117085 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:37.117085 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:37.118505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.140882 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2064/4141] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:37 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:37.150250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.165162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d751286-9cd8-4e5b-a145-2454cf676735 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.263739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.264510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.265036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.265428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.266443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Adding query filter params (scope.project.id=6676c083a8ae45648b11ceb36697daca, user.id=053fd348556248559e288c43749fa28a) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:37.266865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.269658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.339289 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2078/4142] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:42:37 2022] GET /identity/v3/role_assignments?scope.project.id=6676c083a8ae45648b11ceb36697daca&user.id=053fd348556248559e288c43749fa28a&effective => generated 577 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:37.340509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.352892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16105624-4745-44bf-8bf1-55a7dfc0754f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.359032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.361277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.362000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.362566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.364994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.366917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b.: keystone.exception.ImpliedRoleNotFound: 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b. Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = query.one() Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._iter().one() Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._only_one_row( Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:37.400518 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 05 02:42:37.402202 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 05 02:42:37.403640 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 05 02:42:37.403640 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 05 02:42:37.403640 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 05 02:42:37.403640 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b. Oct 05 02:42:37.403640 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:37.407496 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2065/4143] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:37 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 137 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:37.411769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.424046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e814e-03a2-49bf-add9-43f606290ede tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.429695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.430462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.431313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.431759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/4c17e89f32ab43449c1704f89cc77e81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.434405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=4c17e89f32ab43449c1704f89cc77e81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.437937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.444175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 4c17e89f32ab43449c1704f89cc77e81 was removed from user 053fd348556248559e288c43749fa28a on project 6676c083a8ae45648b11ceb36697daca. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:37.444544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:37.445744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:37.460383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2079/4144] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:37 2022] DELETE /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/4c17e89f32ab43449c1704f89cc77e81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:37.465763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.467667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:37.496568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8da9c4-2c3b-4a40-9636-83efcdf8e94c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.560308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.561542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.562029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.562559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.563245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.565825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.597224 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2066/4145] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:37 2022] POST /identity/v3/roles => generated 272 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:37.597538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.611257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a45bb-7ffb-4e0e-968e-1a769ce3d321 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.622920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.623814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.624299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.624739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.625624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Adding query filter params (domain_id=043e7e92af08450bb66119dcb34b07ad) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:37.626577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.631079 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:37.631079 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:37.631079 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:37.632555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.656392 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2080/4146] 10.222.0.16 () {58 vars in 1207 bytes} [Wed Oct 5 02:42:37 2022] GET /identity/v3/roles?domain_id=043e7e92af08450bb66119dcb34b07ad => generated 409 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:37.660748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.675735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acd0f8-80fe-4639-9d2b-dfed32e6c010 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.682472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.683330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.683616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.684019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4cc4ccf67a4a4ae9bddb376b77282dbb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.685417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=4cc4ccf67a4a4ae9bddb376b77282dbb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.687412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.752078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 4cc4ccf67a4a4ae9bddb376b77282dbb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:37.752754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:37.765367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:37.765367 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2067/4147] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:37 2022] DELETE /identity/v3/roles/4cc4ccf67a4a4ae9bddb376b77282dbb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:37.766159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.766159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:37.782729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346899-96b4-475b-b348-45b6f7523bc9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.816446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:37.893147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.893937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.894236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.894523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.895205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Adding query filter params (domain_id=043e7e92af08450bb66119dcb34b07ad) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:37.895522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.897213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:37.906624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2081/4148] 10.222.0.16 () {58 vars in 1207 bytes} [Wed Oct 5 02:42:37 2022] GET /identity/v3/roles?domain_id=043e7e92af08450bb66119dcb34b07ad => generated 148 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:37.910941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.924337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d7af4-e53d-4257-b79c-e59512d5e032 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.934508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.935242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.935528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.935861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4cc4ccf67a4a4ae9bddb376b77282dbb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.951886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Could not find role: 4cc4ccf67a4a4ae9bddb376b77282dbb.: keystone.exception.RoleNotFound: Could not find role: 4cc4ccf67a4a4ae9bddb376b77282dbb. Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 05 02:42:37.959200 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:42:37.960430 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 4cc4ccf67a4a4ae9bddb376b77282dbb. Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:37.961630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2068/4149] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:37 2022] DELETE /identity/v3/roles/4cc4ccf67a4a4ae9bddb376b77282dbb => generated 110 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:37.965816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:37.977728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551382d-4dfc-49e1-bc72-4d3c4f077bc7 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:37.983112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:37.983937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:37.984324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:37.984869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:37.994303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=043e7e92af08450bb66119dcb34b07ad, group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:37.997477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.026944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:38.027696 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2082/4150] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:37 2022] PUT /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:38.040461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f61b1-e079-4021-91c8-fdd779efd91f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:38.248868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:38.254789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.255309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.255770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.270572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=043e7e92af08450bb66119dcb34b07ad, group_id=30b980e44ade4ac7901d53574ee332d7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:38.272777 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:38.272777 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:38.272777 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:38.280526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.333070 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2069/4151] 10.222.0.16 () {58 vars in 1365 bytes} [Wed Oct 5 02:42:38 2022] GET /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles => generated 410 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:38.337357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:38.359809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf281d-e873-4034-9181-d63712033136 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:38.371922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:38.372966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.373456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.374016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.376532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=043e7e92af08450bb66119dcb34b07ad, group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:38.377899 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:38.377899 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:38.377899 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:38.383369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.399894 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2083/4152] 10.222.0.16 () {58 vars in 1465 bytes} [Wed Oct 5 02:42:38 2022] HEAD /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:38.404685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:38.420734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dcce6-88cc-4df6-9348-042dd4ef0f8b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:38.437710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:38.438438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.438729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.439007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.442446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=043e7e92af08450bb66119dcb34b07ad, group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:38.443488 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:38.443488 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:38.443488 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:38.449692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.453742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:38.473686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 92e6ef22eeb44b8aa7350a3e344c44f9 was removed from group 30b980e44ade4ac7901d53574ee332d7 on domain 043e7e92af08450bb66119dcb34b07ad. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:38.473993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:38.476466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:38.523096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2070/4153] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:38 2022] DELETE /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:38.524436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:38.527147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:38.550465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff079b-f8a6-46e5-a56c-f788f7bfb03a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:38.618808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:38.619485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.619955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.620238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.623852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6676c083a8ae45648b11ceb36697daca, group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:38.626684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.647181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2084/4154] 10.222.0.16 () {60 vars in 1486 bytes} [Wed Oct 5 02:42:38 2022] PUT /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:38.651060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:38.665694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9de349-7dee-4ea7-8c8f-7b56420dc563 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:38.735170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea1601-d27e-4c0b-a573-8c66c7dfb798 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:38.735833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1601-d27e-4c0b-a573-8c66c7dfb798 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.736127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1601-d27e-4c0b-a573-8c66c7dfb798 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.736411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1601-d27e-4c0b-a573-8c66c7dfb798 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.738981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea1601-d27e-4c0b-a573-8c66c7dfb798 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_grants(project_id=6676c083a8ae45648b11ceb36697daca, group_id=30b980e44ade4ac7901d53574ee332d7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:38.741594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea1601-d27e-4c0b-a573-8c66c7dfb798 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.753837 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2071/4155] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:42:38 2022] GET /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles => generated 411 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:38.758533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:38.769183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c3406-9e88-4f53-bc82-c1a1b761332c tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:38.774219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:38.781132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.781581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.782648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/groups/30b980e44ade4ac7901d53574ee332d7/users/053fd348556248559e288c43749fa28a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.786139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=30b980e44ade4ac7901d53574ee332d7, user_id=053fd348556248559e288c43749fa28a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:38.787447 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:38.787447 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:38.787447 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:38.789336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:38.827043 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2085/4156] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:42:38 2022] PUT /identity/v3/groups/30b980e44ade4ac7901d53574ee332d7/users/053fd348556248559e288c43749fa28a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:38.828431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:38.828754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:38.837621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:38.922204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] MFA Rules not processed for user `053fd348556248559e288c43749fa28a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:38.923467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:39.093770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2072/4157] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:38 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:39.099079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.210023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b4fc-be84-4ba8-ac1d-b11f3ad4e52f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.218577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.219434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.219800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.220158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.225029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6676c083a8ae45648b11ceb36697daca, group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.227908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.237647 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2086/4158] 10.222.0.16 () {58 vars in 1468 bytes} [Wed Oct 5 02:42:39 2022] HEAD /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:39.242152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.263882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e19e5-6a44-47ab-9850-15b0fe899ae8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.272797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.275429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.276041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.277425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.282782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6676c083a8ae45648b11ceb36697daca, group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.289429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.304521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 92e6ef22eeb44b8aa7350a3e344c44f9 was removed from group 30b980e44ade4ac7901d53574ee332d7 on project 6676c083a8ae45648b11ceb36697daca. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:39.304736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:39.311443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:39.343212 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2073/4159] 10.222.0.16 () {58 vars in 1470 bytes} [Wed Oct 5 02:42:39 2022] DELETE /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:39.360540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.364220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:39.387839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c403958-527f-42f7-bf85-48d216560f42 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.396509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:39.516763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.517537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.518115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.519236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/groups/30b980e44ade4ac7901d53574ee332d7/users/053fd348556248559e288c43749fa28a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.521649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=30b980e44ade4ac7901d53574ee332d7, user_id=053fd348556248559e288c43749fa28a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.522747 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:39.522747 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:39.522747 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:39.524794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.571192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '053fd348556248559e288c43749fa28a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:39.591706 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2087/4160] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:42:39 2022] DELETE /identity/v3/groups/30b980e44ade4ac7901d53574ee332d7/users/053fd348556248559e288c43749fa28a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:39.600079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.611985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5735-2817-4bbe-a891-2cc57f4d25cc tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.632548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:39.706817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.707703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.708726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.709069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.711134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.712273 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:39.712273 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:39.712273 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:39.717086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.730563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2074/4161] 10.222.0.16 () {60 vars in 1381 bytes} [Wed Oct 5 02:42:39 2022] PUT /identity/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:39.738115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.753963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91c8ff-5469-4213-86e4-40b292e25dbd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.761278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.761927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.762541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.762828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.764087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=30b980e44ade4ac7901d53574ee332d7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.765119 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:39.765119 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:39.765119 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:39.766359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.786665 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2088/4162] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 02:42:39 2022] GET /identity/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles => generated 376 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:39.802555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.817566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74295a38-baa7-49c9-8487-5fc08c37807e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.822844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.823510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.824011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.824170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.825942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.827065 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:39.827065 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:39.827065 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:39.827968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.837591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2075/4163] 10.222.0.16 () {58 vars in 1363 bytes} [Wed Oct 5 02:42:39 2022] HEAD /identity/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:39.839786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.852199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c54d4e-2b10-458b-a3a2-7d1014c4ebbe tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.857825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.858503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.858793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.859496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.860840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=30b980e44ade4ac7901d53574ee332d7, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.862919 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:39.862919 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:39.862919 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:39.864125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.877827 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2089/4164] 10.222.0.16 () {58 vars in 1365 bytes} [Wed Oct 5 02:42:39 2022] DELETE /identity/v3/system/groups/30b980e44ade4ac7901d53574ee332d7/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:39.882569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.895139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d867d-c284-41fa-98d4-19b05e96809d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:39.908685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:39.908685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:39.908685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:39.909449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:39.914968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=043e7e92af08450bb66119dcb34b07ad, user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:39.917835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:39.933541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2076/4165] 10.222.0.16 () {60 vars in 1480 bytes} [Wed Oct 5 02:42:39 2022] PUT /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:39.937891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:39.953748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804b7d8-9c54-4da6-978f-847f11654648 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.039131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.040069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.040450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.040939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.042934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=043e7e92af08450bb66119dcb34b07ad, user_id=053fd348556248559e288c43749fa28a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.045179 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.045179 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:40.045179 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:40.061510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.080751 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2090/4166] 10.222.0.16 () {58 vars in 1362 bytes} [Wed Oct 5 02:42:39 2022] GET /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles => generated 409 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:40.084575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.100750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c2bf9-3b10-496a-8c0d-b1ffc3253c4e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.107035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.107871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.108771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.109236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.112727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=043e7e92af08450bb66119dcb34b07ad, user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.114907 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.114907 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:40.114907 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:40.117334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.131805 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2077/4167] 10.222.0.16 () {58 vars in 1462 bytes} [Wed Oct 5 02:42:40 2022] HEAD /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:40.135854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.148057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc234e-a943-4c03-a320-cae30a69f849 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.178558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.179407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.179653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.179940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.183393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=043e7e92af08450bb66119dcb34b07ad, user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.186959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.205812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 92e6ef22eeb44b8aa7350a3e344c44f9 was removed from user 053fd348556248559e288c43749fa28a on domain 043e7e92af08450bb66119dcb34b07ad. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:40.206210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:40.209428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:40.233484 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2091/4168] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Oct 5 02:42:40 2022] DELETE /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:40.239106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.241596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:40.257662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac0d6-37db-4b28-b91f-e0ca87bab26e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.326167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.326936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.327108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.327396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.329658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.333220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.349929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2078/4169] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:40 2022] PUT /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:40.353864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.365179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6b6c-2a8e-412c-84cb-f51f51e7b047 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.411052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:40.429768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.430883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.431764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.432094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.434676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_grants(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.437420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.451852 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2092/4170] 10.222.0.16 () {58 vars in 1365 bytes} [Wed Oct 5 02:42:40 2022] GET /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles => generated 410 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:40.457479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.469559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948a3fc-9d9e-49e3-82d2-d61903e35751 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.474753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.475416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.475697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.475975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.478346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.481093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.499570 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2079/4171] 10.222.0.16 () {58 vars in 1465 bytes} [Wed Oct 5 02:42:40 2022] HEAD /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:40.510199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.520867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98944883-5a6a-45c9-850f-d0340a04051b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.525679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.526344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.526624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.526901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.529110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6676c083a8ae45648b11ceb36697daca, user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.531752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.540068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 92e6ef22eeb44b8aa7350a3e344c44f9 was removed from user 053fd348556248559e288c43749fa28a on project 6676c083a8ae45648b11ceb36697daca. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:40.540068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:40.540759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:40.555203 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2093/4172] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:40 2022] DELETE /identity/v3/projects/6676c083a8ae45648b11ceb36697daca/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:40.560528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.565561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:40.582223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a6c-19db-4cbf-b09a-403e7df25c95 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.655270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.656083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.656382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.656668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.659334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.665713 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.665713 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:40.665713 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:40.666771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.677524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2080/4173] 10.222.0.16 () {60 vars in 1378 bytes} [Wed Oct 5 02:42:40 2022] PUT /identity/v3/system/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:40.682061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.694649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd01460-8b72-459c-a30c-9e42ec8c65fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.700328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.701118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.701506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.702504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/users/053fd348556248559e288c43749fa28a/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.703513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=053fd348556248559e288c43749fa28a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.704686 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.704686 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:40.704686 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:40.706393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.720039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2094/4174] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:42:40 2022] GET /identity/v3/system/users/053fd348556248559e288c43749fa28a/roles => generated 375 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:40.725060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.735117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6fdd-393b-4c0f-b165-e6e1a265e552 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.740884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.741598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.741888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.742175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.743901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.745167 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.745167 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:40.745167 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:40.746063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.751706 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2081/4175] 10.222.0.16 () {58 vars in 1360 bytes} [Wed Oct 5 02:42:40 2022] HEAD /identity/v3/system/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:40.755837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.765756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e787a3-98f2-4d6e-94f9-974b9236de28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.770930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.771570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.771861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.772143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/system/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.773865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=053fd348556248559e288c43749fa28a, role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.774870 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.774870 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:40.774870 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:40.775800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.784576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2095/4176] 10.222.0.16 () {58 vars in 1362 bytes} [Wed Oct 5 02:42:40 2022] DELETE /identity/v3/system/users/053fd348556248559e288c43749fa28a/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:40.789442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.795094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:40.801777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62446e-3b72-4cdb-a7de-90b9bdf3039e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.808695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.809265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.809558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.809841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.810713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.812556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.837508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2082/4177] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:40 2022] POST /identity/v3/roles => generated 269 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:40.838866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.854705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df96154-e233-4567-bde4-78dedd9d7b48 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.865415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.866042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.866390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.866673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.867362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.868376 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:40.868376 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:40.868376 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:40.869452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.903486 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2096/4178] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:40 2022] POST /identity/v3/roles => generated 270 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:40.904252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.915917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9af5d-65dc-46b6-bf75-bcf40dd975a9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:40.922514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:40.923926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:40.924701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:40.925620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/12dcc35b2565426b8fd429c7c42a7306` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:40.928169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8d247f71aed64386a6c0e961341c119a, implied_role_id=12dcc35b2565426b8fd429c7c42a7306)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:40.930315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:40.983545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:40.983933 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2083/4179] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:40 2022] PUT /identity/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/12dcc35b2565426b8fd429c7c42a7306 => generated 530 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:41.005896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23940-e3b2-48f7-8581-3d629345a107 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.091720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.092508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.093174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.093499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.094665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.097050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.119887 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2097/4180] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:40 2022] POST /identity/v3/domains => generated 276 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:41.121404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.135492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ba82-f87d-41c4-9070-f342a4630224 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.209514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.210167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.210454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.210796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.212243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.219227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.221517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:41.228208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.264682 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2084/4181] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:41 2022] POST /identity/v3/roles => generated 270 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:41.265911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.278112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fa10-b6cd-46b5-9d3d-f1b15a6258ff tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.283213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.284608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.285235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.285869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/325ffb69460e4a019d7f04ce1c4b16d9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.289545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8d247f71aed64386a6c0e961341c119a, implied_role_id=325ffb69460e4a019d7f04ce1c4b16d9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.303603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.370228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb080ac-d765-406c-aa8b-7bf2d08e6779 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.371209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2085/4182] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:41 2022] PUT /identity/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/325ffb69460e4a019d7f04ce1c4b16d9 => generated 530 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:41.375652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.394828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:41.465495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.466342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.466794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.467242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.467416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dea4d-c6e2-434d-9de2-f66388a918c0 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.470156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:41.474280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.474986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.475279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.475560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.477552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8d247f71aed64386a6c0e961341c119a, implied_role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.479347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.489366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.492253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.515992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2086/4183] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:41 2022] PUT /identity/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 525 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:41.521102 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2098/4184] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:41.522562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.537278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:41.606873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc612db2-717c-4c11-84ac-0c8cf77a8a6b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.614223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.615077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.615966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.616270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/92e6ef22eeb44b8aa7350a3e344c44f9/implies/8d247f71aed64386a6c0e961341c119a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.618168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=92e6ef22eeb44b8aa7350a3e344c44f9, implied_role_id=8d247f71aed64386a6c0e961341c119a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.619837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] 8d247f71aed64386a6c0e961341c119a cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 8d247f71aed64386a6c0e961341c119a cannot be an implied roles. Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 05 02:42:41.640091 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 05 02:42:41.641387 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:41.641387 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:41.641387 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 05 02:42:41.641387 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 05 02:42:41.641387 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 8d247f71aed64386a6c0e961341c119a cannot be an implied roles. Oct 05 02:42:41.641387 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:41.645335 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2087/4185] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:41 2022] PUT /identity/v3/roles/92e6ef22eeb44b8aa7350a3e344c44f9/implies/8d247f71aed64386a6c0e961341c119a => generated 116 bytes in 124 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:41.646532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.659713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e9bea-f322-42ce-aca4-46d64c554a97 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.672933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.674355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.675053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.675549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.678828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8d247f71aed64386a6c0e961341c119a, implied_role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.680034 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:41.680034 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:41.680034 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:41.681353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.694678 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2099/4186] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:41 2022] DELETE /identity/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:41.699633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.713874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9707aa-b25e-46f6-a1a6-782ec2e3c32f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.786901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.787831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.788604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.789126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/325ffb69460e4a019d7f04ce1c4b16d9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.791391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8d247f71aed64386a6c0e961341c119a, implied_role_id=325ffb69460e4a019d7f04ce1c4b16d9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.793358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.803400 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2088/4187] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:41 2022] DELETE /identity/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/325ffb69460e4a019d7f04ce1c4b16d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:41.807925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.821989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c80c3d-63fc-4b5c-a43b-68825d82b399 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:41.885613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:41.886187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:41.886519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:41.886863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/325ffb69460e4a019d7f04ce1c4b16d9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:41.888089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=325ffb69460e4a019d7f04ce1c4b16d9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:41.889316 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:41.889316 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:41.889316 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:41.890209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:41.934673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 325ffb69460e4a019d7f04ce1c4b16d9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:41.936420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:41.937256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:41.939461 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2100/4188] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:41 2022] DELETE /identity/v3/roles/325ffb69460e4a019d7f04ce1c4b16d9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:41.944380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:41.947318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:41.962490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abcb52-3ccb-4b31-b48b-7e8d2a4e10ac tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.032051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:42.034607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:42.035566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:42.035861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/892f7375db644be9ab67d20f9a7769c7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:42.049730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=892f7375db644be9ab67d20f9a7769c7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:42.051759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:42.078435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '892f7375db644be9ab67d20f9a7769c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.079188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '892f7375db644be9ab67d20f9a7769c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.102869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:42.119914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '892f7375db644be9ab67d20f9a7769c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.120686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '892f7375db644be9ab67d20f9a7769c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.127040 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2089/4189] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:41 2022] PATCH /identity/v3/domains/892f7375db644be9ab67d20f9a7769c7 => generated 277 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:42.128139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:42.139415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6c7e8-1107-468e-8d3d-0f6ff181321e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.222096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:42.222797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:42.223315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:42.223662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/892f7375db644be9ab67d20f9a7769c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:42.230113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:42.243160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=892f7375db644be9ab67d20f9a7769c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:42.246695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:42.284276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '892f7375db644be9ab67d20f9a7769c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.288450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '892f7375db644be9ab67d20f9a7769c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.341427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892f7375db644be9ab67d20f9a7769c7', 'request_id': 'req-5956fa53-0a05-43d8-a0ea-25e94930cad9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.350844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892f7375db644be9ab67d20f9a7769c7', 'request_id': 'req-5956fa53-0a05-43d8-a0ea-25e94930cad9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.357201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892f7375db644be9ab67d20f9a7769c7', 'request_id': 'req-5956fa53-0a05-43d8-a0ea-25e94930cad9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.369515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] The token cache is being invalidate because project 892f7375db644be9ab67d20f9a7769c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:42.369871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.370491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.379639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '892f7375db644be9ab67d20f9a7769c7', 'request_id': 'req-5956fa53-0a05-43d8-a0ea-25e94930cad9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.380752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '892f7375db644be9ab67d20f9a7769c7', 'request_id': 'req-5956fa53-0a05-43d8-a0ea-25e94930cad9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.384477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '892f7375db644be9ab67d20f9a7769c7', 'request_id': 'req-5956fa53-0a05-43d8-a0ea-25e94930cad9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.392005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2101/4190] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:42 2022] DELETE /identity/v3/domains/892f7375db644be9ab67d20f9a7769c7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:42.396374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:42.397916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:42.412594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c42ec6-f8d9-48e0-8e04-23a9cc3ead56 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.471919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:42.472495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:42.472781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:42.473093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/12dcc35b2565426b8fd429c7c42a7306` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:42.474802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8d247f71aed64386a6c0e961341c119a, implied_role_id=12dcc35b2565426b8fd429c7c42a7306)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:42.476415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:42.495055 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2090/4191] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:42 2022] DELETE /identity/v3/roles/8d247f71aed64386a6c0e961341c119a/implies/12dcc35b2565426b8fd429c7c42a7306 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:42.499447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:42.500928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:42.514531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956fa53-0a05-43d8-a0ea-25e94930cad9 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.579478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:42.580454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:42.580830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:42.581171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/12dcc35b2565426b8fd429c7c42a7306` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:42.582851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=12dcc35b2565426b8fd429c7c42a7306)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:42.584106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:42.621296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 12dcc35b2565426b8fd429c7c42a7306 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:42.621594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.622320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.624442 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2102/4192] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:42 2022] DELETE /identity/v3/roles/12dcc35b2565426b8fd429c7c42a7306 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:42.628369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:42.630276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:42.642915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8160f-5c49-4b3d-bf6a-92d5970efc1e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.717809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:42.718586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:42.718876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:42.719155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/8d247f71aed64386a6c0e961341c119a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:42.720316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8d247f71aed64386a6c0e961341c119a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:42.722706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:42.773232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 8d247f71aed64386a6c0e961341c119a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:42.773881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.774913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:42.777517 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2091/4193] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:42 2022] DELETE /identity/v3/roles/8d247f71aed64386a6c0e961341c119a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:42.782971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:42.794691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:42.804762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a77575-462a-40ac-976c-22b77a0ad32d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.884691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:42.885521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:42.886031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:42.886411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:42.888231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:42.889396 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:42.889396 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:42.889396 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:42.890548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:42.923832 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2103/4194] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:42 2022] PUT /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 520 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:42.926785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:42.928209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:42.942046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce5cb1-34ed-4353-a7e1-00a893f4d510 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:42.998721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:43.007282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.007934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.008219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.008502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.010178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.011207 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:43.011207 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:43.011207 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:43.012087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.013013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.013888 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:43.013888 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:43.013888 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:43.014713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.021080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2092/4195] 10.222.0.16 () {58 vars in 1345 bytes} [Wed Oct 5 02:42:42 2022] HEAD /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:43.025053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.036218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5828d3-9c0c-4ff1-83e3-80644285f739 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.040862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.041536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.041817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.042092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.043700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.044702 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:43.044702 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:43.044702 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:43.045623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.051273 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2104/4196] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:42:43 2022] GET /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 520 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:43.055386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.065642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd29c-5032-4b70-a284-26994e3445c2 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.070193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.070855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.071137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.071414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.073047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.074631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.084145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2093/4197] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:43 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:43.088605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.100709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266dd25-ce12-4c36-acc1-162a381f66fd tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.160102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.160760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.161100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.161382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.163019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.164616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b.: keystone.exception.ImpliedRoleNotFound: 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b. Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = query.one() Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._iter().one() Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._only_one_row( Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:43.175125 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 05 02:42:43.176621 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 05 02:42:43.178056 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 05 02:42:43.178056 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b. Oct 05 02:42:43.178056 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:42:43.178056 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2105/4198] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:42:43 2022] GET /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 137 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:43.180943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.194476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8f61e-5d3e-4cb6-93d7-a55ef6d3db21 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.199196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.199868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.200154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.200431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.202156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.203740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b.: keystone.exception.ImpliedRoleNotFound: 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b. Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = query.one() Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._iter().one() Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._only_one_row( Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:43.213158 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 05 02:42:43.214534 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 05 02:42:43.215663 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 05 02:42:43.215663 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 05 02:42:43.215663 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 05 02:42:43.215663 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 4c17e89f32ab43449c1704f89cc77e81 does not imply 2caf7e533c0f47358c92e8a7d8d5e48b. Oct 05 02:42:43.215663 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:43.215663 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2094/4199] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:43 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 137 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 05 02:42:43.220469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.232568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07edc57-dbb3-4038-86ed-1003934a6cab tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.238732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.239381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.239663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.239942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.241785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.243390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.289177 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2106/4200] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:43 2022] PUT /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 520 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:43.293037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.307299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d45832-85ca-4e7c-815e-8c491c58dcb6 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.375736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.376406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.376691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.377066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.379461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=f3d7f62fb6f94f60b1566912abff1773)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.381760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.415318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2095/4201] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:43 2022] PUT /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773 => generated 521 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:43.421755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.438805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245ed2-1243-4326-8cde-d1b8b94a5417 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.499718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:43.514127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.514714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.515005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.515283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.516993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f3d7f62fb6f94f60b1566912abff1773, implied_role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.519431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.546780 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2107/4202] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:43 2022] PUT /identity/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 521 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:43.547944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.558886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624571a2-ef03-4c73-9d5e-00e7f98a03b1 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.617347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.617966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.618254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.618540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.619127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.620149 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:43.620149 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:43.620149 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:43.621059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.643435 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2096/4203] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:42:43 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:43.644818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.660137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc85e-f1ed-4536-8c3a-b37efba0808b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.665646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.666303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.667100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.667100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.668558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f3d7f62fb6f94f60b1566912abff1773, implied_role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.670203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.680558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2108/4204] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:43 2022] DELETE /identity/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:43.684841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.696690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041c5d5-8285-47bb-8aa3-13ee4e35a21f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.757611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:43.776019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.776599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.776887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.777228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.779072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=f3d7f62fb6f94f60b1566912abff1773)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.781103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.795098 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2097/4205] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:43 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:43.796320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.810372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a443ad4-4911-4113-851c-693750f8b012 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.878236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.880003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.880500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.881117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.882893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:43.884939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:43.895648 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2109/4206] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:43 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:43.901588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:43.914834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4deb346-128c-4cda-94c7-34c57fec5617 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:43.994108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:43.995166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:43.995844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:43.996364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:43.997284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.000173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.028344 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2098/4207] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:43 2022] GET /identity/v3/roles => generated 2323 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:44.030325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.043448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6bf87-58fc-42db-8e81-06e40dbfb766 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.051868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.052504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.052798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.053270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.054267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.057338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.080059 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2110/4208] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:44 2022] POST /identity/v3/roles => generated 235 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:44.081839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.100013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b818-90e5-41cf-a2cc-c0403ae83fa8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.106241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.107326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.107725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.108243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/7888c663e683435e9f11454330c3955b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.110628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:update_role(role_id=7888c663e683435e9f11454330c3955b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.112915 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:44.112915 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:44.112915 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:44.114086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.169976 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2099/4209] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 5 02:42:44 2022] PATCH /identity/v3/roles/7888c663e683435e9f11454330c3955b => generated 238 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:44.174884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.185325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7afdae-9844-447f-8580-86123d0ed95f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.190259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.190996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.191309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.191615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/7888c663e683435e9f11454330c3955b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.200271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:get_role(role_id=7888c663e683435e9f11454330c3955b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.201308 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:44.201308 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:44.201308 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:44.202194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.207114 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2111/4210] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:42:44 2022] GET /identity/v3/roles/7888c663e683435e9f11454330c3955b => generated 238 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:44.209078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.222641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d36be-ca7d-43fb-a660-928bd1021583 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.227612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.228289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.228580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.228864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.229547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.231258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.244125 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2100/4211] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:44 2022] GET /identity/v3/roles => generated 2552 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:44.248357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.259221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad1066-277e-49d4-9a48-ab1cfaa2792b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.263884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.264589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.264991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.265526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/7888c663e683435e9f11454330c3955b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.267047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7888c663e683435e9f11454330c3955b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.268850 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:44.268850 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:44.268850 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:44.269546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.308563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 7888c663e683435e9f11454330c3955b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:44.308977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:44.309760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:44.311774 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2112/4212] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:44 2022] DELETE /identity/v3/roles/7888c663e683435e9f11454330c3955b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:44.317629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.319622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:44.333107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558ab37-e7e5-4ca1-83ea-e353f47b4e28 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.393137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.393958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.394239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.394514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.396169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.397841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.426527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2101/4213] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:44 2022] PUT /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 520 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:44.428507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.438810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c125b8-883a-4a94-8640-2f1aa0cb3268 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.491957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:44.510562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.511709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.512407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.512787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.514847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=f3d7f62fb6f94f60b1566912abff1773)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.516581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.543120 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2113/4214] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:44 2022] PUT /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773 => generated 521 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:44.547258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.563472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2343d-bcc6-4ed3-b63d-0055b0c8039d tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.590483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:44.638442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.639125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.639405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.640273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.647821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f3d7f62fb6f94f60b1566912abff1773, implied_role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.649736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.684628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2102/4215] 10.222.0.16 () {60 vars in 1363 bytes} [Wed Oct 5 02:42:44 2022] PUT /identity/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 521 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:44.688265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.699988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ff5eb-7db1-4398-8adb-c9b552c73a9f tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.772191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.773995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.773995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.774362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.775762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=f3d7f62fb6f94f60b1566912abff1773)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.776813 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:44.776813 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:44.776813 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:44.777778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.786411 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2114/4216] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:44 2022] GET /identity/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies => generated 490 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:44.791957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.805413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58eddd-a301-42c6-a57f-616eace9b75e tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.810434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.811168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.811808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.811808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.813004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4c17e89f32ab43449c1704f89cc77e81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.814350 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:44.814350 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:44.814350 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:44.815686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.824161 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2103/4217] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 02:42:44 2022] GET /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies => generated 660 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:44.832051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.849434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412985f-2e7f-433f-b658-d4dbb5a7110b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.858177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.859304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.859591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.859872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.861867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f3d7f62fb6f94f60b1566912abff1773, implied_role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.864280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.874130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2115/4218] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:44 2022] DELETE /identity/v3/roles/f3d7f62fb6f94f60b1566912abff1773/implies/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:44.879005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.889535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e05e-a2b2-4d65-a221-1db713aa48ad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:44.950601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:44.951264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:44.951615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:44.951837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:44.953521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=f3d7f62fb6f94f60b1566912abff1773)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:44.955230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:44.967073 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2104/4219] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:44 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/f3d7f62fb6f94f60b1566912abff1773 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:44.971915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:44.985876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4345-864b-4926-9400-106ea1d22514 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:45.052787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:45.053734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:45.054336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:45.054827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:45.056840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4c17e89f32ab43449c1704f89cc77e81, implied_role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:45.058953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:45.068773 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2116/4220] 10.222.0.16 () {58 vars in 1347 bytes} [Wed Oct 5 02:42:44 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81/implies/2caf7e533c0f47358c92e8a7d8d5e48b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:45.073895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:45.085236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff09038-9566-4887-9fc9-d36a69e7bdcb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:45.167174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:45.167827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:45.168117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:45.168397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/892f7375db644be9ab67d20f9a7769c7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:45.179849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Could not find domain: 892f7375db644be9ab67d20f9a7769c7.: keystone.exception.DomainNotFound: Could not find domain: 892f7375db644be9ab67d20f9a7769c7. Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 892f7375db644be9ab67d20f9a7769c7. Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:42:45.185477 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:42:45.190863 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 892f7375db644be9ab67d20f9a7769c7. Oct 05 02:42:45.192553 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:42:45.196018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2105/4221] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:45 2022] PATCH /identity/v3/domains/892f7375db644be9ab67d20f9a7769c7 => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:42:45.196955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:45.207429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa8450-1275-49a1-93ed-2f36b47ac7ae tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:45.227076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:45.227725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:45.228013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:45.228295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/users/053fd348556248559e288c43749fa28a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:45.229616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_user(user_id=053fd348556248559e288c43749fa28a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:45.231624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:45.314874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053fd348556248559e288c43749fa28a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.318552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:45.339138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053fd348556248559e288c43749fa28a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.340502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053fd348556248559e288c43749fa28a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.366499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053fd348556248559e288c43749fa28a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.367423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053fd348556248559e288c43749fa28a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.385656 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2117/4222] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:45 2022] DELETE /identity/v3/users/053fd348556248559e288c43749fa28a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:45.390126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:45.393902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:45.409748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e463f0-10fe-4def-b250-db5d62ffcf96 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:45.451424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:45.483165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:45.483946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:45.484224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:45.484511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/92e6ef22eeb44b8aa7350a3e344c44f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:45.486200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_role(role_id=92e6ef22eeb44b8aa7350a3e344c44f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:45.487401 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:45.487401 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:45.487401 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:45.488538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:45.539813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 92e6ef22eeb44b8aa7350a3e344c44f9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:45.540116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.540968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.543350 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2106/4223] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:45 2022] DELETE /identity/v3/roles/92e6ef22eeb44b8aa7350a3e344c44f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:45.547721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:45.559088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d453b-6113-486b-b740-3364eb6b82e8 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:45.632927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:45.633596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:45.633883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:45.634553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/groups/30b980e44ade4ac7901d53574ee332d7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:45.635552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_group(group_id=30b980e44ade4ac7901d53574ee332d7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:45.636568 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:45.636568 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:42:45.636568 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:42:45.637812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:45.726179 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2118/4224] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:42:45 2022] DELETE /identity/v3/groups/30b980e44ade4ac7901d53574ee332d7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:45.730003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:45.733653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:45.750620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c400a31-79fa-4e83-863f-165e24fa8c0b tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:45.819373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:45.820019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:45.820311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:45.820581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/projects/6676c083a8ae45648b11ceb36697daca` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:45.821839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6676c083a8ae45648b11ceb36697daca)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:45.823761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:45.880452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6676c083a8ae45648b11ceb36697daca', 'request_id': 'req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.886891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6676c083a8ae45648b11ceb36697daca', 'request_id': 'req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.897014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6676c083a8ae45648b11ceb36697daca', 'request_id': 'req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.914283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] The token cache is being invalidate because project 6676c083a8ae45648b11ceb36697daca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:45.914796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.915422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:45.917340 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2107/4225] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:45 2022] DELETE /identity/v3/projects/6676c083a8ae45648b11ceb36697daca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:45.921554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:45.923668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:45.940750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a995dcb-e476-4fd4-92b6-6fe55e622dad tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:46.031284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:46.031944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:46.032230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:46.032519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:46.034615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=043e7e92af08450bb66119dcb34b07ad)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:46.036356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:46.061624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '043e7e92af08450bb66119dcb34b07ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.062417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '043e7e92af08450bb66119dcb34b07ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.072185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:46.097733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '043e7e92af08450bb66119dcb34b07ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.098368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '043e7e92af08450bb66119dcb34b07ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.100753 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2119/4226] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:45 2022] PATCH /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad => generated 277 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:46.104586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:46.117287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1da4d4-ffa9-403b-a5d7-d06054821dc4 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:46.146229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:46.187945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:46.188590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:46.188869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:46.189403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/domains/043e7e92af08450bb66119dcb34b07ad` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:46.201110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=043e7e92af08450bb66119dcb34b07ad)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:46.203037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:46.246408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '043e7e92af08450bb66119dcb34b07ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.251338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '043e7e92af08450bb66119dcb34b07ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.322019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043e7e92af08450bb66119dcb34b07ad', 'request_id': 'req-dc97b9f2-170f-4102-b239-049d738eb597'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.328786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043e7e92af08450bb66119dcb34b07ad', 'request_id': 'req-dc97b9f2-170f-4102-b239-049d738eb597'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.336746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043e7e92af08450bb66119dcb34b07ad', 'request_id': 'req-dc97b9f2-170f-4102-b239-049d738eb597'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.350457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] The token cache is being invalidate because project 043e7e92af08450bb66119dcb34b07ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:46.350761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.351448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.360583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '043e7e92af08450bb66119dcb34b07ad', 'request_id': 'req-dc97b9f2-170f-4102-b239-049d738eb597'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.361148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '043e7e92af08450bb66119dcb34b07ad', 'request_id': 'req-dc97b9f2-170f-4102-b239-049d738eb597'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.366801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '043e7e92af08450bb66119dcb34b07ad', 'request_id': 'req-dc97b9f2-170f-4102-b239-049d738eb597'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.373791 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2108/4227] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:46 2022] DELETE /identity/v3/domains/043e7e92af08450bb66119dcb34b07ad => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:46.378331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:46.380297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:46.395964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eff42d-2841-4710-8ae8-9c6185870bfb tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:46.509119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:46.509992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:46.510285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:46.510643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/f3d7f62fb6f94f60b1566912abff1773` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:46.512132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f3d7f62fb6f94f60b1566912abff1773)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:46.515648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:46.563939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role f3d7f62fb6f94f60b1566912abff1773 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:46.564355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.565680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.567778 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2120/4228] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:46 2022] DELETE /identity/v3/roles/f3d7f62fb6f94f60b1566912abff1773 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:46.572377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:46.574487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:46.601073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b9f2-170f-4102-b239-049d738eb597 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:46.717835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:46.719012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:46.719710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:46.720353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/2caf7e533c0f47358c92e8a7d8d5e48b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:46.724727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2caf7e533c0f47358c92e8a7d8d5e48b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:46.726812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:46.738588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:46.784045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 2caf7e533c0f47358c92e8a7d8d5e48b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:46.784345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.785057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.789395 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2109/4229] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:46 2022] DELETE /identity/v3/roles/2caf7e533c0f47358c92e8a7d8d5e48b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:46.791698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:46.793680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:46.808701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a556de-ef32-40a0-90d6-496a6fd92145 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:46.938362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12076d806e3642098260a50ab7e65530', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '81aec64fa9b84c308c116ebd03b9e80d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:46.941516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:46.942161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:46.942161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] PATH_INFO: `/v3/roles/4c17e89f32ab43449c1704f89cc77e81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:46.943951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c17e89f32ab43449c1704f89cc77e81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:46.946151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:46.992222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invalidating the token cache because role 4c17e89f32ab43449c1704f89cc77e81 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:46.992767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.993591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9d64c99c-90f5-4641-897d-aa52e273bc82 tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:46.996377 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2121/4230] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:46 2022] DELETE /identity/v3/roles/4c17e89f32ab43449c1704f89cc77e81 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:47.000786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:47.003290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:47.098548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49631ca-f8d5-4bd6-8a16-6578aa7ba64a tempest-RolesV3TestJSON-1135992830 tempest-RolesV3TestJSON-1135992830-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:47.186754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:47.187363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:47.187662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:47.187932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] PATH_INFO: `/v3/users/23e7a8347927445385162c28829824c0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:47.189127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e7a8347927445385162c28829824c0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:47.197316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:47.267261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e7a8347927445385162c28829824c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:47.285714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e7a8347927445385162c28829824c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:47.286790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e7a8347927445385162c28829824c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:47.303415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e7a8347927445385162c28829824c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:47.304104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e7a8347927445385162c28829824c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:47.311852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:47.324979 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2110/4231] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:46 2022] DELETE /identity/v3/users/23e7a8347927445385162c28829824c0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:47.328501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15080201-7585-45bc-9145-41f825428ee1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:47.328786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15080201-7585-45bc-9145-41f825428ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:47.329294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15080201-7585-45bc-9145-41f825428ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:47.355395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-15080201-7585-45bc-9145-41f825428ee1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:47.356736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15080201-7585-45bc-9145-41f825428ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:47.379927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:UPDATE=1,keystone:SELECT=93,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:47.449921 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2122/4232] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:47.462217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:47.464572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:47.550474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc49a1-54ec-4652-944b-0be20c4a1a04 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:47.555636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:47.556384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:47.556716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:47.557172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:47.568934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:47.570524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:47.581818 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2111/4233] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:48.135004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15080201-7585-45bc-9145-41f825428ee1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:48.136630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15080201-7585-45bc-9145-41f825428ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:48.149819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15080201-7585-45bc-9145-41f825428ee1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:48.155563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:48.156379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:48.156938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:48.157706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] PATH_INFO: `/v3/projects/d66df97f62864542b8d0ba4fab135541` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:48.159097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66df97f62864542b8d0ba4fab135541)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:48.161382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:48.224001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66df97f62864542b8d0ba4fab135541', 'request_id': 'req-95444f4c-65f8-4110-a05a-e3fba3984b45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.235227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66df97f62864542b8d0ba4fab135541', 'request_id': 'req-95444f4c-65f8-4110-a05a-e3fba3984b45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.244844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66df97f62864542b8d0ba4fab135541', 'request_id': 'req-95444f4c-65f8-4110-a05a-e3fba3984b45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.259596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] The token cache is being invalidate because project d66df97f62864542b8d0ba4fab135541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:48.260250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.261132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.262824 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2123/4234] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:48 2022] DELETE /identity/v3/projects/d66df97f62864542b8d0ba4fab135541 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:48.266975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:48.278462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caedec-cf67-4e83-9769-b06c36c50e95 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:48.348938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:48.349560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:48.349838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:48.350127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] PATH_INFO: `/v3/users/12076d806e3642098260a50ab7e65530` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:48.351481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12076d806e3642098260a50ab7e65530)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:48.353725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:48.425897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12076d806e3642098260a50ab7e65530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.441361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12076d806e3642098260a50ab7e65530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.442119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12076d806e3642098260a50ab7e65530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.455299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12076d806e3642098260a50ab7e65530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.455983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12076d806e3642098260a50ab7e65530'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:48.496223 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2112/4235] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:48 2022] DELETE /identity/v3/users/12076d806e3642098260a50ab7e65530 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:49.095320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:49.098002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:49.266664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95444f4c-65f8-4110-a05a-e3fba3984b45 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:49.319479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:49.355076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:49.355951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:49.356094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:49.356289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:49.358535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:49.454070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:49.455932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c672-bedc-44d5-95da-6d4a66426ff2 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:49.468869 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2124/4236] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:49.747070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:49.748650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:49.776882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:49.845803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caa197-20f0-4c7f-a606-853c0f117a57 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:49.853571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:49.854223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:49.854511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:49.854790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] PATH_INFO: `/v3/projects/81aec64fa9b84c308c116ebd03b9e80d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:49.856037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81aec64fa9b84c308c116ebd03b9e80d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:49.857996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:49.932509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81aec64fa9b84c308c116ebd03b9e80d', 'request_id': 'req-785331dc-ccc4-419d-94b3-b85e7f5d060e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:49.942503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81aec64fa9b84c308c116ebd03b9e80d', 'request_id': 'req-785331dc-ccc4-419d-94b3-b85e7f5d060e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:49.953002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81aec64fa9b84c308c116ebd03b9e80d', 'request_id': 'req-785331dc-ccc4-419d-94b3-b85e7f5d060e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:49.983353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] The token cache is being invalidate because project 81aec64fa9b84c308c116ebd03b9e80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:49.983658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:49.984782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-785331dc-ccc4-419d-94b3-b85e7f5d060e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:49.987268 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2113/4237] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:42:49 2022] DELETE /identity/v3/projects/81aec64fa9b84c308c116ebd03b9e80d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:49.992424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:49.992801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:49.993172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.039573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:50.041174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:50.115725 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2125/4238] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:50.124053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.124342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.124655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.155235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:50.156471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:50.169148 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2114/4239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:50.170791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.189177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09f856-2f97-4ff5-a301-1d142d11093a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.200846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.201969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.202434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.203017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.204602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:42:50.205214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.208244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.230266 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2126/4240] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:50.235057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.254743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bebc8-38f7-42e4-aed5-19197471752c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.269572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.271015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.271495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.272038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.272926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.275422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.324420 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2115/4241] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:50 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:50.329736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.341251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c684097-471b-4513-8424-3d200ad9b7f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.435906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.436760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.437117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.437485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.438221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.440534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.452534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:50.469538 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2127/4242] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:50 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:50.474184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.486401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac884-a3f9-46a7-a96f-a3dc3085dfb0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.492838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.493618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.493997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.494439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.495346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.497292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.516780 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2116/4243] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:50.518821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.532967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273316b2-fa40-4135-9b18-05763f3096ab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.538842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39758d6-94f0-4a5a-8d6c-eea34fdda770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.539562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39758d6-94f0-4a5a-8d6c-eea34fdda770 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.539908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39758d6-94f0-4a5a-8d6c-eea34fdda770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.540187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39758d6-94f0-4a5a-8d6c-eea34fdda770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.541375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39758d6-94f0-4a5a-8d6c-eea34fdda770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.546109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39758d6-94f0-4a5a-8d6c-eea34fdda770 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.565084 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2128/4244] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:50.566908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.578689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4d12-b679-4a26-8905-d81c77cb8241 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.583577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.584235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.584515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.585347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] PATH_INFO: `/v3/projects/a414211bcd0b4f9b953be73cbb6914ea/users/863e3d6f306a4dff8912b0ae9e57a660/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.600764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a414211bcd0b4f9b953be73cbb6914ea, user_id=863e3d6f306a4dff8912b0ae9e57a660, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.603870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.620575 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2117/4245] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:50 2022] PUT /identity/v3/projects/a414211bcd0b4f9b953be73cbb6914ea/users/863e3d6f306a4dff8912b0ae9e57a660/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:50.632929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.633249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.633527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.667579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] MFA Rules not processed for user `863e3d6f306a4dff8912b0ae9e57a660`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:50.668386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:50.738113 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2129/4246] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:50.743450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.793257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:50.812210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01248522-0978-4ef1-9d06-7b95b9eb8d21 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.817880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.818034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.818276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.818552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.819336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.821276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.859349 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2118/4247] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:50 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:50.866431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:50.879443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa8836-c5eb-4b2b-89e8-6b28578526dd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:50.957975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:50.959105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:50.959629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:50.960193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:50.961358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:50.963799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:50.998523 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2130/4248] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:50 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:51.003151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.017316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e35999-c90d-4c0c-bfaf-d51443ea75f2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.023484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.024208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.024599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.025003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.025773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.027494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.045903 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2119/4249] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:51.046616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.057594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156daae2-99bd-4f04-8420-22fd8a6d9b59 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.063337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.064205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.064952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.065230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] PATH_INFO: `/v3/projects/283c07a0c76747a8be406afe78c2987a/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.089873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283c07a0c76747a8be406afe78c2987a, user_id=8e2485a0ca0646858990a4860cb4a175, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.092657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.114010 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2131/4250] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:51 2022] PUT /identity/v3/projects/283c07a0c76747a8be406afe78c2987a/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:51.118495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.134805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042917f2-4a71-4450-b773-374ec012d1e6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.216172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c9d25-1b7c-4c50-8f1b-b6c071165e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.216825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9d25-1b7c-4c50-8f1b-b6c071165e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.217172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9d25-1b7c-4c50-8f1b-b6c071165e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.217455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c9d25-1b7c-4c50-8f1b-b6c071165e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.218177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9d25-1b7c-4c50-8f1b-b6c071165e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.219897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c9d25-1b7c-4c50-8f1b-b6c071165e39 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.233788 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2120/4251] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:51.238184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.253354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139254be-e095-476e-97b7-51ddc4dfd982 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.259896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.261310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.261601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.261883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] PATH_INFO: `/v3/projects/283c07a0c76747a8be406afe78c2987a/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.264142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283c07a0c76747a8be406afe78c2987a, user_id=8e2485a0ca0646858990a4860cb4a175, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.266827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.279110 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2132/4252] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:51 2022] PUT /identity/v3/projects/283c07a0c76747a8be406afe78c2987a/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:51.290466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.290756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.291028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.322205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] MFA Rules not processed for user `8e2485a0ca0646858990a4860cb4a175`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:51.323442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:51.416937 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2121/4253] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:51.419864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.454005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:51.526256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b50b04-0897-486d-8603-95e6da070339 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.530901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.531375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.531701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.531980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.532877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.535081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.575763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2133/4254] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:51 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:51.577037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.592798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce13880-62c0-41d7-9f9c-f36cc5b6f4ff None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.646072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:51.702469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.703990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.704753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.705468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.710660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.716181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.755266 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2122/4255] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:51 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:51.759302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.772448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49279e69-cbe2-49c7-94c8-02274c1aeed7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.777874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.778514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.778785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.779139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.779740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.781782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.797655 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2134/4256] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:51.803186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.821710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.824652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:51.827866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2dbc7-0bfb-4829-a7de-a55510692b52 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.835749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.836539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.837080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.837475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.838324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.840399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.852696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2123/4257] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:51.859153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:51.886445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f78fa-9e69-43e1-b235-09d7094a2e5a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.904893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fcb77-4acc-455c-b831-055e3a2c9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.906393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fcb77-4acc-455c-b831-055e3a2c9cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.906943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fcb77-4acc-455c-b831-055e3a2c9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.908703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fcb77-4acc-455c-b831-055e3a2c9cc7 admin admin] PATH_INFO: `/v3/projects/2858845cdd954baf9c65832ee2883aab/users/634bd58b37de44978bdc0d2707015309/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.932436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6761-ac1e-47b2-bd23-b6d7bea12de4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:51.938273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:51.938943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.939187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.939428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:51.942592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:51.946076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fcb77-4acc-455c-b831-055e3a2c9cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2858845cdd954baf9c65832ee2883aab, user_id=634bd58b37de44978bdc0d2707015309, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.951728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7fcb77-4acc-455c-b831-055e3a2c9cc7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.957226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:51.959086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:51.971463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2124/4258] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:51 2022] PUT /identity/v3/projects/2858845cdd954baf9c65832ee2883aab/users/634bd58b37de44978bdc0d2707015309/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:51.972378 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2135/4259] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:42:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:42:51.982272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:51.982570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:51.982850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:52.027628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] MFA Rules not processed for user `634bd58b37de44978bdc0d2707015309`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:52.029405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:52.136755 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2125/4260] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:42:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:42:52.143989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:52.250799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cabde-a65b-4a9c-9ee1-5b235d079f24 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:52.298592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:52.335391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:52.336009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:52.336431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:52.337239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:52.337494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:52.339225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:52.365937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2136/4261] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:52 2022] POST /identity/v3/domains => generated 276 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:52.370644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:52.398263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a56f53-9e5c-42f5-9c0d-7a468f45e4f9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:52.550227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:52.552889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:52.553540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:52.554966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:52.557007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:52.560635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:52.601059 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2126/4262] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:52 2022] POST /identity/v3/roles => generated 239 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:52.605194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:52.621297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f0662-497a-43e8-9b3c-85904c81aa96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:52.628740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:52.630531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:52.631349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:52.632457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c/users/634bd58b37de44978bdc0d2707015309/roles/15434b06c4524f41a4027227e7c24b0e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:52.669396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8e56dbcf8a61403a881ad5dfd8acf72c, user_id=634bd58b37de44978bdc0d2707015309, role_id=15434b06c4524f41a4027227e7c24b0e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:52.677765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:52.704093 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2137/4263] 10.222.0.16 () {60 vars in 1480 bytes} [Wed Oct 5 02:42:52 2022] PUT /identity/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c/users/634bd58b37de44978bdc0d2707015309/roles/15434b06c4524f41a4027227e7c24b0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:52.708643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:52.734743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b38f-67d5-4445-a569-52029639e271 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:52.793210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:52.883825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:52.884478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:52.885101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:52.885406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:52.886111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:52.890053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:52.942952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2127/4264] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:52 2022] POST /identity/v3/domains => generated 274 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:52.944321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:52.962522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c93e-f804-416a-a800-aa7bb80c6b9f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.083043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.083792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.084172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.084559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.085411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.087144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.108227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2138/4265] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:52 2022] POST /identity/v3/roles => generated 239 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:53.113881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.125391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd590c16-fe63-4e06-bd35-334273b32e2f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.134190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.135183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.135747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.135901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.137117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.138672 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:53.138672 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:53.138672 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:53.140604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.179168 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2128/4266] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:42:53 2022] POST /identity/v3/groups => generated 324 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:53.183154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.195118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046dd48-6d02-4a27-97f0-ac49ac1228d0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.200462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.201137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.201428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.201721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups/fd796b3fbd7e45a69caa7a3cc3034350/users/634bd58b37de44978bdc0d2707015309` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.213461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fd796b3fbd7e45a69caa7a3cc3034350, user_id=634bd58b37de44978bdc0d2707015309)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.217138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.250543 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2139/4267] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:42:53 2022] PUT /identity/v3/groups/fd796b3fbd7e45a69caa7a3cc3034350/users/634bd58b37de44978bdc0d2707015309 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:53.256123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.271271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf66585-4341-42ee-b6c9-41e4912e73fb tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.341645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.342333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.342704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.343000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/bb693011ef0f4e0a901d246b3d33c278/groups/fd796b3fbd7e45a69caa7a3cc3034350/roles/14e9ab68b7164840adc09ee85e90e4bd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.345410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bb693011ef0f4e0a901d246b3d33c278, group_id=fd796b3fbd7e45a69caa7a3cc3034350, role_id=14e9ab68b7164840adc09ee85e90e4bd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.348504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.365326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2129/4268] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:53 2022] PUT /identity/v3/domains/bb693011ef0f4e0a901d246b3d33c278/groups/fd796b3fbd7e45a69caa7a3cc3034350/roles/14e9ab68b7164840adc09ee85e90e4bd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:53.369503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.386792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aca55-2d10-4cf2-b724-47fb6ab55313 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.462323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.463048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.463343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.463624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.464309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.466023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.494768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2140/4269] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:53 2022] POST /identity/v3/domains => generated 275 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:53.499810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.515275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08052d6-3fc5-4ae3-9ce6-2b1fb470477a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.586971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.587794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.588079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.588454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.589219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.591203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.615558 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2130/4270] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:53 2022] POST /identity/v3/roles => generated 240 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:53.620170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.631532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd40a5-d1a4-42fa-93d3-9cc02194885e tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.637513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.638313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.638605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.638904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/357bd8f5a22746f8883a7b43236f3b77/users/634bd58b37de44978bdc0d2707015309/roles/616da467f8ea41ed8563ca7825d08925` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.650478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:53.669955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=357bd8f5a22746f8883a7b43236f3b77, user_id=634bd58b37de44978bdc0d2707015309, role_id=616da467f8ea41ed8563ca7825d08925)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.674770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.689136 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2141/4271] 10.222.0.16 () {60 vars in 1480 bytes} [Wed Oct 5 02:42:53 2022] PUT /identity/v3/domains/357bd8f5a22746f8883a7b43236f3b77/users/634bd58b37de44978bdc0d2707015309/roles/616da467f8ea41ed8563ca7825d08925 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:53.694000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.711496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6a93-0295-425f-887b-1c91ecf1a748 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.727255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:53.799994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.800754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.802158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.802817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.803684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.810194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.840421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2131/4272] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:42:53 2022] POST /identity/v3/domains => generated 276 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:53.841788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.855929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28c557-cdb7-422a-a89c-3b2593858f96 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.923366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.924101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.924420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.924744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.925463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.927125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:53.944981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2142/4273] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:42:53 2022] POST /identity/v3/roles => generated 240 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:42:53.947633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:53.961766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22506f6-d9ff-4441-87f4-05bcdcc64e58 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:53.968268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:53.969167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:53.969543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:53.970400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:53.970981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:53.973379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.011767 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2132/4274] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:42:53 2022] POST /identity/v3/groups => generated 326 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:54.015959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.026620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728db97-8f10-440d-aae6-85a67e430a13 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.031894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:54.032739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:54.033149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:54.033789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups/1f885af2ebb44827a86a7a459740c816/users/634bd58b37de44978bdc0d2707015309` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:54.040214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1f885af2ebb44827a86a7a459740c816, user_id=634bd58b37de44978bdc0d2707015309)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:54.042305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.070932 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2143/4275] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:42:54 2022] PUT /identity/v3/groups/1f885af2ebb44827a86a7a459740c816/users/634bd58b37de44978bdc0d2707015309 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:54.072224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.091443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec18de1-4e3c-45a0-948f-0fa334fd4a42 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.156843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:54.157554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:54.157942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:54.158472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/49df346bcbc941a78ccca01bcccfe9d7/groups/1f885af2ebb44827a86a7a459740c816/roles/07bff13f52f240548c44b896d8900638` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:54.161157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=49df346bcbc941a78ccca01bcccfe9d7, group_id=1f885af2ebb44827a86a7a459740c816, role_id=07bff13f52f240548c44b896d8900638)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:54.165192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.183026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2133/4276] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:54 2022] PUT /identity/v3/domains/49df346bcbc941a78ccca01bcccfe9d7/groups/1f885af2ebb44827a86a7a459740c816/roles/07bff13f52f240548c44b896d8900638 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:54.187349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.312846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec1b2-5536-4f63-8753-91967b906c35 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.360436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:54.415316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '634bd58b37de44978bdc0d2707015309', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2858845cdd954baf9c65832ee2883aab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:54.415836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:54.416120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:54.416423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] PATH_INFO: `/v3/auth/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:54.417023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:54.418085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.495936 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2144/4277] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:42:54 2022] GET /identity/v3/auth/domains => generated 1169 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:42:54.500513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.577731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37546b4a-b8a5-427d-9a72-741ba46194c4 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.583643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:54.584326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:54.584612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:54.584916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/49df346bcbc941a78ccca01bcccfe9d7/groups/1f885af2ebb44827a86a7a459740c816/roles/07bff13f52f240548c44b896d8900638` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:54.587106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=49df346bcbc941a78ccca01bcccfe9d7, group_id=1f885af2ebb44827a86a7a459740c816, role_id=07bff13f52f240548c44b896d8900638)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:54.590475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.597307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 07bff13f52f240548c44b896d8900638 was removed from group 1f885af2ebb44827a86a7a459740c816 on domain 49df346bcbc941a78ccca01bcccfe9d7. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:54.597599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:54.598518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:54.616101 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2134/4278] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:54 2022] DELETE /identity/v3/domains/49df346bcbc941a78ccca01bcccfe9d7/groups/1f885af2ebb44827a86a7a459740c816/roles/07bff13f52f240548c44b896d8900638 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:54.620637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.622662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:54.637313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cba0d-4cf8-4ae3-b14e-504c523ee4f2 tempest-TokensV3TestJSON-1690227519 tempest-TokensV3TestJSON-1690227519-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.703657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:54.704379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:54.704662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:54.705030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups/1f885af2ebb44827a86a7a459740c816/users/634bd58b37de44978bdc0d2707015309` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:54.706938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1f885af2ebb44827a86a7a459740c816, user_id=634bd58b37de44978bdc0d2707015309)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:54.709035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.718865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:54.735765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2145/4279] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:42:54 2022] DELETE /identity/v3/groups/1f885af2ebb44827a86a7a459740c816/users/634bd58b37de44978bdc0d2707015309 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:54.740933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.754197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc2839-ea92-4729-ba26-fd6ecd9f8231 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.764937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:54.836049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:54.836804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:54.837221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:54.837594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups/1f885af2ebb44827a86a7a459740c816` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:54.838940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1f885af2ebb44827a86a7a459740c816)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:54.840167 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:42:54.840167 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:42:54.840167 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:42:54.841394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:54.907002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2135/4280] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:42:54 2022] DELETE /identity/v3/groups/1f885af2ebb44827a86a7a459740c816 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:54.909204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:54.923710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9403c-c178-4cfe-b586-4a1774581fff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:54.987050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:55.016007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:55.017935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:55.017935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:55.018663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles/07bff13f52f240548c44b896d8900638` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:55.020247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_role(role_id=07bff13f52f240548c44b896d8900638)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:55.022204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:55.073425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 07bff13f52f240548c44b896d8900638 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:55.074206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.075373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.078262 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2146/4281] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:54 2022] DELETE /identity/v3/roles/07bff13f52f240548c44b896d8900638 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:55.084147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:55.086229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:55.103570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742252d-87a2-4aa1-80e1-72d19e5f5afd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:55.221434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:55.222428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:55.222839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:55.223297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/49df346bcbc941a78ccca01bcccfe9d7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:55.225072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=49df346bcbc941a78ccca01bcccfe9d7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:55.227164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:55.293871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.297029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.354527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.358286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.364284 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2136/4282] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:55 2022] PATCH /identity/v3/domains/49df346bcbc941a78ccca01bcccfe9d7 => generated 277 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:55.369124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:55.383910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285a1ee-b2d4-4cf5-8be8-14baac250209 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:55.488809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:55.489892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:55.490333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:55.490773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/49df346bcbc941a78ccca01bcccfe9d7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:55.507899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=49df346bcbc941a78ccca01bcccfe9d7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:55.509912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:55.539078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.545209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.628674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7', 'request_id': 'req-0718b55e-f4c5-49ee-bacc-5a71bedf0356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.642173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7', 'request_id': 'req-0718b55e-f4c5-49ee-bacc-5a71bedf0356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.652166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7', 'request_id': 'req-0718b55e-f4c5-49ee-bacc-5a71bedf0356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.671747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] The token cache is being invalidate because project 49df346bcbc941a78ccca01bcccfe9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:55.672050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.673515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.676134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:55.685689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7', 'request_id': 'req-0718b55e-f4c5-49ee-bacc-5a71bedf0356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.687154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7', 'request_id': 'req-0718b55e-f4c5-49ee-bacc-5a71bedf0356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.692104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '49df346bcbc941a78ccca01bcccfe9d7', 'request_id': 'req-0718b55e-f4c5-49ee-bacc-5a71bedf0356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.698137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2147/4283] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:55 2022] DELETE /identity/v3/domains/49df346bcbc941a78ccca01bcccfe9d7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:55.702478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:55.703906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:55.718513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeae15-d0f7-42ae-b485-3ff4e97d9020 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:55.759220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:55.806226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:55.807145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:55.807595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:55.808382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/357bd8f5a22746f8883a7b43236f3b77/users/634bd58b37de44978bdc0d2707015309/roles/616da467f8ea41ed8563ca7825d08925` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:55.811352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=357bd8f5a22746f8883a7b43236f3b77, user_id=634bd58b37de44978bdc0d2707015309, role_id=616da467f8ea41ed8563ca7825d08925)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:55.815731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:55.822999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 616da467f8ea41ed8563ca7825d08925 was removed from user 634bd58b37de44978bdc0d2707015309 on domain 357bd8f5a22746f8883a7b43236f3b77. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:55.823338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.824083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:55.846707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2137/4284] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Oct 5 02:42:55 2022] DELETE /identity/v3/domains/357bd8f5a22746f8883a7b43236f3b77/users/634bd58b37de44978bdc0d2707015309/roles/616da467f8ea41ed8563ca7825d08925 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:55.851419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:55.853134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:55.868751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b55e-f4c5-49ee-bacc-5a71bedf0356 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:55.942060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:55.943105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:55.943801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:55.944166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles/616da467f8ea41ed8563ca7825d08925` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:55.946114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_role(role_id=616da467f8ea41ed8563ca7825d08925)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:55.948288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:56.005102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 616da467f8ea41ed8563ca7825d08925 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:56.005763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.006667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.009699 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2148/4285] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:55 2022] DELETE /identity/v3/roles/616da467f8ea41ed8563ca7825d08925 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:56.014676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:56.021410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:56.041965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d534a1d-440b-4e25-ad00-a8ebf901669c tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:56.130487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:56.133711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:56.133711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:56.133711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/357bd8f5a22746f8883a7b43236f3b77` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:56.133711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=357bd8f5a22746f8883a7b43236f3b77)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:56.135762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:56.164071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.164828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.216106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.216935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.227468 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2138/4286] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:56 2022] PATCH /identity/v3/domains/357bd8f5a22746f8883a7b43236f3b77 => generated 276 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:56.228860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:56.236332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:56.259995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd8dd6-3352-49c9-bfef-74967c127855 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:56.329805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:56.330703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:56.331050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:56.331334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/357bd8f5a22746f8883a7b43236f3b77` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:56.344568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=357bd8f5a22746f8883a7b43236f3b77)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:56.346607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:56.381194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.382300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.404292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:56.469604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77', 'request_id': 'req-c22b627b-9466-478a-964f-76b9f67af668'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.482912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77', 'request_id': 'req-c22b627b-9466-478a-964f-76b9f67af668'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.492167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77', 'request_id': 'req-c22b627b-9466-478a-964f-76b9f67af668'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.508762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] The token cache is being invalidate because project 357bd8f5a22746f8883a7b43236f3b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:56.508762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.511523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.525041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77', 'request_id': 'req-c22b627b-9466-478a-964f-76b9f67af668'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.525041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77', 'request_id': 'req-c22b627b-9466-478a-964f-76b9f67af668'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.530498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '357bd8f5a22746f8883a7b43236f3b77', 'request_id': 'req-c22b627b-9466-478a-964f-76b9f67af668'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.539003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2149/4287] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:56 2022] DELETE /identity/v3/domains/357bd8f5a22746f8883a7b43236f3b77 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:56.540752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:56.543111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:56.563345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0ca27-3146-4b6c-8c27-437486bb2197 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:56.683815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:56.684806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:56.685273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:56.685680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/bb693011ef0f4e0a901d246b3d33c278/groups/fd796b3fbd7e45a69caa7a3cc3034350/roles/14e9ab68b7164840adc09ee85e90e4bd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:56.689116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bb693011ef0f4e0a901d246b3d33c278, group_id=fd796b3fbd7e45a69caa7a3cc3034350, role_id=14e9ab68b7164840adc09ee85e90e4bd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:56.693273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:56.700968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 14e9ab68b7164840adc09ee85e90e4bd was removed from group fd796b3fbd7e45a69caa7a3cc3034350 on domain bb693011ef0f4e0a901d246b3d33c278. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:56.701398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.702622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.742313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2139/4288] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:56 2022] DELETE /identity/v3/domains/bb693011ef0f4e0a901d246b3d33c278/groups/fd796b3fbd7e45a69caa7a3cc3034350/roles/14e9ab68b7164840adc09ee85e90e4bd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:56.743963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:56.746169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:56.765669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b627b-9466-478a-964f-76b9f67af668 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:56.851348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:56.852021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:56.852307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:56.852612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups/fd796b3fbd7e45a69caa7a3cc3034350/users/634bd58b37de44978bdc0d2707015309` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:56.855395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=fd796b3fbd7e45a69caa7a3cc3034350, user_id=634bd58b37de44978bdc0d2707015309)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:56.857902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:56.870930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:56.895971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2150/4289] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:42:56 2022] DELETE /identity/v3/groups/fd796b3fbd7e45a69caa7a3cc3034350/users/634bd58b37de44978bdc0d2707015309 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:56.900703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:56.902630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:56.925786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72adecb-58b2-441c-8110-68d449db94ff tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:56.967097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:57.045781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:57.046603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:57.047005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:57.047388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/groups/fd796b3fbd7e45a69caa7a3cc3034350` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:57.049539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fd796b3fbd7e45a69caa7a3cc3034350)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:57.054833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:57.127415 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2140/4290] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:42:56 2022] DELETE /identity/v3/groups/fd796b3fbd7e45a69caa7a3cc3034350 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:57.128446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:57.139788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e59745-a213-4996-8f2e-1e0461c6d8de tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:57.217347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:57.218755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:57.219127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:57.219483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles/14e9ab68b7164840adc09ee85e90e4bd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:57.221843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_role(role_id=14e9ab68b7164840adc09ee85e90e4bd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:57.224245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:57.238902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:57.276675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 14e9ab68b7164840adc09ee85e90e4bd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:57.277067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.277779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.281025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2151/4291] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:57 2022] DELETE /identity/v3/roles/14e9ab68b7164840adc09ee85e90e4bd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:57.284758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:57.286659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:57.304976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c31e1a-424c-4fa7-b6c7-5153c450a840 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:57.380160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:57.380838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:57.381345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:57.381791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/bb693011ef0f4e0a901d246b3d33c278` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:57.383363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bb693011ef0f4e0a901d246b3d33c278)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:57.386001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:57.435106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.436246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.545363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.546183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.550705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2141/4292] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:57 2022] PATCH /identity/v3/domains/bb693011ef0f4e0a901d246b3d33c278 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:42:57.554444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:57.568374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beaa73-ff01-4950-8574-8a3ca49c3cf0 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:57.685399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:57.687729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:57.688131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:57.689345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/bb693011ef0f4e0a901d246b3d33c278` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:57.719010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bb693011ef0f4e0a901d246b3d33c278)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:57.721155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:57.775040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.783598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.851059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278', 'request_id': 'req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.864318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278', 'request_id': 'req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.889311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278', 'request_id': 'req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.910689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] The token cache is being invalidate because project bb693011ef0f4e0a901d246b3d33c278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:57.911133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.911909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.924188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278', 'request_id': 'req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.925128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278', 'request_id': 'req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.930122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bb693011ef0f4e0a901d246b3d33c278', 'request_id': 'req-678e4e07-8ea8-4956-b5ec-2a8199a75c7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:57.936888 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2152/4293] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:57 2022] DELETE /identity/v3/domains/bb693011ef0f4e0a901d246b3d33c278 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:57.941048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:57.942574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:57.960192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1fce9-b980-4af2-9b73-cf8c5ce6d432 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:57.995246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:57.995649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:57.996025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:58.025619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:42:58.029950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:58.067006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:58.080551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:58.110780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:58.112200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:58.112557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:58.112920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c/users/634bd58b37de44978bdc0d2707015309/roles/15434b06c4524f41a4027227e7c24b0e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:58.115966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8e56dbcf8a61403a881ad5dfd8acf72c, user_id=634bd58b37de44978bdc0d2707015309, role_id=15434b06c4524f41a4027227e7c24b0e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:58.119264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:58.131366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 15434b06c4524f41a4027227e7c24b0e was removed from user 634bd58b37de44978bdc0d2707015309 on domain 8e56dbcf8a61403a881ad5dfd8acf72c. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:58.131366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.131742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.154045 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2142/4294] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Oct 5 02:42:57 2022] DELETE /identity/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c/users/634bd58b37de44978bdc0d2707015309/roles/15434b06c4524f41a4027227e7c24b0e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:58.159342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:58.161221 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2153/4295] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:42:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:42:58.161395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:58.253081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:58.255627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:58.292077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e2842-72e0-4e71-a9f6-53e37a0da907 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:58.301616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:58.303398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:58.304081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:58.304479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles/15434b06c4524f41a4027227e7c24b0e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:58.306275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_role(role_id=15434b06c4524f41a4027227e7c24b0e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:58.309229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:58.369669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 15434b06c4524f41a4027227e7c24b0e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:58.370170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.371090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.376616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2143/4296] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:42:58 2022] DELETE /identity/v3/roles/15434b06c4524f41a4027227e7c24b0e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:58.378263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:58.382126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:58.400793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075c4c9-debf-475c-8a2c-b179e16f2f6c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:58.471206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d820-8db0-498e-a57f-460810dbaf8b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:58.480276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:58.480975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:58.481246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:58.481708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:58.483837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8e56dbcf8a61403a881ad5dfd8acf72c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:58.485966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:58.513731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:58.514363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:58.514645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:58.514924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:58.516867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:58.518927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.519924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.556108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.556832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.562563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2144/4297] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:42:58 2022] PATCH /identity/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c => generated 277 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:58.563743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:58.566098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:58.577249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:58.608172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:58.609845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:58.628246 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2154/4298] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:42:58.682915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3334d-1c8a-4a5b-b910-a0f188b6779a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:58.697932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:58.698637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:58.698982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:58.699329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:58.728778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8e56dbcf8a61403a881ad5dfd8acf72c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:58.732088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:58.781471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.791900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.912219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c', 'request_id': 'req-4bf966a4-3394-4741-8ef3-5954b0fc59c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.922189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c', 'request_id': 'req-4bf966a4-3394-4741-8ef3-5954b0fc59c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.938368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c', 'request_id': 'req-4bf966a4-3394-4741-8ef3-5954b0fc59c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.983529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] The token cache is being invalidate because project 8e56dbcf8a61403a881ad5dfd8acf72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:58.983941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.984831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.998123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c', 'request_id': 'req-4bf966a4-3394-4741-8ef3-5954b0fc59c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:58.999157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c', 'request_id': 'req-4bf966a4-3394-4741-8ef3-5954b0fc59c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:59.009567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8e56dbcf8a61403a881ad5dfd8acf72c', 'request_id': 'req-4bf966a4-3394-4741-8ef3-5954b0fc59c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:59.021105 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2145/4299] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:42:58 2022] DELETE /identity/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:59.026658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:59.032877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:59.043383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bf34c-b473-4e52-a2ff-49e5d51ee0ec service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:59.261276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:59.262050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:59.262441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:59.262821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:59.263573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:59.265348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:59.311576 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2155/4300] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:42:59.313303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:59.315564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:59.350348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf966a4-3394-4741-8ef3-5954b0fc59c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:59.370809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:59.371615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:59.372181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:59.372713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/a414211bcd0b4f9b953be73cbb6914ea/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:59.382930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a414211bcd0b4f9b953be73cbb6914ea, user_id=8e2485a0ca0646858990a4860cb4a175, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:59.386432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:59.421762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2146/4301] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:42:59 2022] PUT /identity/v3/projects/a414211bcd0b4f9b953be73cbb6914ea/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:42:59.426229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:59.449769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b5314-0194-4488-a5ae-533a7eea59dd tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:59.542947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:59.545829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:59.545829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:59.545829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:59.545829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:59.546413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:59.634982 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2156/4302] 10.222.0.16 () {58 vars in 1146 bytes} [Wed Oct 5 02:42:59 2022] GET /identity/v3/auth/projects => generated 826 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:42:59.635929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:59.653818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635cb37-7822-4495-80b7-f828146940ab tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:59.673105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:59.674221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:59.675067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:59.675453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/a414211bcd0b4f9b953be73cbb6914ea/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:59.685404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a414211bcd0b4f9b953be73cbb6914ea, user_id=8e2485a0ca0646858990a4860cb4a175, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:59.688532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:59.709891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 61064a68b37843f5b88e6641075320de was removed from user 8e2485a0ca0646858990a4860cb4a175 on project a414211bcd0b4f9b953be73cbb6914ea. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:42:59.710358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:59.711230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:42:59.732729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2147/4303] 10.222.0.16 () {58 vars in 1467 bytes} [Wed Oct 5 02:42:59 2022] DELETE /identity/v3/projects/a414211bcd0b4f9b953be73cbb6914ea/users/8e2485a0ca0646858990a4860cb4a175/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:42:59.739542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:59.741768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:42:59.772451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095bcf-3271-41ef-8989-a7f72f853ff1 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:59.878711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:59.879484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:59.879868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:59.880382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:59.881200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:59.883268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:59.894211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:42:59.932553 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2157/4304] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:42:59 2022] POST /identity/v3/users => generated 321 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:42:59.934052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:42:59.947109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bc0b2-d1d5-420e-bbb4-e187672b3b77 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:42:59.953539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:42:59.956777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:42:59.957742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:42:59.958146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:42:59.959419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:42:59.964238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:42:59.984843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:00.022611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2148/4305] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:42:59 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:00.026660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:00.042997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58839845-482c-4704-80b3-a17af097384a tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:00.122144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:00.123191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:00.123621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:00.124001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:00.137204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:00.140164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:00.208754 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2158/4306] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:00 2022] POST /identity/v3/projects => generated 364 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:00.213171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:00.243320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f296f6-bf34-4457-8cfc-40b994676600 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:00.380522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:00.381622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:00.382011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:00.382294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:00.382990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:00.386675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:00.428148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:00.450236 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2149/4307] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:43:00 2022] POST /identity/v3/roles => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:00.453206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c810-09e6-498f-8c8a-5f57e2c39b50 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:00.465824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7d9b6-8221-461c-ab95-c439689cc84d tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:00.466702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d9b6-8221-461c-ab95-c439689cc84d tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:00.467088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d9b6-8221-461c-ab95-c439689cc84d tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:00.467577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d9b6-8221-461c-ab95-c439689cc84d tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/993d406622914f2c83386c302d5e5071/users/601fc15345324e06b1af1654db29dcf4/roles/9ee40f424f454742bf555e10ce80b4a2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:00.496097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7d9b6-8221-461c-ab95-c439689cc84d tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(project_id=993d406622914f2c83386c302d5e5071, user_id=601fc15345324e06b1af1654db29dcf4, role_id=9ee40f424f454742bf555e10ce80b4a2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:00.503905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7d9b6-8221-461c-ab95-c439689cc84d tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:00.530873 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2159/4308] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:00 2022] PUT /identity/v3/projects/993d406622914f2c83386c302d5e5071/users/601fc15345324e06b1af1654db29dcf4/roles/9ee40f424f454742bf555e10ce80b4a2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:00.536176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:00.550287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdedd5-b88d-4cc7-8c37-679ceaa551d9 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:00.727504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072833aa-c23c-400b-969c-f5d33c6c810b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:00.728196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072833aa-c23c-400b-969c-f5d33c6c810b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:00.728481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072833aa-c23c-400b-969c-f5d33c6c810b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:00.728765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072833aa-c23c-400b-969c-f5d33c6c810b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/f4f2739d24874136b8612d40c491fe35/users/601fc15345324e06b1af1654db29dcf4/roles/9ee40f424f454742bf555e10ce80b4a2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:00.741094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072833aa-c23c-400b-969c-f5d33c6c810b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f4f2739d24874136b8612d40c491fe35, user_id=601fc15345324e06b1af1654db29dcf4, role_id=9ee40f424f454742bf555e10ce80b4a2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:00.743793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072833aa-c23c-400b-969c-f5d33c6c810b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:00.793281 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2150/4309] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:00 2022] PUT /identity/v3/projects/f4f2739d24874136b8612d40c491fe35/users/601fc15345324e06b1af1654db29dcf4/roles/9ee40f424f454742bf555e10ce80b4a2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:00.798420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:00.798885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:00.799270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:00.891059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] MFA Rules not processed for user `601fc15345324e06b1af1654db29dcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:00.895835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:00.910205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2160/4310] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:00 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:43:00.916481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4913e8-e597-4470-a1e1-854c7d8b6300 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:00.916770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4913e8-e597-4470-a1e1-854c7d8b6300 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:00.917652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4913e8-e597-4470-a1e1-854c7d8b6300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:00.946655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ef4913e8-e597-4470-a1e1-854c7d8b6300 None None] MFA Rules not processed for user `601fc15345324e06b1af1654db29dcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:00.947824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ef4913e8-e597-4470-a1e1-854c7d8b6300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:01.172270 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2151/4311] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:00 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 05 02:43:01.180354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:01.318246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad1c08-471e-4267-be7c-cbc8682339e0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:01.324611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:01.325730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:01.326182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:01.326743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:01.338523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:01.341477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:01.372205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2161/4312] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Oct 5 02:43:01 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:01.373178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:01.373469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:01.373748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:01.404414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] MFA Rules not processed for user `601fc15345324e06b1af1654db29dcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:01.405699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:01.465674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:01.575592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:01.585566 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2152/4313] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:01 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 05 02:43:01.588382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0628b-7725-4947-948a-b4c4bce25105 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:01.597527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:01.598340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:01.598701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:01.599054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/roles/9ee40f424f454742bf555e10ce80b4a2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:01.600641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9ee40f424f454742bf555e10ce80b4a2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:01.606151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:01.656474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=6,keystone:SELECT=91,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:01.709842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invalidating the token cache because role 9ee40f424f454742bf555e10ce80b4a2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:01.711390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:01.713232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:01.719161 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2162/4314] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:01 2022] DELETE /identity/v3/roles/9ee40f424f454742bf555e10ce80b4a2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:01.724472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:01.740889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189049c7-5ff2-41f9-9336-5a059a638698 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:01.885917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:01.886572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:01.886862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:01.887168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/f4f2739d24874136b8612d40c491fe35` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:01.889042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f4f2739d24874136b8612d40c491fe35)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:01.894937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:02.086367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f2739d24874136b8612d40c491fe35', 'request_id': 'req-1537c22e-7d68-4137-8e88-e16cc601aafc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.102262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f2739d24874136b8612d40c491fe35', 'request_id': 'req-1537c22e-7d68-4137-8e88-e16cc601aafc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.140547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f2739d24874136b8612d40c491fe35', 'request_id': 'req-1537c22e-7d68-4137-8e88-e16cc601aafc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.189685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] The token cache is being invalidate because project f4f2739d24874136b8612d40c491fe35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:02.190335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.191282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.193751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2153/4315] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:01 2022] DELETE /identity/v3/projects/f4f2739d24874136b8612d40c491fe35 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:02.198176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:02.199730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:02.218029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d71ca-410f-45dc-97ad-703d0a56b258 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:02.383974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:02.385063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:02.385459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:02.385860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/f4f2739d24874136b8612d40c491fe35` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:02.405383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f4f2739d24874136b8612d40c491fe35)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:02.409178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Could not find project: f4f2739d24874136b8612d40c491fe35.: keystone.exception.ProjectNotFound: Could not find project: f4f2739d24874136b8612d40c491fe35. Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 05 02:43:02.443174 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f4f2739d24874136b8612d40c491fe35. Oct 05 02:43:02.444946 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:02.451413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:02.452874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:02.455680 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2163/4316] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:02 2022] DELETE /identity/v3/projects/f4f2739d24874136b8612d40c491fe35 => generated 113 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:43:02.475470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537c22e-7d68-4137-8e88-e16cc601aafc tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:02.492655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:02.492655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:02.492655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:02.493250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/projects/993d406622914f2c83386c302d5e5071` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:02.518639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_project(project_id=993d406622914f2c83386c302d5e5071)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:02.522777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:02.664221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993d406622914f2c83386c302d5e5071', 'request_id': 'req-409a83d5-b5ff-46a6-aacb-61f66fce2c90'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.666133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:02.683304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993d406622914f2c83386c302d5e5071', 'request_id': 'req-409a83d5-b5ff-46a6-aacb-61f66fce2c90'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.697296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993d406622914f2c83386c302d5e5071', 'request_id': 'req-409a83d5-b5ff-46a6-aacb-61f66fce2c90'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.723926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] The token cache is being invalidate because project 993d406622914f2c83386c302d5e5071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:02.724503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.725229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:02.732683 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2154/4317] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:02 2022] DELETE /identity/v3/projects/993d406622914f2c83386c302d5e5071 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:02.737115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:02.739206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:02.761239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc2e69-b148-480c-99eb-fd9767409c2b tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:02.846189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:02.847259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:02.847557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:02.848353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/users/601fc15345324e06b1af1654db29dcf4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:02.849827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorizing `identity:delete_user(user_id=601fc15345324e06b1af1654db29dcf4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:02.851830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:03.065300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601fc15345324e06b1af1654db29dcf4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.116186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601fc15345324e06b1af1654db29dcf4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.117216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601fc15345324e06b1af1654db29dcf4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.130343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601fc15345324e06b1af1654db29dcf4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.131083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601fc15345324e06b1af1654db29dcf4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.143004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:03.157589 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2164/4318] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:02 2022] DELETE /identity/v3/users/601fc15345324e06b1af1654db29dcf4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:03.166632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:03.187466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a83d5-b5ff-46a6-aacb-61f66fce2c90 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:03.356760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:03.358285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:03.358768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:03.359214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/49df346bcbc941a78ccca01bcccfe9d7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:03.390206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Could not find domain: 49df346bcbc941a78ccca01bcccfe9d7.: keystone.exception.DomainNotFound: Could not find domain: 49df346bcbc941a78ccca01bcccfe9d7. Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 49df346bcbc941a78ccca01bcccfe9d7. Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:43:03.402648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:43:03.405545 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 49df346bcbc941a78ccca01bcccfe9d7. Oct 05 02:43:03.406899 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:43:03.409611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2155/4319] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:43:03 2022] PATCH /identity/v3/domains/49df346bcbc941a78ccca01bcccfe9d7 => generated 112 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:43:03.422183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:03.424837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:03.462637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d49492-aed6-4f71-bd7d-30534a2b8035 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:03.470806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:03.471816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:03.472472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:03.473023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/357bd8f5a22746f8883a7b43236f3b77` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:03.484964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Could not find domain: 357bd8f5a22746f8883a7b43236f3b77.: keystone.exception.DomainNotFound: Could not find domain: 357bd8f5a22746f8883a7b43236f3b77. Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 357bd8f5a22746f8883a7b43236f3b77. Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:43:03.490777 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:43:03.492066 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 357bd8f5a22746f8883a7b43236f3b77. Oct 05 02:43:03.493265 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:03.507247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2165/4320] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:43:03 2022] PATCH /identity/v3/domains/357bd8f5a22746f8883a7b43236f3b77 => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:43:03.508468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:03.525975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a7b14-5a9f-4466-8f44-407c2b9404c8 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:03.537189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:03.539627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:03.540117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:03.540563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/bb693011ef0f4e0a901d246b3d33c278` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:03.553526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Could not find domain: bb693011ef0f4e0a901d246b3d33c278.: keystone.exception.DomainNotFound: Could not find domain: bb693011ef0f4e0a901d246b3d33c278. Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bb693011ef0f4e0a901d246b3d33c278. Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:43:03.559978 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:43:03.561660 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bb693011ef0f4e0a901d246b3d33c278. Oct 05 02:43:03.562972 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:43:03.572117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:03.583978 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2156/4321] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:43:03 2022] PATCH /identity/v3/domains/bb693011ef0f4e0a901d246b3d33c278 => generated 112 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 05 02:43:03.586794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75938bc2-a34f-4bb7-bd2c-7283def81afe tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:03.595247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732474d6-be24-4f0b-bf05-26838bd00dcf tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e2485a0ca0646858990a4860cb4a175', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283c07a0c76747a8be406afe78c2987a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:03.596359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732474d6-be24-4f0b-bf05-26838bd00dcf tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:03.597277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732474d6-be24-4f0b-bf05-26838bd00dcf tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:03.597568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732474d6-be24-4f0b-bf05-26838bd00dcf tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] PATH_INFO: `/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:03.612695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732474d6-be24-4f0b-bf05-26838bd00dcf tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-732474d6-be24-4f0b-bf05-26838bd00dcf tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Could not find domain: 8e56dbcf8a61403a881ad5dfd8acf72c.: keystone.exception.DomainNotFound: Could not find domain: 8e56dbcf8a61403a881ad5dfd8acf72c. Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8e56dbcf8a61403a881ad5dfd8acf72c. Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:43:03.625421 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:43:03.628058 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8e56dbcf8a61403a881ad5dfd8acf72c. Oct 05 02:43:03.629818 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:43:03.633778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:03.634016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2166/4322] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:43:03 2022] PATCH /identity/v3/domains/8e56dbcf8a61403a881ad5dfd8acf72c => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:43:03.635738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:03.760476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2b6b-5db1-4755-9c3f-c57fa71ca6c5 tempest-TokensV3TestJSON-1270515955 tempest-TokensV3TestJSON-1270515955-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:03.771760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:03.772515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:03.773513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:03.773748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] PATH_INFO: `/v3/users/863e3d6f306a4dff8912b0ae9e57a660` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:03.777752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=863e3d6f306a4dff8912b0ae9e57a660)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:03.783823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:03.906257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863e3d6f306a4dff8912b0ae9e57a660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.951198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863e3d6f306a4dff8912b0ae9e57a660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.952400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863e3d6f306a4dff8912b0ae9e57a660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.961744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:03.977393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863e3d6f306a4dff8912b0ae9e57a660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:03.983719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863e3d6f306a4dff8912b0ae9e57a660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:04.027667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:04.028480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:04.028948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:04.037298 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2157/4323] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:03 2022] DELETE /identity/v3/users/863e3d6f306a4dff8912b0ae9e57a660 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:04.055135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:04.057345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:04.211415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2167/4324] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:04.231484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:04.233165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:04.411148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba23ed-76fa-49f3-9c5c-a520d8efd93c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:04.419905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:04.421077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:04.421522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:04.423546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:04.435556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:04.437481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:04.450578 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2158/4325] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:05.111920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:05.115104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:05.159850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2077aa-016e-41c6-b954-e0de0346de41 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:05.167756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:05.168436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:05.168750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:05.169015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] PATH_INFO: `/v3/projects/a414211bcd0b4f9b953be73cbb6914ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:05.171037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a414211bcd0b4f9b953be73cbb6914ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:05.190938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:05.430248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a414211bcd0b4f9b953be73cbb6914ea', 'request_id': 'req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.451337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a414211bcd0b4f9b953be73cbb6914ea', 'request_id': 'req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.462716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a414211bcd0b4f9b953be73cbb6914ea', 'request_id': 'req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.505872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] The token cache is being invalidate because project a414211bcd0b4f9b953be73cbb6914ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:05.506151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.513546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.516410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2168/4326] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:05 2022] DELETE /identity/v3/projects/a414211bcd0b4f9b953be73cbb6914ea => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:05.521690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:05.535891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd1222-89a3-4255-bc55-1c16ca35ae2b service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:05.679981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:05.680640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:05.680954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:05.681222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] PATH_INFO: `/v3/users/8e2485a0ca0646858990a4860cb4a175` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:05.682374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2485a0ca0646858990a4860cb4a175)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:05.684314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:05.794891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2485a0ca0646858990a4860cb4a175'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.827828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2485a0ca0646858990a4860cb4a175'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.828589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2485a0ca0646858990a4860cb4a175'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.865760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2485a0ca0646858990a4860cb4a175'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.866333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2485a0ca0646858990a4860cb4a175'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:05.905365 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2159/4327] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:05 2022] DELETE /identity/v3/users/8e2485a0ca0646858990a4860cb4a175 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:06.804124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:06.805929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:06.834811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c0bc-466c-4aa3-a1e0-1bf1e885cd12 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:07.075348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:07.076235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:07.078493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:07.078493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] PATH_INFO: `/v3/projects/283c07a0c76747a8be406afe78c2987a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:07.082140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283c07a0c76747a8be406afe78c2987a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:07.088197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:07.108867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:07.274403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283c07a0c76747a8be406afe78c2987a', 'request_id': 'req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.305776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283c07a0c76747a8be406afe78c2987a', 'request_id': 'req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.319115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283c07a0c76747a8be406afe78c2987a', 'request_id': 'req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.367645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] The token cache is being invalidate because project 283c07a0c76747a8be406afe78c2987a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:07.367645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.369060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.376105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2169/4328] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:06 2022] DELETE /identity/v3/projects/283c07a0c76747a8be406afe78c2987a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:07.382070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:07.384095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:07.417096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413eb17-acaa-459c-9660-41a44b2d0e1b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:07.430844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:07.586475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:07.587153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:07.587439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:07.587720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] PATH_INFO: `/v3/users/634bd58b37de44978bdc0d2707015309` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:07.595940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634bd58b37de44978bdc0d2707015309)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:07.601390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:07.774914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.813579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.815942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.852468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.853344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84b0c745-518b-4282-be11-69440f349073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634bd58b37de44978bdc0d2707015309'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:07.883730 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2160/4329] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:07 2022] DELETE /identity/v3/users/634bd58b37de44978bdc0d2707015309 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:08.587519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:08.589353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:08.620130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb6ab5-b751-449f-bd6d-20cc4be2bd89 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:08.787105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:08.788425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:08.789061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:08.789692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] PATH_INFO: `/v3/projects/2858845cdd954baf9c65832ee2883aab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:08.796150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2858845cdd954baf9c65832ee2883aab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:08.800404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:08.951607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2858845cdd954baf9c65832ee2883aab', 'request_id': 'req-104de886-2de1-41a9-acf0-71116f88f06e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:08.967512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2858845cdd954baf9c65832ee2883aab', 'request_id': 'req-104de886-2de1-41a9-acf0-71116f88f06e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:08.980218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2858845cdd954baf9c65832ee2883aab', 'request_id': 'req-104de886-2de1-41a9-acf0-71116f88f06e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:09.000580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] The token cache is being invalidate because project 2858845cdd954baf9c65832ee2883aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:09.001253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:09.002858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-104de886-2de1-41a9-acf0-71116f88f06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:09.004738 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2170/4330] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:08 2022] DELETE /identity/v3/projects/2858845cdd954baf9c65832ee2883aab => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:09.015162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.015761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.015966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.059568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:09.062073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:09.229287 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2161/4331] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:09.231007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.231409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.231708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.302139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:09.303373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:09.323023 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2171/4332] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:09.327424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:09.340764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db676e-fc3d-49d5-b4df-69fc0b72cff0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:09.362159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:09.362791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.363073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.363349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.364260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:43:09.364561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:09.366202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:09.404750 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2162/4333] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:09.405920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:09.423287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdca74-bf41-41eb-b73e-7afdb874bfff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:09.441598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:09.442838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.443122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.443399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.444038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:09.446173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:09.482682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:09.511742 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2172/4334] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:09 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:43:09.513871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:09.527229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf972a6-3bcf-475e-a8bd-c969c9fecb99 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:09.556865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:09.684759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:09.685504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.685794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.686075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.686726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:09.696930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:09.755082 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2163/4335] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:09 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:09.756363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:09.775579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f031e18-5314-4c26-a0f8-d7ed41b94630 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:09.780462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:09.781110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.781389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.781665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.782315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:09.784726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:09.822832 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2173/4336] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:09.827061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:09.841947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d865f29-a8fc-440c-84fa-8f53f697364e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:09.851728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f76ffd-5aa6-440a-af95-88597607da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:09.856357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76ffd-5aa6-440a-af95-88597607da25 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.856695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76ffd-5aa6-440a-af95-88597607da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.857011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76ffd-5aa6-440a-af95-88597607da25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.857910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f76ffd-5aa6-440a-af95-88597607da25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:09.859554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f76ffd-5aa6-440a-af95-88597607da25 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:09.894654 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2164/4337] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:09.898739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:09.919634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff94b-88bf-4b27-b038-9b60b2eaf169 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:09.946623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:09.947218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:09.948266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:09.948266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] PATH_INFO: `/v3/projects/85fcf6bba4d84fe78b028b971d357f43/users/42643b93b25248ab9f1c703da8c0eb94/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:09.993387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fcf6bba4d84fe78b028b971d357f43, user_id=42643b93b25248ab9f1c703da8c0eb94, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:09.996470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:10.041594 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2174/4338] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:09 2022] PUT /identity/v3/projects/85fcf6bba4d84fe78b028b971d357f43/users/42643b93b25248ab9f1c703da8c0eb94/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:10.044431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.044994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.045141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.170655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] MFA Rules not processed for user `42643b93b25248ab9f1c703da8c0eb94`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:10.171914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:10.381740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2165/4339] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:10.382841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:10.399792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d56a2-d77f-48f8-8fb0-015740e78f9b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:10.405259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d871-cf1a-4990-b182-0715286a7b64 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42643b93b25248ab9f1c703da8c0eb94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85fcf6bba4d84fe78b028b971d357f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:10.406703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d871-cf1a-4990-b182-0715286a7b64 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.407100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d871-cf1a-4990-b182-0715286a7b64 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.407474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d871-cf1a-4990-b182-0715286a7b64 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] PATH_INFO: `/v3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.413801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2175/4340] 10.222.0.16 () {58 vars in 1104 bytes} [Wed Oct 5 02:43:10 2022] GET /identity/v3 => generated 255 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:10.414699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:10.425998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f943435-0b0f-4765-b755-0d6415ce1238 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:10.440740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44ff21-885e-430f-8903-8f38f3a8e46a tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42643b93b25248ab9f1c703da8c0eb94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85fcf6bba4d84fe78b028b971d357f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:10.441420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ff21-885e-430f-8903-8f38f3a8e46a tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.441674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ff21-885e-430f-8903-8f38f3a8e46a tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.441953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ff21-885e-430f-8903-8f38f3a8e46a tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] PATH_INFO: `/v3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.447112 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2166/4341] 10.222.0.16 () {58 vars in 1104 bytes} [Wed Oct 5 02:43:10 2022] GET /identity/v3 => generated 255 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:10.448675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d871-cf1a-4990-b182-0715286a7b64 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:10.476462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739d871-cf1a-4990-b182-0715286a7b64 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:10.485027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710e659-69c5-446e-a378-e7832e568300 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42643b93b25248ab9f1c703da8c0eb94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85fcf6bba4d84fe78b028b971d357f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:10.485650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710e659-69c5-446e-a378-e7832e568300 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.486522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710e659-69c5-446e-a378-e7832e568300 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.486959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710e659-69c5-446e-a378-e7832e568300 tempest-TestApiDiscovery-2063495607 tempest-TestApiDiscovery-2063495607-project] PATH_INFO: `/v3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.490889 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2176/4342] 10.222.0.16 () {58 vars in 1104 bytes} [Wed Oct 5 02:43:10 2022] GET /identity/v3 => generated 255 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:10.496264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab93ce2-591c-47f9-b3e5-9805b62be6ec None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.496960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab93ce2-591c-47f9-b3e5-9805b62be6ec None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.497463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab93ce2-591c-47f9-b3e5-9805b62be6ec None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.498994 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2167/4343] 10.222.0.16 () {56 vars in 895 bytes} [Wed Oct 5 02:43:10 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:43:10.509351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8219da-7499-4e2e-a784-838330dea9f0 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.509733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8219da-7499-4e2e-a784-838330dea9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.510041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8219da-7499-4e2e-a784-838330dea9f0 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.516316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2177/4344] 10.222.0.16 () {56 vars in 895 bytes} [Wed Oct 5 02:43:10 2022] GET /identity/ => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:43:10.539556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab93ce2-591c-47f9-b3e5-9805b62be6ec None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:10.679756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab93ce2-591c-47f9-b3e5-9805b62be6ec None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:10.690574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:10.692743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.695013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.697059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] PATH_INFO: `/v3/users/42643b93b25248ab9f1c703da8c0eb94` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.700568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42643b93b25248ab9f1c703da8c0eb94)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:10.704569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:10.753272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:10.815040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42643b93b25248ab9f1c703da8c0eb94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:10.870422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42643b93b25248ab9f1c703da8c0eb94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:10.872494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42643b93b25248ab9f1c703da8c0eb94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:10.899496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42643b93b25248ab9f1c703da8c0eb94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:10.900658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42643b93b25248ab9f1c703da8c0eb94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:10.942959 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2168/4345] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:10 2022] DELETE /identity/v3/users/42643b93b25248ab9f1c703da8c0eb94 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:10.947430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:10.948305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:10.948768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:10.989442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:10.991047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:11.250783 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2178/4346] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:11.269661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:11.271777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:11.484992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4dabe-3a37-4783-b3e3-7581f5df83c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:11.489919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b5c69-ad95-4201-91e6-a48baa24aa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:11.490891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b5c69-ad95-4201-91e6-a48baa24aa27 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:11.491194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b5c69-ad95-4201-91e6-a48baa24aa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:11.491554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b5c69-ad95-4201-91e6-a48baa24aa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:11.514452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b5c69-ad95-4201-91e6-a48baa24aa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:11.516199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b5c69-ad95-4201-91e6-a48baa24aa27 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:11.555294 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2169/4347] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:43:12.506109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:12.514602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:12.537126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d326e-afed-410f-9a7e-86f402ea0480 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:12.582139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:12.582927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:12.583190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:12.583640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] PATH_INFO: `/v3/projects/85fcf6bba4d84fe78b028b971d357f43` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:12.585620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fcf6bba4d84fe78b028b971d357f43)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:12.587755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:12.709232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fcf6bba4d84fe78b028b971d357f43', 'request_id': 'req-5b4221f2-c2b1-4b1e-818d-4803bd68d904'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:12.722619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fcf6bba4d84fe78b028b971d357f43', 'request_id': 'req-5b4221f2-c2b1-4b1e-818d-4803bd68d904'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:12.732125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fcf6bba4d84fe78b028b971d357f43', 'request_id': 'req-5b4221f2-c2b1-4b1e-818d-4803bd68d904'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:12.760158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] The token cache is being invalidate because project 85fcf6bba4d84fe78b028b971d357f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:12.760674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:12.762105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b4221f2-c2b1-4b1e-818d-4803bd68d904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:12.764628 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2179/4348] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:12 2022] DELETE /identity/v3/projects/85fcf6bba4d84fe78b028b971d357f43 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:12.770420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d406a-82f2-455b-9507-d2c2808c6c3c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:12.771495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d406a-82f2-455b-9507-d2c2808c6c3c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:12.772129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d406a-82f2-455b-9507-d2c2808c6c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:12.798101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-624d406a-82f2-455b-9507-d2c2808c6c3c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:12.804394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-624d406a-82f2-455b-9507-d2c2808c6c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:12.949772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:12.950352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:12.950921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:12.975356 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2170/4349] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:12.983187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:12.983589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:12.984104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:12.996505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] MFA Rules not processed for user `9211cfded73b4747b3cb63bcfb3c3ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:13.002649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:13.069507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:13.077456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:13.110400 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2171/4350] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:43:13.111587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:13.124605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:13.129409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e33f0d-cbfa-4b14-8e55-6a74bebb1edd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:13.144827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:13.145600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:13.150265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:13.150265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:13.150265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:43:13.150265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:13.178830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:13.223455 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2172/4351] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:13.227428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:13.259654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d653395-a069-425d-8e02-11cca3b7f734 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:13.268731 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2180/4352] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:13.293906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:13.294760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:13.295046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:13.295429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:13.296162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:13.314522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:13.376801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:13.397273 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2173/4353] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:13 2022] POST /identity/v3/projects => generated 395 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:13.399920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:13.433011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c97c4-a815-43e7-b422-fda9767f6a48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:13.527861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:13.529901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:13.530549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:13.531062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:13.531976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:13.535359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:13.579119 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2181/4354] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:13 2022] POST /identity/v3/users => generated 304 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:13.583176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:13.599758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7b9e-05be-4117-9440-367b69e06a17 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:13.613613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:13.615473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:13.615986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:13.616579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:13.618009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:13.620637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:13.660938 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2174/4355] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:13.661439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:13.678227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349ad2b-07f7-4b08-b56d-37e1ba1ba0b2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:13.701685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:13.702376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:13.702655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:13.702933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] PATH_INFO: `/v3/projects/be906217709d4f4b9af4700e4ffc90f5/users/420103f967ac4a0c9328c0938312eb73/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:13.750730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be906217709d4f4b9af4700e4ffc90f5, user_id=420103f967ac4a0c9328c0938312eb73, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:13.754066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:13.780092 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2182/4356] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:13 2022] PUT /identity/v3/projects/be906217709d4f4b9af4700e4ffc90f5/users/420103f967ac4a0c9328c0938312eb73/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:13.784650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:13.804476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937a67-244f-44df-bca5-2aabc7a48561 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:13.998642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f2d86-eb0f-4156-ad39-be2b465128f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:13.999294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f2d86-eb0f-4156-ad39-be2b465128f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:13.999580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f2d86-eb0f-4156-ad39-be2b465128f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:13.999862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f2d86-eb0f-4156-ad39-be2b465128f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.000539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f2d86-eb0f-4156-ad39-be2b465128f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.002821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f2d86-eb0f-4156-ad39-be2b465128f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.026760 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2175/4357] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:14.027740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:14.047068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3621d4-fcd3-4592-877b-cd4a76519e23 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:14.054908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:14.055685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.056034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.056380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] PATH_INFO: `/v3/projects/be906217709d4f4b9af4700e4ffc90f5/users/420103f967ac4a0c9328c0938312eb73/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.089782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be906217709d4f4b9af4700e4ffc90f5, user_id=420103f967ac4a0c9328c0938312eb73, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.089782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.132839 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2183/4358] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:14 2022] PUT /identity/v3/projects/be906217709d4f4b9af4700e4ffc90f5/users/420103f967ac4a0c9328c0938312eb73/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:14.144032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.144387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.144828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.177091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] MFA Rules not processed for user `420103f967ac4a0c9328c0938312eb73`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:14.179006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:14.270040 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2176/4359] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:14.271431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:14.364822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68b107-043a-4482-8084-1bdf7210abb2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:14.371103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:14.372257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.372559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.372916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.373691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.379309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.422936 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2184/4360] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:14 2022] POST /identity/v3/projects => generated 395 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:14.427685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:14.451771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40d07c-b340-4b95-bd0a-4829fbd3c273 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:14.584615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:14.589490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.590483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.590954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.592277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.595011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.623559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:14.633424 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2177/4361] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:14 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:14.636940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:14.665246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea763a60-4e1c-45b5-b2ac-9f686577ee70 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:14.672772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:14.674437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.674958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.675501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.676401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.678375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.697635 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2185/4362] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:14.701521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:14.726586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656e112-eb62-40c1-bfca-0d0e21a1ec2f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:14.754127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75765c05-0eb5-42e4-a2c6-579fb342cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:14.759639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75765c05-0eb5-42e4-a2c6-579fb342cde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.759946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75765c05-0eb5-42e4-a2c6-579fb342cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.760210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75765c05-0eb5-42e4-a2c6-579fb342cde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.765251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75765c05-0eb5-42e4-a2c6-579fb342cde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.774446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75765c05-0eb5-42e4-a2c6-579fb342cde3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.809557 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2178/4363] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:14.814844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:14.823813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:14.842496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3feb34-6340-4baa-bce7-680f0078b443 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:14.866702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:14.867502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.871055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.873185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] PATH_INFO: `/v3/projects/43ef5e52d38149e5a244a694c0caad68/users/585f0b77dfd341c9917478f9d0ce88bb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:14.902676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ef5e52d38149e5a244a694c0caad68, user_id=585f0b77dfd341c9917478f9d0ce88bb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:14.912404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:14.946762 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2186/4364] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:14 2022] PUT /identity/v3/projects/43ef5e52d38149e5a244a694c0caad68/users/585f0b77dfd341c9917478f9d0ce88bb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:14.961153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:14.961751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:14.962400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:15.033009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] MFA Rules not processed for user `585f0b77dfd341c9917478f9d0ce88bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:15.035733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:15.152761 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2179/4365] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:15.192319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:15.195495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:15.344883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5be93-6fc2-4e02-9f62-63a8e754cb38 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:15.355947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15067b41-252e-4e6d-b379-40f433e0b79b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:15.359870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15067b41-252e-4e6d-b379-40f433e0b79b service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:15.360313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15067b41-252e-4e6d-b379-40f433e0b79b service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:15.360600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15067b41-252e-4e6d-b379-40f433e0b79b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:15.511472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15067b41-252e-4e6d-b379-40f433e0b79b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:15.517484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15067b41-252e-4e6d-b379-40f433e0b79b service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:15.539310 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2187/4366] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:15 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:16.873098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:17.132148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0de9c-783f-4545-b6d4-e93e2b81a240 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:17.148873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:17.149631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:17.152349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:17.152590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] PATH_INFO: `/v3/users/420103f967ac4a0c9328c0938312eb73` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:17.160486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420103f967ac4a0c9328c0938312eb73)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:17.160486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:17.322917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420103f967ac4a0c9328c0938312eb73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:17.375101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420103f967ac4a0c9328c0938312eb73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:17.378790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420103f967ac4a0c9328c0938312eb73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:17.406388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420103f967ac4a0c9328c0938312eb73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:17.411625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420103f967ac4a0c9328c0938312eb73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:17.425541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:17.435636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2180/4367] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:16 2022] DELETE /identity/v3/users/420103f967ac4a0c9328c0938312eb73 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:17.438280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:17.439391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:17.439952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:17.467748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:17.470829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:17.669560 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2188/4368] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:17.691417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:17.693275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:17.875597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00814c6-9b63-4973-9f4b-f6f5438e7267 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:17.902838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:17.909129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:17.910537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:17.910839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:17.955882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:17.960322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:17.998504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2181/4369] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:19.360224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:19.362255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:19.393937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa1d2f-4b7a-4197-9389-86ff68605560 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:19.410487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:19.412302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:19.412610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:19.412861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] PATH_INFO: `/v3/projects/be906217709d4f4b9af4700e4ffc90f5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:19.422152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be906217709d4f4b9af4700e4ffc90f5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:19.424469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:19.549527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:19.612567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be906217709d4f4b9af4700e4ffc90f5', 'request_id': 'req-5b5eca21-3484-438a-9972-8954c942633d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:19.636099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be906217709d4f4b9af4700e4ffc90f5', 'request_id': 'req-5b5eca21-3484-438a-9972-8954c942633d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:19.675498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be906217709d4f4b9af4700e4ffc90f5', 'request_id': 'req-5b5eca21-3484-438a-9972-8954c942633d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:19.730702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] The token cache is being invalidate because project be906217709d4f4b9af4700e4ffc90f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:19.731066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:19.738697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:19.746413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2189/4370] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:19 2022] DELETE /identity/v3/projects/be906217709d4f4b9af4700e4ffc90f5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:19.747167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:19.772049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad637743-d7bf-40dc-abb9-eed79def8df4 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:19.977698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:19.979574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:19.980085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:19.980590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] PATH_INFO: `/v3/users/585f0b77dfd341c9917478f9d0ce88bb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:19.982247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585f0b77dfd341c9917478f9d0ce88bb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:19.987880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:20.093164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585f0b77dfd341c9917478f9d0ce88bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:20.117980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585f0b77dfd341c9917478f9d0ce88bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:20.118748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585f0b77dfd341c9917478f9d0ce88bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:20.137099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585f0b77dfd341c9917478f9d0ce88bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:20.138116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d36de893-978d-4a36-8e5b-559ae54d1673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585f0b77dfd341c9917478f9d0ce88bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:20.181650 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2182/4371] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:19 2022] DELETE /identity/v3/users/585f0b77dfd341c9917478f9d0ce88bb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:21.910136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:21.911858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:21.946083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5eca21-3484-438a-9972-8954c942633d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:22.094627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:22.095862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:22.096233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:22.096551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] PATH_INFO: `/v3/projects/43ef5e52d38149e5a244a694c0caad68` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:22.102751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ef5e52d38149e5a244a694c0caad68)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:22.105258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:22.207803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ef5e52d38149e5a244a694c0caad68', 'request_id': 'req-2cd48dfb-a498-4499-a492-0dcc08d029b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:22.230430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ef5e52d38149e5a244a694c0caad68', 'request_id': 'req-2cd48dfb-a498-4499-a492-0dcc08d029b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:22.241666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ef5e52d38149e5a244a694c0caad68', 'request_id': 'req-2cd48dfb-a498-4499-a492-0dcc08d029b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:22.263068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] The token cache is being invalidate because project 43ef5e52d38149e5a244a694c0caad68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:22.263435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:22.265232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2cd48dfb-a498-4499-a492-0dcc08d029b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:22.284341 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2190/4372] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:21 2022] DELETE /identity/v3/projects/43ef5e52d38149e5a244a694c0caad68 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:22.286605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:22.288407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:22.289814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:22.323179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:22.325190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:22.378235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:22.576352 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2183/4373] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:22.579211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:22.580112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:22.580454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:22.613486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:22.615266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:22.630952 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2191/4374] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:22.632258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:22.643243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6d906-a394-434c-9389-914c8ef5abaa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:22.697061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:22.698005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:22.698128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:22.698368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:22.699055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:43:22.699366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:22.701170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:22.736692 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2184/4375] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:22.738405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:22.778011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66681-22ab-4af2-ad02-1ede21705a52 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:22.798454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:22.799709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:22.801544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:22.802284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:22.803618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:22.806668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:22.909095 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2192/4376] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:22 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:22.910347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:22.925087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bde0b-515c-468f-9b13-f879afa414a4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:23.270806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:23.271595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:23.271887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:23.272183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:23.272853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:23.274898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:23.339426 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2185/4377] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:22 2022] POST /identity/v3/users => generated 287 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:23.344311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:23.361382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b30e8-2e09-4e3c-8735-d811e0dc7e4a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:23.377525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:23.378158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:23.378444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:23.378722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:23.379386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:23.381028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:23.408894 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2193/4378] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:43:23.410311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:23.445209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03e044-1668-48b2-9e65-0d5dd7835543 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:23.464441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9fd3-f0b3-4e2c-9ef1-e075592daaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:23.465677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9fd3-f0b3-4e2c-9ef1-e075592daaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:23.467909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9fd3-f0b3-4e2c-9ef1-e075592daaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:23.470578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9fd3-f0b3-4e2c-9ef1-e075592daaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:23.474735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9fd3-f0b3-4e2c-9ef1-e075592daaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:23.486773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9fd3-f0b3-4e2c-9ef1-e075592daaf4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:23.523764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:23.525380 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2186/4379] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:23.530947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:23.552986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93a93-ad12-475a-a9ae-375b5c63f632 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:23.572249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14849a33-a478-4bd9-9c8f-ddef4f9dc1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:23.572946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14849a33-a478-4bd9-9c8f-ddef4f9dc1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:23.573239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14849a33-a478-4bd9-9c8f-ddef4f9dc1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:23.573519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14849a33-a478-4bd9-9c8f-ddef4f9dc1bf admin admin] PATH_INFO: `/v3/projects/0c8c313781eb48af820cbf6a6809c71e/users/14dcfdfda52045629c0ecd6d2c9ac40e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:23.620684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:23.621354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:23.621799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:23.626158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14849a33-a478-4bd9-9c8f-ddef4f9dc1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8c313781eb48af820cbf6a6809c71e, user_id=14dcfdfda52045629c0ecd6d2c9ac40e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:23.629336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14849a33-a478-4bd9-9c8f-ddef4f9dc1bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:23.648502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:23.650231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:23.680994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2194/4380] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:23 2022] PUT /identity/v3/projects/0c8c313781eb48af820cbf6a6809c71e/users/14dcfdfda52045629c0ecd6d2c9ac40e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:23.686227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:23.686525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:23.686810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:23.757919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] MFA Rules not processed for user `14dcfdfda52045629c0ecd6d2c9ac40e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:23.759181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:23.802907 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2187/4381] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:43:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:43:23.828064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:23.829877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:23.898173 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2195/4382] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:23.902412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:23.908758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:23.989705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4705c06-6ddc-4e89-b627-aaa91a6e01e1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:23.999080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22090ce-3f41-49ed-a635-d7d79976cf54 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:24.005170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:24.005966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.006450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.006825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.007718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:24.009882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:24.058828 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2196/4383] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:23 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:43:24.064360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:24.121520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:24.122433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.122923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.123375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.206652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:24.219447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46c7c-22ca-4d90-8881-979051433748 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:24.237741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:24.238378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.238662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.238938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.239846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:24.241939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:24.249692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:24.251958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:24.263871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2188/4384] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:43:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:43:24.283077 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2197/4385] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:24 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:24.284701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:24.358166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af48f21-5d80-450a-bf1e-f3059de9b9cd service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:24.372811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:24.373715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.374071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.375119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.377488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:24.380036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:24.419153 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2189/4386] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:24.422957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:24.438627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd1707-7be7-4584-a688-90567f6d03ed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:24.457049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9540-e374-4b2e-849e-5d4681702cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:24.458007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9540-e374-4b2e-849e-5d4681702cab admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.458509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9540-e374-4b2e-849e-5d4681702cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.458889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9540-e374-4b2e-849e-5d4681702cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.460254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9540-e374-4b2e-849e-5d4681702cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:24.461425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9540-e374-4b2e-849e-5d4681702cab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:24.481381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2198/4387] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:24.482921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:24.512788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b41d-9194-49ce-92db-58176a929710 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:24.519478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:24.520818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.521244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.521527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] PATH_INFO: `/v3/projects/71ad96a666ff47b5b584770633d59311/users/19faff9f67a24d43ae115e45781da986/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.571027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ad96a666ff47b5b584770633d59311, user_id=19faff9f67a24d43ae115e45781da986, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:24.582244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:24.627656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2190/4388] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:24 2022] PUT /identity/v3/projects/71ad96a666ff47b5b584770633d59311/users/19faff9f67a24d43ae115e45781da986/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:24.629646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0eeff-a4dd-495e-8fac-c4a3eed43fd4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:24.629942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0eeff-a4dd-495e-8fac-c4a3eed43fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:24.630287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0eeff-a4dd-495e-8fac-c4a3eed43fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:24.700225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-32b0eeff-a4dd-495e-8fac-c4a3eed43fd4 None None] MFA Rules not processed for user `19faff9f67a24d43ae115e45781da986`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:24.701494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32b0eeff-a4dd-495e-8fac-c4a3eed43fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:24.832493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2199/4389] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:24.842584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:24.844382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:24.966288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:25.000239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67891a-ed4a-486d-86fe-f6b393e7b567 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:25.012314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:25.013294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:25.013770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:25.014231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:25.185421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:25.191826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:25.243934 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2191/4390] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:25.498332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:25.499303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:25.499753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:25.542902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:25.544435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:25.696417 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2200/4391] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:43:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:25.713092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:25.837281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5532662-a294-4e1e-8396-d7ceb042582d service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:25.855098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb50fcd-de2c-4cad-9bd6-7733ab5b9922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:25.856065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb50fcd-de2c-4cad-9bd6-7733ab5b9922 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:25.856536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb50fcd-de2c-4cad-9bd6-7733ab5b9922 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:25.857008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb50fcd-de2c-4cad-9bd6-7733ab5b9922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:25.887292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb50fcd-de2c-4cad-9bd6-7733ab5b9922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:25.894617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb50fcd-de2c-4cad-9bd6-7733ab5b9922 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:25.941731 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2192/4392] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:43:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:26.599565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:26.616932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263bb36-9d25-44cd-8638-bef1ba4a5c30 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:26.628176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:26.628829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:26.631303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:26.631616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:26.672282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:26.675981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:26.708687 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2201/4393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:26.838609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:26.839523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:26.839996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:26.886906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:26.888637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:26.897566 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2193/4394] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:43:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:27.020526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:27.078281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8d466-a7fb-4ac5-956f-b15923aa99e5 service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:27.113674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577bb94-d837-4716-b607-a9e57cfd37c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:27.116804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577bb94-d837-4716-b607-a9e57cfd37c7 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:27.122126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577bb94-d837-4716-b607-a9e57cfd37c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:27.123492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577bb94-d837-4716-b607-a9e57cfd37c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:27.192875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577bb94-d837-4716-b607-a9e57cfd37c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:27.213440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577bb94-d837-4716-b607-a9e57cfd37c7 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:27.229830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2202/4395] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:43:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:43:27.703378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:27.815075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65988c5-befa-49c2-a1e3-1e93cda28cbc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:27.821819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:27.822526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:27.822814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:27.823092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] PATH_INFO: `/v3/users/14dcfdfda52045629c0ecd6d2c9ac40e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:27.824320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14dcfdfda52045629c0ecd6d2c9ac40e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:27.827038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:27.924743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:28.000784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14dcfdfda52045629c0ecd6d2c9ac40e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:28.037749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14dcfdfda52045629c0ecd6d2c9ac40e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:28.038792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14dcfdfda52045629c0ecd6d2c9ac40e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:28.066276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14dcfdfda52045629c0ecd6d2c9ac40e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:28.068250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14dcfdfda52045629c0ecd6d2c9ac40e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:28.093008 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2194/4396] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:27 2022] DELETE /identity/v3/users/14dcfdfda52045629c0ecd6d2c9ac40e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:28.098589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:28.099774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:28.100249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:28.153811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:28.156668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:28.218241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:28.275920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2203/4397] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:28.447341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:28.448864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:28.595051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9629-031c-4cdc-a512-f205bf427941 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:28.611643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:28.612287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:28.612571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:28.612847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:28.634119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:28.635599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:28.666816 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2195/4398] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:29.870899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:29.872458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:29.895499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9033-43e3-4272-970d-ceea1c485870 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:29.911174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:29.912076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:29.912563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:29.913052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] PATH_INFO: `/v3/projects/0c8c313781eb48af820cbf6a6809c71e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:29.914425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8c313781eb48af820cbf6a6809c71e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:29.916533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:30.031534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8c313781eb48af820cbf6a6809c71e', 'request_id': 'req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.051129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8c313781eb48af820cbf6a6809c71e', 'request_id': 'req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.072613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8c313781eb48af820cbf6a6809c71e', 'request_id': 'req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.094102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] The token cache is being invalidate because project 0c8c313781eb48af820cbf6a6809c71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:30.094533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.106581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.110754 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2204/4399] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:29 2022] DELETE /identity/v3/projects/0c8c313781eb48af820cbf6a6809c71e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:30.114994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:30.133106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f495c-fd97-46b8-83e6-a2ad9b48eddc service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:30.348800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:30.351766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:30.352183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:30.353137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] PATH_INFO: `/v3/users/19faff9f67a24d43ae115e45781da986` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:30.356807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19faff9f67a24d43ae115e45781da986)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:30.367787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:30.495942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:30.518685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19faff9f67a24d43ae115e45781da986'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.554435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19faff9f67a24d43ae115e45781da986'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.555545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19faff9f67a24d43ae115e45781da986'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.575127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19faff9f67a24d43ae115e45781da986'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.576307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b687eaf8-57f8-4cf3-9ee6-2eb1c81bbd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19faff9f67a24d43ae115e45781da986'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:30.602072 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2196/4400] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:30 2022] DELETE /identity/v3/users/19faff9f67a24d43ae115e45781da986 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:33.889162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:33.890636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:33.916798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e6a7-6836-40bb-b690-aaf4c05ff3c5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:34.026686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:34.027482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:34.029625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:34.030246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] PATH_INFO: `/v3/projects/71ad96a666ff47b5b584770633d59311` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:34.031918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ad96a666ff47b5b584770633d59311)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:34.034742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:34.179167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ad96a666ff47b5b584770633d59311', 'request_id': 'req-94c25e90-ee9a-4571-b7d9-1e273841fe2c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:34.211891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ad96a666ff47b5b584770633d59311', 'request_id': 'req-94c25e90-ee9a-4571-b7d9-1e273841fe2c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:34.234488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ad96a666ff47b5b584770633d59311', 'request_id': 'req-94c25e90-ee9a-4571-b7d9-1e273841fe2c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:34.238034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:34.264711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] The token cache is being invalidate because project 71ad96a666ff47b5b584770633d59311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:34.267616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:34.270581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-94c25e90-ee9a-4571-b7d9-1e273841fe2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:34.278092 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2205/4401] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:33 2022] DELETE /identity/v3/projects/71ad96a666ff47b5b584770633d59311 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:34.279436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:34.279930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:34.280076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:34.318755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:34.323487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:34.491276 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2197/4402] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:34.502014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:34.502856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:34.503140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:34.574977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:34.576527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:34.642114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:34.648556 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2206/4403] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:34.657953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2a4a-6a4d-4463-a7b0-284e16303565 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:34.672073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:34.672834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:34.673756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:34.674454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:34.675226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:43:34.675604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:34.677391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:34.709387 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2198/4404] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:34.712209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:34.730715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da0de3-60d0-4f6c-ac19-39660b38663d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:34.744672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:34.746560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:34.747032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:34.747588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:34.748610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:34.756800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:34.844550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:34.855870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2207/4405] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:34 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:34.858532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b05e-31b8-4f47-936f-34cfd6c5e575 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:35.079023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:35.080529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:35.080781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:35.081173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:35.082352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:35.083982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:35.177013 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2199/4406] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:34 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:35.178955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:35.204839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d60c66-647a-42f1-bdd3-feac9c7f9b58 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:35.229281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:35.230020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:35.230429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:35.230787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:35.232315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:35.236411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:35.279490 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2208/4407] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:35.280719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:35.295472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6b96-7c5d-44b2-a1f3-edd88103c2df admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:35.322485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fa8cc-cd8d-48ff-850a-0c588a3fdf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:35.323128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa8cc-cd8d-48ff-850a-0c588a3fdf56 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:35.323406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa8cc-cd8d-48ff-850a-0c588a3fdf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:35.323680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fa8cc-cd8d-48ff-850a-0c588a3fdf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:35.324458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fa8cc-cd8d-48ff-850a-0c588a3fdf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:35.326093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fa8cc-cd8d-48ff-850a-0c588a3fdf56 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:35.368079 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2200/4408] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:35.372284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:35.393313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb69e7-b85b-467f-8c8c-5c38496eef50 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:35.404648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:35.405754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:35.406312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:35.406723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] PATH_INFO: `/v3/projects/6078f5e18f054d6ca5e91914d67ec4b7/users/6fec181de08743d488bfb3f711fcac7d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:35.459183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6078f5e18f054d6ca5e91914d67ec4b7, user_id=6fec181de08743d488bfb3f711fcac7d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:35.463377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:35.500691 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2209/4409] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:35 2022] PUT /identity/v3/projects/6078f5e18f054d6ca5e91914d67ec4b7/users/6fec181de08743d488bfb3f711fcac7d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:35.513119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:35.514195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:35.514633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:35.657888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] MFA Rules not processed for user `6fec181de08743d488bfb3f711fcac7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:35.659566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:35.695746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:35.813026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2201/4410] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:35.830675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:35.833217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:35.967927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb73ca-4fe9-47cf-a9a4-947e763609a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:35.980674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:35.981343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:35.981625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:35.981901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:36.000132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:36.009320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:36.028969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2210/4411] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:36.793807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:36.847914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:36.849427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:37.018568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340e9a4-9417-40ca-8585-ae2411244291 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:37.026634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8ddeb-e9c9-4fff-b9a7-a1afff3d601d service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:37.036922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:37.037196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:37.037533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:37.037793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:37.038010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:37.038134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:37.038343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] PATH_INFO: `/v3/users/6746153a53d94c4a9b8d1167a7fa7c4a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:37.038655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] PATH_INFO: `/v3/users/6fec181de08743d488bfb3f711fcac7d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:37.042153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fec181de08743d488bfb3f711fcac7d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:37.042901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6746153a53d94c4a9b8d1167a7fa7c4a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:37.044814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:37.048392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:37.188230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fec181de08743d488bfb3f711fcac7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.211844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:37.238866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fec181de08743d488bfb3f711fcac7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.243600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fec181de08743d488bfb3f711fcac7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.249331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6746153a53d94c4a9b8d1167a7fa7c4a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.271960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fec181de08743d488bfb3f711fcac7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.273797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5f58c3c-12f9-4cc8-ae73-a06ec0890a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fec181de08743d488bfb3f711fcac7d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.315183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6746153a53d94c4a9b8d1167a7fa7c4a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.318212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6746153a53d94c4a9b8d1167a7fa7c4a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.349441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6746153a53d94c4a9b8d1167a7fa7c4a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.349441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6746153a53d94c4a9b8d1167a7fa7c4a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:37.350876 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2202/4412] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:36 2022] DELETE /identity/v3/users/6fec181de08743d488bfb3f711fcac7d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:37.356408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:37.358976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:37.359633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:37.391320 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2211/4413] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:43:36 2022] DELETE /identity/v3/users/6746153a53d94c4a9b8d1167a7fa7c4a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:37.422122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:37.427419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:37.523393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:37.753690 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2203/4414] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:37.780617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:37.784367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.042164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de789eb-1058-4198-a0bc-4e717b8f9640 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:38.062992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e01da2-0f6e-4f83-a45c-972ecc3a0df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:38.063999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e01da2-0f6e-4f83-a45c-972ecc3a0df5 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.064530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e01da2-0f6e-4f83-a45c-972ecc3a0df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.065097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e01da2-0f6e-4f83-a45c-972ecc3a0df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.089744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e01da2-0f6e-4f83-a45c-972ecc3a0df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:38.091856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e01da2-0f6e-4f83-a45c-972ecc3a0df5 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:38.094406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:38.097347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.130759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf8cd9-a557-4aea-912b-5d5774a3cc4e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:38.158208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2212/4415] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:38.163405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:38.164849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.166203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.167144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.167739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.172030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.172630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] PATH_INFO: `/v3/projects/2ced783ca2614e7996ccac3bc9ad97c7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.176010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ced783ca2614e7996ccac3bc9ad97c7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:38.190840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:38.245689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:38.256603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.309542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ced783ca2614e7996ccac3bc9ad97c7', 'request_id': 'req-224c06cf-9f22-4514-8cb6-4706205e73cc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.331632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ced783ca2614e7996ccac3bc9ad97c7', 'request_id': 'req-224c06cf-9f22-4514-8cb6-4706205e73cc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.344030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ced783ca2614e7996ccac3bc9ad97c7', 'request_id': 'req-224c06cf-9f22-4514-8cb6-4706205e73cc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.374818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] The token cache is being invalidate because project 2ced783ca2614e7996ccac3bc9ad97c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:38.375577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.377502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-224c06cf-9f22-4514-8cb6-4706205e73cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.386424 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2204/4416] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:38 2022] DELETE /identity/v3/projects/2ced783ca2614e7996ccac3bc9ad97c7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:38.391380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d03e-92f2-4e6f-a1e6-70dde5cbc9bb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.391578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d03e-92f2-4e6f-a1e6-70dde5cbc9bb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.392389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d03e-92f2-4e6f-a1e6-70dde5cbc9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.450483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-99f9d03e-92f2-4e6f-a1e6-70dde5cbc9bb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:38.455502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99f9d03e-92f2-4e6f-a1e6-70dde5cbc9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.474049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2213/4417] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:38.489079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:38.490841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.619118 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2205/4418] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:38.625702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.630560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.631870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.635821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:38.650139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225eb22-af90-4e56-87d0-7a74790ae268 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:38.665766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:38.666413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.666704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.667863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.688693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:38.690910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:38.702278 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2214/4419] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:43:38.707062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:38.709406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.728021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:38.730858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:38.749864 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2206/4420] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:43:38.755350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:38.762008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acd76c-ac1d-4fc8-a50b-64c0d473fe99 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:38.767935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:38.768722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.769154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.769533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] PATH_INFO: `/v3/projects/6078f5e18f054d6ca5e91914d67ec4b7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.771030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6078f5e18f054d6ca5e91914d67ec4b7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:38.772153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da386ad-8af8-4abb-8689-4f58e468b1ad None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:38.774749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:38.786467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:38.796032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.796990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.797445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:38.802833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:43:38.805904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:38.807823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:38.846519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2207/4421] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:38.849446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:38.870886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6078f5e18f054d6ca5e91914d67ec4b7', 'request_id': 'req-e82ae581-e8c5-49c6-a10b-ca46223f3994'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.892946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6078f5e18f054d6ca5e91914d67ec4b7', 'request_id': 'req-e82ae581-e8c5-49c6-a10b-ca46223f3994'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.910828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6078f5e18f054d6ca5e91914d67ec4b7', 'request_id': 'req-e82ae581-e8c5-49c6-a10b-ca46223f3994'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.931540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bf6d5-741d-4e6f-b972-b9f54812772e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:38.953472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] The token cache is being invalidate because project 6078f5e18f054d6ca5e91914d67ec4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:43:38.957040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.960939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e82ae581-e8c5-49c6-a10b-ca46223f3994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:43:38.966745 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2215/4422] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:43:38 2022] DELETE /identity/v3/projects/6078f5e18f054d6ca5e91914d67ec4b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:38.972050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22565a4-a9e9-4e6e-888a-5eec866a6dcb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:38.972493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22565a4-a9e9-4e6e-888a-5eec866a6dcb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:38.973066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22565a4-a9e9-4e6e-888a-5eec866a6dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.031703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d22565a4-a9e9-4e6e-888a-5eec866a6dcb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:39.033748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d22565a4-a9e9-4e6e-888a-5eec866a6dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:39.069343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:39.136010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.136662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.136943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.137232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.145841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.154020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.211083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2216/4423] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:39.212578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.220139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.220796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.255186 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2208/4424] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:38 2022] POST /identity/v3/projects => generated 379 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:39.257018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.259749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:39.295094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:39.298928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:39.375737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3480c1-e70a-409e-85d2-c0bba3ca81f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.383409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.384448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.384954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.385478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.386288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.388957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.433714 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2209/4425] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:39 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:39.437910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.461920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bcdc6-28fb-4777-8cd9-974ca1d978f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.475541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2217/4426] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:39.479555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.488350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.489187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.489989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.490362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.491138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.496601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.508733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe756-ccae-4ca1-b911-f0dd9bbb22d3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.514132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.514763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.515041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.515311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.525327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:43:39.525848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.527646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.538462 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2210/4427] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:39.539438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.549670 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2218/4428] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:43:39.554222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.566129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:39.577058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429120b9-3256-44b0-a354-98ffe9b7de78 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.592539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dc133-df76-4f40-acd6-124029c86c4e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.614967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.615384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.616026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.616303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.616576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.618729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.624769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.625378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.626472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.628651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.630466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.632882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.667340 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2211/4429] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:39.675176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.734719 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2219/4430] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:39 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:43:39.737777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.781279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e490c55-5d9e-4cbb-80ba-f8a2edbdcbed admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.895144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101920ab-e1d5-44fc-9404-c32c8d26c589 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:39.904074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b79ae-b117-4221-ae67-9e8dd3c52772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.905552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b79ae-b117-4221-ae67-9e8dd3c52772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.906231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b79ae-b117-4221-ae67-9e8dd3c52772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.906733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b79ae-b117-4221-ae67-9e8dd3c52772 admin admin] PATH_INFO: `/v3/projects/d797c0058e8c456290081d056df79292/users/ff170a5be8a04902b66e5f0e79fd47df/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.915457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:39.915967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.916257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.916539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.917224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.919673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.927493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b79ae-b117-4221-ae67-9e8dd3c52772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d797c0058e8c456290081d056df79292, user_id=ff170a5be8a04902b66e5f0e79fd47df, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:39.930926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b79ae-b117-4221-ae67-9e8dd3c52772 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:39.951607 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2212/4431] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:39 2022] PUT /identity/v3/projects/d797c0058e8c456290081d056df79292/users/ff170a5be8a04902b66e5f0e79fd47df/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:39.958296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:39.958973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:39.959616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:39.964598 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2220/4432] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:39 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:43:39.968923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:39.998098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:40.000169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:40.002929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fd7d8-a651-4bf8-a588-021013ec36b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:40.016206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:40.175538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2213/4433] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:43:40.188821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:40.189929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:40.190217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:40.190514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:40.191164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:40.192780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:40.204561 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2221/4434] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:43:40.209807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:40.228963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:40.230031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156d07-f6c1-4247-938c-0f77e5373d28 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:40.231884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:40.237397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:40.238189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:40.238556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:40.238899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:40.240067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:40.242185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:40.274947 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2214/4435] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:40.279489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:40.311033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c76233-c3e4-46f5-abfb-ce27073065af admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:40.326328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea11b5a-623b-433c-82c2-fd2ad2b8ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:40.327642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea11b5a-623b-433c-82c2-fd2ad2b8ec6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:40.328816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea11b5a-623b-433c-82c2-fd2ad2b8ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:40.330851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea11b5a-623b-433c-82c2-fd2ad2b8ec6e admin admin] PATH_INFO: `/v3/projects/a6e9d6ad39254aad8bd121e32a801a98/users/9462feb53e5247ce9bbd7917fedfb179/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:40.358191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea11b5a-623b-433c-82c2-fd2ad2b8ec6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e9d6ad39254aad8bd121e32a801a98, user_id=9462feb53e5247ce9bbd7917fedfb179, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:40.361166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea11b5a-623b-433c-82c2-fd2ad2b8ec6e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:40.390963 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2215/4436] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:40 2022] PUT /identity/v3/projects/a6e9d6ad39254aad8bd121e32a801a98/users/9462feb53e5247ce9bbd7917fedfb179/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:43:40.392669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900f09-9c6c-4d6b-b471-4e3185f2426d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:40.402093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:40.402397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:40.402840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:40.441516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:40.474185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] MFA Rules not processed for user `9462feb53e5247ce9bbd7917fedfb179`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:40.480536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:40.528324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:40.528987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:40.530801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:40.531095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:40.699316 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2216/4437] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:43:40.699993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:40.700269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:40.704199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:40.736238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256755a-490b-4ae8-9798-09a552b6746a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:40.750731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:40.751594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:40.752053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:40.752667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:40.753519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:40.755711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:40.779017 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2222/4438] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:40.881620 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2217/4439] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:43:40 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:40.884655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:40.899787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674faa1-6f7f-4631-82bb-89f8363f0f3b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:41.149224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:41.149866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:41.150151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:41.150427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:41.151120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:41.153892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:41.231146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2223/4440] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:43:40 2022] POST /identity/v3/users => generated 298 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:43:41.232710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:41.267887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c0d5c-3bd0-4a65-95e3-8d4388183d44 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:41.289385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:41.294305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:41.294550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:41.295987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:41.296699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:41.307731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:41.352540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:41.362621 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2218/4441] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:43:41.371854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f5c53-e6b5-4394-8f31-d49748c0cb94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:41.388219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:41.388929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:41.389217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:41.389500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] PATH_INFO: `/v3/projects/ee8e9dbd5c2740568d5b77b141dc399f/users/66e1c91d5fab4237ad171934a9ab0ce4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:41.449561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8e9dbd5c2740568d5b77b141dc399f, user_id=66e1c91d5fab4237ad171934a9ab0ce4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:41.453020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:41.525757 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2224/4442] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:41 2022] PUT /identity/v3/projects/ee8e9dbd5c2740568d5b77b141dc399f/users/66e1c91d5fab4237ad171934a9ab0ce4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:41.529641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:41.554210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60c4e7-1883-4eac-b3e7-db46be7aa7fc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:41.671839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:41.733847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723ebf-4919-4dd0-826e-ac12d8c4dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:41.734762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723ebf-4919-4dd0-826e-ac12d8c4dc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:41.735042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723ebf-4919-4dd0-826e-ac12d8c4dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:41.735840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723ebf-4919-4dd0-826e-ac12d8c4dc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:41.736526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723ebf-4919-4dd0-826e-ac12d8c4dc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:41.744810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723ebf-4919-4dd0-826e-ac12d8c4dc44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:41.810524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2219/4443] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:43:41.816224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:41.838136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9404f9-847c-48af-ad16-f9b14d4604c1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:41.856625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:41.857360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:41.858291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:41.858603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] PATH_INFO: `/v3/projects/ee8e9dbd5c2740568d5b77b141dc399f/users/66e1c91d5fab4237ad171934a9ab0ce4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:41.874325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8e9dbd5c2740568d5b77b141dc399f, user_id=66e1c91d5fab4237ad171934a9ab0ce4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:41.879462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:41.908767 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2225/4444] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:43:41 2022] PUT /identity/v3/projects/ee8e9dbd5c2740568d5b77b141dc399f/users/66e1c91d5fab4237ad171934a9ab0ce4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:43:41.922584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:41.923871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:41.924406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:42.031787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] MFA Rules not processed for user `66e1c91d5fab4237ad171934a9ab0ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:42.036966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:42.342828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2220/4445] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:43:42.392026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:42.394292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:42.458307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:42.531881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b7b68-86a2-4364-b16d-240df7af01e1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:42.556185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:42.556732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:42.557075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:42.557360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:42.741034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:42.742604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:42.763789 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2226/4446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:44.420259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:44.433141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad615da0-666b-4c3a-9123-bab8ea963942 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:44.452214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67ebd7-b562-454b-9733-9f4c2c489172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:44.453104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67ebd7-b562-454b-9733-9f4c2c489172 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:44.453390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67ebd7-b562-454b-9733-9f4c2c489172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:44.454881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67ebd7-b562-454b-9733-9f4c2c489172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:44.491271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67ebd7-b562-454b-9733-9f4c2c489172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:44.500445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67ebd7-b562-454b-9733-9f4c2c489172 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:44.571286 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2221/4447] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:52.758863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=37 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:54.547072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=53 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:43:55.341340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:55.345297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:55.506798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff37e6-399f-4907-92a2-c7bdaeea6fbf service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:55.516215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28450142-5728-41da-a25b-75ea458b328a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:55.517561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28450142-5728-41da-a25b-75ea458b328a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:55.518054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28450142-5728-41da-a25b-75ea458b328a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:55.519646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28450142-5728-41da-a25b-75ea458b328a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:55.521942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28450142-5728-41da-a25b-75ea458b328a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:55.620542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28450142-5728-41da-a25b-75ea458b328a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:55.622680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28450142-5728-41da-a25b-75ea458b328a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:55.639850 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2227/4448] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:43:56.889449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:56.891012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:56.891606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:56.948434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:56.950296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:57.054565 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2222/4449] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:57.062394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:57.062967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:57.062967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:57.099624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:43:57.102137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:43:57.130234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2228/4450] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:43:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:43:57.137691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:43:57.153980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e6420-97a1-4031-9730-d6d9284f5b7c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:43:57.166609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:43:57.167351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:43:57.167732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:43:57.168103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:43:57.195443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:43:57.197179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:43:57.214264 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2223/4451] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:43:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:01.462097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:01.463687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:01.569836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7343127-e6ea-463d-8f34-e3574041407e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:01.575057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:01.578222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:01.579684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:01.580207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] PATH_INFO: `/v3/users/9211cfded73b4747b3cb63bcfb3c3ff8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:01.581767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9211cfded73b4747b3cb63bcfb3c3ff8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:01.584010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:01.630180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:01.670187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9211cfded73b4747b3cb63bcfb3c3ff8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:01.703384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9211cfded73b4747b3cb63bcfb3c3ff8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:01.717679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9211cfded73b4747b3cb63bcfb3c3ff8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:01.741743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9211cfded73b4747b3cb63bcfb3c3ff8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:01.742555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2664570c-1ab5-4a0b-9a0e-31c17894e595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9211cfded73b4747b3cb63bcfb3c3ff8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:01.764245 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2229/4452] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:01 2022] DELETE /identity/v3/users/9211cfded73b4747b3cb63bcfb3c3ff8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:02.190436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:02.223341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3d748-c3c0-4c87-901c-db1ed669269e service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:02.468677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:02.471808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:02.472859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:02.473425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] PATH_INFO: `/v3/projects/58c3c2b9910b4ba48a52cb1e3f1ef254` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:02.475814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c3c2b9910b4ba48a52cb1e3f1ef254)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:02.479276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:02.664775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'request_id': 'req-37a6b628-e77c-4dc8-9af9-75e5c5488acb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:02.685650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'request_id': 'req-37a6b628-e77c-4dc8-9af9-75e5c5488acb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:02.703948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c3c2b9910b4ba48a52cb1e3f1ef254', 'request_id': 'req-37a6b628-e77c-4dc8-9af9-75e5c5488acb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:02.721411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] The token cache is being invalidate because project 58c3c2b9910b4ba48a52cb1e3f1ef254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:02.721761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:02.722699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37a6b628-e77c-4dc8-9af9-75e5c5488acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:02.724553 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2224/4453] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:02 2022] DELETE /identity/v3/projects/58c3c2b9910b4ba48a52cb1e3f1ef254 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:02.732269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:02.732781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:02.732948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:02.806895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:02.809923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:02.934098 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2230/4454] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:02.943273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:02.944029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:02.944597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:02.978549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:02.991194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:02.994962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:03.004505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2225/4455] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:03.008750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.020196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc24b-98af-4536-b67a-509034bf01e9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.026002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.026830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.027308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.027763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.028574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:03.029082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.030865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.049980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2231/4456] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:03.052180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.068719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9e0d-314c-46ef-a958-72c7f335b684 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.074661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179f8bb-be76-4480-b29e-e9cbe81b95f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.075284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179f8bb-be76-4480-b29e-e9cbe81b95f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.075565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179f8bb-be76-4480-b29e-e9cbe81b95f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.075840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179f8bb-be76-4480-b29e-e9cbe81b95f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.076505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179f8bb-be76-4480-b29e-e9cbe81b95f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.078523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179f8bb-be76-4480-b29e-e9cbe81b95f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.136422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2226/4457] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:03 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:44:03.136811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.163426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5666-5f9c-4a5b-ac4d-13d8c28cebbd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.196022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.196517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.197018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.229630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:03.232440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:03.308477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b830d2-b412-4d85-a130-c5b247b34de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.309754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b830d2-b412-4d85-a130-c5b247b34de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.312041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b830d2-b412-4d85-a130-c5b247b34de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.314680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b830d2-b412-4d85-a130-c5b247b34de6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.315643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b830d2-b412-4d85-a130-c5b247b34de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.320411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b830d2-b412-4d85-a130-c5b247b34de6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.405061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2232/4458] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:03 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:03.411654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.412122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.412419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.414055 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2227/4459] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:44:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:03.415658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.432839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8e402-b7b2-4fcd-a345-338775b6f4ad None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.440491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.441833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.443065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.443649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.445324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.447662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.463048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2228/4460] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:03.464143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.471828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:03.473108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:03.474060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:03.493325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2233/4461] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:44:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:03.495781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.522485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71fa35-04d2-466d-9c13-b39a51d7e2f8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.533589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.535242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.535791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.536422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.537390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.540255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.558883 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2234/4462] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:03.560708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.564272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:03.594441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:03.669292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdff753-8e22-458d-af87-68e449ca499d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.680471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.681341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.681728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.682130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.703295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.710144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.731225 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2229/4463] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:44:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:03.732438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:03.759102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd246a5-9f0c-45f3-857c-544eb461ef50 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.759877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe1ac9-4fe2-4624-b518-41f5efa6064e service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:03.770428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8009-b69d-4511-a788-202724cdc703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.772261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8009-b69d-4511-a788-202724cdc703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.772580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8009-b69d-4511-a788-202724cdc703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.772846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8009-b69d-4511-a788-202724cdc703 admin admin] PATH_INFO: `/v3/projects/e4e4790602ed424f8fed3f9a58f11f8d/users/50721b88e9bb40c285e981a01c34dab7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.777283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7ed73-04e5-4ff9-b2d8-03c12cb2169a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:03.779421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ed73-04e5-4ff9-b2d8-03c12cb2169a service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.779857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ed73-04e5-4ff9-b2d8-03c12cb2169a service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.780368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7ed73-04e5-4ff9-b2d8-03c12cb2169a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.814435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7ed73-04e5-4ff9-b2d8-03c12cb2169a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.815921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e8009-b69d-4511-a788-202724cdc703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e4790602ed424f8fed3f9a58f11f8d, user_id=50721b88e9bb40c285e981a01c34dab7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:03.819257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e8009-b69d-4511-a788-202724cdc703 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.821939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad7ed73-04e5-4ff9-b2d8-03c12cb2169a service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:03.838296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2235/4464] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:44:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:03.865066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2230/4465] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:03 2022] PUT /identity/v3/projects/e4e4790602ed424f8fed3f9a58f11f8d/users/50721b88e9bb40c285e981a01c34dab7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:03.876639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:03.877038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:03.877222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:03.950607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] MFA Rules not processed for user `50721b88e9bb40c285e981a01c34dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:03.954832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:04.059753 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2236/4466] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:04.072595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca419dc-1217-476a-8779-a95ebc454743 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:04.073313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca419dc-1217-476a-8779-a95ebc454743 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:04.073872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca419dc-1217-476a-8779-a95ebc454743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:04.130747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-eca419dc-1217-476a-8779-a95ebc454743 None None] MFA Rules not processed for user `50721b88e9bb40c285e981a01c34dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:04.132024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eca419dc-1217-476a-8779-a95ebc454743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:04.149786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2231/4467] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:04.775835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:04.777553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:04.907755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752e7b-e54b-47a7-b32b-a5a9e5647f6c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:04.933212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c086b-be79-4616-96a3-6f941eb7309d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:04.934109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c086b-be79-4616-96a3-6f941eb7309d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:04.934568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c086b-be79-4616-96a3-6f941eb7309d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:04.935041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c086b-be79-4616-96a3-6f941eb7309d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:04.948747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c086b-be79-4616-96a3-6f941eb7309d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:04.950803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c086b-be79-4616-96a3-6f941eb7309d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:04.964992 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2237/4468] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:05.004975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1906-2f59-4165-800a-3e0d802888d9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:05.006014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1906-2f59-4165-800a-3e0d802888d9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:05.006590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff1906-2f59-4165-800a-3e0d802888d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:05.062560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98ff1906-2f59-4165-800a-3e0d802888d9 None None] MFA Rules not processed for user `50721b88e9bb40c285e981a01c34dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:05.065738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98ff1906-2f59-4165-800a-3e0d802888d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:05.075771 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2232/4469] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:05.122333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f102d5-1e9e-45bd-8b2d-3567a7722407 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:05.122626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f102d5-1e9e-45bd-8b2d-3567a7722407 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:05.122897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f102d5-1e9e-45bd-8b2d-3567a7722407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:05.168408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e2f102d5-1e9e-45bd-8b2d-3567a7722407 None None] MFA Rules not processed for user `50721b88e9bb40c285e981a01c34dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:05.169970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e2f102d5-1e9e-45bd-8b2d-3567a7722407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:05.187347 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2238/4470] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:05.265750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:05.266420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:05.267033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:05.319512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] MFA Rules not processed for user `50721b88e9bb40c285e981a01c34dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:05.325865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:05.345696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2233/4471] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:05.412508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337f158-e8d8-4e21-8e0b-3e2bea7c1624 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:05.412508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337f158-e8d8-4e21-8e0b-3e2bea7c1624 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:05.413636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337f158-e8d8-4e21-8e0b-3e2bea7c1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:05.424246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:05.459670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2337f158-e8d8-4e21-8e0b-3e2bea7c1624 None None] MFA Rules not processed for user `50721b88e9bb40c285e981a01c34dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:05.461083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2337f158-e8d8-4e21-8e0b-3e2bea7c1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:05.493995 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2239/4472] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:05.530280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:05.574108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:05.679961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9a3f-c105-4a59-bc3a-e9adc400726c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:05.685249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:05.687287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:05.687638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:05.688891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] PATH_INFO: `/v3/users/50721b88e9bb40c285e981a01c34dab7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:05.690461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50721b88e9bb40c285e981a01c34dab7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:05.692987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:05.800799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50721b88e9bb40c285e981a01c34dab7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:05.833982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50721b88e9bb40c285e981a01c34dab7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:05.834610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50721b88e9bb40c285e981a01c34dab7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:05.858035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50721b88e9bb40c285e981a01c34dab7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:05.859040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50721b88e9bb40c285e981a01c34dab7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:05.895789 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2234/4473] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:05 2022] DELETE /identity/v3/users/50721b88e9bb40c285e981a01c34dab7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:05.900412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:05.901489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:05.901966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:05.968815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:05.971221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:06.186995 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2240/4474] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:06.198044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:06.199485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:06.364545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff014c36-66ed-4713-88a8-85072aa4160d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:06.375618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c16f7-cc3a-476b-9322-048d73910dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:06.376502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c16f7-cc3a-476b-9322-048d73910dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:06.376780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c16f7-cc3a-476b-9322-048d73910dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:06.377973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c16f7-cc3a-476b-9322-048d73910dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:06.391512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c16f7-cc3a-476b-9322-048d73910dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:06.394330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c16f7-cc3a-476b-9322-048d73910dc6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:06.410651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2235/4475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:06.913520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:06.915316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:06.945247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7a5c-9459-4acc-bb6b-604b55ddc957 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:06.980039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:06.980708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:06.981019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:06.981299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] PATH_INFO: `/v3/projects/e4e4790602ed424f8fed3f9a58f11f8d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:06.993869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e4790602ed424f8fed3f9a58f11f8d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:06.996548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:07.088553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e4790602ed424f8fed3f9a58f11f8d', 'request_id': 'req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:07.101571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e4790602ed424f8fed3f9a58f11f8d', 'request_id': 'req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:07.111210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e4790602ed424f8fed3f9a58f11f8d', 'request_id': 'req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:07.128489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] The token cache is being invalidate because project e4e4790602ed424f8fed3f9a58f11f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:07.129101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:07.130971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e539fdf-c3c8-4bf1-bc58-87713fa7fa0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:07.136385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2241/4476] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:06 2022] DELETE /identity/v3/projects/e4e4790602ed424f8fed3f9a58f11f8d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:07.139554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:07.140130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:07.142303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:07.206801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:07.211650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:07.391969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:07.519567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2236/4477] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:07.525864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:07.526194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:07.526568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:07.586636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:07.589634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:07.606139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2242/4478] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:07.610900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:07.635789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27ce54-2ea9-488e-a1e0-c2af76534216 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:07.642104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:07.643213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:07.643744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:07.644250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:07.645367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:07.645913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:07.647961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:07.663186 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2237/4479] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:07.668749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:07.683001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398e51b-4bce-493b-a729-9c7e59e66d5f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:07.708043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:07.709171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:07.710446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:07.711649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:07.713530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:07.717646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:07.791466 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2243/4480] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:07 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:07.795760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:07.811833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb56397-88ac-44cd-b807-6a37143ae4f5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:07.963877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:07.965496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:07.965789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:07.966604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:07.967845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:07.970038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:08.021945 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2238/4481] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:07 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:08.023811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:08.070858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b336626-9355-4732-8e96-6d20564d995b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:08.113307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:08.114096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:08.114238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:08.114553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:08.124685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:08.131529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:08.153536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2244/4482] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:08.157702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:08.174898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcf81c-3f99-4dc5-b031-f10bae31e498 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:08.183958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6e8d5-5e69-4f28-a692-89e5546615de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:08.185057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6e8d5-5e69-4f28-a692-89e5546615de admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:08.185057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6e8d5-5e69-4f28-a692-89e5546615de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:08.185308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6e8d5-5e69-4f28-a692-89e5546615de admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:08.185825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6e8d5-5e69-4f28-a692-89e5546615de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:08.187458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6e8d5-5e69-4f28-a692-89e5546615de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:08.235727 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2239/4483] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:08.240548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:08.255973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7c52-1b59-4979-a694-db20be8868ab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:08.267122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:08.268136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:08.268596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:08.269262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] PATH_INFO: `/v3/projects/b8325066949145cf92e3ec5dd67f44a2/users/ed6bf791f0d34cbe822b35402973cc49/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:08.314745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8325066949145cf92e3ec5dd67f44a2, user_id=ed6bf791f0d34cbe822b35402973cc49, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:08.317666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:08.357615 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2245/4484] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:08 2022] PUT /identity/v3/projects/b8325066949145cf92e3ec5dd67f44a2/users/ed6bf791f0d34cbe822b35402973cc49/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:08.359507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:08.360562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:08.361068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:08.397695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:08.399481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:08.558520 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2240/4485] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:08.633884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:08.637123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:08.666142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:08.790213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa46e8-985c-403e-a3c3-b8b97bcab4e3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:08.804327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7bd32-0918-42d9-9e53-725e40400078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:08.805238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bd32-0918-42d9-9e53-725e40400078 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:08.805726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bd32-0918-42d9-9e53-725e40400078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:08.808058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bd32-0918-42d9-9e53-725e40400078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:08.827341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7bd32-0918-42d9-9e53-725e40400078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:08.829038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7bd32-0918-42d9-9e53-725e40400078 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:08.841062 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2246/4486] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:12.853122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:12.854686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:12.876531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dfe3a-1417-4c79-9065-bfca6961524a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:12.886150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:12.887819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:12.888538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:12.889236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] PATH_INFO: `/v3/users/9462feb53e5247ce9bbd7917fedfb179` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:12.891437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9462feb53e5247ce9bbd7917fedfb179)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:12.894372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:13.005498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:13.013779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9462feb53e5247ce9bbd7917fedfb179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:13.046265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9462feb53e5247ce9bbd7917fedfb179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:13.049349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9462feb53e5247ce9bbd7917fedfb179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:13.079519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9462feb53e5247ce9bbd7917fedfb179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:13.080990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9462feb53e5247ce9bbd7917fedfb179'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:13.125026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2241/4487] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:12 2022] DELETE /identity/v3/users/9462feb53e5247ce9bbd7917fedfb179 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:13.130233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:13.132160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:13.133194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:13.203254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:13.205017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:13.384522 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2247/4488] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:13.476221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:13.478329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:13.654461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67590d4-0768-4cf7-a494-7ebf48561518 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:13.665003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:13.665965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:13.666399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:13.667072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:13.694347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:13.697600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:13.726234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2242/4489] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:14.757321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:14.758910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:14.775567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba27b9f-ca19-4531-ae9a-45e5bfd84322 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:14.782767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:14.784508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:14.785087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:14.785594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] PATH_INFO: `/v3/projects/a6e9d6ad39254aad8bd121e32a801a98` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:14.787111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e9d6ad39254aad8bd121e32a801a98)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:14.789467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:14.904318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e9d6ad39254aad8bd121e32a801a98', 'request_id': 'req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:14.951559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e9d6ad39254aad8bd121e32a801a98', 'request_id': 'req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:14.995162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e9d6ad39254aad8bd121e32a801a98', 'request_id': 'req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.042114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] The token cache is being invalidate because project a6e9d6ad39254aad8bd121e32a801a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:15.042725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.044288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.052254 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2248/4490] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:14 2022] DELETE /identity/v3/projects/a6e9d6ad39254aad8bd121e32a801a98 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:15.053461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:15.064868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc91ad2-5822-4040-ba89-13d60dcc0ceb service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:15.213734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:15.214436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:15.215023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:15.215398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] PATH_INFO: `/v3/users/66e1c91d5fab4237ad171934a9ab0ce4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:15.217085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e1c91d5fab4237ad171934a9ab0ce4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:15.220717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:15.308463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e1c91d5fab4237ad171934a9ab0ce4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.326296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:15.333338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e1c91d5fab4237ad171934a9ab0ce4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.335306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e1c91d5fab4237ad171934a9ab0ce4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.352401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e1c91d5fab4237ad171934a9ab0ce4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.353398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-101d0bcf-6a6f-4021-89a5-4371142be0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e1c91d5fab4237ad171934a9ab0ce4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:15.397931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2243/4491] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:15 2022] DELETE /identity/v3/users/66e1c91d5fab4237ad171934a9ab0ce4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:16.155779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:16.159332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:16.212066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b756b9b-3313-4d60-b33e-b12ebd4e4efc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:16.335072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:16.373273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:16.374197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:16.374577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:16.374949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] PATH_INFO: `/v3/projects/ee8e9dbd5c2740568d5b77b141dc399f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:16.377406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8e9dbd5c2740568d5b77b141dc399f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:16.380069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:16.573789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8e9dbd5c2740568d5b77b141dc399f', 'request_id': 'req-a3a3f9c0-d967-4b09-a838-26e2de7b912e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:16.600118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8e9dbd5c2740568d5b77b141dc399f', 'request_id': 'req-a3a3f9c0-d967-4b09-a838-26e2de7b912e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:16.607625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8e9dbd5c2740568d5b77b141dc399f', 'request_id': 'req-a3a3f9c0-d967-4b09-a838-26e2de7b912e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:16.658417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] The token cache is being invalidate because project ee8e9dbd5c2740568d5b77b141dc399f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:16.666621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:16.668734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3a3f9c0-d967-4b09-a838-26e2de7b912e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:16.680478 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2249/4492] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:16 2022] DELETE /identity/v3/projects/ee8e9dbd5c2740568d5b77b141dc399f => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:16.683332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:16.683904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:16.684333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:16.734364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:16.736161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:16.878413 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2244/4493] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:16.887480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:16.887764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:16.888037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:16.928640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:16.930195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:16.956615 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2250/4494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:16.958276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:16.976449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b413-f619-4d24-989a-292cd1514713 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:16.988435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:16.989493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:16.991024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:16.991560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:16.992448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:16.993069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:16.995006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:17.031656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2245/4495] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:44:17.034964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:17.047956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28107a-2dab-46fc-b57a-03a23467ad38 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:17.056239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:17.057209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:17.057488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:17.057758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:17.058993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:17.060994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:17.127460 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2251/4496] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:17 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:17.131826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:17.151840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d60d-b68a-43af-afd4-56b8ad8e8881 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:17.300379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:17.301413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:17.301867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:17.302337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:17.303166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:17.305980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:17.351260 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2246/4497] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:17 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:17.355945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:17.370353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57f91-33cc-4419-87f2-4d08ab18eb0e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:17.392338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:17.392806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:17.393123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:17.393455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:17.394113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:17.396555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:17.415143 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2252/4498] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:17.424201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:17.451131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bdd5-e771-44a4-b726-4c01f608653c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:17.466431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a641aff-3dae-49d5-8641-9f9f0d56ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:17.466431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641aff-3dae-49d5-8641-9f9f0d56ba33 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:17.466829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641aff-3dae-49d5-8641-9f9f0d56ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:17.466941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a641aff-3dae-49d5-8641-9f9f0d56ba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:17.467753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641aff-3dae-49d5-8641-9f9f0d56ba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:17.469520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a641aff-3dae-49d5-8641-9f9f0d56ba33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:17.491567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2247/4499] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:17.495977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:17.536726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c88a-3327-4a62-9d86-c0813f02267a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:17.549263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:17.550595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:17.551065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:17.551533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] PATH_INFO: `/v3/projects/ee949ac23a8d4e2287edaa2b88ec6315/users/86538babf73d46bd982cb7dc750ff26f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:17.633821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee949ac23a8d4e2287edaa2b88ec6315, user_id=86538babf73d46bd982cb7dc750ff26f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:17.637091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:17.688279 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2253/4500] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:17 2022] PUT /identity/v3/projects/ee949ac23a8d4e2287edaa2b88ec6315/users/86538babf73d46bd982cb7dc750ff26f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:44:17.698981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:17.700249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:17.700724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:17.764679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] MFA Rules not processed for user `86538babf73d46bd982cb7dc750ff26f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:17.766808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:17.826492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:17.931199 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2248/4501] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:17.932112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:18.112050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e1f2-5c8f-4fb6-a1eb-b3dad53aab65 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:18.127067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:18.127976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.128263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.128612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.129524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:18.136770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:18.160418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:18.192776 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2254/4502] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:17 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:44:18.197804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:18.229014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962b03e-8fe4-4609-9254-508a8640ecb2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:18.424947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:18.425739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.426124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.426496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.427236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:18.433118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:18.486789 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2249/4503] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:18 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:18.491275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:18.511404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c090bc-15aa-4e0a-9d8b-ee46c850a6fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:18.521634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:18.524963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.525584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.526084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.527182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:18.529181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:18.555599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:18.569734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4bdcf-7d63-422b-b516-6b2c88d27753 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:18.570032 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2255/4504] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:18.580885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:18.581849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.582140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.582422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] PATH_INFO: `/v3/projects/fb19528eb0db4758bbfc503dd9a95e0f/users/321d5fb50c99400d93a4d50cc5d9d1f4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.604653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb19528eb0db4758bbfc503dd9a95e0f, user_id=321d5fb50c99400d93a4d50cc5d9d1f4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:18.611828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:18.637927 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2250/4505] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:18 2022] PUT /identity/v3/projects/fb19528eb0db4758bbfc503dd9a95e0f/users/321d5fb50c99400d93a4d50cc5d9d1f4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:18.642524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:18.661922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf885f-c012-4966-833a-e6f413a477da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:18.782860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7a27c-ace4-44bc-acf7-677036f64015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:18.783486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7a27c-ace4-44bc-acf7-677036f64015 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.783771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7a27c-ace4-44bc-acf7-677036f64015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.784047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7a27c-ace4-44bc-acf7-677036f64015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.784701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7a27c-ace4-44bc-acf7-677036f64015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:18.786392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7a27c-ace4-44bc-acf7-677036f64015 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:18.798827 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2256/4506] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:18.802975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:18.820154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf20e87-dab6-42ff-b170-4235be62159f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:18.847756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:18.851654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.852282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.852771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] PATH_INFO: `/v3/projects/fb19528eb0db4758bbfc503dd9a95e0f/users/321d5fb50c99400d93a4d50cc5d9d1f4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.856125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb19528eb0db4758bbfc503dd9a95e0f, user_id=321d5fb50c99400d93a4d50cc5d9d1f4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:18.859524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:18.877649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2251/4507] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:18 2022] PUT /identity/v3/projects/fb19528eb0db4758bbfc503dd9a95e0f/users/321d5fb50c99400d93a4d50cc5d9d1f4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:44:18.892744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:18.893061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:18.894059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:18.981863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] MFA Rules not processed for user `321d5fb50c99400d93a4d50cc5d9d1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:18.983797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:19.209701 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2257/4508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:19.210852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:19.232943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ef529-0939-40bc-b68b-2b8d0e734549 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:19.266640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d5fb50c99400d93a4d50cc5d9d1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb19528eb0db4758bbfc503dd9a95e0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:19.267500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:19.268959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:19.269494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:19.271051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:19.272164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:19.274826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:19.310929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2252/4509] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:19.328992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:19.337514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74be10e-63e5-4801-951c-360cd45ae2e0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:19.361701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d5fb50c99400d93a4d50cc5d9d1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb19528eb0db4758bbfc503dd9a95e0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:19.362589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:19.363835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:19.364317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:19.366556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:19.369027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:19.442930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:19.453888 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2258/4510] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:19 2022] POST /identity/v3/projects => generated 349 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:19.456558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424773c5-f4b1-4a38-a361-8b4be773aa0e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:19.595808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d5fb50c99400d93a4d50cc5d9d1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb19528eb0db4758bbfc503dd9a95e0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:19.596794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:19.599532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:19.600026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:19.600935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:19.602070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:19.603888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:19.634501 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2253/4511] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:44:19.657517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:19.667167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:19.803634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:19.827138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86806b75-8268-47d8-9ee3-5eb19ca3c210 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:19.834947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30389861-13c2-4ec2-a25a-fe3d7405d17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:19.835725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389861-13c2-4ec2-a25a-fe3d7405d17d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:19.836133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389861-13c2-4ec2-a25a-fe3d7405d17d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:19.836579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389861-13c2-4ec2-a25a-fe3d7405d17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:19.878232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389861-13c2-4ec2-a25a-fe3d7405d17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:19.885489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389861-13c2-4ec2-a25a-fe3d7405d17d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:19.910756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2259/4512] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:20.442975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:20.442975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:20.459193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:20.589700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb00c1-fda3-437e-94d2-76bdbf168027 tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:20.599434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:20.600452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:20.600868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:20.601294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] PATH_INFO: `/v3/users/1b4b5f0c43074932a8963727adfee38a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:20.607507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4b5f0c43074932a8963727adfee38a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:20.610828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:20.754399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4b5f0c43074932a8963727adfee38a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:20.822971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4b5f0c43074932a8963727adfee38a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:20.824086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4b5f0c43074932a8963727adfee38a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:20.843293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4b5f0c43074932a8963727adfee38a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:20.844218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4b5f0c43074932a8963727adfee38a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:20.878316 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2254/4513] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:20 2022] DELETE /identity/v3/users/1b4b5f0c43074932a8963727adfee38a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:20.879711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:20.880454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:20.880867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:20.933998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:20.935346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:21.120412 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2260/4514] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:21.195884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:21.197621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:21.334050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621934d3-3471-4dbf-bf3b-c367cd64f469 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:21.339049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:21.340080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:21.340080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:21.340497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:21.358283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:21.360645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:21.389695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2255/4515] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:22.335697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:22.341417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:22.404142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a50b1-5e43-40bc-91cc-b35f7d8840e1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:22.427215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:22.433252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:22.433252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:22.434699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] PATH_INFO: `/v3/projects/446a33968038476fbc98fc0b6b1795c0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:22.449931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446a33968038476fbc98fc0b6b1795c0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:22.460603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:22.637342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446a33968038476fbc98fc0b6b1795c0', 'request_id': 'req-fe41f782-bafb-4a05-abbf-93eb3338c397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:22.675788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446a33968038476fbc98fc0b6b1795c0', 'request_id': 'req-fe41f782-bafb-4a05-abbf-93eb3338c397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:22.701943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446a33968038476fbc98fc0b6b1795c0', 'request_id': 'req-fe41f782-bafb-4a05-abbf-93eb3338c397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:22.734435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] The token cache is being invalidate because project 446a33968038476fbc98fc0b6b1795c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:22.735642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:22.736551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:22.738420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2261/4516] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:22 2022] DELETE /identity/v3/projects/446a33968038476fbc98fc0b6b1795c0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:22.742864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:22.763525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47951-8c8d-4f19-b881-6daffa5c9e41 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:22.841427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:22.918867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:22.920102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:22.920102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:22.920102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] PATH_INFO: `/v3/users/5bda07d8c2fa4f64b27d6eff9c821472` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:22.923815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bda07d8c2fa4f64b27d6eff9c821472)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:22.933654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:23.107480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bda07d8c2fa4f64b27d6eff9c821472'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:23.142565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bda07d8c2fa4f64b27d6eff9c821472'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:23.143723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bda07d8c2fa4f64b27d6eff9c821472'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:23.163211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bda07d8c2fa4f64b27d6eff9c821472'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:23.164069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cc036d8-2b7c-415d-880c-57c62514c90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bda07d8c2fa4f64b27d6eff9c821472'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:23.209876 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2256/4517] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:22 2022] DELETE /identity/v3/users/5bda07d8c2fa4f64b27d6eff9c821472 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:24.090734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:24.094761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:24.120790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f782-bafb-4a05-abbf-93eb3338c397 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:24.244374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:24.245292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:24.245676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:24.246044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] PATH_INFO: `/v3/projects/f42e21e5ff8247d2b2fc27a30b7a4fd9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:24.247366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42e21e5ff8247d2b2fc27a30b7a4fd9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:24.249580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:24.300065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:24.412864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42e21e5ff8247d2b2fc27a30b7a4fd9', 'request_id': 'req-127cabff-ad0d-482c-bb1d-05aa42952c49'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:24.438507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42e21e5ff8247d2b2fc27a30b7a4fd9', 'request_id': 'req-127cabff-ad0d-482c-bb1d-05aa42952c49'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:24.448626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42e21e5ff8247d2b2fc27a30b7a4fd9', 'request_id': 'req-127cabff-ad0d-482c-bb1d-05aa42952c49'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:24.499113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] The token cache is being invalidate because project f42e21e5ff8247d2b2fc27a30b7a4fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:24.499442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:24.500785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-127cabff-ad0d-482c-bb1d-05aa42952c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:24.504305 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2262/4518] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:24 2022] DELETE /identity/v3/projects/f42e21e5ff8247d2b2fc27a30b7a4fd9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:24.509123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:24.509656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:24.509656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:24.581331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:24.582587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:24.839933 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2257/4519] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:24.841767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:24.842055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:24.842420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:24.890013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:24.891838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:24.911382 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2263/4520] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:24.917134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:24.935887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f745-812c-4ed1-9589-f705b619ed20 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:24.963751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:24.964442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:24.964724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:24.965042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:24.967114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:24.967450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:24.969875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:24.997751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2258/4521] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:24.998491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.017933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6c1d3-1101-4ab4-9bbc-a25e24c8b820 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:25.027035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa54605-6344-4b13-96b0-fa2a333f0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:25.027756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54605-6344-4b13-96b0-fa2a333f0583 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.028180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54605-6344-4b13-96b0-fa2a333f0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.028464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa54605-6344-4b13-96b0-fa2a333f0583 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.029181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa54605-6344-4b13-96b0-fa2a333f0583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:25.032610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa54605-6344-4b13-96b0-fa2a333f0583 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:25.168079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.178139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2264/4522] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:24 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:25.189231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51829e-d4db-41d9-be42-a220f098bc3d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:25.298295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:25.305933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.306233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.307663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.395961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:25.398733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.401297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.401595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.402304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:25.411197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:25.417120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] MFA Rules not processed for user `ed6bf791f0d34cbe822b35402973cc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:25.418411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:25.487327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2259/4523] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:25 2022] POST /identity/v3/users => generated 292 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:25.490005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.547699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5255-7dfe-47ec-b3ac-0a2b648ab4ac admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:25.562249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:25.563735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.564187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.564560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.565634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:25.567270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:25.606241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2260/4524] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:25.607142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.613376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:25.668862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455fd98-1a57-4271-8fce-d1524830f32a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:25.683693 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2265/4525] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:25.684575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.688774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:25.689464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.689748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.690026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] PATH_INFO: `/v3/users/685ca76cf1164f8f9a013b3195c9ee94` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.697756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=685ca76cf1164f8f9a013b3195c9ee94)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:25.699920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:25.716509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb618a2-a35d-4079-ac9c-c505dcd427f8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:25.729058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f812e-84fb-465a-8af3-316989b83345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:25.729677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f812e-84fb-465a-8af3-316989b83345 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.730115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f812e-84fb-465a-8af3-316989b83345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.730530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f812e-84fb-465a-8af3-316989b83345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.731320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f812e-84fb-465a-8af3-316989b83345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:25.733202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f812e-84fb-465a-8af3-316989b83345 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:25.760655 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2266/4526] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:25.762318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.762798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.763249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.788394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] MFA Rules not processed for user `ed6bf791f0d34cbe822b35402973cc49`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:25.790100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:25.803709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2267/4527] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:25.805020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.809377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685ca76cf1164f8f9a013b3195c9ee94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:25.819127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abce40d-80e5-43e0-a632-78fe0a50b7f8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:25.824380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:25.825353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:25.826037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:25.826492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] PATH_INFO: `/v3/projects/55746a2ec736442bb2f0231a18576c0e/users/0870a7203edb4dca8dd5e5f98cb0334c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:25.847416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55746a2ec736442bb2f0231a18576c0e, user_id=0870a7203edb4dca8dd5e5f98cb0334c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:25.850754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:25.881033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685ca76cf1164f8f9a013b3195c9ee94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:25.882451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685ca76cf1164f8f9a013b3195c9ee94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:25.884981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2268/4528] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:25 2022] PUT /identity/v3/projects/55746a2ec736442bb2f0231a18576c0e/users/0870a7203edb4dca8dd5e5f98cb0334c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:25.886108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.889200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:25.899849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685ca76cf1164f8f9a013b3195c9ee94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:25.900616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685ca76cf1164f8f9a013b3195c9ee94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:25.918820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:25.933028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2261/4529] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:25 2022] DELETE /identity/v3/users/685ca76cf1164f8f9a013b3195c9ee94 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:25.934458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:25.938883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.036577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c3900-1a5b-497f-93fb-c33feb572f0f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:26.060210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46de21-6f3e-415d-aa27-a566accfa8d6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:26.066759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '321d5fb50c99400d93a4d50cc5d9d1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb19528eb0db4758bbfc503dd9a95e0f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:26.067597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.068128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.068550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] PATH_INFO: `/v3/projects/286d1e566a024fe097df36cd585f27fb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.069914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorizing `identity:delete_project(project_id=286d1e566a024fe097df36cd585f27fb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:26.072300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:26.121610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:26.154229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286d1e566a024fe097df36cd585f27fb', 'request_id': 'req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.163302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:26.164171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.164615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.165115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.167440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.172758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286d1e566a024fe097df36cd585f27fb', 'request_id': 'req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.191270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286d1e566a024fe097df36cd585f27fb', 'request_id': 'req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.211907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] The token cache is being invalidate because project 286d1e566a024fe097df36cd585f27fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:26.212204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.213908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f80f2d76-dfde-4a9c-a9c6-98ff8594fe3e tempest-QuotasNegativeTest-429253111 tempest-QuotasNegativeTest-429253111-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.216146 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2262/4530] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:25 2022] DELETE /identity/v3/projects/286d1e566a024fe097df36cd585f27fb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:26.217006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.217289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.217562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.261665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:26.263703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d7aad-0311-4d65-9614-ba672c5ec287 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:26.276048 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2269/4531] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:26.277588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.279560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] MFA Rules not processed for user `0870a7203edb4dca8dd5e5f98cb0334c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:26.280798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.282275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.282609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.324049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:26.325105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.431747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2263/4532] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:26.435223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:26.438859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:26.439384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.473341 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2270/4533] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:26.481539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:26.486100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.536373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea742f0-3737-4aa1-8781-88c52543ab84 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:26.546055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3272e-1a91-46d2-8523-e8e77f2ae2e0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:26.552032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:26.552669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.552992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.553277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] PATH_INFO: `/v3/users/86538babf73d46bd982cb7dc750ff26f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.554598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86538babf73d46bd982cb7dc750ff26f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:26.556561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:26.563105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:26.563832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.564434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.564656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.565940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:26.567224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:26.637044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86538babf73d46bd982cb7dc750ff26f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.639576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:26.655004 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2271/4534] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:26 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:26.658177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:26.662346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.671543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86538babf73d46bd982cb7dc750ff26f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.675918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86538babf73d46bd982cb7dc750ff26f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.726084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86538babf73d46bd982cb7dc750ff26f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.726870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86538babf73d46bd982cb7dc750ff26f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:26.747235 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2264/4535] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:26 2022] DELETE /identity/v3/users/86538babf73d46bd982cb7dc750ff26f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:26.751438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:26.753052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.785631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99249d9c-9bc2-4aa8-8b80-6f032488e9bf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:26.870597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:26.871523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.871808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.872089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.874551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:26.914890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f229e6-72cb-47e6-9488-6e44445ba25d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:26.922840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6bd40-18a1-4695-9675-f51bf5e1b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:26.923632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6bd40-18a1-4695-9675-f51bf5e1b20f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.923971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6bd40-18a1-4695-9675-f51bf5e1b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.924256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6bd40-18a1-4695-9675-f51bf5e1b20f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.925110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6bd40-18a1-4695-9675-f51bf5e1b20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:26.927616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6bd40-18a1-4695-9675-f51bf5e1b20f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:26.960469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2265/4536] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:26 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:26.962262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:26.962561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:26.962931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:26.973482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:26.976016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:26.988583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2272/4537] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:26.989427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.001560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:27.002801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:27.006966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e55b7-c13d-4e9d-bfc5-251648d6c777 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.016427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.017177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.017468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.017746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.018398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.020586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.025924 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2266/4538] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:27.040995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.049181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2273/4539] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:27.049897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.057841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289cbea-8741-4e5c-8982-3a28352a9c89 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.059790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:27.069970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.070809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.071093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.071411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] PATH_INFO: `/v3/projects/e08f86f777f243b999e5954a739c7e20/users/a0463bf73c804387aac197adfbb36b73/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.087440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d3abc-60d6-40ab-a069-444a117a6ba0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.094785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.095420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.095703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.095979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.102180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08f86f777f243b999e5954a739c7e20, user_id=a0463bf73c804387aac197adfbb36b73, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.104876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.118355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.120456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.143856 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2267/4540] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:27 2022] PUT /identity/v3/projects/e08f86f777f243b999e5954a739c7e20/users/a0463bf73c804387aac197adfbb36b73/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:27.144507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.154124 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2274/4541] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:27.246973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5313f-0468-4a8f-80aa-2fd7864955b7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.255621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04c0c7-e484-4d41-aeb2-58c3813ab20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.256478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c0c7-e484-4d41-aeb2-58c3813ab20f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.256854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c0c7-e484-4d41-aeb2-58c3813ab20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.257369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04c0c7-e484-4d41-aeb2-58c3813ab20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.259394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04c0c7-e484-4d41-aeb2-58c3813ab20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.262020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04c0c7-e484-4d41-aeb2-58c3813ab20f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.279303 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2268/4542] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:27.283715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.314560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae637772-7db9-4daa-a4d1-2a3d6ca71197 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.333350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.336587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.336997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.346488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] PATH_INFO: `/v3/projects/e08f86f777f243b999e5954a739c7e20/users/a0463bf73c804387aac197adfbb36b73/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.374012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08f86f777f243b999e5954a739c7e20, user_id=a0463bf73c804387aac197adfbb36b73, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.374012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.400361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:27.418424 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2275/4543] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:27 2022] PUT /identity/v3/projects/e08f86f777f243b999e5954a739c7e20/users/a0463bf73c804387aac197adfbb36b73/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:27.429794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.430419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.430809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.446002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.447954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:27.486164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] MFA Rules not processed for user `a0463bf73c804387aac197adfbb36b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:27.487454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:27.508735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:27.558405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe80b0b-f42e-4c89-8bff-b5816ee55274 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.566237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.568136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.568618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.569172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] PATH_INFO: `/v3/projects/4c648282a2fa410fb5a1645f953e9d0e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.573977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c648282a2fa410fb5a1645f953e9d0e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.594713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.684205 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2269/4544] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:27.685632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:27.690802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:27.713732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c648282a2fa410fb5a1645f953e9d0e', 'request_id': 'req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.726666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c648282a2fa410fb5a1645f953e9d0e', 'request_id': 'req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.734992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c648282a2fa410fb5a1645f953e9d0e', 'request_id': 'req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.744713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e3d7c-8067-4d57-a0ac-bd9a025b7a4e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:27.770283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] The token cache is being invalidate because project 4c648282a2fa410fb5a1645f953e9d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:27.770283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.773654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-23fe4d61-6dfe-4e4f-bb2d-c9115f8e1d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.781922 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2276/4545] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:27 2022] DELETE /identity/v3/projects/4c648282a2fa410fb5a1645f953e9d0e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:27.784613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.784941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.785652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.856422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:27.857761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:27.898094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:27.898823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:27.899170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:27.900169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] PATH_INFO: `/v3/projects/ee949ac23a8d4e2287edaa2b88ec6315` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:27.901573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee949ac23a8d4e2287edaa2b88ec6315)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:27.904311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:27.980513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee949ac23a8d4e2287edaa2b88ec6315', 'request_id': 'req-406cad9e-1e35-40de-a418-30a493a41b75'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.988586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee949ac23a8d4e2287edaa2b88ec6315', 'request_id': 'req-406cad9e-1e35-40de-a418-30a493a41b75'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:27.997247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee949ac23a8d4e2287edaa2b88ec6315', 'request_id': 'req-406cad9e-1e35-40de-a418-30a493a41b75'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.010491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2277/4546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:28.012253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.016785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.027363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] The token cache is being invalidate because project ee949ac23a8d4e2287edaa2b88ec6315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:28.027658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.028332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-406cad9e-1e35-40de-a418-30a493a41b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.029871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2270/4547] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:27 2022] DELETE /identity/v3/projects/ee949ac23a8d4e2287edaa2b88ec6315 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:28.031062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.031373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.031647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.080549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:28.085136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:28.086373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.140025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:28.147311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060121-092f-4299-985f-2f2b0b5d7df6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.193593 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2271/4548] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:28.195393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.197470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.229494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61aaf-bdea-4d65-b8e0-f28a71ae03c1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.236384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.237212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.237566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.237954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] PATH_INFO: `/v3/users/321d5fb50c99400d93a4d50cc5d9d1f4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.239268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321d5fb50c99400d93a4d50cc5d9d1f4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.241810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.306899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321d5fb50c99400d93a4d50cc5d9d1f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.308435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.309768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.310122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.310740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.314115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.323076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321d5fb50c99400d93a4d50cc5d9d1f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.324462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321d5fb50c99400d93a4d50cc5d9d1f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.336070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321d5fb50c99400d93a4d50cc5d9d1f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.337314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321d5fb50c99400d93a4d50cc5d9d1f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:28.357754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2272/4549] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:28 2022] DELETE /identity/v3/users/321d5fb50c99400d93a4d50cc5d9d1f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:28.357754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.358617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.451768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.457943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.478870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2278/4550] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:28.490823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b51398-0bb3-4305-b8a9-b251f6fbcc40 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.496445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.497091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.497422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.497753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.498360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:28.498912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.501080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.520769 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2273/4551] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:28.524828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.543186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558286ef-add0-41b4-bd93-74b2a773eb3d service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.550917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.551941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.552188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.552468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.553584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.555814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.605711 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2279/4552] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:28.625780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.637942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f76c21-b10f-45c5-bcfd-185606d0c804 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.725202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:28.760444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.761175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.761466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.761743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.762430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.768733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.823782 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2274/4553] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:28 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:28.831362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.845129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8ddb5-b183-443b-82cb-324545137de9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.856721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.858095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.858449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.858921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.859716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.861581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.877910 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2280/4554] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:28.887478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.890376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.892955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.903405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa10928-ee94-4d25-ad86-50690685ac67 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.910669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.911394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.911706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.912951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.918564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.920660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.924967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9340d4b-555e-4c2a-8c6b-9c38e9bc8f2e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.940519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2275/4555] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:28.940519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:28.942521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:28.949320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.951042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.951620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.952394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] PATH_INFO: `/v3/users/0870a7203edb4dca8dd5e5f98cb0334c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.961693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0870a7203edb4dca8dd5e5f98cb0334c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.969590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9701e2-9d76-440e-934f-e3fb36f5af97 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:28.974627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:28.977746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:28.978401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:28.978685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:28.979340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] PATH_INFO: `/v3/projects/fb19528eb0db4758bbfc503dd9a95e0f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:28.981422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb19528eb0db4758bbfc503dd9a95e0f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:28.983894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.029250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:29.082958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0870a7203edb4dca8dd5e5f98cb0334c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.110474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0870a7203edb4dca8dd5e5f98cb0334c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.115709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0870a7203edb4dca8dd5e5f98cb0334c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.127906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0870a7203edb4dca8dd5e5f98cb0334c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.128639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0870a7203edb4dca8dd5e5f98cb0334c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.135539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb19528eb0db4758bbfc503dd9a95e0f', 'request_id': 'req-a013f84d-514f-4319-bf7f-1241fd6f7c81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.144377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb19528eb0db4758bbfc503dd9a95e0f', 'request_id': 'req-a013f84d-514f-4319-bf7f-1241fd6f7c81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.153204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2281/4556] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:28 2022] DELETE /identity/v3/users/0870a7203edb4dca8dd5e5f98cb0334c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:29.153204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.153714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.154357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb19528eb0db4758bbfc503dd9a95e0f', 'request_id': 'req-a013f84d-514f-4319-bf7f-1241fd6f7c81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.173286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] The token cache is being invalidate because project fb19528eb0db4758bbfc503dd9a95e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:29.173729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.174519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a013f84d-514f-4319-bf7f-1241fd6f7c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.176850 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2276/4557] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:28 2022] DELETE /identity/v3/projects/fb19528eb0db4758bbfc503dd9a95e0f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:29.178709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8b52-3fca-4250-a3b3-6c69efa1c013 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.179361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8b52-3fca-4250-a3b3-6c69efa1c013 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.182998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8b52-3fca-4250-a3b3-6c69efa1c013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.207018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a5cc8b52-3fca-4250-a3b3-6c69efa1c013 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:29.208235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a5cc8b52-3fca-4250-a3b3-6c69efa1c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.235053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30ade-6c5f-455b-923d-7d6132c9fdcc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:29.243443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f266a-63f2-4c92-83dd-a6d1d0fd711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:29.244581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f266a-63f2-4c92-83dd-a6d1d0fd711c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.245806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f266a-63f2-4c92-83dd-a6d1d0fd711c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.246549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f266a-63f2-4c92-83dd-a6d1d0fd711c admin admin] PATH_INFO: `/v3/projects/b50a949cef5142278391b2760253f1bd/users/3c8f423d352a454ba4fd559973784e31/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.271667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f266a-63f2-4c92-83dd-a6d1d0fd711c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50a949cef5142278391b2760253f1bd, user_id=3c8f423d352a454ba4fd559973784e31, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:29.276176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f266a-63f2-4c92-83dd-a6d1d0fd711c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.295180 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2282/4558] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:29 2022] PUT /identity/v3/projects/b50a949cef5142278391b2760253f1bd/users/3c8f423d352a454ba4fd559973784e31/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:29.301100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.301619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.302083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.320101 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2277/4559] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:29.320101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730668-51b1-4885-ab4b-b60f46f9268c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.320101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730668-51b1-4885-ab4b-b60f46f9268c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.326322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69730668-51b1-4885-ab4b-b60f46f9268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.355311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:29.362137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.378473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-69730668-51b1-4885-ab4b-b60f46f9268c None None] MFA Rules not processed for user `3c8f423d352a454ba4fd559973784e31`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:29.380626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-69730668-51b1-4885-ab4b-b60f46f9268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.472017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:29.516218 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2283/4560] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:29.517755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.519576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.569511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:29.582120 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2278/4561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:29.584812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.585931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.586566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.635274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:29.639711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.671675 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2279/4562] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:29.671675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.674699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.686890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19306e20-dbf9-4359-b7b4-df836366a8af None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:29.700328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:29.702974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.703675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.704430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4deb046-545c-4fff-8841-47c06c8abfc7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:29.705094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.710171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:29.711147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.711331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.711570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.724830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:29.727747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.731553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:29.733071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.747001 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2284/4563] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:29.748734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.754382 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2280/4564] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:29.759178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.762805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.772808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a048-c5ac-4f56-844f-e5c063668d42 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:29.779621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:29.781883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.782470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.783343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.784595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:29.784937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:29.786740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.793722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236e7b2-a3ce-4616-b0b4-fa733673cbec service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:29.804169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2285/4565] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:29.808487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.831145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:29.831936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.832859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.833742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] PATH_INFO: `/v3/users/3c8f423d352a454ba4fd559973784e31` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.838923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8f423d352a454ba4fd559973784e31)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:29.845684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.846508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f03d-a1dc-4deb-87ed-67f99e2b4e36 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:29.869328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:29.869873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:29.870156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:29.870580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:29.871063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:29.882897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:29.935296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8f423d352a454ba4fd559973784e31'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.956519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8f423d352a454ba4fd559973784e31'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.957395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8f423d352a454ba4fd559973784e31'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.959610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2286/4566] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:29.960557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:29.970319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:29.972083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8f423d352a454ba4fd559973784e31'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.972815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a821db85-fcb2-4fd1-a407-1949383a68d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8f423d352a454ba4fd559973784e31'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:29.997796 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2281/4567] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:29 2022] DELETE /identity/v3/users/3c8f423d352a454ba4fd559973784e31 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:30.000584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.003041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.003352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.053428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:30.055880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.093431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643600cc-4591-4584-a590-950676a6b38a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.185008 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2282/4568] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:30.186787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.187797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.188095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.195846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.196277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.197080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.197750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.201275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.242125 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2287/4569] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:29 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:30.248612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:30.249230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.264105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1a4c-6be4-4ed3-b8de-f62acf4ebe25 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.269367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.269997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.270277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.270556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.271208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.272807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.292030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0053f-caec-4b86-923d-b05876b30eab None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.296683 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2288/4570] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:44:30.301228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.301892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.302177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.302607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.303480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.313962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.315414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.321564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692016-0dba-463b-9a95-b831f15a493c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.327087 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2283/4571] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:44:30.337624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bd2f6-d474-4da8-a33f-2ea0d225b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.338368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bd2f6-d474-4da8-a33f-2ea0d225b4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.338722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bd2f6-d474-4da8-a33f-2ea0d225b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.339093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bd2f6-d474-4da8-a33f-2ea0d225b4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.340003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bd2f6-d474-4da8-a33f-2ea0d225b4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.342288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bd2f6-d474-4da8-a33f-2ea0d225b4b4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.359941 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2289/4572] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:44:30.364558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.392681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b1358-9a9d-42f4-91fb-8b8211ca2c3d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.402664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c217567-ff83-406d-a4c6-3c0ff2c50812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.403522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c217567-ff83-406d-a4c6-3c0ff2c50812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.403873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c217567-ff83-406d-a4c6-3c0ff2c50812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.404267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c217567-ff83-406d-a4c6-3c0ff2c50812 admin admin] PATH_INFO: `/v3/projects/6b32de5befbf4d7e8e19089f903418e8/users/6eebd7f64d4048d2ba471aac4298fc51/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.425604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c217567-ff83-406d-a4c6-3c0ff2c50812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b32de5befbf4d7e8e19089f903418e8, user_id=6eebd7f64d4048d2ba471aac4298fc51, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.429697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c217567-ff83-406d-a4c6-3c0ff2c50812 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.452302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.452594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.452876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.457141 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2284/4573] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:30 2022] PUT /identity/v3/projects/6b32de5befbf4d7e8e19089f903418e8/users/6eebd7f64d4048d2ba471aac4298fc51/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:30.466964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.467628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.468385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.474152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:30.481764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:30.484022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.521255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] MFA Rules not processed for user `6eebd7f64d4048d2ba471aac4298fc51`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:30.522725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.615130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2290/4574] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:30.643065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.644752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.680033 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2285/4575] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:30.694732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.696346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.830278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad344e-a44a-4d33-9da9-ae8085f2b488 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.832061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e4f3-bdc4-43ba-8c8f-a5240249c178 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:30.845075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.845712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.845987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.846273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.855386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:30.856015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:30.856296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:30.856882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:30.867418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.869534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.880026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:30.884446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:30.886666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2286/4576] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:44:30.887536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.900352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:30.927771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2291/4577] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:44:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:44:30.929416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:30.935132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:31.003334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:31.070216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7c3b4-563f-4d19-876c-fc184160e2a5 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:31.079568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d037-de79-424f-baef-a0b0e300a2cb service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:31.100480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:31.105406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.106162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.107188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] PATH_INFO: `/v3/projects/b50a949cef5142278391b2760253f1bd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.112068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:31.113698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50a949cef5142278391b2760253f1bd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:31.115078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.115621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.115904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] PATH_INFO: `/v3/projects/55746a2ec736442bb2f0231a18576c0e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.120293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:31.123952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55746a2ec736442bb2f0231a18576c0e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:31.132802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:31.273146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55746a2ec736442bb2f0231a18576c0e', 'request_id': 'req-c1b185b5-7bdb-400a-840a-acb2fd6038c1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.274137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:31.288076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50a949cef5142278391b2760253f1bd', 'request_id': 'req-21da89cc-f544-43fc-b9d4-ad36b13f42cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.297376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55746a2ec736442bb2f0231a18576c0e', 'request_id': 'req-c1b185b5-7bdb-400a-840a-acb2fd6038c1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.303741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50a949cef5142278391b2760253f1bd', 'request_id': 'req-21da89cc-f544-43fc-b9d4-ad36b13f42cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.313831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50a949cef5142278391b2760253f1bd', 'request_id': 'req-21da89cc-f544-43fc-b9d4-ad36b13f42cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.327837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55746a2ec736442bb2f0231a18576c0e', 'request_id': 'req-c1b185b5-7bdb-400a-840a-acb2fd6038c1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.399574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] The token cache is being invalidate because project b50a949cef5142278391b2760253f1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:31.400064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.403378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-21da89cc-f544-43fc-b9d4-ad36b13f42cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.411382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] The token cache is being invalidate because project 55746a2ec736442bb2f0231a18576c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:31.412500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.413234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2292/4578] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:30 2022] DELETE /identity/v3/projects/b50a949cef5142278391b2760253f1bd => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:31.415068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.417469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71315e-8ec9-405c-80ac-955c656cf5d0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.419897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71315e-8ec9-405c-80ac-955c656cf5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.420228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71315e-8ec9-405c-80ac-955c656cf5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.427239 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2287/4579] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:30 2022] DELETE /identity/v3/projects/55746a2ec736442bb2f0231a18576c0e => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:31.429094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:31.430736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:31.478946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0d71315e-8ec9-405c-80ac-955c656cf5d0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:31.483171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d71315e-8ec9-405c-80ac-955c656cf5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:31.626056 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2293/4580] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:31.628025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.628419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.629460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.681698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:31.681698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:31.688774 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2294/4581] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:31.691469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b185b5-7bdb-400a-840a-acb2fd6038c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:31.694171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:31.707739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:31.709235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.709520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.709797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] PATH_INFO: `/v3/users/a0463bf73c804387aac197adfbb36b73` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.711997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469645b4-7399-4cfe-bac4-1d1e336408ba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:31.714324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0463bf73c804387aac197adfbb36b73)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:31.717649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:31.720174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:31.720868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.721293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.721763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.722823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:31.723194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:31.724933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:31.744679 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2295/4582] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:31.749509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:31.770942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d873ff-ad67-4141-9c22-9437d1abe51d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:31.783763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:31.784469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:31.784822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:31.785097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:31.789335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:31.791502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:31.842194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0463bf73c804387aac197adfbb36b73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.903841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0463bf73c804387aac197adfbb36b73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.908297 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2296/4583] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:31 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:31.908458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0463bf73c804387aac197adfbb36b73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.913931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:31.916347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:31.928404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0463bf73c804387aac197adfbb36b73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.929142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0463bf73c804387aac197adfbb36b73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:31.930968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:31.989647 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2288/4584] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:31 2022] DELETE /identity/v3/users/a0463bf73c804387aac197adfbb36b73 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:32.084740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b5628-ac9e-40ec-8c58-7eb3326314c4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:32.217411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:32.266237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:32.267255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:32.267746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:32.268195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:32.269146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:32.271435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:32.307819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2297/4585] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:31 2022] POST /identity/v3/users => generated 288 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:32.312526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:32.330564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368d10f-50e3-474a-9c13-b3d66113a6c3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:32.364217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:32.366058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:32.366343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:32.366622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:32.368524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:32.373281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:32.411582 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2289/4586] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:32.416006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:32.431954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e768d6-89df-4371-b0f0-f53d42735830 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:32.438217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17b3d0-621c-49f8-804a-fe14d4dba849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:32.439282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17b3d0-621c-49f8-804a-fe14d4dba849 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:32.439412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17b3d0-621c-49f8-804a-fe14d4dba849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:32.439740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17b3d0-621c-49f8-804a-fe14d4dba849 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:32.440472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17b3d0-621c-49f8-804a-fe14d4dba849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:32.442200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17b3d0-621c-49f8-804a-fe14d4dba849 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:32.478945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:32.494420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2298/4587] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:32.500433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad8b0-6aee-4f9f-b8d9-9ba28a91d631 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:32.519478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:32.520182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:32.522526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:32.522822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] PATH_INFO: `/v3/projects/27bef2e6f0cc457ca51616becc72450e/users/c43d17e9f5e54bae8b24c4c7262be025/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:32.559960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=27bef2e6f0cc457ca51616becc72450e, user_id=c43d17e9f5e54bae8b24c4c7262be025, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:32.563875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:32.610013 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2290/4588] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:32 2022] PUT /identity/v3/projects/27bef2e6f0cc457ca51616becc72450e/users/c43d17e9f5e54bae8b24c4c7262be025/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:44:32.613999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:32.614422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:32.614901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:32.733193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:32.735171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:32.786562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] MFA Rules not processed for user `c43d17e9f5e54bae8b24c4c7262be025`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:32.787912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:32.938255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004692d-4c87-42ef-a0b1-7b3f966f68fe admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:32.943669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:32.944701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:32.945122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:32.945525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] PATH_INFO: `/v3/projects/e08f86f777f243b999e5954a739c7e20` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:32.948542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08f86f777f243b999e5954a739c7e20)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:32.949642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:33.011257 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2299/4589] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:33.012731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:33.017815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:33.051240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08f86f777f243b999e5954a739c7e20', 'request_id': 'req-10106670-385d-4f94-b34a-38c0f6802dfd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:33.058841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08f86f777f243b999e5954a739c7e20', 'request_id': 'req-10106670-385d-4f94-b34a-38c0f6802dfd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:33.068486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08f86f777f243b999e5954a739c7e20', 'request_id': 'req-10106670-385d-4f94-b34a-38c0f6802dfd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:33.097220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] The token cache is being invalidate because project e08f86f777f243b999e5954a739c7e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:33.101505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:33.103844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10106670-385d-4f94-b34a-38c0f6802dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:33.114031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2291/4590] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:32 2022] DELETE /identity/v3/projects/e08f86f777f243b999e5954a739c7e20 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:44:33.117964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198c8b-50e7-479a-95c1-b9602cc3ec64 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.120493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198c8b-50e7-479a-95c1-b9602cc3ec64 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.120992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198c8b-50e7-479a-95c1-b9602cc3ec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.184055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed198c8b-50e7-479a-95c1-b9602cc3ec64 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:33.189415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed198c8b-50e7-479a-95c1-b9602cc3ec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:33.224038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9638-16ae-4754-9e82-d2b741aa7250 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:33.308757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:33.371618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:33.372894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2292/4591] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:33.379724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.380038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.380335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.391120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.391374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.391811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.394089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:33.460015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:33.478821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:33.483392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:33.507126 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2293/4592] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:33.511100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:33.525335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffa1c7-7664-43a8-b247-3cc8e6229258 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:33.532871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:33.533528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.534244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.534527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.535201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:33.535508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:33.537980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:33.556511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:33.557344 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2294/4593] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:33.562543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:33.563254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:33.581440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5fe3-a79a-4dbf-8376-2b10e496e3bc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:33.588267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bfb0a-c89f-4a65-a87d-961da08ecb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:33.588895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfb0a-c89f-4a65-a87d-961da08ecb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.589211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfb0a-c89f-4a65-a87d-961da08ecb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.591754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bfb0a-c89f-4a65-a87d-961da08ecb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.592435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bfb0a-c89f-4a65-a87d-961da08ecb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:33.596210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bfb0a-c89f-4a65-a87d-961da08ecb53 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:33.598665 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2300/4594] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:33.701789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:33.705868 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2295/4595] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:33 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:44:33.723632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fe75a-c177-4649-bf5e-ad972c5a65c6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:33.745703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.746317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.746836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.774485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:33.776278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:33.896996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2296/4596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:33.919265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:33.920084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.920560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.921005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.921504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:33.923873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:33.955577 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2301/4597] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:33 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:33.960010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:33.981776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b100696-a8e5-4777-9c39-312d74e01eea None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:33.990227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:33.991188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:33.991536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:33.991881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:33.992774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:33.994512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:34.012076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2297/4598] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:34.016475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.032020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb52521-ce06-4ac6-bff5-ea275a9c0d8b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:34.040446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa344-8b20-4424-9483-9f37c7602eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:34.041548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa344-8b20-4424-9483-9f37c7602eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.042174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa344-8b20-4424-9483-9f37c7602eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.042825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa344-8b20-4424-9483-9f37c7602eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:34.043572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6aa344-8b20-4424-9483-9f37c7602eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:34.045513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6aa344-8b20-4424-9483-9f37c7602eb0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:34.058895 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2302/4599] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:34.063621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.079896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22249f5-70d2-4d69-805f-dad1f0ae7f00 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:34.086223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:34.086900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.087299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.087579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] PATH_INFO: `/v3/projects/1d09761b85a94ad18dee2fc99f4330e5/users/c15229f8cca64c82965d0202d667e25c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:34.116012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d09761b85a94ad18dee2fc99f4330e5, user_id=c15229f8cca64c82965d0202d667e25c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:34.118912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:34.146621 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2298/4600] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:34 2022] PUT /identity/v3/projects/1d09761b85a94ad18dee2fc99f4330e5/users/c15229f8cca64c82965d0202d667e25c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:34.159275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.159496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.159791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:34.257184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] MFA Rules not processed for user `c15229f8cca64c82965d0202d667e25c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:34.258761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:34.378998 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2303/4601] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:34.380355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.527681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61362cca-622d-4e48-ac76-63d9b772fe61 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:34.545682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:34.546411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.546607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.547104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:34.547835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:34.549790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:34.589767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:34.614486 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2299/4602] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:34 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:34.618348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.643040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d63da6-a4d3-407c-8216-824a64f2dec6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:34.681507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:34.788244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:34.789663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.791499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.792022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:34.795481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:34.800590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:34.857890 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2304/4603] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:34 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:34.862790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.883861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81b75-f0a7-4bbf-b665-b6f669f0aaa8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:34.897763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:34.898436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.898685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.898962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:34.899631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:34.903175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:34.936681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2300/4604] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:34.938750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.950550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:34.953996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:34.964663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228449c-0860-49a8-a6ac-f40dae7ce71f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:34.978487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:34.979187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:34.979759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:34.980046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] PATH_INFO: `/v3/projects/f227eaada8ec40b5acf001faf8493850/users/4ac5ac3750c74fd29e6c3e365b00b3c7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.018288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30b664-4aa1-495f-95e6-b78a978c7a19 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:35.022519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f227eaada8ec40b5acf001faf8493850, user_id=4ac5ac3750c74fd29e6c3e365b00b3c7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:35.026544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:35.037779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:35.045020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.047373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.048402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] PATH_INFO: `/v3/users/c43d17e9f5e54bae8b24c4c7262be025` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.052536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43d17e9f5e54bae8b24c4c7262be025)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:35.061247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2305/4605] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:34 2022] PUT /identity/v3/projects/f227eaada8ec40b5acf001faf8493850/users/4ac5ac3750c74fd29e6c3e365b00b3c7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:35.062487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:35.063287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:35.219603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa158-70c6-43c9-8516-7965126ec2ff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:35.228706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43d17e9f5e54bae8b24c4c7262be025'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:35.233133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:35.233790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.234687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.236016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.236696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:35.244680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:35.247393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43d17e9f5e54bae8b24c4c7262be025'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:35.248227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43d17e9f5e54bae8b24c4c7262be025'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:35.269105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2306/4606] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:35.270109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43d17e9f5e54bae8b24c4c7262be025'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:35.273367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e430a6b1-1832-4038-8996-7dd11ea722dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43d17e9f5e54bae8b24c4c7262be025'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:35.274003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:35.278095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:35.301482 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2301/4607] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:34 2022] DELETE /identity/v3/users/c43d17e9f5e54bae8b24c4c7262be025 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:35.308863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.309059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1222b2-3da4-4916-bca5-55531561f975 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:35.309328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.309666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.343060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:35.346318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:35.485852 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2302/4608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:35.490801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e6581-8fec-4165-b6e8-baf7afbd454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:35.491520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6581-8fec-4165-b6e8-baf7afbd454f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.492380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6581-8fec-4165-b6e8-baf7afbd454f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.492669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e6581-8fec-4165-b6e8-baf7afbd454f admin admin] PATH_INFO: `/v3/projects/f227eaada8ec40b5acf001faf8493850/users/4ac5ac3750c74fd29e6c3e365b00b3c7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.497770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:35.498817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e6581-8fec-4165-b6e8-baf7afbd454f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f227eaada8ec40b5acf001faf8493850, user_id=4ac5ac3750c74fd29e6c3e365b00b3c7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:35.503344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:35.505117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e6581-8fec-4165-b6e8-baf7afbd454f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:35.543375 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2307/4609] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:35 2022] PUT /identity/v3/projects/f227eaada8ec40b5acf001faf8493850/users/4ac5ac3750c74fd29e6c3e365b00b3c7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:35.544631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.544943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.545222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.610038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] MFA Rules not processed for user `4ac5ac3750c74fd29e6c3e365b00b3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:35.611221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:35.637181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:35.647573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f1742-ce63-4bdc-9000-4d7371026afa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:35.694961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:35.775975 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2308/4610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:35.782870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:35.792893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:35.795728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.795843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.796102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.801699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329766d6-8ee3-4106-852a-feb4baefc736 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:35.829991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:35.830618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.830901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.831178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.836529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:35.836861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:35.844941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:35.877759 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2309/4611] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:35.908802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:35.955557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b408af3-82db-42c9-bc5e-a685df2e0088 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:35.988266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:35.989403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:35.992475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:35.994164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:35.995527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:35.999495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:36.023814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:36.026779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:36.053213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2303/4612] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:36.073941 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2310/4613] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:35 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:36.075677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:36.097536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff49037-8dae-4b08-9285-5156db85f32a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:36.273943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:36.274779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:36.275343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:36.275754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:36.276695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:36.277384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:36.279390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba376c8-df55-4723-b601-418ee4b51b8a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:36.329412 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2304/4614] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:36.518977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:36.520962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:36.711929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680bc84-d644-4f1b-9423-bf71bb0ceb08 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:36.757561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:36.758534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:36.763778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:36.764283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:36.793712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:36.800301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:36.866666 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2311/4615] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:36.902633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5350f6-4591-47c9-8b45-1317a868d0fd None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:36.903424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5350f6-4591-47c9-8b45-1317a868d0fd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:36.903857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5350f6-4591-47c9-8b45-1317a868d0fd None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:36.905935 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2305/4616] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:44:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:44:36.912535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:44:36.936372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:36.968258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fde430-de0b-490b-9779-01a09acf531e service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:36.996670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:36.997410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:36.997695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.002678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/projects/9e304a79cc6e41aaa255690c1a4cd667` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.004312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e304a79cc6e41aaa255690c1a4cd667)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:37.014984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:37.036411 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2312/4617] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:44:36 2022] GET /identity/v3/projects/9e304a79cc6e41aaa255690c1a4cd667 => generated 369 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:37.226184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3430-fd17-42ae-aa50-bf1376622aa1 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:37.227132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3430-fd17-42ae-aa50-bf1376622aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.227132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3430-fd17-42ae-aa50-bf1376622aa1 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.230208 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2306/4618] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:44:37.264350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:44:37.299907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:37.341783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e12b8-67e7-476c-9d26-3631482193b7 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:37.368844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:37.372473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:37.374106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.384070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/projects/9e304a79cc6e41aaa255690c1a4cd667` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.394443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e304a79cc6e41aaa255690c1a4cd667)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:37.406725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:37.428439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2313/4619] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:44:37 2022] GET /identity/v3/projects/9e304a79cc6e41aaa255690c1a4cd667 => generated 369 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:37.568758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3430-fd17-42ae-aa50-bf1376622aa1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:37.590622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3430-fd17-42ae-aa50-bf1376622aa1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:37.602509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:37.604336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:37.607766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:37.608524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:37.608913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.609983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.610765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:37.611405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:37.614148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:37.663963 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2307/4620] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:37.667875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:37.696775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a87fb-ad89-41a2-b0ba-63b2477c2cb9 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:37.702282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:37.703412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:37.703854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.705594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.706583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:37.712684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:37.761910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:37.768288 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2308/4621] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:37 2022] POST /identity/v3/users => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:37.772767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:37.830452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6de637-f798-493e-aaa4-096786e900f8 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:37.844388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:37.851573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:37.852088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.853040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.853784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:37.854104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:37.855954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7fb5d-2e0e-4f7b-b30d-c068adb27061 tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:37.870077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc0f6e-321c-42e6-86a9-afc29a0ac11a tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:37.886061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:37.887003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:37.887733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:37.888265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] PATH_INFO: `/v3/projects/27bef2e6f0cc457ca51616becc72450e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:37.888422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2309/4622] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:37.893104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27bef2e6f0cc457ca51616becc72450e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:37.895683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:38.077420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27bef2e6f0cc457ca51616becc72450e', 'request_id': 'req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:38.101545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27bef2e6f0cc457ca51616becc72450e', 'request_id': 'req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:38.142574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27bef2e6f0cc457ca51616becc72450e', 'request_id': 'req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:38.169651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] The token cache is being invalidate because project 27bef2e6f0cc457ca51616becc72450e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:38.169950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:38.170641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce73a670-e6f2-4fe2-a0fd-c9bdad905b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:38.173250 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2314/4623] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:37 2022] DELETE /identity/v3/projects/27bef2e6f0cc457ca51616becc72450e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:38.178557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:38.178847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:38.179131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:38.231771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:38.233238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:38.264865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:38.429320 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2310/4624] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:38.437003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724919-78ff-44a6-9ae0-6532440dd5c3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:38.437332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724919-78ff-44a6-9ae0-6532440dd5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:38.437734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724919-78ff-44a6-9ae0-6532440dd5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:38.478802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-79724919-78ff-44a6-9ae0-6532440dd5c3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:38.482209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-79724919-78ff-44a6-9ae0-6532440dd5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:38.510062 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2315/4625] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:38.513937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:38.528428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd49bd-88d7-4f9c-81b9-1925fea6d321 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:38.548840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:38.549515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:38.550518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:38.550630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:38.551236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:38.551543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:38.558240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:38.560172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:38.560492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:38.560792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:38.567612 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2316/4626] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:44:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:44:38.573919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:44:38.576225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:38.592685 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2311/4627] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:38.604149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:38.628482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0079-2cb3-4976-b9e7-7883cf491803 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:38.645214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:38.646277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:38.657030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:38.657030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:38.657030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:38.657030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:38.752638 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2312/4628] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:38 2022] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:38.757188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:38.814179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:38.815573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:38.871747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf247775-c4c7-472a-b3b5-04d51e9a8132 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:38.884607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:38.885715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:38.886178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:38.886616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:38.887650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:38.891252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:38.954582 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2313/4629] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:38 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:38.979548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:39.000313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:39.033808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a965e61-69b8-46c0-b957-1b0e02b704db None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:39.039235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcae73-1539-4e1d-8595-7abe6aafdeaa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:39.081684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:39.081684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.088878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.089468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.091248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:39.097798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:39.161247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2314/4630] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:39.165891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:39.178289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3d8ad-c40f-4215-84ad-ac687823ddb2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:39.196842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d53b7-f051-4a37-a490-dac1d652ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:39.198512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d53b7-f051-4a37-a490-dac1d652ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.198814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d53b7-f051-4a37-a490-dac1d652ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.199610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d53b7-f051-4a37-a490-dac1d652ee97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.200264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d53b7-f051-4a37-a490-dac1d652ee97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:39.202565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d53b7-f051-4a37-a490-dac1d652ee97 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:39.209574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:39.209895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.210081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.210364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/projects/9e304a79cc6e41aaa255690c1a4cd667` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.213510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e304a79cc6e41aaa255690c1a4cd667)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:39.215930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:39.223667 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2317/4631] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:44:38 2022] GET /identity/v3/projects/9e304a79cc6e41aaa255690c1a4cd667 => generated 369 bytes in 650 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:44:39.231122 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2315/4632] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:39.231258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:39.265426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01b092-8cd1-4955-8ef2-e9d4d703d65b tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:39.278917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:39.280048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.280575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.281059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] PATH_INFO: `/v3/projects/5d4cbe199e5f47cb99a7aa21be39dab3/users/2f2733a24ce5429daeb16f9a20f71577/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.332629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4cbe199e5f47cb99a7aa21be39dab3, user_id=2f2733a24ce5429daeb16f9a20f71577, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:39.335894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:39.388794 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2318/4633] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:39 2022] PUT /identity/v3/projects/5d4cbe199e5f47cb99a7aa21be39dab3/users/2f2733a24ce5429daeb16f9a20f71577/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:39.399870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.400371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.400497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.486987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] MFA Rules not processed for user `2f2733a24ce5429daeb16f9a20f71577`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:39.488392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:39.580949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:39.699825 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2316/4634] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:39.702467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:39.812973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bb761-88cd-4685-9230-5ddf47b461e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:39.812973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a414f-437e-41c3-896e-68aba7d1c21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:39.812973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a414f-437e-41c3-896e-68aba7d1c21f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.812973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a414f-437e-41c3-896e-68aba7d1c21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.813420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a414f-437e-41c3-896e-68aba7d1c21f admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.813420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a414f-437e-41c3-896e-68aba7d1c21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:39.813420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a414f-437e-41c3-896e-68aba7d1c21f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:39.861208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2319/4635] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:39 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:44:39.865394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:39.883425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0095a3-3d81-4169-8d9b-0b5e8804f359 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:39.994450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:39.995601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:39.995941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:39.996146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:39.999289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:40.006154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32af395-b7da-4f5b-9f66-397941c3da9e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:40.006912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32af395-b7da-4f5b-9f66-397941c3da9e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:40.006912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32af395-b7da-4f5b-9f66-397941c3da9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:40.014467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:40.075201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a32af395-b7da-4f5b-9f66-397941c3da9e None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:40.080651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a32af395-b7da-4f5b-9f66-397941c3da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:40.110628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2317/4636] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:39 2022] POST /identity/v3/users => generated 309 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:40.123472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:40.159726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32744d64-5724-41b6-a65e-9f406a9d560f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:40.176117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:40.176583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:40.176877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:40.177156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:40.177994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:40.185103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:40.230040 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2318/4637] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:40.236124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:40.264541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aea15-a59c-49eb-9741-66fd711d4c37 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:40.275925 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2320/4638] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:44:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:40.290455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58942c4-2f11-4141-b0dc-a38ad35b5547 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:40.290741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58942c4-2f11-4141-b0dc-a38ad35b5547 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:40.291017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58942c4-2f11-4141-b0dc-a38ad35b5547 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:40.296008 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2321/4639] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:44:40 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:44:40.296157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:40.297230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:40.297591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:40.298901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] PATH_INFO: `/v3/projects/5e4b62e5bd804240bf9f65a7ad04b1d2/users/35665ac88d844f148863be1d09f8b9dd/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:40.304716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58942c4-2f11-4141-b0dc-a38ad35b5547 None None] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:44:40.335497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4b62e5bd804240bf9f65a7ad04b1d2, user_id=35665ac88d844f148863be1d09f8b9dd, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:40.338219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:40.358647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:40.373355 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2319/4640] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:40 2022] PUT /identity/v3/projects/5e4b62e5bd804240bf9f65a7ad04b1d2/users/35665ac88d844f148863be1d09f8b9dd/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:40.380761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:40.389204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:40.513432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58942c4-2f11-4141-b0dc-a38ad35b5547 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:40.627840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8705d8-0282-4e6a-ba14-bac456291f1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:40.639911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:40.641478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:40.641905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:40.642358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:40.668500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58942c4-2f11-4141-b0dc-a38ad35b5547 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:40.741833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:40.803067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:40.806098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:40.818308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2320/4641] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:44:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:40.819325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:40.971115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:40.971688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:40.971885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:40.972172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/projects/9e304a79cc6e41aaa255690c1a4cd667` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:41.010179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e304a79cc6e41aaa255690c1a4cd667)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:41.010179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:41.022292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8beb89-ed60-4acc-b866-9a1a021e307a service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:41.026666 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2322/4642] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:44:40 2022] GET /identity/v3/projects/9e304a79cc6e41aaa255690c1a4cd667 => generated 369 bytes in 722 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:41.056695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:41.057761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:41.057761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:41.058333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:41.059202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:41.061633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:41.102904 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2321/4643] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:41.106710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:41.116677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:41.141102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345aa42-c822-478e-91cf-39c292a6383d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:41.159511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2677e02-a4c4-4efd-9959-7e10e1814cc9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:41.162498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8982b49-d5fa-4c8e-91a4-486044e96aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:41.163180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982b49-d5fa-4c8e-91a4-486044e96aad admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:41.163463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982b49-d5fa-4c8e-91a4-486044e96aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:41.163737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8982b49-d5fa-4c8e-91a4-486044e96aad admin admin] PATH_INFO: `/v3/projects/5e4b62e5bd804240bf9f65a7ad04b1d2/users/35665ac88d844f148863be1d09f8b9dd/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:41.178785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982b49-d5fa-4c8e-91a4-486044e96aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4b62e5bd804240bf9f65a7ad04b1d2, user_id=35665ac88d844f148863be1d09f8b9dd, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:41.181544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8982b49-d5fa-4c8e-91a4-486044e96aad admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:41.193617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:41.194276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:41.194564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:41.194841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/users/3fc907b3ac954ae58f60d54de765a4c9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:41.224573 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2323/4644] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:41 2022] PUT /identity/v3/projects/5e4b62e5bd804240bf9f65a7ad04b1d2/users/35665ac88d844f148863be1d09f8b9dd/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:41.263243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fc907b3ac954ae58f60d54de765a4c9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:41.265601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:41.348530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:41.348830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:41.349143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:41.387936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] MFA Rules not processed for user `35665ac88d844f148863be1d09f8b9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:41.389634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:41.495410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc907b3ac954ae58f60d54de765a4c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:41.496191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:41.539294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc907b3ac954ae58f60d54de765a4c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:41.539987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc907b3ac954ae58f60d54de765a4c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:41.553593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc907b3ac954ae58f60d54de765a4c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:41.554619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc907b3ac954ae58f60d54de765a4c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:41.593447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2322/4645] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:41 2022] DELETE /identity/v3/users/3fc907b3ac954ae58f60d54de765a4c9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:41.594463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:41.595941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:41.693225 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2324/4646] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:41 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:41.700521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:41.703669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:41.707926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:41.813364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8925-443d-4849-831f-f9041f01a73d tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:41.828324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac5ac3750c74fd29e6c3e365b00b3c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f227eaada8ec40b5acf001faf8493850', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:41.829321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:41.829321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:41.829608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] PATH_INFO: `/v3/projects/9e304a79cc6e41aaa255690c1a4cd667` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:41.834263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e304a79cc6e41aaa255690c1a4cd667)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:41.836211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:41.977914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6b024-1cec-40f7-b30e-f2b4726d6b3c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:42.013752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e304a79cc6e41aaa255690c1a4cd667', 'request_id': 'req-284a6281-f387-46d4-ae22-d61f854980fd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.043185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e304a79cc6e41aaa255690c1a4cd667', 'request_id': 'req-284a6281-f387-46d4-ae22-d61f854980fd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.065718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e304a79cc6e41aaa255690c1a4cd667', 'request_id': 'req-284a6281-f387-46d4-ae22-d61f854980fd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.094664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] The token cache is being invalidate because project 9e304a79cc6e41aaa255690c1a4cd667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:42.095006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.100664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.103111 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2323/4647] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:41 2022] DELETE /identity/v3/projects/9e304a79cc6e41aaa255690c1a4cd667 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:44:42.109909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:42.115361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:42.121104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:42.122319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:42.122816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:42.123353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:42.129767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:42.355685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:42.360290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc6d66-801f-4544-8f9b-ecc3ff00b9ba service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:42.382351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a6281-f387-46d4-ae22-d61f854980fd tempest-QuotasAdminTestV257-912963654 tempest-QuotasAdminTestV257-912963654-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:42.386379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2325/4648] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:41 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:42.405703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:42.408360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:42.408360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:42.408634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] PATH_INFO: `/v3/users/c15229f8cca64c82965d0202d667e25c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:42.410918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15229f8cca64c82965d0202d667e25c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:42.414712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:42.582101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15229f8cca64c82965d0202d667e25c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.647344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:42.653555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15229f8cca64c82965d0202d667e25c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.660616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15229f8cca64c82965d0202d667e25c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.694558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15229f8cca64c82965d0202d667e25c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.696026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15229f8cca64c82965d0202d667e25c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:42.739056 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2324/4649] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:42 2022] DELETE /identity/v3/users/c15229f8cca64c82965d0202d667e25c => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:42.744931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:42.747262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:42.747262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:42.815291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:42.816558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:42.841659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:42.853828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:42.854803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:43.094237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145f9c4-3bee-43fc-a725-bca3a0b2bc88 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:43.103912 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2326/4650] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:43.116737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:43.117510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:43.117795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:43.118068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] PATH_INFO: `/v3/users/2f2733a24ce5429daeb16f9a20f71577` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:43.122758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2733a24ce5429daeb16f9a20f71577)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:43.125558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:43.171374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:43.173863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:43.289761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2733a24ce5429daeb16f9a20f71577'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:43.342400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2733a24ce5429daeb16f9a20f71577'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:43.344160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2733a24ce5429daeb16f9a20f71577'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:43.356404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e9fa6-125c-4cd5-8be0-e21ba84e1424 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:43.369205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:43.369784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2733a24ce5429daeb16f9a20f71577'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:43.370654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a66d28e4-5b9c-4272-a508-c76429eade37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2733a24ce5429daeb16f9a20f71577'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:43.371427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:43.371683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:43.371969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:43.379193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:43.401475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2325/4651] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:42 2022] DELETE /identity/v3/users/2f2733a24ce5429daeb16f9a20f71577 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:43.413504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:43.415190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:43.418430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:43.425215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:43.427485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:43.432243 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2327/4652] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:43.489513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:43.495698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:43.693623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:43.733531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2326/4653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:43.844365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:43.845861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:43.868005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baed86-e2ce-4c2a-a0f2-afd6897e1967 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:44.005824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:44.010383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:44.010764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:44.011057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:44.036316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:44.038033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:44.060766 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2328/4654] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:46.023981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:46.026546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:46.055984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17861a13-8234-46a2-9d26-45dbf8e1a760 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:46.069923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:46.070820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:46.071286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:46.071713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] PATH_INFO: `/v3/projects/1d09761b85a94ad18dee2fc99f4330e5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:46.073068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d09761b85a94ad18dee2fc99f4330e5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:46.077774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:46.210411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d09761b85a94ad18dee2fc99f4330e5', 'request_id': 'req-73faa947-4631-49da-b243-bdcfa332b138'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.226559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d09761b85a94ad18dee2fc99f4330e5', 'request_id': 'req-73faa947-4631-49da-b243-bdcfa332b138'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.233512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d09761b85a94ad18dee2fc99f4330e5', 'request_id': 'req-73faa947-4631-49da-b243-bdcfa332b138'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.258320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] The token cache is being invalidate because project 1d09761b85a94ad18dee2fc99f4330e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:46.258626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.261221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.269971 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2327/4655] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:46 2022] DELETE /identity/v3/projects/1d09761b85a94ad18dee2fc99f4330e5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:46.274534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:46.298782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994853-02a0-4c7d-9a89-bde3b54b8da9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:46.427706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:46.428621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:46.429125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:46.429543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] PATH_INFO: `/v3/users/4ac5ac3750c74fd29e6c3e365b00b3c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:46.431626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac5ac3750c74fd29e6c3e365b00b3c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:46.438295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:46.441256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:46.610961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac5ac3750c74fd29e6c3e365b00b3c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.656841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac5ac3750c74fd29e6c3e365b00b3c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.657824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac5ac3750c74fd29e6c3e365b00b3c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.679482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac5ac3750c74fd29e6c3e365b00b3c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.680117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac5ac3750c74fd29e6c3e365b00b3c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:46.704651 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2329/4656] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:46 2022] DELETE /identity/v3/users/4ac5ac3750c74fd29e6c3e365b00b3c7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:47.052304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:47.054503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:47.103302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa947-4631-49da-b243-bdcfa332b138 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:47.306093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:47.306849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:47.307203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:47.307549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] PATH_INFO: `/v3/projects/5d4cbe199e5f47cb99a7aa21be39dab3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:47.308770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4cbe199e5f47cb99a7aa21be39dab3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:47.316026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:47.431680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4cbe199e5f47cb99a7aa21be39dab3', 'request_id': 'req-d8b84aee-f7f7-4d11-9a15-c260298988c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.461760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4cbe199e5f47cb99a7aa21be39dab3', 'request_id': 'req-d8b84aee-f7f7-4d11-9a15-c260298988c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.483293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4cbe199e5f47cb99a7aa21be39dab3', 'request_id': 'req-d8b84aee-f7f7-4d11-9a15-c260298988c9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.504699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] The token cache is being invalidate because project 5d4cbe199e5f47cb99a7aa21be39dab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:47.505046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.512356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.515949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2328/4657] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:47 2022] DELETE /identity/v3/projects/5d4cbe199e5f47cb99a7aa21be39dab3 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:47.520079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:47.522354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:47.557277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d94463-1da6-45c2-aa20-33a8248a4d47 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:47.762131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:47.762987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:47.764737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:47.765146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] PATH_INFO: `/v3/users/35665ac88d844f148863be1d09f8b9dd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:47.769502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35665ac88d844f148863be1d09f8b9dd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:47.773883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:47.914781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35665ac88d844f148863be1d09f8b9dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.966938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35665ac88d844f148863be1d09f8b9dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.967772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35665ac88d844f148863be1d09f8b9dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.994519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35665ac88d844f148863be1d09f8b9dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:47.995332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35665ac88d844f148863be1d09f8b9dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:48.013961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:48.029865 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2330/4658] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:47 2022] DELETE /identity/v3/users/35665ac88d844f148863be1d09f8b9dd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:49.747831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:49.750399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:49.776867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b84aee-f7f7-4d11-9a15-c260298988c9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:49.814916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:49.951210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:49.952380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:49.952380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:49.952380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] PATH_INFO: `/v3/projects/5e4b62e5bd804240bf9f65a7ad04b1d2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:49.954241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4b62e5bd804240bf9f65a7ad04b1d2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:49.956890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:49.976262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:49.977765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:50.003469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0d5b-583c-4ed2-bf85-98ef97ae9b16 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:50.028447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:50.029301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.029588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.029870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] PATH_INFO: `/v3/projects/f227eaada8ec40b5acf001faf8493850` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.032351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f227eaada8ec40b5acf001faf8493850)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:50.034055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:50.144129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4b62e5bd804240bf9f65a7ad04b1d2', 'request_id': 'req-c88180a3-9236-4fb4-bfbc-89ed916b9c25'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.162391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4b62e5bd804240bf9f65a7ad04b1d2', 'request_id': 'req-c88180a3-9236-4fb4-bfbc-89ed916b9c25'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.178348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f227eaada8ec40b5acf001faf8493850', 'request_id': 'req-ac0306fd-7df8-4556-a3ae-def05641029d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.193889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4b62e5bd804240bf9f65a7ad04b1d2', 'request_id': 'req-c88180a3-9236-4fb4-bfbc-89ed916b9c25'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.201760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f227eaada8ec40b5acf001faf8493850', 'request_id': 'req-ac0306fd-7df8-4556-a3ae-def05641029d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.220110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f227eaada8ec40b5acf001faf8493850', 'request_id': 'req-ac0306fd-7df8-4556-a3ae-def05641029d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.231766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] The token cache is being invalidate because project 5e4b62e5bd804240bf9f65a7ad04b1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:50.232303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.234974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c88180a3-9236-4fb4-bfbc-89ed916b9c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.252691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] The token cache is being invalidate because project f227eaada8ec40b5acf001faf8493850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:44:50.253026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.255033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0306fd-7df8-4556-a3ae-def05641029d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:50.256549 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2329/4659] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:49 2022] DELETE /identity/v3/projects/5e4b62e5bd804240bf9f65a7ad04b1d2 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:50.261729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b488-aedc-4cd3-a0a4-07f6f0bbc306 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.262639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b488-aedc-4cd3-a0a4-07f6f0bbc306 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.263096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05b488-aedc-4cd3-a0a4-07f6f0bbc306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.270109 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2331/4660] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:44:49 2022] DELETE /identity/v3/projects/f227eaada8ec40b5acf001faf8493850 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:50.271759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7dff-ea06-4149-85be-62144cb3b063 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.272121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7dff-ea06-4149-85be-62144cb3b063 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.272331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7dff-ea06-4149-85be-62144cb3b063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.318959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6c05b488-aedc-4cd3-a0a4-07f6f0bbc306 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:50.319209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c05b488-aedc-4cd3-a0a4-07f6f0bbc306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:50.342279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-402c7dff-ea06-4149-85be-62144cb3b063 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:50.344266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-402c7dff-ea06-4149-85be-62144cb3b063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:50.483498 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2330/4661] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:50.491436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.491767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.491997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.521916 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2332/4662] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:50.527754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.528139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.528340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.540952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:50.542930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:50.569700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2331/4663] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:50.575576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:50.610052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:50.611334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:50.614376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc2b0-e83f-433f-81f1-ee2eb90dfaa6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:50.630356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:50.630994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.631804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.631804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.632303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:50.635999 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2333/4664] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:50.639737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:50.643595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:50.646050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:50.664846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d83a-cab0-4244-80a6-97020896a277 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:50.674706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:50.675348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.675643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.675908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.676577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:44:50.676889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:50.682410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:50.707909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2332/4665] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:50.708832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:50.716585 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2334/4666] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:44:50.717797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:50.739836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870cb08-3085-4dbb-a384-27fd78157ccb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:50.749379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:50.750222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.750512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.750791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.751445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:50.757770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:50.771090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9277e0-8df9-48ea-80f6-a8ce3f944883 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:50.799348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:50.800330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:50.800587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:50.801039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:50.801430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:50.803385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:50.829025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2335/4667] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:50.833954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:50.909300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2333/4668] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/projects => generated 357 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:50.910663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:50.920755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:50.967547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:51.024106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574fe1-2642-4960-a262-60fb71eddc9e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.112977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dbba4-00b7-4d5f-a27b-ab29e41fa7ad admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.123994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.125369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.125919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.126354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.127358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.129772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.170865 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2334/4669] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/users => generated 279 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:51.172633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.208212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22438f90-6714-49b7-825b-80ba45bde5d6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.227508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.227508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.227508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.227508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.228804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.229365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.229647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.229919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.230581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.232545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.234843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.239159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.274802 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2335/4670] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:51.275770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.314196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2336/4671] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:50 2022] POST /identity/v3/users => generated 290 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:44:51.325071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.331918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9cdaa-30bf-4878-ba4f-96ffdf8d134e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.364802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.366416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.366416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.366416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.367063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.368677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.378255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f81919-02a2-4281-bf8d-a9b506a1edd3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.399914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.400559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.401032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.401286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.401951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.403554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.416446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2336/4672] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:51.420174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.448701 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2337/4673] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:51.449703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.461871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02f3a-4101-4a4c-8ae5-284f50e2fbb9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.479272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9670d-0fc0-424e-9e60-ff5b4ae1ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.480006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9670d-0fc0-424e-9e60-ff5b4ae1ce2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.480269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9670d-0fc0-424e-9e60-ff5b4ae1ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.480521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9670d-0fc0-424e-9e60-ff5b4ae1ce2b admin admin] PATH_INFO: `/v3/projects/80409c3923b84abea5f230a0213a0a43/users/4018c38edc5e441ca529dc8404868a52/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.485910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0575-8093-43db-826b-c4fac1a64e10 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.516377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.516599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.516850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.517099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.517737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.519371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.542824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9670d-0fc0-424e-9e60-ff5b4ae1ce2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80409c3923b84abea5f230a0213a0a43, user_id=4018c38edc5e441ca529dc8404868a52, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.543473 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2338/4674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:51.549916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9670d-0fc0-424e-9e60-ff5b4ae1ce2b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.551660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.569708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1fe9-1670-4535-a451-3a6d2c6e73f4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:51.582733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d2d62-6ac7-406f-8003-270cae4f69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:51.583630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2d62-6ac7-406f-8003-270cae4f69c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.583957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2d62-6ac7-406f-8003-270cae4f69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.584237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d2d62-6ac7-406f-8003-270cae4f69c2 admin admin] PATH_INFO: `/v3/projects/866f7da063ae4a9c9303deff8d91c6ae/users/5339c00a88e6415b981ab6c1d68b14bb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.605752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2337/4675] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:51 2022] PUT /identity/v3/projects/80409c3923b84abea5f230a0213a0a43/users/4018c38edc5e441ca529dc8404868a52/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:51.608155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.608155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.608155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.633166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d2d62-6ac7-406f-8003-270cae4f69c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866f7da063ae4a9c9303deff8d91c6ae, user_id=5339c00a88e6415b981ab6c1d68b14bb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:51.635898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d2d62-6ac7-406f-8003-270cae4f69c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:51.664724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] MFA Rules not processed for user `4018c38edc5e441ca529dc8404868a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:51.667958 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2339/4676] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:51 2022] PUT /identity/v3/projects/866f7da063ae4a9c9303deff8d91c6ae/users/5339c00a88e6415b981ab6c1d68b14bb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:51.696988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:51.700707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:51.701063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:51.701364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:51.757509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] MFA Rules not processed for user `5339c00a88e6415b981ab6c1d68b14bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:51.758955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:51.869104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2340/4677] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:51.971827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:51.974326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2338/4678] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:52.032439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:52.133134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03ddfa-ca81-4462-a51e-54a541b60868 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:52.144462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:52.146163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:52.146664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:52.147150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:52.148090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:52.154433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:52.233997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2341/4679] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:44:51 2022] POST /identity/v3/projects => generated 357 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:52.238238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:52.263529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea12aa-1fe5-474d-930f-28cc2b9e12fa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:52.363647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:52.366704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:52.433022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:52.497721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:52.498362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:52.501865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:52.502103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:52.502781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:52.512762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:52.605519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2339/4680] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:44:52 2022] POST /identity/v3/users => generated 285 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:44:52.606515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:52.619808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae09c4-799e-4eeb-b8d1-32b8c2c35bf7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:52.643337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:52.643991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:52.644244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:52.644521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:52.653688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd812d-7e68-46ff-b42d-7cfae65f9a73 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:52.676270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:52.681914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:52.683374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:52.683936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:52.684812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:52.695531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:52.737459 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2340/4681] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:52.739193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:52.779326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712e72a-2744-476f-89ee-b8dd13a43244 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:52.795778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:52.796305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:52.797195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:52.797456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] PATH_INFO: `/v3/projects/b7cbaa13c2d24637a1f102df7c95ddb0/users/85e18aab878740d28c692811c3dbc30a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:52.805299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:52.806924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:52.851377 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2342/4682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:44:52.872670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cbaa13c2d24637a1f102df7c95ddb0, user_id=85e18aab878740d28c692811c3dbc30a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:52.878060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:52.947531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2341/4683] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:52 2022] PUT /identity/v3/projects/b7cbaa13c2d24637a1f102df7c95ddb0/users/85e18aab878740d28c692811c3dbc30a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:52.949812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:52.974648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb732c40-1401-4f0c-84e4-4280f7e165fb service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:53.129591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:53.168081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9209a86-5e15-4e7a-a615-ef3f8fd32274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:53.168629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9209a86-5e15-4e7a-a615-ef3f8fd32274 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:53.168928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9209a86-5e15-4e7a-a615-ef3f8fd32274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:53.169248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9209a86-5e15-4e7a-a615-ef3f8fd32274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:53.169905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9209a86-5e15-4e7a-a615-ef3f8fd32274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:53.175559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9209a86-5e15-4e7a-a615-ef3f8fd32274 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:53.210626 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2343/4684] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:44:53.212107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:53.229745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf217-a1a0-4b8e-a5c1-851e2a53e523 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:53.239333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:53.240021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:53.240305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:53.240587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] PATH_INFO: `/v3/projects/b7cbaa13c2d24637a1f102df7c95ddb0/users/85e18aab878740d28c692811c3dbc30a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:53.247984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cbaa13c2d24637a1f102df7c95ddb0, user_id=85e18aab878740d28c692811c3dbc30a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:53.253390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:53.285046 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2342/4685] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:44:53 2022] PUT /identity/v3/projects/b7cbaa13c2d24637a1f102df7c95ddb0/users/85e18aab878740d28c692811c3dbc30a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:53.296295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:53.297972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:53.298651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:53.361500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] MFA Rules not processed for user `85e18aab878740d28c692811c3dbc30a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:53.365181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:53.695624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2344/4686] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:53.714138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:53.723526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:53.944713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013779e3-5aa2-4099-95ba-278f2e183e4b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:53.960515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e2a74-1911-46d0-a40a-be9074ddf39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:53.961784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2a74-1911-46d0-a40a-be9074ddf39f service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:53.965299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2a74-1911-46d0-a40a-be9074ddf39f service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:53.965708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2a74-1911-46d0-a40a-be9074ddf39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:53.989278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2a74-1911-46d0-a40a-be9074ddf39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:53.991155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2a74-1911-46d0-a40a-be9074ddf39f service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:54.027587 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2343/4687] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:54.227785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:54.244991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fdc52-6dde-445d-bc67-934c83a58aae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:54.252654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:54.253747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:54.254259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:54.254758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:54.413488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:54.417000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:54.471621 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2345/4688] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:44:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:44:56.151344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23ec9-7d39-47e5-8bbe-dbe7552c9ed5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:56.152676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23ec9-7d39-47e5-8bbe-dbe7552c9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:56.153151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a23ec9-7d39-47e5-8bbe-dbe7552c9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:56.194182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d9a23ec9-7d39-47e5-8bbe-dbe7552c9ed5 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:56.195714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d9a23ec9-7d39-47e5-8bbe-dbe7552c9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:56.452490 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2344/4689] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:44:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:44:56.470738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:56.474059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:56.678773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:56.683999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443cfa5-fcc8-4446-a95b-c894777eb4e9 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:56.694319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b2f95-3998-446d-b345-5127474c7e65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:56.695186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2f95-3998-446d-b345-5127474c7e65 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:56.695677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2f95-3998-446d-b345-5127474c7e65 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:56.696333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b2f95-3998-446d-b345-5127474c7e65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:56.710162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b2f95-3998-446d-b345-5127474c7e65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:56.712177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b2f95-3998-446d-b345-5127474c7e65 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:56.771336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2346/4690] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:57.102859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:57.103149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:57.105143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:57.181202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] MFA Rules not processed for user `5339c00a88e6415b981ab6c1d68b14bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:57.185270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:57.216207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:44:57.376630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2345/4691] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:58.793062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:58.794004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:58.794493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:58.835340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:58.836885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:44:58.862263 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2347/4692] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:44:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:44:58.868830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:58.909245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f76b1-a247-4932-a034-4bd5bac35c8b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:58.936341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cea5b-9cd4-4cb4-86a0-d1ea5b46ac85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:58.937103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cea5b-9cd4-4cb4-86a0-d1ea5b46ac85 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:58.937402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cea5b-9cd4-4cb4-86a0-d1ea5b46ac85 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:58.937770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cea5b-9cd4-4cb4-86a0-d1ea5b46ac85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:58.967036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cea5b-9cd4-4cb4-86a0-d1ea5b46ac85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:58.969359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cea5b-9cd4-4cb4-86a0-d1ea5b46ac85 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:59.004757 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2346/4693] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:44:59.273494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:44:59.465852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ffd1-506f-4ec8-8c37-16ffbcad77a7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:44:59.477275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:44:59.477635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:59.477847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:59.478109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] PATH_INFO: `/v3/users/5339c00a88e6415b981ab6c1d68b14bb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:59.484403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5339c00a88e6415b981ab6c1d68b14bb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:44:59.486526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:44:59.578520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5339c00a88e6415b981ab6c1d68b14bb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:59.609074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5339c00a88e6415b981ab6c1d68b14bb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:59.609835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5339c00a88e6415b981ab6c1d68b14bb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:59.638674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5339c00a88e6415b981ab6c1d68b14bb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:59.639336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5339c00a88e6415b981ab6c1d68b14bb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:44:59.679842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2348/4694] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:44:59 2022] DELETE /identity/v3/users/5339c00a88e6415b981ab6c1d68b14bb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:44:59.683874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:44:59.684167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:44:59.684448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:44:59.790829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:44:59.792190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:00.038545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2347/4695] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:00.060189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:00.062552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:00.193668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:00.260331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1525a0-1d0e-47a9-aa78-5f0e0dbf55cd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:00.264399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4640d6-6a5b-49f2-8233-696f4c7559b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:00.265820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4640d6-6a5b-49f2-8233-696f4c7559b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:00.266362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4640d6-6a5b-49f2-8233-696f4c7559b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:00.266786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4640d6-6a5b-49f2-8233-696f4c7559b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:00.278083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4640d6-6a5b-49f2-8233-696f4c7559b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:00.280105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4640d6-6a5b-49f2-8233-696f4c7559b5 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:00.299368 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2349/4696] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:00.807943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:00.809426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:00.827296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649aa06-62d8-4b67-b9bb-556fafc90994 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:00.845137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:00.846051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:00.846541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:00.846993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] PATH_INFO: `/v3/projects/866f7da063ae4a9c9303deff8d91c6ae` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:00.848325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866f7da063ae4a9c9303deff8d91c6ae)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:00.854055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:01.071725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866f7da063ae4a9c9303deff8d91c6ae', 'request_id': 'req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:01.083892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866f7da063ae4a9c9303deff8d91c6ae', 'request_id': 'req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:01.097865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866f7da063ae4a9c9303deff8d91c6ae', 'request_id': 'req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:01.131672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] The token cache is being invalidate because project 866f7da063ae4a9c9303deff8d91c6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:01.135936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:01.138557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cf15810-f2df-4da6-9a6a-9ac1fa1b03d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:01.143634 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2348/4697] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:00 2022] DELETE /identity/v3/projects/866f7da063ae4a9c9303deff8d91c6ae => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:01.150327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.150770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.150927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.187284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:01.189591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:01.282870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2350/4698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:01.291039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93026f5-b522-4607-bc38-df757292d096 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.291787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93026f5-b522-4607-bc38-df757292d096 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.292363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93026f5-b522-4607-bc38-df757292d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.321943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e93026f5-b522-4607-bc38-df757292d096 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:01.323432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e93026f5-b522-4607-bc38-df757292d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:01.334014 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2349/4699] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:01.337956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:01.352171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d30cbb-eed3-489d-9e4d-c99c9492d0df None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:01.363107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:01.363738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.369161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.369498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.370195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:45:01.370675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:01.372308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:01.423152 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2351/4700] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:45:01.429668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93026f5-b522-4607-bc38-df757292d096 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:01.450496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93026f5-b522-4607-bc38-df757292d096 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:01.465344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:01.466204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.467798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.468596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.498559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:01.507656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:01.621865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:01.622617 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2350/4701] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:01 2022] POST /identity/v3/projects => generated 397 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:01.639419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd7a71-ba5f-46d0-b489-7901738712b1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:01.786375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:01.787713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.788207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.788839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.789889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:01.792382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:01.840530 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2352/4702] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:01 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:45:01.842326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:01.850370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:01.868988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0e16-cafb-4944-b378-fcb8fcbffcf4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:01.888937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:01.891601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.893453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.894843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.897477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:01.902878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:01.945754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2351/4703] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:01.949160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:01.971442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adce376-d1e7-472a-b295-ceaa7148eb38 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:01.983139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320f4d0-49ea-456e-a970-347e46a015cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:01.984441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f4d0-49ea-456e-a970-347e46a015cb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:01.985350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f4d0-49ea-456e-a970-347e46a015cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:01.986250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320f4d0-49ea-456e-a970-347e46a015cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:01.987300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f4d0-49ea-456e-a970-347e46a015cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:01.993233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320f4d0-49ea-456e-a970-347e46a015cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:02.014511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2353/4704] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:02.018258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:02.037304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89237644-4d21-4a9a-b2d4-2f8aaccbfb73 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:02.049304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:02.050038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:02.050276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:02.054091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] PATH_INFO: `/v3/projects/1ae15e13c1ae4b2db5de94fbd428867d/users/c14d2fac851e4bbaaa760b5c3406a335/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:02.096760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae15e13c1ae4b2db5de94fbd428867d, user_id=c14d2fac851e4bbaaa760b5c3406a335, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:02.102755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:02.135177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2352/4705] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:02 2022] PUT /identity/v3/projects/1ae15e13c1ae4b2db5de94fbd428867d/users/c14d2fac851e4bbaaa760b5c3406a335/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:02.141813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:02.141813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:02.142193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:02.204072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:02.219263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:02.269209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:02.334279 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2354/4706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:02.371218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:02.373855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:02.463114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d44d-2ce9-460a-9183-f841f0e436d4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:02.467727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:02.469395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:02.469673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:02.469944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:02.482363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:02.484493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:02.498348 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2353/4707] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:03.939192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:03.939192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:04.101163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c2afc-d162-4bc6-9f44-19813c0f51b9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:04.111576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:04.112243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:04.112526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:04.112800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:04.119647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:04.328990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:04.334874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:04.368188 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2355/4708] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:04.506924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:04.516137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8962ce4-4f12-49ba-a871-718a770ac28d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:04.525302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:04.526096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:04.526401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:04.526740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:04.530229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:04.558216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:04.561394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f011-cbf0-4379-b036-6683c71e56b8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:04.575852 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2354/4709] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:05.887682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:05.889288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:06.114025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:06.138951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1e29-0e65-43ae-8051-67a9bb40b7fd service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:06.180983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:06.181621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:06.181903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:06.182175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:06.190439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:06.225406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:06.227692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:06.259403 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2356/4710] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:07.459017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0bc4c-124d-4547-bfde-cabe8e0887f0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:07.459861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0bc4c-124d-4547-bfde-cabe8e0887f0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:07.460334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0bc4c-124d-4547-bfde-cabe8e0887f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:07.574485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-16d0bc4c-124d-4547-bfde-cabe8e0887f0 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:07.576259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-16d0bc4c-124d-4547-bfde-cabe8e0887f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:07.737629 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2355/4711] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:07.753361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:07.754883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:07.959490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7731-b61c-4b70-a3c9-0f44dedf81a2 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:07.983144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:07.984541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:07.985005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:07.985434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:08.005765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:08.007847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:08.033080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2357/4712] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:08.297748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb377-6bc6-4e46-98cd-a2f4e6e9ef25 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:08.298286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb377-6bc6-4e46-98cd-a2f4e6e9ef25 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:08.299794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adb377-6bc6-4e46-98cd-a2f4e6e9ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:08.325828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b0adb377-6bc6-4e46-98cd-a2f4e6e9ef25 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:08.327247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0adb377-6bc6-4e46-98cd-a2f4e6e9ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:08.381516 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2356/4713] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:08.408611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:08.425404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec857b5-41eb-400f-a8e4-b6b5405470ba service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:08.464561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:08.465279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:08.465606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:08.466203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:08.486659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:08.488277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:08.540944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2358/4714] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:45:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:10.128871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d7d5-5891-4b75-92fb-84a3c2e63346 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:10.129440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d7d5-5891-4b75-92fb-84a3c2e63346 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:10.130032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d7d5-5891-4b75-92fb-84a3c2e63346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:10.187531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d033d7d5-5891-4b75-92fb-84a3c2e63346 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:10.194963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d033d7d5-5891-4b75-92fb-84a3c2e63346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:10.229333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2357/4715] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:45:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:10.241433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:10.259345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552355-11aa-4f26-9f05-58f818e9811d service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:10.290473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:10.291390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:10.298574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:10.298896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:10.345594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:10.347296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:10.381797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2359/4716] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:45:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:11.532647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:11.533247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:11.533382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:11.604679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:11.606189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:11.629608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2358/4717] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:11.675397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:11.691906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b406675-f22c-4fe5-ab7c-7d12190fb7cb service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:11.710843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:11.712695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:11.714202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:11.714667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:11.736940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:11.742999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:11.766601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2360/4718] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:12.701402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:12.704840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:12.754145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be209f5-5dcb-4a04-964e-0c3ef90a4003 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:12.769477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:12.770562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:12.771222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:12.771705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] PATH_INFO: `/v3/users/ed6bf791f0d34cbe822b35402973cc49` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:12.775741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6bf791f0d34cbe822b35402973cc49)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:12.782343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:12.846322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:12.923956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6bf791f0d34cbe822b35402973cc49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:12.966426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6bf791f0d34cbe822b35402973cc49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:12.967364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6bf791f0d34cbe822b35402973cc49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:12.980928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6bf791f0d34cbe822b35402973cc49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:12.982004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b72166d8-8f5f-4464-9326-711d69765927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6bf791f0d34cbe822b35402973cc49'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:13.033612 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2359/4719] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:12 2022] DELETE /identity/v3/users/ed6bf791f0d34cbe822b35402973cc49 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:14.644625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:14.662979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f5b3-ddfa-4b0c-88db-714897c312e4 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:14.939349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:14.940137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:14.941626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:14.948700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] PATH_INFO: `/v3/projects/b8325066949145cf92e3ec5dd67f44a2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:14.951675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8325066949145cf92e3ec5dd67f44a2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:14.957540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:15.099215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:15.128371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8325066949145cf92e3ec5dd67f44a2', 'request_id': 'req-b9881834-5402-4af0-8fa3-5b79ace129cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:15.152528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8325066949145cf92e3ec5dd67f44a2', 'request_id': 'req-b9881834-5402-4af0-8fa3-5b79ace129cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:15.163942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8325066949145cf92e3ec5dd67f44a2', 'request_id': 'req-b9881834-5402-4af0-8fa3-5b79ace129cc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:15.193966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] The token cache is being invalidate because project b8325066949145cf92e3ec5dd67f44a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:15.196997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:15.198532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b9881834-5402-4af0-8fa3-5b79ace129cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:15.205274 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2361/4720] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:14 2022] DELETE /identity/v3/projects/b8325066949145cf92e3ec5dd67f44a2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:15.210148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:15.211131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:15.211737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:15.254318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:15.258116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:15.468802 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2360/4721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:15.475454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:15.476083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:15.476594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:15.527264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:15.528877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:15.585488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:15.594430 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2362/4722] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:15.602340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc954c-a74d-4120-a235-9e7e25381cc8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:15.623509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:15.633321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:15.633650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:15.636145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:15.638233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:45:15.641312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:15.646284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:15.726328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:15.748101 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2361/4723] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:45:15.774392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbbf1c-c174-45c3-9078-a9cb9319c161 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:15.784732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:15.785769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:15.786278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:15.786758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:15.788207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:15.790866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:15.833256 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2363/4724] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:15 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:15.848857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:15.860820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dfc34-286c-469c-b30c-2719fe2bf7ae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:16.130365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:16.130365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:16.130365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:16.130365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:16.130697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:16.144120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:16.260944 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2362/4725] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:15 2022] POST /identity/v3/users => generated 289 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:16.265222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:16.281611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617999d-7844-4997-9c74-f158cde8a968 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:16.294011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:16.295023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:16.296773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:16.297566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:16.301439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:16.303544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:16.334239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:16.345539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728812a5-a1cb-4e82-a961-afa0440d3620 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:16.346253 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2364/4726] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:16.357866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12b97-9abd-4f03-9bcc-612933160bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:16.359604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12b97-9abd-4f03-9bcc-612933160bab admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:16.360765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12b97-9abd-4f03-9bcc-612933160bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:16.361357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12b97-9abd-4f03-9bcc-612933160bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:16.362344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef12b97-9abd-4f03-9bcc-612933160bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:16.364607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef12b97-9abd-4f03-9bcc-612933160bab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:16.380489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2363/4727] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:16.384955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:16.402691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bc3a6-0a2e-4c78-8b96-1a47db0cc649 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:16.414923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:16.418563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:16.419130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:16.419646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] PATH_INFO: `/v3/projects/14c9c845b4e04fb09dc03de04a799cf3/users/27a14e4e71454d18946512dedba312a0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:16.460492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c9c845b4e04fb09dc03de04a799cf3, user_id=27a14e4e71454d18946512dedba312a0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:16.468777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:16.508954 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2365/4728] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:16 2022] PUT /identity/v3/projects/14c9c845b4e04fb09dc03de04a799cf3/users/27a14e4e71454d18946512dedba312a0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:16.513543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499bee-8c03-44dd-9102-bb8c5a6aa156 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:16.513835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499bee-8c03-44dd-9102-bb8c5a6aa156 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:16.514128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499bee-8c03-44dd-9102-bb8c5a6aa156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:16.594392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-60499bee-8c03-44dd-9102-bb8c5a6aa156 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:16.597070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-60499bee-8c03-44dd-9102-bb8c5a6aa156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:16.606604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:16.909685 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2364/4729] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:17.243896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:17.254727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:17.430298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d7011-0555-4b01-8b4d-5ff7c6f20f83 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:17.441591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73cf6c-7025-4eb8-a1b2-53c2ac8e69bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:17.442736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cf6c-7025-4eb8-a1b2-53c2ac8e69bf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:17.445215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cf6c-7025-4eb8-a1b2-53c2ac8e69bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:17.446115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cf6c-7025-4eb8-a1b2-53c2ac8e69bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:17.471888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cf6c-7025-4eb8-a1b2-53c2ac8e69bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:17.475924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cf6c-7025-4eb8-a1b2-53c2ac8e69bf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:17.520085 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2366/4730] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:19.559780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:19.562625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:19.563111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:19.671579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] MFA Rules not processed for user `c14d2fac851e4bbaaa760b5c3406a335`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:19.673318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:19.879422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2365/4731] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:19.890571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:19.892817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:19.893782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:19.978234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] MFA Rules not processed for user `c14d2fac851e4bbaaa760b5c3406a335`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:19.986665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:20.019701 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2367/4732] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:20.326458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:20.339163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:20.759531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733981b0-79bb-4a4f-a5f1-05ae3d558376 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:20.786187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7aba-943e-4126-b0b9-93a9e73790ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:20.804993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7aba-943e-4126-b0b9-93a9e73790ef service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:20.805333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7aba-943e-4126-b0b9-93a9e73790ef service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:20.805534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7aba-943e-4126-b0b9-93a9e73790ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:20.873640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7aba-943e-4126-b0b9-93a9e73790ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:20.879874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7aba-943e-4126-b0b9-93a9e73790ef service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:20.961691 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2366/4733] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:23.160775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:23.197419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017b2af-7b93-4d75-bc26-19ca1912836a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:23.216340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:23.217623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:23.218700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:23.222535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:23.226011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:23.261371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:23.263238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:23.293041 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2368/4734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:26.862554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b766ff-7ac4-4186-b225-33141448cbd2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:26.864180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b766ff-7ac4-4186-b225-33141448cbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:26.864803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b766ff-7ac4-4186-b225-33141448cbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:26.887918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b1b766ff-7ac4-4186-b225-33141448cbd2 None None] MFA Rules not processed for user `728544ca5e164540b3c5395534542955`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:26.889958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1b766ff-7ac4-4186-b225-33141448cbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:26.909995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:26.973529 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2367/4735] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:31.758758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:31.760270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:31.865310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad471174-c840-4836-8c96-c0d9afa1ad50 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:31.879091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:31.879766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:31.880050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:31.882521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] PATH_INFO: `/v3/users/4018c38edc5e441ca529dc8404868a52` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:31.887447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4018c38edc5e441ca529dc8404868a52)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:31.891121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:31.905073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:31.978302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4018c38edc5e441ca529dc8404868a52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:32.014641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4018c38edc5e441ca529dc8404868a52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:32.015800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4018c38edc5e441ca529dc8404868a52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:32.043112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4018c38edc5e441ca529dc8404868a52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:32.043976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4018c38edc5e441ca529dc8404868a52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:32.074320 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2369/4736] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:31 2022] DELETE /identity/v3/users/4018c38edc5e441ca529dc8404868a52 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:32.079571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d64d-dd24-4b97-a4e9-afac0402b61c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:32.080108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d64d-dd24-4b97-a4e9-afac0402b61c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:32.080433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d64d-dd24-4b97-a4e9-afac0402b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:32.167605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e37d64d-dd24-4b97-a4e9-afac0402b61c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:32.169127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e37d64d-dd24-4b97-a4e9-afac0402b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:32.377903 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2368/4737] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:32.439172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:32.440685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:32.579864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e1fa5-4c80-4045-88a0-702158955b44 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:32.580145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e1fa5-4c80-4045-88a0-702158955b44 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:32.580763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e1fa5-4c80-4045-88a0-702158955b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:32.626407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-085e1fa5-4c80-4045-88a0-702158955b44 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:32.647927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-085e1fa5-4c80-4045-88a0-702158955b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:32.681120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33580066-c2cc-420a-9606-221c162aab94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:32.689616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:32.690761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:32.692080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:32.692684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:32.720596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:32.722329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:32.769714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2370/4738] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:32.836759 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2369/4739] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:32.853128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:32.855126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:33.071079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56cd1-f1a5-4b32-b089-0bd2a8077332 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:33.093223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7538b64-76ef-4efa-a865-a4c4d273de1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:33.094575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538b64-76ef-4efa-a865-a4c4d273de1d service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:33.094861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538b64-76ef-4efa-a865-a4c4d273de1d service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:33.095143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7538b64-76ef-4efa-a865-a4c4d273de1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:33.129753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7538b64-76ef-4efa-a865-a4c4d273de1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:33.131401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7538b64-76ef-4efa-a865-a4c4d273de1d service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:33.152721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:33.174380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2371/4740] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:45:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:45:34.298211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:34.298722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:34.299199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:34.371636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] MFA Rules not processed for user `27a14e4e71454d18946512dedba312a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:34.373890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:34.489257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:34.523639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2370/4741] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:34.543081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:34.546790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:34.547598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:34.584547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] MFA Rules not processed for user `27a14e4e71454d18946512dedba312a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:34.586500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:34.603301 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2372/4742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:34.615833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:34.618000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:34.855597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595eec6-ab2d-42d0-a180-4ea50abf3cf1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:34.870505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:34.871194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:34.871517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:34.871795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:34.892694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:34.894746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:34.944966 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2371/4743] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:35.636418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:35.637995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:35.672829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184756d1-3ee5-4ecb-8761-419d464ff92c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:35.684473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:35.687058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:35.688436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:35.688712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] PATH_INFO: `/v3/projects/80409c3923b84abea5f230a0213a0a43` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:35.692895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80409c3923b84abea5f230a0213a0a43)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:35.730714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:35.885013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80409c3923b84abea5f230a0213a0a43', 'request_id': 'req-1ecc6d09-1ca9-44b1-b856-7072f63969b3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:35.896014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80409c3923b84abea5f230a0213a0a43', 'request_id': 'req-1ecc6d09-1ca9-44b1-b856-7072f63969b3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:35.971435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80409c3923b84abea5f230a0213a0a43', 'request_id': 'req-1ecc6d09-1ca9-44b1-b856-7072f63969b3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.008443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] The token cache is being invalidate because project 80409c3923b84abea5f230a0213a0a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:36.008887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.010328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.017170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2373/4744] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:35 2022] DELETE /identity/v3/projects/80409c3923b84abea5f230a0213a0a43 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:36.029803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:36.043057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbf576-4f18-439d-9f30-c51df4cc84a5 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:36.212271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:36.212970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:36.235486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:36.235890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] PATH_INFO: `/v3/users/85e18aab878740d28c692811c3dbc30a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:36.240486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e18aab878740d28c692811c3dbc30a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:36.243184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:36.345431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e18aab878740d28c692811c3dbc30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.371733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:36.379390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e18aab878740d28c692811c3dbc30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.380373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e18aab878740d28c692811c3dbc30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.391687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e18aab878740d28c692811c3dbc30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.392458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e18aab878740d28c692811c3dbc30a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:36.423487 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2372/4745] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:36 2022] DELETE /identity/v3/users/85e18aab878740d28c692811c3dbc30a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:38.439668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:38.444302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:38.748058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc6d09-1ca9-44b1-b856-7072f63969b3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:38.884480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:38.891268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:38.891669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:38.891966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:38.896449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:38.928473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:38.930292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba3d56-5e20-49e2-9081-16707f7129d5 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:38.969783 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2374/4746] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:39.131798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:39.134111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:39.378104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e398120-7578-4028-9bc6-c84495675e6a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:39.391321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:39.392112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:39.393367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:39.394536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] PATH_INFO: `/v3/projects/b7cbaa13c2d24637a1f102df7c95ddb0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:39.397420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7cbaa13c2d24637a1f102df7c95ddb0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:39.425657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:39.574445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7cbaa13c2d24637a1f102df7c95ddb0', 'request_id': 'req-744b2a99-d265-4768-9caf-8659c7a81b35'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:39.592140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7cbaa13c2d24637a1f102df7c95ddb0', 'request_id': 'req-744b2a99-d265-4768-9caf-8659c7a81b35'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:39.605668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7cbaa13c2d24637a1f102df7c95ddb0', 'request_id': 'req-744b2a99-d265-4768-9caf-8659c7a81b35'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:39.627506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] The token cache is being invalidate because project b7cbaa13c2d24637a1f102df7c95ddb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:39.628511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:39.629731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-744b2a99-d265-4768-9caf-8659c7a81b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:39.632003 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2373/4747] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:39 2022] DELETE /identity/v3/projects/b7cbaa13c2d24637a1f102df7c95ddb0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:39.638460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:39.638844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:39.640721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:39.695820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:39.818049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:39.819297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:39.948876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2375/4748] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:39.958839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:39.959129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:39.959409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.020775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:40.027070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:40.048660 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2374/4749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:40.052765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:40.067269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc7db3-48a0-4063-8b27-e36fb4e7c97c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:40.079155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:40.082001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.082292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.082557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.083255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:45:40.083565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:40.087636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:40.119979 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2376/4750] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:45:40.125449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:40.137512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c4c94-d039-433d-aad3-d7d880d1a82b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:40.154762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:40.155996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.156983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.157513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.158570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:40.160960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:40.204867 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2375/4751] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:40 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:45:40.208265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:40.231114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ea2b0-575a-4153-8f58-f38947138941 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:40.422804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:40.423509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.425076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.425879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.447581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:40.456931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:40.557965 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2377/4752] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:40 2022] POST /identity/v3/users => generated 285 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:40.563538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:40.581692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f26ea-0cf9-4e7a-bc4c-22ae29cae237 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:40.588810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:40.589865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.590656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.591256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.592096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:40.594770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:40.612356 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2376/4753] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:45:40.613157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:40.632522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17d05d-a6e5-44c3-9ce8-986bb1c052f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:40.642742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ea3c4-dae5-4067-873f-762366d22fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:40.643618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea3c4-dae5-4067-873f-762366d22fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.643870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea3c4-dae5-4067-873f-762366d22fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.644135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ea3c4-dae5-4067-873f-762366d22fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.656064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ea3c4-dae5-4067-873f-762366d22fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:40.657831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ea3c4-dae5-4067-873f-762366d22fa8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:40.681363 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2378/4754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:45:40.685733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:40.701735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78806b1-1e49-4a0e-b0d7-14a6c6ce032b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:40.711787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:40.712468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.712751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.713055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] PATH_INFO: `/v3/projects/855e412a449f4f0f82c9f3e35dc1b55e/users/35f79be25b4d4cf99525b3a00876ef6d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.751373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=855e412a449f4f0f82c9f3e35dc1b55e, user_id=35f79be25b4d4cf99525b3a00876ef6d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:40.755917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:40.783468 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2377/4755] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:40 2022] PUT /identity/v3/projects/855e412a449f4f0f82c9f3e35dc1b55e/users/35f79be25b4d4cf99525b3a00876ef6d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:40.790832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:40.791339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:40.791654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:40.835150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] MFA Rules not processed for user `35f79be25b4d4cf99525b3a00876ef6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:40.836651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:40.915374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:40.996887 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2379/4756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:40.998127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:41.005413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:41.090131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266965-b951-4d90-aad0-5a45b11404cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:41.097266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:41.098707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.099326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.099808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.100721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:41.102912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:41.175751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2378/4757] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:40 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:41.180088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:41.199925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34957e0f-1233-41bf-b462-9a98a4697081 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:41.373563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:41.374822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.375118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.375404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.376207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:41.378190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:41.435458 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2380/4758] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:41 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:41.439890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:41.453855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c6cfc-b864-41e8-8796-e618f627ab53 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:41.503685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:41.505644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.506233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.506680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.507672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:41.515457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:41.536034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2379/4759] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:41.536231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:41.559446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560c30d-e6a1-4bbe-8ff6-a4cdb958a06f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:41.564854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:41.565621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.565903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.566176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] PATH_INFO: `/v3/projects/96fb9dc9457441f2b80c0868b399be32/users/d71a326dc48b46ea845c39b2ce900de4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.597596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fb9dc9457441f2b80c0868b399be32, user_id=d71a326dc48b46ea845c39b2ce900de4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:41.600738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:41.629130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2381/4760] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:41 2022] PUT /identity/v3/projects/96fb9dc9457441f2b80c0868b399be32/users/d71a326dc48b46ea845c39b2ce900de4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:41.633191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:41.653289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0bedc-4c57-404c-893a-2930fd160e0c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:41.772028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b115bdd-4c79-4019-a4ef-aae37928f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:41.773524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115bdd-4c79-4019-a4ef-aae37928f02c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.775126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115bdd-4c79-4019-a4ef-aae37928f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.775635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b115bdd-4c79-4019-a4ef-aae37928f02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.777976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b115bdd-4c79-4019-a4ef-aae37928f02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:41.782265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b115bdd-4c79-4019-a4ef-aae37928f02c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:41.808002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2380/4761] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:41.812887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:41.825834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e6c9c-37dd-4d88-98f1-86279807c1aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:41.832448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:41.833406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.834136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.835819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] PATH_INFO: `/v3/projects/96fb9dc9457441f2b80c0868b399be32/users/d71a326dc48b46ea845c39b2ce900de4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.849863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fb9dc9457441f2b80c0868b399be32, user_id=d71a326dc48b46ea845c39b2ce900de4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:41.853249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:41.871312 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2382/4762] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:41 2022] PUT /identity/v3/projects/96fb9dc9457441f2b80c0868b399be32/users/d71a326dc48b46ea845c39b2ce900de4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:41.883043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:41.883354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:41.883609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:41.917240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] MFA Rules not processed for user `d71a326dc48b46ea845c39b2ce900de4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:41.918461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:42.002599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:42.015954 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2381/4763] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:42.022279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:42.024424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:42.123069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf28f-bc50-460e-a9c7-0e04440ce27e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:42.127876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:42.128668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:42.129110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:42.129385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:42.140514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:42.142399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:42.168431 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2383/4764] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:42.211569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:42.225707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f969c4-139e-49c7-9868-72d3a77fb40c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:42.229320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535466b7-8fb4-4b25-87aa-c4b7411eb9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:42.229930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535466b7-8fb4-4b25-87aa-c4b7411eb9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:42.230209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535466b7-8fb4-4b25-87aa-c4b7411eb9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:42.230482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535466b7-8fb4-4b25-87aa-c4b7411eb9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:42.388270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535466b7-8fb4-4b25-87aa-c4b7411eb9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:42.395392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535466b7-8fb4-4b25-87aa-c4b7411eb9a4 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:42.453962 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2382/4765] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:43.289583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:43.291110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:43.379134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:43.441856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfe550-5856-42b7-8735-0ab2010f0e2a service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:43.447183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:43.447995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:43.448427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:43.449031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] PATH_INFO: `/v3/users/cc626f587b9541ce82f7d52f426b129d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:43.450329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc626f587b9541ce82f7d52f426b129d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:43.452947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:43.545231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc626f587b9541ce82f7d52f426b129d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:43.568784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc626f587b9541ce82f7d52f426b129d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:43.571042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc626f587b9541ce82f7d52f426b129d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:43.598719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc626f587b9541ce82f7d52f426b129d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:43.599776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc626f587b9541ce82f7d52f426b129d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:43.627730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2384/4766] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:43 2022] DELETE /identity/v3/users/cc626f587b9541ce82f7d52f426b129d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:43.632343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:43.632820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:43.632949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:43.669998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:43.672462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:43.746861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2383/4767] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:43.761884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:43.763267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:43.899433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7af9a3-69af-4c49-a9bb-a472efb58278 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:43.903927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:43.904568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:43.905445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:43.905737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:43.922913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:43.924393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:43.944695 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2385/4768] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:44.629035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:44.631031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:44.669488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a12f0-bc7f-4c2d-b5e6-96259e37fbd4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:44.676366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:44.677325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:44.677765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:44.678106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] PATH_INFO: `/v3/projects/53c0d3a590cd4154999aa75e3009cfd1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:44.679591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c0d3a590cd4154999aa75e3009cfd1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:44.682758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:44.835387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c0d3a590cd4154999aa75e3009cfd1', 'request_id': 'req-18700da8-13bb-403c-b94e-b981a9f99f5c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:44.850069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c0d3a590cd4154999aa75e3009cfd1', 'request_id': 'req-18700da8-13bb-403c-b94e-b981a9f99f5c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:44.864455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c0d3a590cd4154999aa75e3009cfd1', 'request_id': 'req-18700da8-13bb-403c-b94e-b981a9f99f5c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:44.893548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] The token cache is being invalidate because project 53c0d3a590cd4154999aa75e3009cfd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:44.893863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:44.894912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:44.901327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2384/4769] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:44 2022] DELETE /identity/v3/projects/53c0d3a590cd4154999aa75e3009cfd1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:44.902747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:44.926910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188cc5-cb4e-4f73-9acc-6a5644f823a0 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:45.055646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:45.065775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:45.066545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:45.066877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:45.067351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] PATH_INFO: `/v3/users/026fb3f61b59467a9e652a6dafbaf548` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:45.068577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=026fb3f61b59467a9e652a6dafbaf548)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:45.071046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:45.141457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026fb3f61b59467a9e652a6dafbaf548'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.157929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026fb3f61b59467a9e652a6dafbaf548'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.158736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026fb3f61b59467a9e652a6dafbaf548'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.168248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026fb3f61b59467a9e652a6dafbaf548'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.169099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-61678c4c-184e-4466-9376-a17c3c14f49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026fb3f61b59467a9e652a6dafbaf548'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.190237 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2386/4770] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:44 2022] DELETE /identity/v3/users/026fb3f61b59467a9e652a6dafbaf548 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:45.767263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:45.768758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:45.794214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18700da8-13bb-403c-b94e-b981a9f99f5c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:45.827672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:45.905652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:45.906601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:45.907029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:45.908095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] PATH_INFO: `/v3/projects/4a2500b400b848e585c6c20d0e5053fb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:45.909309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2500b400b848e585c6c20d0e5053fb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:45.911316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:45.972058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2500b400b848e585c6c20d0e5053fb', 'request_id': 'req-5d42a760-8594-4f9a-9578-a13fd27e6830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.978674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2500b400b848e585c6c20d0e5053fb', 'request_id': 'req-5d42a760-8594-4f9a-9578-a13fd27e6830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:45.985930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2500b400b848e585c6c20d0e5053fb', 'request_id': 'req-5d42a760-8594-4f9a-9578-a13fd27e6830'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:46.003720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] The token cache is being invalidate because project 4a2500b400b848e585c6c20d0e5053fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:46.004016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:46.005304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d42a760-8594-4f9a-9578-a13fd27e6830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:46.007868 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2385/4771] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:45 2022] DELETE /identity/v3/projects/4a2500b400b848e585c6c20d0e5053fb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:46.012851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.013341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.013341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.046131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:46.047468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:46.155283 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2387/4772] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:46.164231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.164523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.164809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.233513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:46.234752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:46.286813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2386/4773] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:46.287567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:46.309046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f433c2-39cd-4ac2-a674-50fff207e32a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:46.362162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:46.362802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.363089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.363369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.364036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:45:46.373943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:46.376525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:46.396828 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2388/4774] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:45:46.399347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:46.411554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014af6-cd14-4132-b813-fb37fab80a45 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:46.417540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:46.418490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.418958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.419574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.420478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:46.422603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:46.483942 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2387/4775] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:46 2022] POST /identity/v3/projects => generated 401 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:46.485740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:46.504196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb7d5e-3e38-456f-a0ce-a0db58cc6d60 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:46.619721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:46.620602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.621046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.621544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.623239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:46.625807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:46.640781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:46.683106 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2389/4776] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:46 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:45:46.687490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:46.729209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a612bb-8488-4ba8-82da-1ef81824e011 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:46.743206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:46.744387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.745084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.746763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.748078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:46.750628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:46.772891 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2388/4777] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:46.776605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:46.791206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991e88-b104-42d4-af0a-d73208145035 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:46.798176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683508a0-11cf-4859-a0c8-c2a916167fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:46.799660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683508a0-11cf-4859-a0c8-c2a916167fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.800019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683508a0-11cf-4859-a0c8-c2a916167fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.800936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683508a0-11cf-4859-a0c8-c2a916167fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.801750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683508a0-11cf-4859-a0c8-c2a916167fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:46.805918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683508a0-11cf-4859-a0c8-c2a916167fd5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:46.838022 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2390/4778] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:45:46.839777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:46.853584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582e81-45c4-4c0f-b079-187ff9fe9db1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:46.862143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:46.863219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.863719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.864239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] PATH_INFO: `/v3/projects/08bcef080b0f40eb91af065a0cd71060/users/4f6d0954d11b4fbeafdcf5504801f6b2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.893088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08bcef080b0f40eb91af065a0cd71060, user_id=4f6d0954d11b4fbeafdcf5504801f6b2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:46.896624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:46.918322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2389/4779] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:46 2022] PUT /identity/v3/projects/08bcef080b0f40eb91af065a0cd71060/users/4f6d0954d11b4fbeafdcf5504801f6b2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:46.929878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:46.930168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:46.930453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:46.973229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] MFA Rules not processed for user `4f6d0954d11b4fbeafdcf5504801f6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:46.974613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:47.052710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2391/4780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:47.068649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:47.069581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:47.069822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:47.072386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:47.149228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:47.174886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389aae-591b-4b6d-831e-5237beb83a3e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:47.180363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:47.181231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.181620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.181998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] PATH_INFO: `/v3/users/35f79be25b4d4cf99525b3a00876ef6d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.184563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f79be25b4d4cf99525b3a00876ef6d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:47.187919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:47.190564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05391ba6-28fd-4414-9cb5-9bf66b016c74 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:47.198943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:47.200028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.200528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.201027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.214188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:47.216081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:47.233677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2390/4781] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:47 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:47.262434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f79be25b4d4cf99525b3a00876ef6d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.284934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f79be25b4d4cf99525b3a00876ef6d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.288268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f79be25b4d4cf99525b3a00876ef6d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.290138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:47.300199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f79be25b4d4cf99525b3a00876ef6d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.302603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8d0aba17-1cfe-4d07-bbc8-8c143c5f25dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f79be25b4d4cf99525b3a00876ef6d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.305057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128723a-6724-4ea9-973a-d7ef67d1b619 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:47.306808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:47.313654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:47.314309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.314612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.314866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] PATH_INFO: `/v3/users/4f6d0954d11b4fbeafdcf5504801f6b2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.316679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6d0954d11b4fbeafdcf5504801f6b2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:47.319675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:47.344225 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2392/4782] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:47 2022] DELETE /identity/v3/users/35f79be25b4d4cf99525b3a00876ef6d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:47.346076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.346937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.347319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.401106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:47.401106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:47.416076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6d0954d11b4fbeafdcf5504801f6b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.443133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6d0954d11b4fbeafdcf5504801f6b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.444181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6d0954d11b4fbeafdcf5504801f6b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.457212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6d0954d11b4fbeafdcf5504801f6b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.458465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b599f3d-6bdd-42d6-8ba5-cec0e33e4f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6d0954d11b4fbeafdcf5504801f6b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:47.494152 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2391/4783] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:47 2022] DELETE /identity/v3/users/4f6d0954d11b4fbeafdcf5504801f6b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:47.497945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.498309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.500745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.542162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:47.543400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:47.569314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2393/4784] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:47.579561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:47.581067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:47.699581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c61d3b-f91f-4a19-a176-c540076a850d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:47.707290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2392/4785] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:47.722471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:47.799826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:47.808655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1189a-ceb4-4ede-b9c5-25338be897c0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:47.815863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d8403-b50e-43a8-a2b9-b9c597bb7f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:47.817006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d8403-b50e-43a8-a2b9-b9c597bb7f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.817502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d8403-b50e-43a8-a2b9-b9c597bb7f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.817982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d8403-b50e-43a8-a2b9-b9c597bb7f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.833123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d8403-b50e-43a8-a2b9-b9c597bb7f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:47.834717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d8403-b50e-43a8-a2b9-b9c597bb7f28 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:47.845982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:47.846621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.846907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.847353 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2393/4786] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:45:47.857334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:47.888436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:47.891468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:47.907429 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2394/4787] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:45:47.980793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:47.981275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:47.981413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:48.011698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:48.013229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:48.096358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2394/4788] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:48.566405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:48.569732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:48.598722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a07d3-efe3-4b0f-9268-ab3158d776c4 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:48.612443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:48.615761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:48.617923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:48.618030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] PATH_INFO: `/v3/projects/08bcef080b0f40eb91af065a0cd71060` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:48.622126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08bcef080b0f40eb91af065a0cd71060)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:48.632339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:48.718302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:48.720280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:48.749975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0ee2-b76c-4af4-ae12-7e132959948c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:48.763394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:48.764427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:48.764857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:48.765204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] PATH_INFO: `/v3/projects/855e412a449f4f0f82c9f3e35dc1b55e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:48.767472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855e412a449f4f0f82c9f3e35dc1b55e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:48.774995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:48.807583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:48.811383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08bcef080b0f40eb91af065a0cd71060', 'request_id': 'req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.835143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08bcef080b0f40eb91af065a0cd71060', 'request_id': 'req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.850347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08bcef080b0f40eb91af065a0cd71060', 'request_id': 'req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.882672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] The token cache is being invalidate because project 08bcef080b0f40eb91af065a0cd71060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:48.883275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.884142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c43b69f-bb9f-49ef-a6bc-21a7a5a023b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.885913 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2395/4789] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:48 2022] DELETE /identity/v3/projects/08bcef080b0f40eb91af065a0cd71060 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:48.891292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73c9e-eecf-43d1-8060-38206b40008f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:48.891810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73c9e-eecf-43d1-8060-38206b40008f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:48.892268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73c9e-eecf-43d1-8060-38206b40008f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:48.894030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855e412a449f4f0f82c9f3e35dc1b55e', 'request_id': 'req-e40bad2d-c0da-4808-8437-a621c0318f93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.902181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855e412a449f4f0f82c9f3e35dc1b55e', 'request_id': 'req-e40bad2d-c0da-4808-8437-a621c0318f93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.915777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855e412a449f4f0f82c9f3e35dc1b55e', 'request_id': 'req-e40bad2d-c0da-4808-8437-a621c0318f93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.950140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a2a73c9e-eecf-43d1-8060-38206b40008f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:48.953268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a2a73c9e-eecf-43d1-8060-38206b40008f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:48.955116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] The token cache is being invalidate because project 855e412a449f4f0f82c9f3e35dc1b55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:48.955421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.957187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:48.961504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2395/4790] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:48 2022] DELETE /identity/v3/projects/855e412a449f4f0f82c9f3e35dc1b55e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:48.965466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:48.968315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:49.081495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2396/4791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:49.089647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.090616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.091256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.100452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bad2d-c0da-4808-8437-a621c0318f93 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.106504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.107217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.107507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.107840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] PATH_INFO: `/v3/users/d71a326dc48b46ea845c39b2ce900de4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.109994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71a326dc48b46ea845c39b2ce900de4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.111982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.138433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:49.140604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:49.141919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:49.159115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2397/4792] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:49.163908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.180404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a2f0b-ff69-4554-95a7-a2b0b7047b56 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.182845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71a326dc48b46ea845c39b2ce900de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.188012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.189158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.189815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.190537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.191369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:45:49.192022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.194991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.205345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71a326dc48b46ea845c39b2ce900de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.206196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71a326dc48b46ea845c39b2ce900de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.225684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71a326dc48b46ea845c39b2ce900de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.225880 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2398/4793] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:45:49.225976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71a326dc48b46ea845c39b2ce900de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.228431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.233757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:49.267317 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2396/4794] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:45:48 2022] DELETE /identity/v3/users/d71a326dc48b46ea845c39b2ce900de4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:49.271777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b4eb7-55b6-496b-a044-fcc399271f7f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.395880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.396652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.396983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.397381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.398085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.401139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.455166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2399/4795] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:49 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:49.460298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.489024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeab436-65d1-47d4-9db9-88d892936729 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.683721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.685925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.686456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.686998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.688198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.694717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.752820 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2397/4796] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:49 2022] POST /identity/v3/users => generated 295 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:49.757012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.770180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c17624-c3bd-4350-abca-b7fc7123ea99 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.778803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.779537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.784306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.784306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.784684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.786236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.810228 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2400/4797] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:45:49.814971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.828513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd63fc4-d029-49dd-bcc2-d65f86ec5696 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.838783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.840125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.840882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:49.841227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.841718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.842322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.844003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.845885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.860462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b94046-27b2-42d3-8d7d-b6b571ff889f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.866160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.867585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.868158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.868535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] PATH_INFO: `/v3/projects/96fb9dc9457441f2b80c0868b399be32` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.870507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fb9dc9457441f2b80c0868b399be32)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.872961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.899165 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2398/4798] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:49.905952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:49.925607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:49.928236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95abf7-cda6-4229-acb5-5ce4d3d44fad admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:49.939655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934eff-989e-4f64-a8a7-0982f6f41df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:49.940326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934eff-989e-4f64-a8a7-0982f6f41df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:49.940657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934eff-989e-4f64-a8a7-0982f6f41df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:49.940949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934eff-989e-4f64-a8a7-0982f6f41df6 admin admin] PATH_INFO: `/v3/projects/534df890fde640cc913ecd53e83540bc/users/9e8f069e9e2a48549d02a1505b648a88/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:49.972745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fb9dc9457441f2b80c0868b399be32', 'request_id': 'req-f0a39e83-e194-462a-9839-9939556be0c5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.973163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25934eff-989e-4f64-a8a7-0982f6f41df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534df890fde640cc913ecd53e83540bc, user_id=9e8f069e9e2a48549d02a1505b648a88, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:49.976150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25934eff-989e-4f64-a8a7-0982f6f41df6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:49.984770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fb9dc9457441f2b80c0868b399be32', 'request_id': 'req-f0a39e83-e194-462a-9839-9939556be0c5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.994479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fb9dc9457441f2b80c0868b399be32', 'request_id': 'req-f0a39e83-e194-462a-9839-9939556be0c5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:49.996094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2399/4799] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:49 2022] PUT /identity/v3/projects/534df890fde640cc913ecd53e83540bc/users/9e8f069e9e2a48549d02a1505b648a88/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:50.001839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc8fd-4ccc-4fe9-a939-42c26f75dbc5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.002279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc8fd-4ccc-4fe9-a939-42c26f75dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.002832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1cc8fd-4ccc-4fe9-a939-42c26f75dbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.010449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] The token cache is being invalidate because project 96fb9dc9457441f2b80c0868b399be32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:45:50.011238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:50.012182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0a39e83-e194-462a-9839-9939556be0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:45:50.014751 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2401/4800] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:45:49 2022] DELETE /identity/v3/projects/96fb9dc9457441f2b80c0868b399be32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:50.019743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.020152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.021422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.044031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0e1cc8fd-4ccc-4fe9-a939-42c26f75dbc5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:50.048349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0e1cc8fd-4ccc-4fe9-a939-42c26f75dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:50.052023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:50.054435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:50.132503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:50.188779 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2402/4801] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:50.197001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2400/4802] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:45:50.198323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.198613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.198890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.201058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.202818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:50.231621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:50.233540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:50.244535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2401/4803] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:50.250824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.265744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48621-bf24-46ff-954c-34594588e1dc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.272223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.272955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.273399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.273804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.274645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:45:50.275305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.277328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:50.295544 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2402/4804] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:45:50.300240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.317152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455cc10-aea8-4bcb-807b-33fb1574c1da admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.324679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.325344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.325590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.325916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.328931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.337697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:50.376478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80a64a-08ae-4138-8753-84925a82f672 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.388547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.389524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.389832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.390118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.397371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2403/4805] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:50 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:50.403278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.407899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.410075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:50.446570 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2403/4806] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:50.638706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d9ee-64dd-4226-be16-379a76a67638 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.661741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.662731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.663212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.663677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.664745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.670165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:50.742562 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2404/4807] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:50 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:50.749592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.768605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160e45-0979-4f83-a249-c55b86a8adc9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.790914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.791943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.792274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.792613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.793980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.797826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:50.824535 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2404/4808] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:50.827578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.853306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1470ea-e80c-47eb-9b5e-70849feccf33 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.867634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b40e3-3e9b-48c9-a348-019e26b45cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.870743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b40e3-3e9b-48c9-a348-019e26b45cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.871293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b40e3-3e9b-48c9-a348-019e26b45cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.871722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b40e3-3e9b-48c9-a348-019e26b45cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.872784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b40e3-3e9b-48c9-a348-019e26b45cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.880127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b40e3-3e9b-48c9-a348-019e26b45cc4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:50.906797 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2405/4809] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:50.912441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:50.928188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131118f-96bb-4c45-84dc-388f05751937 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:50.943572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:50.945437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:50.947272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:50.948853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] PATH_INFO: `/v3/projects/c2198bbb35944e31bf3793ff09f73dc0/users/7c445d9f397b4860abc064d713404185/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:50.990310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2198bbb35944e31bf3793ff09f73dc0, user_id=7c445d9f397b4860abc064d713404185, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:50.994919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:51.040079 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2405/4810] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:50 2022] PUT /identity/v3/projects/c2198bbb35944e31bf3793ff09f73dc0/users/7c445d9f397b4860abc064d713404185/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:51.053482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:51.053814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:51.054050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:51.110054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] MFA Rules not processed for user `7c445d9f397b4860abc064d713404185`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:51.111368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:51.300832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2406/4811] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:51.305546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:51.340433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:51.416094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fcead-2b3a-4a33-ab4c-03cf4f2a1270 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:51.422973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:51.423739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:51.424088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:51.424586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:51.425390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:51.427617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:51.497323 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2406/4812] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:51 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:51.501885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:51.521866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e8907-6458-4311-a34d-7f2e6669b75a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:51.552826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:51.698931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:51.699916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:51.700616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:51.701219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:51.703216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:51.707634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:51.745989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2407/4813] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:51 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:51.746859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:51.766524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68440b-f9da-45ad-a656-ff33bc01312c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:51.782536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:51.783438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:51.783946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:51.784419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:51.785369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:51.787401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:51.839012 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2407/4814] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:51.840349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:51.866148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b720f1-e3ad-4c3f-a7e9-b4012cdbd385 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:51.876144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c243c7c-f833-4b31-9560-70aad80e1669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:51.877567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c243c7c-f833-4b31-9560-70aad80e1669 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:51.878010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c243c7c-f833-4b31-9560-70aad80e1669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:51.878827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c243c7c-f833-4b31-9560-70aad80e1669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:51.879947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c243c7c-f833-4b31-9560-70aad80e1669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:51.882883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c243c7c-f833-4b31-9560-70aad80e1669 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:51.909456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:51.910552 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2408/4815] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:45:51.933533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29004d-6e29-4b21-9cd2-37c02294c170 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:51.952875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:51.953600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:51.953880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:51.954175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] PATH_INFO: `/v3/projects/f81cfd9f86744ef4b378e6e0e3e91652/users/a8d6767ec81e44ba861cc3f08ece459b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:51.985996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81cfd9f86744ef4b378e6e0e3e91652, user_id=a8d6767ec81e44ba861cc3f08ece459b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:51.989275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:52.012966 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2408/4816] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:51 2022] PUT /identity/v3/projects/f81cfd9f86744ef4b378e6e0e3e91652/users/a8d6767ec81e44ba861cc3f08ece459b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:52.034305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:52.036630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:52.039104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:52.149635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] MFA Rules not processed for user `a8d6767ec81e44ba861cc3f08ece459b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:52.151881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:52.265670 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2409/4817] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:52.270290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:52.401468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a53c-5413-4547-8a4b-440e77d69945 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:52.417182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:52.419100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:52.419495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:52.421909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:52.425938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:52.429451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:52.502282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2409/4818] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:45:52 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:52.506375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:52.536995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f7e24-18ef-4573-9e7c-366dc0410014 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:52.726907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:52.728292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:52.728738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:52.730146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:52.731520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:52.735031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:52.799017 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2410/4819] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:45:52 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:45:52.803111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:52.821979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255915b8-6321-4357-b5f9-fd97f858320b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:52.827663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:52.828356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:52.828639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:52.828940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:52.829590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:52.831389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:52.864788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2410/4820] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:52.866137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:52.878819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d8de3-51a1-4982-93b3-bbf6adf626ab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:52.884582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:52.885389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:52.885748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:52.886103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] PATH_INFO: `/v3/projects/6407ea8a03634300810684304aa881ee/users/dd15b6e9393f4efa9a47c69af19489da/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:52.940061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:52.944484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6407ea8a03634300810684304aa881ee, user_id=dd15b6e9393f4efa9a47c69af19489da, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:52.960862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:52.989262 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2411/4821] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:52 2022] PUT /identity/v3/projects/6407ea8a03634300810684304aa881ee/users/dd15b6e9393f4efa9a47c69af19489da/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:45:52.995480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:53.009406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624a2fa-d447-4cf4-84e0-3b87ba916192 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:53.114347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:45:53.143952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab53bd-1ca5-49bd-86a2-69a3889a8f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:53.144997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab53bd-1ca5-49bd-86a2-69a3889a8f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:53.145291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab53bd-1ca5-49bd-86a2-69a3889a8f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:53.145571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab53bd-1ca5-49bd-86a2-69a3889a8f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:53.146348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab53bd-1ca5-49bd-86a2-69a3889a8f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:53.148052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab53bd-1ca5-49bd-86a2-69a3889a8f9d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:53.163463 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2411/4822] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:45:53.164130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:53.179518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdd9ad-6098-43c6-8b45-69554695545d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:53.191756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:53.193689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:53.194310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:53.194771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] PATH_INFO: `/v3/projects/6407ea8a03634300810684304aa881ee/users/dd15b6e9393f4efa9a47c69af19489da/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:53.197736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6407ea8a03634300810684304aa881ee, user_id=dd15b6e9393f4efa9a47c69af19489da, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:53.202417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:53.229388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2412/4823] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:45:53 2022] PUT /identity/v3/projects/6407ea8a03634300810684304aa881ee/users/dd15b6e9393f4efa9a47c69af19489da/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:45:53.241767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87379-8784-4bdb-a185-ea6bd5a63867 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:53.242375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87379-8784-4bdb-a185-ea6bd5a63867 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:53.243170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad87379-8784-4bdb-a185-ea6bd5a63867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:53.279201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bad87379-8784-4bdb-a185-ea6bd5a63867 None None] MFA Rules not processed for user `dd15b6e9393f4efa9a47c69af19489da`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:53.296313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bad87379-8784-4bdb-a185-ea6bd5a63867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:53.424179 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2412/4824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:53.438083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:53.439999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:53.603747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e9a37-3e85-409c-a37e-b491fac7e760 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:53.607504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:53.608283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:53.608573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:53.608842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:53.619922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:53.621815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:53.636018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2413/4825] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:53.783449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf698-10c6-4b2a-8ab6-3acb9e8aaaa4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:53.783737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf698-10c6-4b2a-8ab6-3acb9e8aaaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:53.784019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedf698-10c6-4b2a-8ab6-3acb9e8aaaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:53.817950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8aedf698-10c6-4b2a-8ab6-3acb9e8aaaa4 None None] MFA Rules not processed for user `c14d2fac851e4bbaaa760b5c3406a335`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:53.819497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8aedf698-10c6-4b2a-8ab6-3acb9e8aaaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:53.959873 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2413/4826] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:54.694933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:54.697074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:54.716000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f664-f7ef-45af-9391-6a92e17aa45e service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:54.723734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:54.724415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:54.724956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:54.725265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:54.901853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:54.903552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:54.916020 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2414/4827] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:45:58.081861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07835-3622-451e-8ce7-1b01b6f2f15b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:58.082480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07835-3622-451e-8ce7-1b01b6f2f15b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:58.082480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb07835-3622-451e-8ce7-1b01b6f2f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:58.120691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4cb07835-3622-451e-8ce7-1b01b6f2f15b None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:45:58.121994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4cb07835-3622-451e-8ce7-1b01b6f2f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:58.228814 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2414/4828] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:45:58.883146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:45:58.896200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0f94f-c4cd-4361-9519-e438440ef46d service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:45:58.920926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:45:58.920926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:45:58.920926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:45:58.920926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:45:58.921387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:45:59.061834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:45:59.063558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:45:59.079730 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2415/4829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:45:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:02.730425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:02.731566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:02.732013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:02.844992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] MFA Rules not processed for user `9e8f069e9e2a48549d02a1505b648a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:02.852000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:02.870235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:03.156955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2415/4830] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:03.160162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:03.161911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:03.234752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:03.354441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210b246-b8c4-44cd-b080-44cdedb3a302 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:03.368127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:03.368818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:03.372575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:03.373614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:03.376520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:03.387347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:03.452505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2416/4831] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:46:03 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:46:03.457421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:03.493375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470a326-d996-4b5c-be1f-2090047d7bcd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:03.699233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:03.699777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:03.700066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:03.700343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:03.701018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:03.706474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:03.748329 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2416/4832] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:46:03 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:46:03.749890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:03.779441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2274e-fac7-4a37-812d-330b394da809 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:03.809248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:03.811439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:03.811733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:03.812050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:03.813563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:03.819048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:03.848434 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2417/4833] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:46:03.852965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:03.867028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a1348-a8e3-4b56-b993-c17fe90307f4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:03.878291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:03.879228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:03.879662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:03.880118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] PATH_INFO: `/v3/projects/767e0b2cdbec480c99dd45925d537536/users/92d3c125819b41039f16db48a58e8a3c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:03.900478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=767e0b2cdbec480c99dd45925d537536, user_id=92d3c125819b41039f16db48a58e8a3c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:03.913033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:03.947205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2417/4834] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:46:03 2022] PUT /identity/v3/projects/767e0b2cdbec480c99dd45925d537536/users/92d3c125819b41039f16db48a58e8a3c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:03.953371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:03.971438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99799-6f94-47c4-bcdf-6ceeea6a2a0f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:04.081338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:04.083047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:04.083475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:04.083956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:04.084829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:04.086637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:04.104821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2418/4835] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:46:04.114235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:04.139736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a901fc8-eb9c-46d8-809c-15916135c4fd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:04.162997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:04.165235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:04.167105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:04.167702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] PATH_INFO: `/v3/projects/767e0b2cdbec480c99dd45925d537536/users/92d3c125819b41039f16db48a58e8a3c/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:04.174073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=767e0b2cdbec480c99dd45925d537536, user_id=92d3c125819b41039f16db48a58e8a3c, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:04.183574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:04.198763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2418/4836] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:46:04 2022] PUT /identity/v3/projects/767e0b2cdbec480c99dd45925d537536/users/92d3c125819b41039f16db48a58e8a3c/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:05.524101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:05.709558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b3203-8b6f-4361-8540-4dd29e6108f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:05.823465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:05.848680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39737760-1590-432a-9ba8-07dd973e8b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:05.849722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39737760-1590-432a-9ba8-07dd973e8b2c service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:05.860969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39737760-1590-432a-9ba8-07dd973e8b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:05.863625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39737760-1590-432a-9ba8-07dd973e8b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:06.030666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39737760-1590-432a-9ba8-07dd973e8b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:06.032344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39737760-1590-432a-9ba8-07dd973e8b2c service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:06.047189 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2419/4837] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:11.739327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:11.815824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:11.820447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a747832-8188-4fac-a640-549faee1cdcc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:11.842774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:11.844936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:11.845273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:11.845551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] PATH_INFO: `/v3/users/7c445d9f397b4860abc064d713404185` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:11.847223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c445d9f397b4860abc064d713404185)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:11.851720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:11.961126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c445d9f397b4860abc064d713404185'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:11.993480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c445d9f397b4860abc064d713404185'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:11.994525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c445d9f397b4860abc064d713404185'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:12.009371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c445d9f397b4860abc064d713404185'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:12.010568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c445d9f397b4860abc064d713404185'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:12.032422 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2419/4838] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:46:11 2022] DELETE /identity/v3/users/7c445d9f397b4860abc064d713404185 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:12.037524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:12.039482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:12.040502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:12.086576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:12.088640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:12.244066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2420/4839] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:12.255926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:12.257683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:12.468741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeee5-8583-4da9-8bdd-d07d02cffc6e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:12.478271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:12.480164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:12.480455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:12.480946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:12.505236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:12.506673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:12.518721 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2420/4840] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:14.303495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:14.305080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:14.328699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c627d-56a8-4627-9252-1e47aa4c64a8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:14.343283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:14.344016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:14.344299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:14.344581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] PATH_INFO: `/v3/projects/c2198bbb35944e31bf3793ff09f73dc0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:14.358115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2198bbb35944e31bf3793ff09f73dc0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:14.360561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:14.446365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2198bbb35944e31bf3793ff09f73dc0', 'request_id': 'req-23b2a5ff-d032-44d2-85df-473dabfe782b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.455760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2198bbb35944e31bf3793ff09f73dc0', 'request_id': 'req-23b2a5ff-d032-44d2-85df-473dabfe782b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.464865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2198bbb35944e31bf3793ff09f73dc0', 'request_id': 'req-23b2a5ff-d032-44d2-85df-473dabfe782b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.495484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] The token cache is being invalidate because project c2198bbb35944e31bf3793ff09f73dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:46:14.495779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.499781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23b2a5ff-d032-44d2-85df-473dabfe782b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.506625 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2421/4841] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:46:14 2022] DELETE /identity/v3/projects/c2198bbb35944e31bf3793ff09f73dc0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:14.507950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:14.525671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306cae0-e888-4e40-b31c-860939049c21 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:14.699192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:14.701344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:14.702090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:14.702688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] PATH_INFO: `/v3/users/a8d6767ec81e44ba861cc3f08ece459b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:14.704211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d6767ec81e44ba861cc3f08ece459b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:14.707332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:14.777793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:14.808951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:14.809341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:14.809559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:14.830771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d6767ec81e44ba861cc3f08ece459b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.853573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d6767ec81e44ba861cc3f08ece459b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.854392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d6767ec81e44ba861cc3f08ece459b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.870685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d6767ec81e44ba861cc3f08ece459b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.871766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d6767ec81e44ba861cc3f08ece459b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:14.893648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] MFA Rules not processed for user `4c2aedcc40d84bb6a287c2bac019ed4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:14.894888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:14.898370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2421/4842] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:46:14 2022] DELETE /identity/v3/users/a8d6767ec81e44ba861cc3f08ece459b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:46:14.916369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:14.978938 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2422/4843] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:15.753643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:15.761466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:15.952230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c32b-5250-4052-9b3f-09f9fab7bef3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:15.958314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:15.959103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:15.959757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:15.960129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] PATH_INFO: `/v3/projects/f81cfd9f86744ef4b378e6e0e3e91652` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:15.961517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81cfd9f86744ef4b378e6e0e3e91652)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:15.963979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:16.087292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81cfd9f86744ef4b378e6e0e3e91652', 'request_id': 'req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.101070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81cfd9f86744ef4b378e6e0e3e91652', 'request_id': 'req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.111430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81cfd9f86744ef4b378e6e0e3e91652', 'request_id': 'req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.139636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] The token cache is being invalidate because project f81cfd9f86744ef4b378e6e0e3e91652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:46:16.139887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.142698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4c4a359f-17e5-4ff4-8b89-d6bf2a8b9854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.144547 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2422/4844] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:46:15 2022] DELETE /identity/v3/projects/f81cfd9f86744ef4b378e6e0e3e91652 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:16.148768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:16.170304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16f10-485b-4aae-94be-c26dbf6ef370 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:16.267787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:16.270535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:16.270896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:16.271188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] PATH_INFO: `/v3/users/dd15b6e9393f4efa9a47c69af19489da` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:16.273723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd15b6e9393f4efa9a47c69af19489da)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:16.275874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:16.354611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd15b6e9393f4efa9a47c69af19489da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.411684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd15b6e9393f4efa9a47c69af19489da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.412979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd15b6e9393f4efa9a47c69af19489da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.431617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd15b6e9393f4efa9a47c69af19489da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.432417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd15b6e9393f4efa9a47c69af19489da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:16.465882 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2423/4845] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:46:16 2022] DELETE /identity/v3/users/dd15b6e9393f4efa9a47c69af19489da => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:17.200055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:17.200535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:17.200821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:17.252317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] MFA Rules not processed for user `92d3c125819b41039f16db48a58e8a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:17.253663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:17.276064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:17.379729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2423/4846] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:17.387007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:17.388738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:17.529653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:17.544301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2e70a-80d7-4fbc-89b0-e42a9648ec4c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:17.557720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:17.559178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:17.559668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:17.560262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:17.565737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:17.700649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:17.706866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ff97b-3ef2-4810-aaa1-6fd20125d859 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:17.735914 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2424/4847] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:17.747920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:17.749528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:17.907355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266846f-dac7-4ae5-b28e-ac84f754c390 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:17.918994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:17.920175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:17.920859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:17.921353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] PATH_INFO: `/v3/projects/6407ea8a03634300810684304aa881ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:17.924531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6407ea8a03634300810684304aa881ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:17.926495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:18.010108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6407ea8a03634300810684304aa881ee', 'request_id': 'req-f958f398-e268-45b2-afb6-5f02ce7d64fe'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:18.020418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6407ea8a03634300810684304aa881ee', 'request_id': 'req-f958f398-e268-45b2-afb6-5f02ce7d64fe'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:18.032344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6407ea8a03634300810684304aa881ee', 'request_id': 'req-f958f398-e268-45b2-afb6-5f02ce7d64fe'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:18.065511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] The token cache is being invalidate because project 6407ea8a03634300810684304aa881ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:46:18.066279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:18.066496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f958f398-e268-45b2-afb6-5f02ce7d64fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:18.068280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2424/4848] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:46:17 2022] DELETE /identity/v3/projects/6407ea8a03634300810684304aa881ee => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:18.077542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.078256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.078696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.119376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:18.120727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:18.264230 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2425/4849] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:18.272885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.272885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.273645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.328402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:18.331639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:18.358264 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2425/4850] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:18.362751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:18.378073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9c387-caea-449b-813d-accbcbaf8149 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:18.393108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:18.393771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.394244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.394671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.395572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:46:18.396034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:18.398079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:18.426066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2426/4851] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:46:18.430661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:18.442245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f02f-fca2-47ae-9713-ad2575f9db4e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:18.469029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:18.469932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.470407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.470830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.475818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:18.485650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:18.562865 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2426/4852] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:46:18 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:46:18.568742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:18.598975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c8f39-ce93-40fd-a900-779aba019f5a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:18.726549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:18.727858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.728293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.728714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.729613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:18.733876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:18.780398 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2427/4853] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:46:18 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:46:18.781874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:18.797086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8b566-83c9-417e-9884-8e0daf6f5817 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:18.816130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:18.817020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.817542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.818031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.818921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:18.821457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:18.849000 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2427/4854] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:46:18.850824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:18.867269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17db8-1861-4747-a7f9-fd4549d4e91c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:18.885638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d3bf1-e544-44f3-bea9-f2d110c1f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:18.886271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3bf1-e544-44f3-bea9-f2d110c1f904 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.886559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3bf1-e544-44f3-bea9-f2d110c1f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.889326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3bf1-e544-44f3-bea9-f2d110c1f904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:18.890044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d3bf1-e544-44f3-bea9-f2d110c1f904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:18.898076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d3bf1-e544-44f3-bea9-f2d110c1f904 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:18.930156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2428/4855] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:46:18.934107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:18.941728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:18.948640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d361-e13c-4777-bba6-984b44fc0bab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:18.966279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:18.968968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:18.969519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:18.970047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] PATH_INFO: `/v3/projects/069b603901554b669ad402c5bc2afbc8/users/2f3d69e3be1b4cc480a5ee7e2f6902e9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:19.005448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069b603901554b669ad402c5bc2afbc8, user_id=2f3d69e3be1b4cc480a5ee7e2f6902e9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:19.010033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:19.037918 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2428/4856] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:46:18 2022] PUT /identity/v3/projects/069b603901554b669ad402c5bc2afbc8/users/2f3d69e3be1b4cc480a5ee7e2f6902e9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:19.050229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:19.050516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:19.050797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:19.073502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:19.104484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] MFA Rules not processed for user `2f3d69e3be1b4cc480a5ee7e2f6902e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:19.106016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:19.270497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2429/4857] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:19.286306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:19.288347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:19.369839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694d95-f96f-4c0e-a92c-55fb834786b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:19.375395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b5aa9-136a-4c0e-80ad-5db2525a0739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:19.376407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5aa9-136a-4c0e-80ad-5db2525a0739 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:19.376840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5aa9-136a-4c0e-80ad-5db2525a0739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:19.377312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b5aa9-136a-4c0e-80ad-5db2525a0739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:19.393909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b5aa9-136a-4c0e-80ad-5db2525a0739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:19.397182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b5aa9-136a-4c0e-80ad-5db2525a0739 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:19.424923 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2429/4858] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:19.492289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:19.599595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3dd7-c58e-4895-8137-fbaadac2445c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:19.624082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:19.625157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:19.625521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:19.627531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] PATH_INFO: `/v3/users/2f3d69e3be1b4cc480a5ee7e2f6902e9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:19.628823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3d69e3be1b4cc480a5ee7e2f6902e9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:19.631705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:19.762046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3d69e3be1b4cc480a5ee7e2f6902e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:19.801398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3d69e3be1b4cc480a5ee7e2f6902e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:19.804065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3d69e3be1b4cc480a5ee7e2f6902e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:19.828163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3d69e3be1b4cc480a5ee7e2f6902e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:19.829305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3d69e3be1b4cc480a5ee7e2f6902e9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:19.849809 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2430/4859] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:46:19 2022] DELETE /identity/v3/users/2f3d69e3be1b4cc480a5ee7e2f6902e9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:19.855253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:19.855545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:19.856509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:19.893096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:19.894796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:20.066794 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2430/4860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:20.079749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:20.081525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:20.140624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:20.246608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7862f4a-bde2-40b7-8db5-3e7b2f7e0fa0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:20.252843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:20.253935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:20.254213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:20.254537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:20.282078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:20.283562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:20.318647 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2431/4861] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:20.542414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:20.544837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:20.579713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be7139-7f54-4a63-b9f2-1c5b0040a343 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:20.589291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:20.593472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:20.593765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:20.594523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:20.599287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:20.616825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:20.620430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:20.641358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2431/4862] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:22.210528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:22.212131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:22.410666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bdc7a-b005-47a8-ba37-795409361970 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:22.417581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:22.418226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:22.418513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:22.418792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:22.420761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:22.594084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:22.596959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdeb42-d989-47d3-bc3d-52d5088dd17d service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:22.622087 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2432/4863] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:22.723044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:22.724675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:22.776599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a772b2e-52a8-473d-8004-e90a49c4d744 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:22.792058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:22.792921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:22.793360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:22.793820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] PATH_INFO: `/v3/projects/069b603901554b669ad402c5bc2afbc8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:22.798811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069b603901554b669ad402c5bc2afbc8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:22.814505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:22.984299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069b603901554b669ad402c5bc2afbc8', 'request_id': 'req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:23.010608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069b603901554b669ad402c5bc2afbc8', 'request_id': 'req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:23.027513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069b603901554b669ad402c5bc2afbc8', 'request_id': 'req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:23.028775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:23.063274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] The token cache is being invalidate because project 069b603901554b669ad402c5bc2afbc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:46:23.063582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:23.066462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77bf6efb-f856-4ab9-88dc-8ece09b92ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:23.092970 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2432/4864] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:46:22 2022] DELETE /identity/v3/projects/069b603901554b669ad402c5bc2afbc8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:26.244167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea0cd-2ac8-4af0-80f2-e9b8f30392e9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:26.244699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea0cd-2ac8-4af0-80f2-e9b8f30392e9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:26.245073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ea0cd-2ac8-4af0-80f2-e9b8f30392e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:26.274238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fa8ea0cd-2ac8-4af0-80f2-e9b8f30392e9 None None] MFA Rules not processed for user `27a14e4e71454d18946512dedba312a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:26.275865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fa8ea0cd-2ac8-4af0-80f2-e9b8f30392e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:26.368350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:26.399108 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2433/4865] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:26.571873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:26.572753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:26.573632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:26.616739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] MFA Rules not processed for user `728544ca5e164540b3c5395534542955`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:26.619982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:26.792224 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2433/4866] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:36.768349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=28 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:38.415728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:38.416244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:38.416343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:38.494046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:38.526300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:38.746233 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2434/4867] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:48.732740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=25 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:48.799119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:48.801382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:48.888768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b680700-8661-42be-9f64-9212b6ba03e4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:48.893643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:48.895181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:48.895835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:48.896336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:48.898288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:49.006240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:49.007692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:49.035389 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2434/4868] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:49.848228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:49.879100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bec115-d508-4428-b07e-aff9f8263fae None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:49.889619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:49.890446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:49.891714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:49.892245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:49.895054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:49.920832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:49.928125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e72a30-e2e1-444f-8ca5-830ca7256e14 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:49.960659 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2435/4869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:53.194027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:53.196175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:53.284690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c945f8-327d-4701-8d88-7f5ca4203fb9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:53.290433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:53.291344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:53.292445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:53.293120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] PATH_INFO: `/v3/users/6eebd7f64d4048d2ba471aac4298fc51` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:53.294982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eebd7f64d4048d2ba471aac4298fc51)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:53.297623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:53.387396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:53.391613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eebd7f64d4048d2ba471aac4298fc51'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:53.411189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eebd7f64d4048d2ba471aac4298fc51'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:53.412893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eebd7f64d4048d2ba471aac4298fc51'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:53.422893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eebd7f64d4048d2ba471aac4298fc51'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:53.423899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eebd7f64d4048d2ba471aac4298fc51'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:53.440072 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2435/4870] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:46:53 2022] DELETE /identity/v3/users/6eebd7f64d4048d2ba471aac4298fc51 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:53.444783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:53.445295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:53.445390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:53.468321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:53.470071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:53.556312 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2436/4871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:53.569767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:53.572849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:53.681959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13249ed-5e06-4066-9879-51af39c27bb9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:53.686071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ed108-b2e5-4dcb-987d-9153841a3aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:53.686733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed108-b2e5-4dcb-987d-9153841a3aaa service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:53.687019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed108-b2e5-4dcb-987d-9153841a3aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:53.687433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ed108-b2e5-4dcb-987d-9153841a3aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:53.697841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed108-b2e5-4dcb-987d-9153841a3aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:53.699384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ed108-b2e5-4dcb-987d-9153841a3aaa service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:53.718733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2436/4872] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:46:54.098437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.100375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:54.113766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e43e-b69e-485b-b9a4-f7ae7bf99444 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.119124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.120088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.120475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.120858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] PATH_INFO: `/v3/projects/6b32de5befbf4d7e8e19089f903418e8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.122869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b32de5befbf4d7e8e19089f903418e8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.125200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.182355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b32de5befbf4d7e8e19089f903418e8', 'request_id': 'req-d32422c8-5fb0-496a-97db-efbd7eb50260'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:54.188507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b32de5befbf4d7e8e19089f903418e8', 'request_id': 'req-d32422c8-5fb0-496a-97db-efbd7eb50260'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:54.195387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b32de5befbf4d7e8e19089f903418e8', 'request_id': 'req-d32422c8-5fb0-496a-97db-efbd7eb50260'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:54.210801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] The token cache is being invalidate because project 6b32de5befbf4d7e8e19089f903418e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:46:54.211108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:54.212062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d32422c8-5fb0-496a-97db-efbd7eb50260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:46:54.213974 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2437/4873] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:46:54 2022] DELETE /identity/v3/projects/6b32de5befbf4d7e8e19089f903418e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:54.219063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.219523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.219723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.240105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:54.241511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:54.312205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2437/4874] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:46:54.321160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.321452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.321706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.347244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:54.348485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:54.361374 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2438/4875] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:46:54.365288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.386675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665e4d2-4740-4a0f-abc6-4219b5621bf6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.395429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.396146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.396428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.396779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.397540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:46:54.397852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.399766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.425467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2438/4876] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:46:54.426441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.438993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32830c5-8cc7-438c-89aa-af64583041ad None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.448085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.451148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.451667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.452014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.452697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.454648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.505860 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2439/4877] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:46:54 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:46:54.507452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.519728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264555-cf72-45bc-be1e-47d07aa3c386 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.585250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:54.599456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.602959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.604607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.604951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.605758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.607911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.644595 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2439/4878] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:46:54 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:46:54.647327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.676763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6799-b04a-467a-8a20-5e6a660e9160 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.682199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.683059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.683192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.683358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.683999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.685679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.702758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.713879 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2440/4879] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:46:54.716628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c5264-22d8-4053-8f1c-742a7cfb30d2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.723039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990712de-8a2d-45ba-9bcb-cea1992c5998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.724321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990712de-8a2d-45ba-9bcb-cea1992c5998 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.724321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990712de-8a2d-45ba-9bcb-cea1992c5998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.724631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990712de-8a2d-45ba-9bcb-cea1992c5998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.725270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990712de-8a2d-45ba-9bcb-cea1992c5998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.727822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990712de-8a2d-45ba-9bcb-cea1992c5998 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.745460 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2440/4880] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:46:54.747102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.765708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ebc21-515e-4ba3-93b4-e7d5a6547330 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:54.775204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:54.775882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.776158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.776440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] PATH_INFO: `/v3/projects/bae476fec82e4716ad3b198154815ed1/users/4badccbd2290473b93ba122a4d9a5196/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.795123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae476fec82e4716ad3b198154815ed1, user_id=4badccbd2290473b93ba122a4d9a5196, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:54.797821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:54.815792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2441/4881] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:46:54 2022] PUT /identity/v3/projects/bae476fec82e4716ad3b198154815ed1/users/4badccbd2290473b93ba122a4d9a5196/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:46:54.827440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165094-8c14-4e3e-ac39-155d5371cabc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:54.827613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165094-8c14-4e3e-ac39-155d5371cabc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:54.827879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165094-8c14-4e3e-ac39-155d5371cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:54.863627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-be165094-8c14-4e3e-ac39-155d5371cabc None None] MFA Rules not processed for user `4badccbd2290473b93ba122a4d9a5196`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:46:54.865577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-be165094-8c14-4e3e-ac39-155d5371cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:54.939868 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2441/4882] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:46:54.971235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:46:54.974784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:46:54.992714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:46:55.065498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e4e34-3de1-4150-acc6-ee34c625f0aa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:46:55.070828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd6639-4df3-4db2-b965-1e42bafb87f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:46:55.071458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd6639-4df3-4db2-b965-1e42bafb87f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:46:55.071770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd6639-4df3-4db2-b965-1e42bafb87f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:46:55.072020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd6639-4df3-4db2-b965-1e42bafb87f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:46:55.083128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd6639-4df3-4db2-b965-1e42bafb87f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:46:55.084610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd6639-4df3-4db2-b965-1e42bafb87f5 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:46:55.097704 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2442/4883] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:46:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:04.595329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:04.596192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:04.596645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:04.619100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] MFA Rules not processed for user `9e8f069e9e2a48549d02a1505b648a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:04.620568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:04.702889 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2442/4884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:04.784756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:04.785347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:04.785347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:04.805755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] MFA Rules not processed for user `9e8f069e9e2a48549d02a1505b648a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:04.806973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:04.815439 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2443/4885] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:08.272091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:08.275569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:08.431523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06266ca3-1c7a-4ea9-a81b-fb18eab1fe27 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:08.437538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:08.438309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:08.438604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:08.438881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] PATH_INFO: `/v3/users/c14d2fac851e4bbaaa760b5c3406a335` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:08.440131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14d2fac851e4bbaaa760b5c3406a335)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:08.442117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:08.451205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:08.531372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14d2fac851e4bbaaa760b5c3406a335'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:08.561189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14d2fac851e4bbaaa760b5c3406a335'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:08.562215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14d2fac851e4bbaaa760b5c3406a335'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:08.574160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14d2fac851e4bbaaa760b5c3406a335'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:08.576021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d723b474-56d1-46f9-8a3a-2d7370a643ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14d2fac851e4bbaaa760b5c3406a335'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:08.594396 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2443/4886] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:47:08 2022] DELETE /identity/v3/users/c14d2fac851e4bbaaa760b5c3406a335 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:09.040038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.055686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a015a-0668-45a8-83b5-ac473fbc7143 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.151527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.152409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.152765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.154002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] PATH_INFO: `/v3/projects/1ae15e13c1ae4b2db5de94fbd428867d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.155400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae15e13c1ae4b2db5de94fbd428867d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.157494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.222927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae15e13c1ae4b2db5de94fbd428867d', 'request_id': 'req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:09.232119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae15e13c1ae4b2db5de94fbd428867d', 'request_id': 'req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:09.241328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae15e13c1ae4b2db5de94fbd428867d', 'request_id': 'req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:09.261527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] The token cache is being invalidate because project 1ae15e13c1ae4b2db5de94fbd428867d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:47:09.262287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:09.265053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-478df0e3-2bd1-4ed9-a6d4-b13a96a4269e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:09.268464 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2444/4887] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:47:09 2022] DELETE /identity/v3/projects/1ae15e13c1ae4b2db5de94fbd428867d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:09.273371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.274254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.274695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.301521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:09.303099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:09.397095 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2444/4888] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:09.400337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.400631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.400928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.424181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:09.425444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:09.433943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2445/4889] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:09.438617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.449192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb306e-cc58-4ee3-bbff-945480cf52ad None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.456858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.457917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.458374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.458792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.459820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:47:09.460344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.462193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.476136 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2445/4890] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:47:09.480564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.491041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc874da-24d2-4a07-af91-7daa15b549df None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.496978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.497829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.498282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.498724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.499541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.501835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.531512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:09.554458 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2446/4891] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:47:09 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:47:09.555415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.567045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab73389-d698-4b8d-8c05-2d0c32b486b8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.694247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.694883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.695170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.696166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.696779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.700968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.724956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:09.746169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2446/4892] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:47:09 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:47:09.747012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.766917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c057be9-3670-4d12-96da-f4bc998c6e18 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.773377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.774085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.774364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.774982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.775909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.779892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.806300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2447/4893] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:47:09.810757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.824260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2aaeab-4466-4013-99be-d6e5e8f191f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.832548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d84463-be8d-4458-8b02-8c722d6102aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.833561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84463-be8d-4458-8b02-8c722d6102aa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.834147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84463-be8d-4458-8b02-8c722d6102aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.834607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84463-be8d-4458-8b02-8c722d6102aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.835262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84463-be8d-4458-8b02-8c722d6102aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.845254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84463-be8d-4458-8b02-8c722d6102aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.858917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2447/4894] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:47:09.863345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:09.876541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e4447-963c-4cf7-8d80-702fbf2f2c23 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:09.882395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:09.883251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.883836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.884124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] PATH_INFO: `/v3/projects/630c364945fd482aabf658b63a514f84/users/45e78ecac3ef4fc1b40178d58817ee7f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.911879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] RBAC: Authorizing `identity:create_grant(project_id=630c364945fd482aabf658b63a514f84, user_id=45e78ecac3ef4fc1b40178d58817ee7f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:09.915606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:09.932132 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2448/4895] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:47:09 2022] PUT /identity/v3/projects/630c364945fd482aabf658b63a514f84/users/45e78ecac3ef4fc1b40178d58817ee7f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:09.944623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:09.945190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:09.945703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:09.984592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] MFA Rules not processed for user `45e78ecac3ef4fc1b40178d58817ee7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:09.986178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:10.095513 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2448/4896] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:10.270250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:10.273110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:10.367409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6a16b-1e62-423d-a6b9-52a0d195569d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:10.379669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:10.382089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:10.383104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:10.383492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:10.394121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:10.395832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:10.410067 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2449/4897] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:10.488575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:10.491078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:10.585645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83529d78-cd4b-489e-a861-0365326933c3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:10.590068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:10.590879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:10.591378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:10.591656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:10.594175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:10.614276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:10.629181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138ac0c-554d-47de-be08-1c2079044e72 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:10.633842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2449/4898] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:12.323167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:12.424255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e62d8-2bd7-43e6-ba0a-b396c93edbe3 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:12.429269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:12.430215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:12.430718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:12.431149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] PATH_INFO: `/v3/users/45e78ecac3ef4fc1b40178d58817ee7f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:12.432455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e78ecac3ef4fc1b40178d58817ee7f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:12.434936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:12.498167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e78ecac3ef4fc1b40178d58817ee7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:12.499634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:12.513683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e78ecac3ef4fc1b40178d58817ee7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:12.514434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e78ecac3ef4fc1b40178d58817ee7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:12.525041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e78ecac3ef4fc1b40178d58817ee7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:12.525722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e78ecac3ef4fc1b40178d58817ee7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:12.540741 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2450/4899] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:47:12 2022] DELETE /identity/v3/users/45e78ecac3ef4fc1b40178d58817ee7f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:12.545256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:12.545742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:12.546086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:12.566534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:12.567890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:12.581514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:12.585077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:12.694981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2450/4900] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:12.710237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:12.721934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705ee0f-8069-44c7-bf89-1562422a3f4c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:12.729917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:12.730774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:12.732020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:12.732498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:12.734738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:12.750973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:12.752289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b80dbc-2cd7-4774-9e58-9c677dab6508 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:12.754327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:12.766440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2451/4901] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:12.780289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0305d-fc35-40fd-a814-8e1322f4d82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:12.781106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0305d-fc35-40fd-a814-8e1322f4d82d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:12.781690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0305d-fc35-40fd-a814-8e1322f4d82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:12.781805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0305d-fc35-40fd-a814-8e1322f4d82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:12.792997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0305d-fc35-40fd-a814-8e1322f4d82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:12.795325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0305d-fc35-40fd-a814-8e1322f4d82d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:12.813167 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2451/4902] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:13.498526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:13.500253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:13.528996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee95d46-4e91-47e8-9c2d-c3d9e9ecec61 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:13.539034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:13.540081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:13.540513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:13.540985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] PATH_INFO: `/v3/projects/630c364945fd482aabf658b63a514f84` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:13.548320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630c364945fd482aabf658b63a514f84)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:13.550727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:13.685035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630c364945fd482aabf658b63a514f84', 'request_id': 'req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:13.703622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630c364945fd482aabf658b63a514f84', 'request_id': 'req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:13.720485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630c364945fd482aabf658b63a514f84', 'request_id': 'req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:13.756051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] The token cache is being invalidate because project 630c364945fd482aabf658b63a514f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:47:13.756357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:13.759493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7589ef5f-00aa-4899-96c5-5ec6d38d34c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:13.765412 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2452/4903] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:47:13 2022] DELETE /identity/v3/projects/630c364945fd482aabf658b63a514f84 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:13.770360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5234528-8036-46aa-b397-6101e76831dc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:13.770860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5234528-8036-46aa-b397-6101e76831dc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:13.770942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5234528-8036-46aa-b397-6101e76831dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:13.806657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d5234528-8036-46aa-b397-6101e76831dc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:13.813256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5234528-8036-46aa-b397-6101e76831dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:13.833913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:13.968838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2452/4904] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:13.972962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:13.974106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:13.974396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.011634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:14.015154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:14.035240 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2453/4905] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:14.040487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5234528-8036-46aa-b397-6101e76831dc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.051968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5234528-8036-46aa-b397-6101e76831dc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.057557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.058304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.060123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.060763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.061484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:47:14.062783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.064426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.087049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2453/4906] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:47:14.088725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.101128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf95442-f82b-4488-89d9-f2fda13bf721 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.107483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.109178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.109482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.109764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.110421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.112688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.162020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.162261 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2454/4907] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:47:14 2022] POST /identity/v3/projects => generated 397 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:47:14.177923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd9337-e9dd-405b-9f17-cb609d4c5331 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.337931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.338484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.338768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.339044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.348506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.354219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.389558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.402533 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2454/4908] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:47:14 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:47:14.407249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d29e7e-9594-45ba-aedb-531641d2b713 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.412937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.413874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.415621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.416019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.416920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.419435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.452162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2455/4909] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:47:14.459614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.481121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93c5b4-79c7-46fa-b898-7010aea5e3fc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.495635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcec47-3438-4c18-9ec0-45d7d60fc65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.495893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcec47-3438-4c18-9ec0-45d7d60fc65c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.500828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcec47-3438-4c18-9ec0-45d7d60fc65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.502327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcec47-3438-4c18-9ec0-45d7d60fc65c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.503154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcec47-3438-4c18-9ec0-45d7d60fc65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.505842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcec47-3438-4c18-9ec0-45d7d60fc65c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.538275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2455/4910] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:47:14.539656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.558210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d12130-730a-4894-b103-f29d56a16396 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.565764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.567303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.567737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.568311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] PATH_INFO: `/v3/projects/afcc750c588548109028bc2cafbad90a/users/6dfade6ab7784ee8bd06cabbd1eb8c0a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.579978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:14.594771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcc750c588548109028bc2cafbad90a, user_id=6dfade6ab7784ee8bd06cabbd1eb8c0a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.598058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.626888 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2456/4911] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:47:14 2022] PUT /identity/v3/projects/afcc750c588548109028bc2cafbad90a/users/6dfade6ab7784ee8bd06cabbd1eb8c0a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:47:14.632196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.632501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.632767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.673825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:14.675387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:14.794323 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2456/4912] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:14.804949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:14.807054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:14.939025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211e5b-e7f5-47bf-82c4-1df4b1d8a2b2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:14.943418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:14.944193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:14.944478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:14.944753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:14.955773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:14.957285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:14.970527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2457/4913] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:16.487717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:16.489829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:16.524012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3266-49c9-409d-96fd-d1dfcff40efd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:16.550225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:16.551139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:16.551697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:16.552393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:16.555629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:16.577889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:16.582167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe073f0-8aa2-4713-91e5-43c383bcf856 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:16.611996 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2457/4914] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:22.826293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:22.828308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:22.992980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322e1b0-4320-47b7-b499-34653b6f7391 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:23.001547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:23.001956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:23.002638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:23.002935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:23.004748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:23.042148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:23.046063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:23.064742 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2458/4915] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:26.234696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:26.235246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:26.235246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:26.255906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:26.315348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] MFA Rules not processed for user `6dfade6ab7784ee8bd06cabbd1eb8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:26.317427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:26.457012 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2458/4916] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:26.464934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:26.468087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:26.665227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b585f1-bb3b-4267-adc7-b3f79b452b28 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:26.683594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:26.686250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:26.686482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:26.686764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:26.708444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:26.714416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:26.746808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2459/4917] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:28.763126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:28.791562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2cdb8-a3c5-4682-bd07-ab395a80d16c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:28.813668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:28.814295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:28.814582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:28.814856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:28.816734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:28.852835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:28.855897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:28.899890 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2459/4918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:35.898924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:35.907177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:35.918726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4885d25-4fc6-40a3-9092-73fd5d60660e service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:35.932307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:35.936177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:35.936481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:35.937235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:35.943775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:35.977135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:36.001690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:36.038687 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2460/4919] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:38.883285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=37 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:40.229127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:40.240343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a718a49-3007-484f-8b70-f9086137aa64 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:40.245902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:40.247753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:40.248217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:40.248494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] PATH_INFO: `/v3/users/6dfade6ab7784ee8bd06cabbd1eb8c0a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:40.249849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfade6ab7784ee8bd06cabbd1eb8c0a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:40.251771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:40.307056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfade6ab7784ee8bd06cabbd1eb8c0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.323728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfade6ab7784ee8bd06cabbd1eb8c0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.325290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfade6ab7784ee8bd06cabbd1eb8c0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.335767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfade6ab7784ee8bd06cabbd1eb8c0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.336678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa3616f8-93ab-486c-80da-ad6019ad6185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfade6ab7784ee8bd06cabbd1eb8c0a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.359134 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2460/4920] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:47:40 2022] DELETE /identity/v3/users/6dfade6ab7784ee8bd06cabbd1eb8c0a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:40.721133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:40.732305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910797b-46be-4b88-b0e1-bb44524292e0 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:40.821455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:40.822053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:40.822484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:40.822770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] PATH_INFO: `/v3/projects/afcc750c588548109028bc2cafbad90a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:40.823969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcc750c588548109028bc2cafbad90a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:40.826053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:40.879315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcc750c588548109028bc2cafbad90a', 'request_id': 'req-b9b48edf-6d99-4286-b0d7-e9d286d17082'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.889817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcc750c588548109028bc2cafbad90a', 'request_id': 'req-b9b48edf-6d99-4286-b0d7-e9d286d17082'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.898490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcc750c588548109028bc2cafbad90a', 'request_id': 'req-b9b48edf-6d99-4286-b0d7-e9d286d17082'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.920048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] The token cache is being invalidate because project afcc750c588548109028bc2cafbad90a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:47:40.920048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.920405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b9b48edf-6d99-4286-b0d7-e9d286d17082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:47:40.922279 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2461/4921] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:47:40 2022] DELETE /identity/v3/projects/afcc750c588548109028bc2cafbad90a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:47:40.927236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:40.927664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:40.928271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:40.973446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:40.975422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:41.074657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2461/4922] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:41.155004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.155894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.156366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.178778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:41.180436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:41.195897 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2462/4923] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:41.199026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.219479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a3516-c1c0-4fce-ad6b-c276e13d5b22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.245203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.245930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.246470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.246909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.247719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:47:41.248824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.251916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.266930 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2462/4924] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:47:41.273542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.285580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1567d5-b0ce-4d5c-bf60-9548f124fdf2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.291232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.292076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.292542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.293013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.294401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.296501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.361505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2463/4925] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:47:41 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:47:41.365321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.382762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6f2e9-6537-481c-9556-eafd35cc65fd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.455142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.456292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.456622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.457050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.457692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.459813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.470777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:41.493655 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2463/4926] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:47:41 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:47:41.498987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.510923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622720-38e7-470a-b8cb-5bc3857e86cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.516652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.517301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.517585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.517860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.518505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.520161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.533210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2464/4927] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:47:41.535473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.549933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19260e-258c-4353-ab19-511ac7520224 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.555261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d488db-fd7d-4952-b17f-88bf1623563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.556013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d488db-fd7d-4952-b17f-88bf1623563a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.556295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d488db-fd7d-4952-b17f-88bf1623563a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.556747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d488db-fd7d-4952-b17f-88bf1623563a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.557616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d488db-fd7d-4952-b17f-88bf1623563a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.560473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d488db-fd7d-4952-b17f-88bf1623563a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.582426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.584041 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2464/4928] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:47:41.593450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffa06-b7cd-4566-ab34-0a8e49ead91e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.600094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d516bb-53fa-4e0e-9e58-e6270e2e9abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.600823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d516bb-53fa-4e0e-9e58-e6270e2e9abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.601163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d516bb-53fa-4e0e-9e58-e6270e2e9abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.601491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d516bb-53fa-4e0e-9e58-e6270e2e9abd admin admin] PATH_INFO: `/v3/projects/a2a0fa4883254728921c0c49aa4e60b1/users/569a3db98b7a44aeb902f7956af5a710/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.626396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d516bb-53fa-4e0e-9e58-e6270e2e9abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a0fa4883254728921c0c49aa4e60b1, user_id=569a3db98b7a44aeb902f7956af5a710, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.630691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d516bb-53fa-4e0e-9e58-e6270e2e9abd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.669142 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2465/4929] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:47:41 2022] PUT /identity/v3/projects/a2a0fa4883254728921c0c49aa4e60b1/users/569a3db98b7a44aeb902f7956af5a710/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:47:41.676033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.676506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.676882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.700143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:41.701473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:41.782253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.782799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.782905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.787553 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2465/4930] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:41.797601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:41.800203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:41.856372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:41.903115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:41.904491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:41.927608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c05df-1cbb-4492-9ebc-1768771c3bd8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:41.934940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:41.936308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:41.937058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:41.937532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:41.956114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:41.957982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:41.982160 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2466/4931] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:47:41.997207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2466/4932] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:47:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:47:42.061517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:42.063589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:42.265097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:42.272119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52393e5-3fff-4acc-a5ff-4ffd258409b3 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:42.286873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653160cd-6f0e-401c-aa17-f6f401357234 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:42.287788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653160cd-6f0e-401c-aa17-f6f401357234 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:42.288147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653160cd-6f0e-401c-aa17-f6f401357234 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:42.288669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653160cd-6f0e-401c-aa17-f6f401357234 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:42.301566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653160cd-6f0e-401c-aa17-f6f401357234 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:42.303730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653160cd-6f0e-401c-aa17-f6f401357234 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:42.331769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2467/4933] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:47:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:47:42.470629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:42.472443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:42.720972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473ff6a-3668-4d6f-b946-38a1678ab902 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:42.735513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:42.736174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:42.736705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:42.736705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:42.740776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:42.777221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:42.779844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:42.796916 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2467/4934] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:52.327126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:52.787410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=66 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:47:52.936103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ffb80-dc2a-47f4-bbf8-e611acfa2734 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:52.936329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ffb80-dc2a-47f4-bbf8-e611acfa2734 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:52.936756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ffb80-dc2a-47f4-bbf8-e611acfa2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:53.019218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ee0ffb80-dc2a-47f4-bbf8-e611acfa2734 None None] MFA Rules not processed for user `569a3db98b7a44aeb902f7956af5a710`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:53.020938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee0ffb80-dc2a-47f4-bbf8-e611acfa2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:53.199687 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2468/4935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:47:53.256033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:47:53.260530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:53.299441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9115619-03df-4dc4-bb49-e8f18c5e42e5 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:47:53.316053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:47:53.317227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:53.317726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:53.318211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:53.342340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:47:53.348197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:47:53.375697 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2468/4936] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:47:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:47:59.131503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:47:59.131950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:47:59.132154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:47:59.178811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] MFA Rules not processed for user `569a3db98b7a44aeb902f7956af5a710`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:47:59.197620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:47:59.221582 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2469/4937] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:00.598500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:00.601686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:00.609894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:00.613056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:00.640551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968ed3-7f74-4e39-93ae-52ab6ddca26c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:00.668786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:00.669571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:00.669939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:00.671972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] PATH_INFO: `/v3/users/27a14e4e71454d18946512dedba312a0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:00.675537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a14e4e71454d18946512dedba312a0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:00.679319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:00.790262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a14e4e71454d18946512dedba312a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:00.807005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a14e4e71454d18946512dedba312a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:00.808014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a14e4e71454d18946512dedba312a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:00.830262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a14e4e71454d18946512dedba312a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:00.831825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a14e4e71454d18946512dedba312a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:00.842117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda10c04-3ffb-4e64-a3d2-a76d15e95810 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:00.864647 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2470/4938] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:48:00 2022] DELETE /identity/v3/users/27a14e4e71454d18946512dedba312a0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:48:00.865501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:00.869903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:00.871916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:00.872387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:00.882973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:00.922310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:00.938621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:00.984573 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2469/4939] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:01.238886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:01.240845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:01.357711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:01.388798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cce361-6167-4617-8d29-6f1f9834408d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:01.396216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:01.396845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:01.397241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:01.397525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:01.400030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:01.426340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:01.428951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5526c-18f6-44f5-b238-1eb782533f40 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:01.447705 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2471/4940] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:01.731142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:01.732780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:01.753927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bd8e5-20f7-460d-97fc-727dc5f2d4e8 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:01.913747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:01.915662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:01.915887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:01.916169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] PATH_INFO: `/v3/projects/14c9c845b4e04fb09dc03de04a799cf3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:01.919270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c9c845b4e04fb09dc03de04a799cf3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:01.921284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:02.150042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c9c845b4e04fb09dc03de04a799cf3', 'request_id': 'req-3758b971-6b97-4ee1-9e15-32922bc17100'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:02.164615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c9c845b4e04fb09dc03de04a799cf3', 'request_id': 'req-3758b971-6b97-4ee1-9e15-32922bc17100'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:02.182222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c9c845b4e04fb09dc03de04a799cf3', 'request_id': 'req-3758b971-6b97-4ee1-9e15-32922bc17100'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:02.212731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] The token cache is being invalidate because project 14c9c845b4e04fb09dc03de04a799cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:48:02.213325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:02.214364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3758b971-6b97-4ee1-9e15-32922bc17100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:02.218408 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2470/4941] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:48:01 2022] DELETE /identity/v3/projects/14c9c845b4e04fb09dc03de04a799cf3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:48:02.223677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:02.224743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:02.225272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:02.264039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:02.273046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:02.522201 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2472/4942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:02.530784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:02.531243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:02.531678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:02.557509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:02.571940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:02.578475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:02.601508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2471/4943] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:02.606904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:02.621052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53be16f-c0cd-4168-8abc-812ddc604be1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:02.639689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:02.640631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:02.641151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:02.641615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:02.642488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:48:02.642981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:02.644776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:02.698497 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2473/4944] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:48:02.700372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:02.712015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf849c-8965-46d7-b726-ee4087c2602e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:02.719740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:02.720641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:02.721208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:02.721631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:02.723485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:02.725956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:02.794273 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2472/4945] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:48:02 2022] POST /identity/v3/projects => generated 395 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:48:02.799801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:02.817580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdecfb1-aaa9-435d-ad8f-b78a7ed5e2df admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:02.942016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:02.942903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:02.943520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:02.945000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:02.946260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:02.948594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:02.992594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:02.993944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2474/4946] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:48:02 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:48:03.025798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82f7d2-6e39-4869-8e18-89c1c50ce7b2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:03.037355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:03.037993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:03.038276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:03.038555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:03.039213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:03.040831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:03.066572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2473/4947] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:48:03.070634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:03.087740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671301-4f29-4586-8245-dafc093d487e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:03.111434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fefa3-bc16-49eb-abea-e54ef12d1907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:03.112364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fefa3-bc16-49eb-abea-e54ef12d1907 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:03.112656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fefa3-bc16-49eb-abea-e54ef12d1907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:03.112969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fefa3-bc16-49eb-abea-e54ef12d1907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:03.113650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fefa3-bc16-49eb-abea-e54ef12d1907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:03.116500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fefa3-bc16-49eb-abea-e54ef12d1907 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:03.146115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2475/4948] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:48:03.146512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:03.168347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fa14c-fe19-41e7-98b7-533903538298 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:03.179868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:03.180843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:03.181402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:03.181853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] PATH_INFO: `/v3/projects/1eab97ab9390449da800dab7d39217da/users/4660830930074af2905b664500feefe6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:03.227663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eab97ab9390449da800dab7d39217da, user_id=4660830930074af2905b664500feefe6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:03.232255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:03.270254 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2474/4949] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:48:03 2022] PUT /identity/v3/projects/1eab97ab9390449da800dab7d39217da/users/4660830930074af2905b664500feefe6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:48:03.276128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f465-9445-4b0a-a1f5-4d24c10d0b21 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:03.276527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f465-9445-4b0a-a1f5-4d24c10d0b21 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:03.276692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72f465-9445-4b0a-a1f5-4d24c10d0b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:03.317708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3e72f465-9445-4b0a-a1f5-4d24c10d0b21 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:03.321682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e72f465-9445-4b0a-a1f5-4d24c10d0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:03.448211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:03.486516 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2476/4950] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:03.500842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:03.502711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:03.605034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed0490-651f-4a53-bbd8-b4a0e8efe9d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:03.612288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:03.613651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:03.614125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:03.614707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:03.629770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:03.631566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:03.653656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2475/4951] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:09.150568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac49e87-8e51-494d-a5b3-d629da0828f8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:09.151498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac49e87-8e51-494d-a5b3-d629da0828f8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:09.152361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac49e87-8e51-494d-a5b3-d629da0828f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:09.192140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eac49e87-8e51-494d-a5b3-d629da0828f8 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:09.193558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eac49e87-8e51-494d-a5b3-d629da0828f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:09.338457 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2477/4952] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:48:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:09.346892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:09.354147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:09.498235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aca2aa-c750-44bf-9c31-31b2adeea11e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:09.516567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:09.517294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:09.517675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:09.519480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:09.543502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:09.545983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:09.574821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2476/4953] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:48:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:48:12.665706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:12.674944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10711aaf-5982-4ad7-a2b1-8d10a9184cf0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:12.674944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10711aaf-5982-4ad7-a2b1-8d10a9184cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:12.676160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10711aaf-5982-4ad7-a2b1-8d10a9184cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:12.681740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:12.721407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-10711aaf-5982-4ad7-a2b1-8d10a9184cf0 None None] MFA Rules not processed for user `4660830930074af2905b664500feefe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:12.724950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10711aaf-5982-4ad7-a2b1-8d10a9184cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:12.822464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:12.838903 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2478/4954] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:12.842786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:12.843319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:12.844145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:12.874954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae81bb-689a-4a30-bf2e-ce840e5e2fd0 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:12.881213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] MFA Rules not processed for user `4660830930074af2905b664500feefe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:12.882416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:12.882918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:12.883397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:12.884116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:12.884566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:12.888678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:12.897557 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2479/4955] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:48:12.904774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:12.908519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba0843-3e5a-4bec-8dd7-d9fb6c012bdb service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:12.937075 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2477/4956] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:13.190121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:13.192197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:13.313028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1818-c6cc-4e52-b00d-ee67997da0b1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:13.313632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1818-c6cc-4e52-b00d-ee67997da0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:13.314177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1818-c6cc-4e52-b00d-ee67997da0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:13.355814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b30d1818-c6cc-4e52-b00d-ee67997da0b1 None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:13.357926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b30d1818-c6cc-4e52-b00d-ee67997da0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:13.400649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241ff34-0751-48b3-a4ac-0b86360c63c6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:13.421490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:13.422230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:13.422711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:13.423614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:13.447377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:13.454445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:13.467055 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2480/4957] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:13.564973 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2478/4958] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:48:23.460938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:23.528777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=41 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:47.165314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:47.167209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:47.182768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af6e08-7ae0-42bf-9df0-0490357975a7 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:47.187747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:47.188473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:47.188873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:47.189230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] PATH_INFO: `/v3/users/4badccbd2290473b93ba122a4d9a5196` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:47.190447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4badccbd2290473b93ba122a4d9a5196)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:47.192411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:47.253270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4badccbd2290473b93ba122a4d9a5196'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.268929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4badccbd2290473b93ba122a4d9a5196'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.269788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4badccbd2290473b93ba122a4d9a5196'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.278586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4badccbd2290473b93ba122a4d9a5196'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.279338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4badccbd2290473b93ba122a4d9a5196'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.295473 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2481/4959] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:48:47 2022] DELETE /identity/v3/users/4badccbd2290473b93ba122a4d9a5196 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:48:47.297380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:47.297871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:47.298037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:47.318979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:47.320215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:47.392192 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2479/4960] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:47.402490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:47.404033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:47.499029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4d2a5-ec42-4194-a902-f52539375b6d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:47.503532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda759cc-c969-4288-a868-2fed0c3b71e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:47.504340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda759cc-c969-4288-a868-2fed0c3b71e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:47.504702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda759cc-c969-4288-a868-2fed0c3b71e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:47.505024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda759cc-c969-4288-a868-2fed0c3b71e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:47.516332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda759cc-c969-4288-a868-2fed0c3b71e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:47.517824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda759cc-c969-4288-a868-2fed0c3b71e8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:47.530485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2482/4961] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:47.730551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:47.732181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:47.752501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a036f5-192d-471e-93da-5e56f2954a03 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:47.757407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:47.758107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:47.758393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:47.758683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] PATH_INFO: `/v3/projects/bae476fec82e4716ad3b198154815ed1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:47.759884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae476fec82e4716ad3b198154815ed1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:47.761807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:47.818365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae476fec82e4716ad3b198154815ed1', 'request_id': 'req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.824330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae476fec82e4716ad3b198154815ed1', 'request_id': 'req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.830727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae476fec82e4716ad3b198154815ed1', 'request_id': 'req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.845270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] The token cache is being invalidate because project bae476fec82e4716ad3b198154815ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:48:47.845644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.846365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d630cc09-ce0a-4eaf-b92d-ed7e453836d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:48:47.848057 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2480/4962] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:48:47 2022] DELETE /identity/v3/projects/bae476fec82e4716ad3b198154815ed1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:48:47.853018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:47.853340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:47.853620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:47.875864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:47.877111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:48.009651 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2483/4963] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:48.017716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.018238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.018909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.053950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:48.055608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:48.066319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2481/4964] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:48.070442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.081086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8148618-e81e-4d71-9dbd-2ddf055aa14c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.086361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.086976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.087365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.087731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.088520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:48:48.089534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.091128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.105749 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2484/4965] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:48:48.110171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.120413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f20b4-7e68-495e-9fb0-2ef2fcc12f9a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.130223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.131192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.131599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.131832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.132606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.134832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.171785 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2482/4966] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:48:48 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:48:48.176794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.184284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:48.191825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a310bed-0b2a-4276-a809-c210647ae833 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.264201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.264828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.265141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.265422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.266193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.268129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.295385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2485/4967] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:48:48 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:48:48.300073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.313432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9d7ae-fb6e-4b08-887f-e742633db0f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.319255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.319950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.320295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.320698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.321768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.324005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.334403 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2483/4968] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:48:48.338322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.351891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04896f4-ecb8-42ff-9b32-c73744d0b69c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.360235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afaf86-3f4a-42ab-9780-dadfcbaa4557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.361247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afaf86-3f4a-42ab-9780-dadfcbaa4557 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.365026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afaf86-3f4a-42ab-9780-dadfcbaa4557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.365429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afaf86-3f4a-42ab-9780-dadfcbaa4557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.366213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afaf86-3f4a-42ab-9780-dadfcbaa4557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.367869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afaf86-3f4a-42ab-9780-dadfcbaa4557 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.380314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2486/4969] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:48:48.384601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.395963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e43948-792b-420d-811d-4955cba839a0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.401239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.402612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.402897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.403170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] PATH_INFO: `/v3/projects/a1991248efac4b2b9b3c8c4f9f018073/users/30bf8b08f5f24055a1d6501c162af7b9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.419424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1991248efac4b2b9b3c8c4f9f018073, user_id=30bf8b08f5f24055a1d6501c162af7b9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.422164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.438010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2484/4970] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:48:48 2022] PUT /identity/v3/projects/a1991248efac4b2b9b3c8c4f9f018073/users/30bf8b08f5f24055a1d6501c162af7b9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:48:48.449916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.450291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.450658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.480759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] MFA Rules not processed for user `30bf8b08f5f24055a1d6501c162af7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:48:48.482025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:48.573803 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2487/4971] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:48:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:48:48.584215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:48.586455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:48.609334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:48.651964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dadd1a-d1db-4674-a2ed-436ba7208ec5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:48.655955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:48.656572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:48.656856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:48.657163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:48.667330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:48.668432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:48.677663 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2485/4972] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:57.889594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:48:57.891285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:58.007499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cede213-eb18-4e4b-9e9c-21935a7652a6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:48:58.047142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:48:58.048085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:48:58.048521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:48:58.049075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:48:58.051492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:48:58.061447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:48:58.139635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:48:58.141538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d407bfd-928e-4914-8769-a0a852da4e06 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:48:58.165734 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2488/4973] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:48:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:48:58.673558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=17 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:04.908998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:04.973780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb00d0-3349-4624-b6a2-789ad26201d9 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:04.978248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:04.979357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:04.979758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:04.980036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] PATH_INFO: `/v3/users/30bf8b08f5f24055a1d6501c162af7b9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:04.981189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bf8b08f5f24055a1d6501c162af7b9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:04.983105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.031619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bf8b08f5f24055a1d6501c162af7b9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.044865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bf8b08f5f24055a1d6501c162af7b9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.045579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bf8b08f5f24055a1d6501c162af7b9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.053327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bf8b08f5f24055a1d6501c162af7b9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.054036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bf8b08f5f24055a1d6501c162af7b9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.067494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2486/4974] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:04 2022] DELETE /identity/v3/users/30bf8b08f5f24055a1d6501c162af7b9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:05.071949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.072447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.072666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.092278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:05.093525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:05.155262 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2489/4975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:05.165051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.166554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:05.225667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa616-4507-4b62-813a-ac3e05f18398 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:05.229985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17c37-7246-42ad-a7c3-be25c1e5267e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:05.230593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17c37-7246-42ad-a7c3-be25c1e5267e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.230874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17c37-7246-42ad-a7c3-be25c1e5267e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.231182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17c37-7246-42ad-a7c3-be25c1e5267e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.240421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17c37-7246-42ad-a7c3-be25c1e5267e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:05.241881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17c37-7246-42ad-a7c3-be25c1e5267e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.252197 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2487/4976] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:05.451361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.453896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:05.471400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27decdd9-90f7-4edf-98f3-4b434b4e1ee3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:05.478695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:05.480438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.480958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.481536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] PATH_INFO: `/v3/projects/a1991248efac4b2b9b3c8c4f9f018073` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.482932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1991248efac4b2b9b3c8c4f9f018073)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:05.485447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.553570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1991248efac4b2b9b3c8c4f9f018073', 'request_id': 'req-ddc40944-faea-4e99-b661-86c5a86076c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.563166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1991248efac4b2b9b3c8c4f9f018073', 'request_id': 'req-ddc40944-faea-4e99-b661-86c5a86076c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.570499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1991248efac4b2b9b3c8c4f9f018073', 'request_id': 'req-ddc40944-faea-4e99-b661-86c5a86076c8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.584481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] The token cache is being invalidate because project a1991248efac4b2b9b3c8c4f9f018073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:05.584703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.585406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ddc40944-faea-4e99-b661-86c5a86076c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:05.587120 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2490/4977] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:05 2022] DELETE /identity/v3/projects/a1991248efac4b2b9b3c8c4f9f018073 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:05.592306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.592594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.592870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.612863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:05.614076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:05.633328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:05.690747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2488/4978] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:05.695653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.695966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.696266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.718580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:05.719769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:05.728117 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2491/4979] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:05.732543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.742513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ecb3a-9d3e-4ec4-b278-935b1a65dead None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:05.747745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:05.748354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.748631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.748955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.749609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:05.749909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:05.751515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.768056 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2489/4980] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:05.769180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.780333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8177ed-3bbd-4682-b0f0-d7eb5eac2626 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:05.785125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:05.785731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.786012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.786285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.786916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:05.789013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.822324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2492/4981] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:05 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:05.825083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.842757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bce912-521d-4dfa-a11e-f7ea26b53139 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:05.904406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:05.905042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.905324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.905597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.906230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:05.908142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.935025 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2490/4982] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:05 2022] POST /identity/v3/users => generated 281 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:05.939549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.945345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:05.954995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391c9cf-0dd4-4d2d-a600-94a37abeb8f8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:05.965369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:05.966288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:05.966578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:05.966850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:05.967496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:05.969314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:05.981768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2493/4983] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:05.985816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:05.996702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fb2e1-3d4a-49c9-9a9d-a115010ba510 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:06.002812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e043c4-2904-46c5-9bc0-51841e10d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:06.003480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e043c4-2904-46c5-9bc0-51841e10d9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:06.003760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e043c4-2904-46c5-9bc0-51841e10d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:06.004031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e043c4-2904-46c5-9bc0-51841e10d9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:06.004679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e043c4-2904-46c5-9bc0-51841e10d9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:06.006308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e043c4-2904-46c5-9bc0-51841e10d9e6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:06.018504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2491/4984] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:06.022855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:06.034153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642b10-567b-4e46-b594-91daf2649bf9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:06.039212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:06.039892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:06.040170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:06.040446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] PATH_INFO: `/v3/projects/291d8c578e0348bea646ba4f775efe84/users/22f7a92f2b24482f9c0b5f37c8f4426b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:06.056781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291d8c578e0348bea646ba4f775efe84, user_id=22f7a92f2b24482f9c0b5f37c8f4426b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:06.060027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:06.075106 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2494/4985] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:06 2022] PUT /identity/v3/projects/291d8c578e0348bea646ba4f775efe84/users/22f7a92f2b24482f9c0b5f37c8f4426b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:06.175041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:06.175328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:06.175606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:06.203800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] MFA Rules not processed for user `22f7a92f2b24482f9c0b5f37c8f4426b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:06.205178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:06.271088 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2492/4986] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:06.283427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:06.285699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:06.348980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16016f8-264d-423e-9816-38aab2919bb1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:06.352429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:06.353069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:06.353348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:06.353619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:06.362769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:06.364514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:06.375029 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2495/4987] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:06.493430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:06.495399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:06.510632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095ddb8-f581-4472-90f1-adb49f8c6bd1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:06.515320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:06.516006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:06.516374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:06.516716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:06.518743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:06.535953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:06.604680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:06.607620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:06.627247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2493/4988] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:11.156687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:11.169417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:11.193582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec4dd-79eb-4a7b-9e06-579270d0bc5a service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:11.200559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:11.201303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:11.201592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:11.201889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] PATH_INFO: `/v3/users/4c2aedcc40d84bb6a287c2bac019ed4e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:11.203066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2aedcc40d84bb6a287c2bac019ed4e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:11.205367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:11.262921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2aedcc40d84bb6a287c2bac019ed4e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.288649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2aedcc40d84bb6a287c2bac019ed4e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.289510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2aedcc40d84bb6a287c2bac019ed4e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.299203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2aedcc40d84bb6a287c2bac019ed4e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.300128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bbb14a9b-aaf8-46ed-99b4-cab604ea10ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2aedcc40d84bb6a287c2bac019ed4e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.314808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2496/4989] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:11 2022] DELETE /identity/v3/users/4c2aedcc40d84bb6a287c2bac019ed4e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:11.513063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:11.524608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa48b-374a-48d6-bead-dcad2a02cb31 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:11.610310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:11.611273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:11.611657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:11.611972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] PATH_INFO: `/v3/projects/20891ecf732b4c4597e3bfa0d96585a7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:11.613523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20891ecf732b4c4597e3bfa0d96585a7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:11.616066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:11.686457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20891ecf732b4c4597e3bfa0d96585a7', 'request_id': 'req-96c3076e-06d4-4dfb-8353-6916d11c6af0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.694155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20891ecf732b4c4597e3bfa0d96585a7', 'request_id': 'req-96c3076e-06d4-4dfb-8353-6916d11c6af0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.706450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20891ecf732b4c4597e3bfa0d96585a7', 'request_id': 'req-96c3076e-06d4-4dfb-8353-6916d11c6af0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.725664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] The token cache is being invalidate because project 20891ecf732b4c4597e3bfa0d96585a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:11.726026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.726804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-96c3076e-06d4-4dfb-8353-6916d11c6af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:11.728585 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2494/4990] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:11 2022] DELETE /identity/v3/projects/20891ecf732b4c4597e3bfa0d96585a7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:11.734548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:11.735055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:11.735502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:11.758386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:11.759882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:11.825812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:11.875351 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2497/4991] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:11.883815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:11.884099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:11.885636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:11.910984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:11.912258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:11.921721 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2495/4992] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:11.926278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:11.937668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55038270-ea95-4a92-a0a8-ce694fa8ddb6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:11.942886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:11.943489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:11.943825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:11.944108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:11.944771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:11.946494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:11.948188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:11.963277 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2498/4993] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:11.969296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:11.979684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebf1c1-8870-45b2-94c8-2f0f7d796777 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:11.988887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:11.989701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:11.989983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:11.990254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:11.990906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:11.993039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.023107 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2496/4994] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:11 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:12.028329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.039378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e5317-53d1-464c-8e74-a8753a7929dd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.114048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.114664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.114974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.115247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.115886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.118284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.149688 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2499/4995] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:12 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:12.151644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.164399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d9eb8-e015-4044-8421-f985ff0b53f3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.171410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.172573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.172573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.172573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.173787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.175035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.196287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.197254 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2497/4996] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:12.219602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966481-9d26-4053-9ce1-d01f50d9afe4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.237292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06dacc2-deb4-4c85-82ff-9f7e82b2614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.237292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dacc2-deb4-4c85-82ff-9f7e82b2614e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.237292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dacc2-deb4-4c85-82ff-9f7e82b2614e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.237292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06dacc2-deb4-4c85-82ff-9f7e82b2614e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.237777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dacc2-deb4-4c85-82ff-9f7e82b2614e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.237777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06dacc2-deb4-4c85-82ff-9f7e82b2614e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.247079 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2500/4997] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:12.251424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.257547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:12.265928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b2e1e-6a8f-4c70-a117-70aa8d36b296 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.276692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.278291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.278795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.279803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] PATH_INFO: `/v3/projects/2d2f4dab67b34cbc996ae059722ff52d/users/35eb8b60742944df84bcbc86233a2891/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.307125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2f4dab67b34cbc996ae059722ff52d, user_id=35eb8b60742944df84bcbc86233a2891, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.311289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.332998 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2498/4998] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:12 2022] PUT /identity/v3/projects/2d2f4dab67b34cbc996ae059722ff52d/users/35eb8b60742944df84bcbc86233a2891/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:12.344834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.345149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.345584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.390554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] MFA Rules not processed for user `35eb8b60742944df84bcbc86233a2891`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:12.391818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:12.493381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2501/4999] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:12.497864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.572035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0527ade-081d-4edc-9b8e-789975d4877f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.578170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.578985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.579488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.579845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.580792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.583045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.617427 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2499/5000] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:12.622525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.634348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b8aa8-db0a-4d70-8e05-b0d2327e2f8c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.689701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:12.718672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.719301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.719585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.719861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.720517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.722494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.750358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2502/5001] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:12 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:12.751448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.762780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8595e2-53a5-4bfb-ad63-729dedaf9d14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.768607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.769504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.769958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.770464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.771179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.773021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.785991 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2500/5002] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:12.790446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.802335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d11b-cd18-476e-9116-fee8636b2c4e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.809363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.810361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.810645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.810926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] PATH_INFO: `/v3/projects/caec118293b748cba41012d58f13573a/users/984af77891854e85959da5da3d4cde8a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.826797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caec118293b748cba41012d58f13573a, user_id=984af77891854e85959da5da3d4cde8a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.829527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.847939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2503/5003] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:12 2022] PUT /identity/v3/projects/caec118293b748cba41012d58f13573a/users/984af77891854e85959da5da3d4cde8a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:12.849237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.860329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc8b45-7573-448a-815f-3c9ed58b429a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.942853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b4080-23bb-4d1f-8088-0fa91dd90b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.943913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4080-23bb-4d1f-8088-0fa91dd90b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.944261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4080-23bb-4d1f-8088-0fa91dd90b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.944658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b4080-23bb-4d1f-8088-0fa91dd90b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.945201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b4080-23bb-4d1f-8088-0fa91dd90b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.947006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b4080-23bb-4d1f-8088-0fa91dd90b85 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.958371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2501/5004] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:12.962406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:12.973827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ceef-b5c7-4203-953f-c6bab2aefa07 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:12.978816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:12.980259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:12.980547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:12.980835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] PATH_INFO: `/v3/projects/caec118293b748cba41012d58f13573a/users/984af77891854e85959da5da3d4cde8a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:12.983045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caec118293b748cba41012d58f13573a, user_id=984af77891854e85959da5da3d4cde8a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:12.985828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:12.997848 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2504/5005] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:12 2022] PUT /identity/v3/projects/caec118293b748cba41012d58f13573a/users/984af77891854e85959da5da3d4cde8a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:13.012405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.014293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.014803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.058823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] MFA Rules not processed for user `984af77891854e85959da5da3d4cde8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:13.060107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:13.109977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:13.147282 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2502/5006] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:13.151642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.163892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09d94da-f0ab-47d2-bd45-c9eb199a6b87 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.170415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.171265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.171724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.172174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.173051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.175592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.202770 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2505/5007] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:49:13 2022] POST /identity/v3/domains => generated 275 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:13.207568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.219902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a7127-3a5d-4f33-883a-239db6ee0fa3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.283264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.283886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.284262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.284606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.285349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.289892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.317945 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2503/5008] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:13 2022] POST /identity/v3/groups => generated 281 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:13.319985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.331132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b901a-3236-46f0-b8ac-06c934ac3807 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.335814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.336441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.336733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.337042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.343814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:update_group(group_id=9d0b01af3b1c4e1fbf023a76d9e56f4b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.345021 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:13.345021 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:49:13.345021 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:49:13.346557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.368799 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2506/5009] 10.222.0.16 () {60 vars in 1247 bytes} [Wed Oct 5 02:49:13 2022] PATCH /identity/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b => generated 292 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:13.370247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.380626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84266-4de1-4ef2-b018-98aa80d2ea87 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.386523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.387291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.387573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.387865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.393256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:get_group(group_id=9d0b01af3b1c4e1fbf023a76d9e56f4b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.394277 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:13.394277 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:13.394277 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:13.396153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.401308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2504/5010] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:13 2022] GET /identity/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b => generated 292 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:13.403781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.414580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364ced3-2510-443b-abe5-3b5af44f9e49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.423807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.424619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.425355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.425791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.427881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:update_group(group_id=9d0b01af3b1c4e1fbf023a76d9e56f4b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.430114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.456710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2507/5011] 10.222.0.16 () {60 vars in 1246 bytes} [Wed Oct 5 02:49:13 2022] PATCH /identity/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:13.459837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.497167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768128-a225-483b-bb1a-45b1d99b8bff tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.505724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.507036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.507326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.507613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.514193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9d0b01af3b1c4e1fbf023a76d9e56f4b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.516205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.562581 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2505/5012] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:13 2022] DELETE /identity/v3/groups/9d0b01af3b1c4e1fbf023a76d9e56f4b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:13.568418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.579252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef38dc-3955-4115-98bd-cd9e09941d71 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.648092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.649177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.649462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.649740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.650519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.652994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.673350 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2508/5013] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:13 2022] POST /identity/v3/groups => generated 324 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:13.684666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.707297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0f14-668a-4852-a3f0-504f1e8123a9 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.713196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.713992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.714470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.714849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.715600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.717548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.747648 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2506/5014] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:13 2022] POST /identity/v3/users => generated 319 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:13.751850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.763739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705607f-c21a-4921-98c0-d100c1362bd2 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.768649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.769415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.769765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.770132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/97276a627a6c40169ff3cb5ce40deb71` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.790305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=97276a627a6c40169ff3cb5ce40deb71)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.792495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.821871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:UPDATE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:13.837027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.838309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2509/5015] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:49:13 2022] PUT /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/97276a627a6c40169ff3cb5ce40deb71 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:13.859737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67485301-f23f-466d-83da-f8ce2221d2b0 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.906221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:13.939602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.940225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.940776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.940964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:13.941584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:13.943807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:13.973722 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2507/5016] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:13 2022] POST /identity/v3/users => generated 323 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:13.977625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:13.989489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8b40-93d4-4399-a16d-83b756d72f49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:13.997669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:13.998329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:13.998611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:13.998885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/4fafe658d4ed4eb18954a9410d1df38f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.016162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=4fafe658d4ed4eb18954a9410d1df38f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.018741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.058569 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2510/5017] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:49:13 2022] PUT /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/4fafe658d4ed4eb18954a9410d1df38f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:14.062807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.076112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f177-0040-4e83-83f9-bf4962fe3eb5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.143930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.144722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.145139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.145525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.146272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.148400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.177921 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2508/5018] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:14 2022] POST /identity/v3/users => generated 323 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:14.182900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.194825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b725b-e85f-4613-a8c6-d36fa42f25bd tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.205164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.205808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.206134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.206460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/1b7733af2ddf4867b93d211374e9fd82` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.225009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=1b7733af2ddf4867b93d211374e9fd82)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.227014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.273511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2511/5019] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:49:14 2022] PUT /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/1b7733af2ddf4867b93d211374e9fd82 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:14.274820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.287453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d0f7-b31d-433f-9861-9188145a70a7 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.364154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.364887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.365276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.365631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.367050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=7b35bdd6fed44282b291ef54d6ca757d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.368318 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:14.368318 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:14.368318 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:14.370053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.389769 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2509/5020] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:49:14 2022] GET /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users => generated 1081 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:14.395248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.413524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c7a4b-b0dc-4456-9f29-b7487f5f8449 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.419807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.420482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.420793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.421106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/97276a627a6c40169ff3cb5ce40deb71` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.423997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=97276a627a6c40169ff3cb5ce40deb71)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.425610 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:14.425610 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:49:14.425610 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:49:14.426353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fadaa7-dd3e-43ce-9095-822d428b758c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.462000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.463790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2512/5021] 10.222.0.16 () {58 vars in 1342 bytes} [Wed Oct 5 02:49:14 2022] HEAD /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/97276a627a6c40169ff3cb5ce40deb71 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:14.491080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967938e-71f9-400a-8a4c-3a517893dd3b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.505907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.506720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.507098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.507472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/97276a627a6c40169ff3cb5ce40deb71` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.509622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=97276a627a6c40169ff3cb5ce40deb71)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.511137 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:14.511137 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:14.511137 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:14.512684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.527548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dba62-16da-4181-9edd-1694a6764177 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.527747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dba62-16da-4181-9edd-1694a6764177 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.528069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dba62-16da-4181-9edd-1694a6764177 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.529674 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2513/5022] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 05 02:49:14.531203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '97276a627a6c40169ff3cb5ce40deb71'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:14.535624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.535981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.536330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.555544 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2510/5023] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:49:14 2022] DELETE /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/97276a627a6c40169ff3cb5ce40deb71 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:14.559730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.602286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:14.603599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:14.633222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:14.688199 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2514/5024] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:49:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:14.690187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b562b1a-06a5-49c2-bb4b-bb2a430f115a tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.695534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.696313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.696670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.697225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/4fafe658d4ed4eb18954a9410d1df38f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.700672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=4fafe658d4ed4eb18954a9410d1df38f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.702131 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:14.702131 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:14.702131 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:14.703915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.706501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.707976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:14.728512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2511/5025] 10.222.0.16 () {58 vars in 1342 bytes} [Wed Oct 5 02:49:14 2022] HEAD /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/4fafe658d4ed4eb18954a9410d1df38f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:14.733645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.746643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec285bc-3288-40a8-863a-defe26836de0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.747077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8d4ac-0452-401d-b16d-b0ffca238314 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.754435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.755492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.756374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.757256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/4fafe658d4ed4eb18954a9410d1df38f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.761085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.762066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=4fafe658d4ed4eb18954a9410d1df38f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.766396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.766592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.766930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.767346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.783285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4fafe658d4ed4eb18954a9410d1df38f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:14.797785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.800125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.819587 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2515/5026] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:14.822109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2512/5027] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:49:14 2022] DELETE /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/4fafe658d4ed4eb18954a9410d1df38f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:14.827056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.849830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee68f-0b65-4f2c-bd69-054b738d0743 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:14.950205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:14.951326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:14.951844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:14.953060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/1b7733af2ddf4867b93d211374e9fd82` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:14.955179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=1b7733af2ddf4867b93d211374e9fd82)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:14.957622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:14.959472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:14.980281 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2516/5028] 10.222.0.16 () {58 vars in 1342 bytes} [Wed Oct 5 02:49:14 2022] HEAD /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/1b7733af2ddf4867b93d211374e9fd82 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:14.981863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:14.994781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ea41c-e75c-4013-a7c2-1d234e1df557 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.001031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.002064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.002577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.003154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/1b7733af2ddf4867b93d211374e9fd82` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.005550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7b35bdd6fed44282b291ef54d6ca757d, user_id=1b7733af2ddf4867b93d211374e9fd82)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.008671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.020977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1b7733af2ddf4867b93d211374e9fd82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.056242 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2513/5029] 10.222.0.16 () {58 vars in 1344 bytes} [Wed Oct 5 02:49:14 2022] DELETE /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users/1b7733af2ddf4867b93d211374e9fd82 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:15.060844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.076670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d346-b66c-472e-8857-896af38c77b3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.141034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.141713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.141997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.142275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.143606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=7b35bdd6fed44282b291ef54d6ca757d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.144671 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:15.144671 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:49:15.144671 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:49:15.145926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.156332 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2517/5030] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:49:15 2022] GET /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d/users => generated 145 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:15.161078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.172285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa512c0-652d-4b85-9e44-f3a2699b581c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.177923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.178559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.178846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.179316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users/1b7733af2ddf4867b93d211374e9fd82` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.180711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1b7733af2ddf4867b93d211374e9fd82)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.183593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.236259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7733af2ddf4867b93d211374e9fd82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.250404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7733af2ddf4867b93d211374e9fd82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.251421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7733af2ddf4867b93d211374e9fd82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.269099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7733af2ddf4867b93d211374e9fd82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.270080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7733af2ddf4867b93d211374e9fd82'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.287681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2514/5031] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:15 2022] DELETE /identity/v3/users/1b7733af2ddf4867b93d211374e9fd82 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:15.292084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.294659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.307898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d79b8-b889-45ed-8b69-dfe95334c906 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.369108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.370481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.371114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.371417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users/4fafe658d4ed4eb18954a9410d1df38f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.372615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4fafe658d4ed4eb18954a9410d1df38f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.375687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.425960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fafe658d4ed4eb18954a9410d1df38f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.426578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.428242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.439539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fafe658d4ed4eb18954a9410d1df38f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.440250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fafe658d4ed4eb18954a9410d1df38f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.451947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fafe658d4ed4eb18954a9410d1df38f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.452811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fafe658d4ed4eb18954a9410d1df38f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.470427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2518/5032] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:15 2022] DELETE /identity/v3/users/4fafe658d4ed4eb18954a9410d1df38f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:15.471584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.473008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.485013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:15.489600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:15.506436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da14091-2004-409a-805c-51ae19484a02 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.544826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1f1fb-2ef0-43b8-ab7d-f456ef46314b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.549563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.550194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.550474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.550786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users/97276a627a6c40169ff3cb5ce40deb71` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.551944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_user(user_id=97276a627a6c40169ff3cb5ce40deb71)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.554079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.566026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.566671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.566960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.567243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] PATH_INFO: `/v3/users/22f7a92f2b24482f9c0b5f37c8f4426b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.568563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f7a92f2b24482f9c0b5f37c8f4426b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.570365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.601310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97276a627a6c40169ff3cb5ce40deb71'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.614789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97276a627a6c40169ff3cb5ce40deb71'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.615486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97276a627a6c40169ff3cb5ce40deb71'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.617455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f7a92f2b24482f9c0b5f37c8f4426b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.624586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97276a627a6c40169ff3cb5ce40deb71'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.625271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97276a627a6c40169ff3cb5ce40deb71'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.631499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f7a92f2b24482f9c0b5f37c8f4426b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.632559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f7a92f2b24482f9c0b5f37c8f4426b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.640236 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2519/5033] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:15 2022] DELETE /identity/v3/users/97276a627a6c40169ff3cb5ce40deb71 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:15.643585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f7a92f2b24482f9c0b5f37c8f4426b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.643585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-489cb57d-9f76-4f5e-9f30-ddd44f5619d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f7a92f2b24482f9c0b5f37c8f4426b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:15.644423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.645904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.655871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2515/5034] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:15 2022] DELETE /identity/v3/users/22f7a92f2b24482f9c0b5f37c8f4426b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:15.660580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.661544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.662028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.683954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:15.685098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.712217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfce031-fc9a-46e8-b05f-d44f39464f75 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.746567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:15.747159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2516/5035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:15.756570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.758109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.779814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:15.781112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.781908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.782196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.782520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7b35bdd6fed44282b291ef54d6ca757d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.783691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7b35bdd6fed44282b291ef54d6ca757d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.785668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.821482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859f9ab-526e-4f7d-94b4-002e30a8c65d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.825613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.826247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.826530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.826807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.829418 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2520/5036] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:15 2022] DELETE /identity/v3/groups/7b35bdd6fed44282b291ef54d6ca757d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:15.834491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.836098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:15.841836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.843274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.854596 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2517/5037] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:49:15.903656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdff6c-f8b1-41f4-bfae-68f78e30dbf3 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.908361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.909016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.909330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.909605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.910244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.912164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.932759 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2521/5038] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:15 2022] POST /identity/v3/groups => generated 326 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:15.937552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.949466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b03196-aeb5-466c-9196-46bb5bd74ee0 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.954356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.954965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.955248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.955528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.956305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.958306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:15.974496 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2518/5039] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:15 2022] POST /identity/v3/groups => generated 324 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:15.978648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:15.989418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b7fb-5425-48ae-8516-a143fcdfbf49 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:15.994392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:15.995216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:15.995507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:15.996043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:15.996697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:15.998704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.018131 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2522/5040] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:15 2022] POST /identity/v3/groups => generated 326 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:16.019432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.030949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ebf72-73fe-4668-983c-c882da4f8166 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.033760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.035624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:16.036452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.037363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.037654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.037922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.038553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.039568 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:16.039568 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:16.039568 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:16.042172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.052792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2519/5041] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Oct 5 02:49:16 2022] GET /identity/v3/groups => generated 1486 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:16.053912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.066795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3e239-cdd2-4824-8309-d880c2c0820b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.073087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.073746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.074032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.074311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/2f958853c4cd419d9b905865053fbdff` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.079834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2f958853c4cd419d9b905865053fbdff)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.081772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.115874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f66b6-1f75-4fd1-8c90-75bb2d949df4 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.121804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.122523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.122811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.123094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] PATH_INFO: `/v3/projects/291d8c578e0348bea646ba4f775efe84` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.124266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291d8c578e0348bea646ba4f775efe84)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.126226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.140429 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2520/5042] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:16 2022] DELETE /identity/v3/groups/2f958853c4cd419d9b905865053fbdff => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:16.145570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.159411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:16.200302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291d8c578e0348bea646ba4f775efe84', 'request_id': 'req-d3df78c7-2a7b-4771-93c9-3ff507744a61'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:16.210434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291d8c578e0348bea646ba4f775efe84', 'request_id': 'req-d3df78c7-2a7b-4771-93c9-3ff507744a61'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:16.218498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291d8c578e0348bea646ba4f775efe84', 'request_id': 'req-d3df78c7-2a7b-4771-93c9-3ff507744a61'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:16.232872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] The token cache is being invalidate because project 291d8c578e0348bea646ba4f775efe84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:16.233209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:16.234156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3df78c7-2a7b-4771-93c9-3ff507744a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:16.239852 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2523/5043] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:16 2022] DELETE /identity/v3/projects/291d8c578e0348bea646ba4f775efe84 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:16.242030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa30b-7fe5-4273-ad0d-4d63b3864116 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.242380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa30b-7fe5-4273-ad0d-4d63b3864116 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.242661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa30b-7fe5-4273-ad0d-4d63b3864116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.251494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659037-18dc-44eb-adae-1f2de47bbe77 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.266025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f46fa30b-7fe5-4273-ad0d-4d63b3864116 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:16.267512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f46fa30b-7fe5-4273-ad0d-4d63b3864116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:16.318552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:16.336273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.337013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.337262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.339096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/7a2a989ca3f448508ccca44339d75bac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.344754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7a2a989ca3f448508ccca44339d75bac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.346820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.349045 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2524/5044] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:16.353003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.354094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.354921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.376468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:16.377734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:16.390656 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2525/5045] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:16.398105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.408026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ebe82-8d0e-40e7-aa7b-15c885aa2b47 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.409210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2521/5046] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:16 2022] DELETE /identity/v3/groups/7a2a989ca3f448508ccca44339d75bac => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:16.413158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.415168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:16.466233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.467096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.467573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.467988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.468995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:16.469465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.471979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.484191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba433-ecd9-4f73-bbfc-4432730eda1c tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.488766 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2526/5047] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:16.488982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.489721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.490005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.490283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/698e3b4adf1140a781cf2ac88f3fb371` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.493140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.496364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=698e3b4adf1140a781cf2ac88f3fb371)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.498355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.504005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b1736-ee22-4819-9539-76de273ad7e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.508942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.509722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.510634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.510940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.511572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.513487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.542888 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2522/5048] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:16 2022] DELETE /identity/v3/groups/698e3b4adf1140a781cf2ac88f3fb371 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:16.546318 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2527/5049] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:16.548453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.548601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.559202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:16.620526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c84b7-cbaf-46e5-b6c0-40f423ebd4dc tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.621417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36ce77-cf12-40ee-b24a-c35ec73a14dc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.625859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.626559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.626902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.627246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.627963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.630043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.643520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:16.673135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2523/5050] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:16.678574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.691669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8192f9-fb0d-4a8a-82a6-0fe86cdf86be admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.699171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.699959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.700514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.700890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.702048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.704543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.706994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.707612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.707896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.708284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.708970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.711040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.726362 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2524/5051] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:16.727972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.742303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e053a2-44ee-4ef0-8cd6-73809e7b30d6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.744146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2528/5052] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/users => generated 321 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:16.749508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.753770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.755252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.755760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.757122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.757807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.759426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.765671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7667-f770-4314-bb47-4c3e7bdb7627 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.771808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.772847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.773059 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2525/5053] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:16.773244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.773244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.773702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.776166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.776806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.787674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4bccb-6f57-4c5e-86f1-71f2b5bc3f40 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.792600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2529/5054] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/groups => generated 325 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:16.793597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbffd09-cd8e-405f-8c2c-4448856576e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.794540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbffd09-cd8e-405f-8c2c-4448856576e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.794905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbffd09-cd8e-405f-8c2c-4448856576e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.795518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbffd09-cd8e-405f-8c2c-4448856576e7 admin admin] PATH_INFO: `/v3/projects/09cdebb4eb1142428aa9346d23b6304a/users/83ec0f8edbeb4d6c84dd3ff9c0106a85/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.796515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.807429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1feb-39ad-4614-8bae-79ef29f4878b tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.811489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbffd09-cd8e-405f-8c2c-4448856576e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09cdebb4eb1142428aa9346d23b6304a, user_id=83ec0f8edbeb4d6c84dd3ff9c0106a85, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.813431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.814272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbffd09-cd8e-405f-8c2c-4448856576e7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.814484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.814779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.815058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/4f1ded364a4245cb8d7c23c8633d4906/users/ecf3c17cb4124d76a472e97100dc7808` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.830541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2526/5055] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:16 2022] PUT /identity/v3/projects/09cdebb4eb1142428aa9346d23b6304a/users/83ec0f8edbeb4d6c84dd3ff9c0106a85/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:16.839502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4f1ded364a4245cb8d7c23c8633d4906, user_id=ecf3c17cb4124d76a472e97100dc7808)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.839502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.840885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.841197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.841470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.865972 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2530/5056] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:49:16 2022] PUT /identity/v3/groups/4f1ded364a4245cb8d7c23c8633d4906/users/ecf3c17cb4124d76a472e97100dc7808 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:16.870583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.873931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] MFA Rules not processed for user `83ec0f8edbeb4d6c84dd3ff9c0106a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:16.875158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:16.928672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:16.935795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f98e-31e5-4426-91ca-b543cbdcd550 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.940921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.941542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.941829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.942107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.942697 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2527/5057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:16.942820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.944812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:16.947185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.960542 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2531/5058] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/groups => generated 325 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:16.964857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:16.974500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9700aa-e565-4087-9281-b5b0b064d8e1 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:16.979941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:16.980398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:16.980677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:16.980985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/a1da1ce3454b4da5b0bba8d0afee145a/users/ecf3c17cb4124d76a472e97100dc7808` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:16.987045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a1da1ce3454b4da5b0bba8d0afee145a, user_id=ecf3c17cb4124d76a472e97100dc7808)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:16.989007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.012887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b724c-e220-47ca-958c-8f62437ca50d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.014130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2532/5059] 10.222.0.16 () {60 vars in 1360 bytes} [Wed Oct 5 02:49:16 2022] PUT /identity/v3/groups/a1da1ce3454b4da5b0bba8d0afee145a/users/ecf3c17cb4124d76a472e97100dc7808 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:17.017935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.054959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:17.073991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.074605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.074887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.075195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.075827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.077847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.082069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d662b-ef1f-4cc9-9c1c-13f19763c7ea tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.086732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.087362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.087656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.087919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users/ecf3c17cb4124d76a472e97100dc7808/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.089792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=ecf3c17cb4124d76a472e97100dc7808)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.091879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.111652 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2528/5060] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:16 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:17.111856 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2533/5061] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:49:17 2022] GET /identity/v3/users/ecf3c17cb4124d76a472e97100dc7808/groups => generated 836 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:17.112660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.112796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.122706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805a390-a53c-4f5a-bc8d-9560d12fef12 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.177105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b38ef9-3bf4-421b-9eb0-6d16dee2fe52 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.180394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.181059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.181350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.181631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/a1da1ce3454b4da5b0bba8d0afee145a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.181892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.182505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.182783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.182895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a1da1ce3454b4da5b0bba8d0afee145a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.183057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.183683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.184724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.185640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.208392 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2529/5062] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:17 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:17.212150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.222250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797879b-37aa-4fdc-bf24-d3bdfda44e25 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.226811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.227414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.227691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.227968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.228607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.231253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.239828 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2534/5063] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:17 2022] DELETE /identity/v3/groups/a1da1ce3454b4da5b0bba8d0afee145a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:17.244023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.246092 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2530/5064] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:17.249988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.256687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:17.260102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbcb90-cb9f-4a43-831e-2f75ca96f8b3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.310825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112434-9f64-404e-8c03-be8f2b00f404 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.315975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.316618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.316927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.317221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/groups/4f1ded364a4245cb8d7c23c8633d4906` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.319036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4f1ded364a4245cb8d7c23c8633d4906)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.321170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.323591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.325317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.325960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.325960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] PATH_INFO: `/v3/projects/7b8683dc60fe4cf8b77131e2fc9769cc/users/fa8a99b8555f4605850eb320944398c4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.353190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683dc60fe4cf8b77131e2fc9769cc, user_id=fa8a99b8555f4605850eb320944398c4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.356805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.373363 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2531/5065] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:17 2022] PUT /identity/v3/projects/7b8683dc60fe4cf8b77131e2fc9769cc/users/fa8a99b8555f4605850eb320944398c4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:17.377349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.395432 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2535/5066] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:17 2022] DELETE /identity/v3/groups/4f1ded364a4245cb8d7c23c8633d4906 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:17.399495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.409036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:17.457088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57857-a559-45c2-b36c-8c2bfdd4a9de admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.479153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96eda-6392-4433-9b56-f52e6e317050 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.485143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.485959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.486315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.486661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/users/ecf3c17cb4124d76a472e97100dc7808` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.488349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ecf3c17cb4124d76a472e97100dc7808)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.490771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.528715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.529687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.531516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.531516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.531516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.534208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.548996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2532/5067] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:17.550088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.554956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf3c17cb4124d76a472e97100dc7808'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.563041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d097-3327-4dde-9098-365e9461201e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.569207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096a5b1-6f37-49c0-86b0-1ae9168968e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.570853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096a5b1-6f37-49c0-86b0-1ae9168968e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.570853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096a5b1-6f37-49c0-86b0-1ae9168968e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.570853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096a5b1-6f37-49c0-86b0-1ae9168968e3 admin admin] PATH_INFO: `/v3/projects/7b8683dc60fe4cf8b77131e2fc9769cc/users/fa8a99b8555f4605850eb320944398c4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.572405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf3c17cb4124d76a472e97100dc7808'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.573304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096a5b1-6f37-49c0-86b0-1ae9168968e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683dc60fe4cf8b77131e2fc9769cc, user_id=fa8a99b8555f4605850eb320944398c4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.574224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf3c17cb4124d76a472e97100dc7808'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.576108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096a5b1-6f37-49c0-86b0-1ae9168968e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.580179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:17.585496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf3c17cb4124d76a472e97100dc7808'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.587818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf3c17cb4124d76a472e97100dc7808'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.589964 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2533/5068] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:17 2022] PUT /identity/v3/projects/7b8683dc60fe4cf8b77131e2fc9769cc/users/fa8a99b8555f4605850eb320944398c4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:17.602689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.602978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.603259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.608543 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2536/5069] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:17 2022] DELETE /identity/v3/users/ecf3c17cb4124d76a472e97100dc7808 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:17.613634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.615196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:17.642764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] MFA Rules not processed for user `fa8a99b8555f4605850eb320944398c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:17.644042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:17.708885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfa14f-c684-493e-b283-fadd22c13b58 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.714533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.715292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.715708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.716115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/domains/082780c477764f419c2e0933fa91f6dd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.717555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=082780c477764f419c2e0933fa91f6dd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.719553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.727130 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2534/5070] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:17.739823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.741411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:17.745430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '082780c477764f419c2e0933fa91f6dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.746513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '082780c477764f419c2e0933fa91f6dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.775001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '082780c477764f419c2e0933fa91f6dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.775683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '082780c477764f419c2e0933fa91f6dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.778201 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2537/5071] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:49:17 2022] PATCH /identity/v3/domains/082780c477764f419c2e0933fa91f6dd => generated 276 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:17.782090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:17.783389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:17.790182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:17.802585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6662-c05f-4df6-bedf-240d31156017 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.853425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbca7ff-9c88-4829-9a7c-b858aa0354b6 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:17.855349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.856153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.856435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.856707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.858732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:17.859865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '984af77891854e85959da5da3d4cde8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caec118293b748cba41012d58f13573a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:17.860503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:17.861026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:17.861305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] PATH_INFO: `/v3/domains/082780c477764f419c2e0933fa91f6dd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:17.874099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=082780c477764f419c2e0933fa91f6dd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.875732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.900816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '082780c477764f419c2e0933fa91f6dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.904158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '082780c477764f419c2e0933fa91f6dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.930605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:17.931001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:17.933097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:17.947260 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2535/5072] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:49:17.964282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082780c477764f419c2e0933fa91f6dd', 'request_id': 'req-a31a7527-e22f-44a2-b423-efc1b5645fa5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.971837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082780c477764f419c2e0933fa91f6dd', 'request_id': 'req-a31a7527-e22f-44a2-b423-efc1b5645fa5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.978017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082780c477764f419c2e0933fa91f6dd', 'request_id': 'req-a31a7527-e22f-44a2-b423-efc1b5645fa5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.992595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] The token cache is being invalidate because project 082780c477764f419c2e0933fa91f6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:17.992924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:17.993600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.002664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '082780c477764f419c2e0933fa91f6dd', 'request_id': 'req-a31a7527-e22f-44a2-b423-efc1b5645fa5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.003331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '082780c477764f419c2e0933fa91f6dd', 'request_id': 'req-a31a7527-e22f-44a2-b423-efc1b5645fa5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.006746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a31a7527-e22f-44a2-b423-efc1b5645fa5 tempest-GroupsV3TestJSON-764383125 tempest-GroupsV3TestJSON-764383125-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '082780c477764f419c2e0933fa91f6dd', 'request_id': 'req-a31a7527-e22f-44a2-b423-efc1b5645fa5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.013196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2538/5073] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:17 2022] DELETE /identity/v3/domains/082780c477764f419c2e0933fa91f6dd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:18.017425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:18.019001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.107090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f8e6b-3d47-4295-aed7-10091bbdd074 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:18.163009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:18.173418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:18.174506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.175086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.175385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] PATH_INFO: `/v3/users/35eb8b60742944df84bcbc86233a2891` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.181252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35eb8b60742944df84bcbc86233a2891)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:18.183951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:18.272987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35eb8b60742944df84bcbc86233a2891'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.297449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35eb8b60742944df84bcbc86233a2891'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.298113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35eb8b60742944df84bcbc86233a2891'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.309118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35eb8b60742944df84bcbc86233a2891'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.310353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35eb8b60742944df84bcbc86233a2891'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.328289 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2536/5074] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:18 2022] DELETE /identity/v3/users/35eb8b60742944df84bcbc86233a2891 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:18.332683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.333072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.333353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.356208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:18.357403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.422637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:18.424519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.433582 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2539/5075] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:18.443652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:18.445417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.501622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b33265-acc8-4ac3-8027-5d0ff5a00c69 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:18.506370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:18.507000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.507277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.507695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] PATH_INFO: `/v3/users/83ec0f8edbeb4d6c84dd3ff9c0106a85` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.508841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ec0f8edbeb4d6c84dd3ff9c0106a85)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:18.511464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:18.513612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced73d89-a7d3-4d59-ad7f-da1f4758fb28 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:18.518596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256a397-112a-4204-96cb-27e97495f8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:18.519220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a397-112a-4204-96cb-27e97495f8cf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.519505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a397-112a-4204-96cb-27e97495f8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.519780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256a397-112a-4204-96cb-27e97495f8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.529859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a397-112a-4204-96cb-27e97495f8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:18.531323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256a397-112a-4204-96cb-27e97495f8cf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:18.549414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2540/5076] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:49:18.572937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ec0f8edbeb4d6c84dd3ff9c0106a85'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.586692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ec0f8edbeb4d6c84dd3ff9c0106a85'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.587548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ec0f8edbeb4d6c84dd3ff9c0106a85'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.600484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ec0f8edbeb4d6c84dd3ff9c0106a85'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.601234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ec0f8edbeb4d6c84dd3ff9c0106a85'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:18.612944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:18.622665 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2537/5077] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:18 2022] DELETE /identity/v3/users/83ec0f8edbeb4d6c84dd3ff9c0106a85 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:18.627786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.628213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.628555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.662169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:18.663401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.708345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:18.755971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2541/5078] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:18.769680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:18.771461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.843341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270458a6-4de1-4a44-84f7-243883d1edf4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:18.849538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:18.850779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.851162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.851524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.863069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:18.864969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:18.880951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2538/5079] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:18.926922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:18.929046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:18.947305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991222ef-babb-42b7-9a95-85eb157c4648 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:18.965904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:18.966540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:18.967356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:18.967638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] PATH_INFO: `/v3/projects/2d2f4dab67b34cbc996ae059722ff52d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:18.969411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2f4dab67b34cbc996ae059722ff52d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:18.971363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:19.048578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2f4dab67b34cbc996ae059722ff52d', 'request_id': 'req-14c8b114-baf9-4857-9198-317dfc6f7399'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.064120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2f4dab67b34cbc996ae059722ff52d', 'request_id': 'req-14c8b114-baf9-4857-9198-317dfc6f7399'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.070535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2f4dab67b34cbc996ae059722ff52d', 'request_id': 'req-14c8b114-baf9-4857-9198-317dfc6f7399'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.091027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] The token cache is being invalidate because project 2d2f4dab67b34cbc996ae059722ff52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:19.091390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.092119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.094583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2542/5080] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:18 2022] DELETE /identity/v3/projects/2d2f4dab67b34cbc996ae059722ff52d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:19.098373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:19.109496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5edda-fbdc-4fb9-8af7-430650a99f9c service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:19.191948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:19.193024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:19.193537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:19.194212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] PATH_INFO: `/v3/users/984af77891854e85959da5da3d4cde8a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:19.195894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984af77891854e85959da5da3d4cde8a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:19.199088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:19.270720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984af77891854e85959da5da3d4cde8a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.288000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984af77891854e85959da5da3d4cde8a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.289130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984af77891854e85959da5da3d4cde8a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.298280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984af77891854e85959da5da3d4cde8a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.299218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984af77891854e85959da5da3d4cde8a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.312643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2539/5081] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:19 2022] DELETE /identity/v3/users/984af77891854e85959da5da3d4cde8a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:19.426031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:19.428101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:19.441959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b114-baf9-4857-9198-317dfc6f7399 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:19.567576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:19.567914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:19.568551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:19.568551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] PATH_INFO: `/v3/projects/09cdebb4eb1142428aa9346d23b6304a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:19.569833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09cdebb4eb1142428aa9346d23b6304a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:19.571785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:19.632802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:19.634406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:19.640361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09cdebb4eb1142428aa9346d23b6304a', 'request_id': 'req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.649792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d892-0d89-41eb-a113-e3abea44dd10 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:19.662935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09cdebb4eb1142428aa9346d23b6304a', 'request_id': 'req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.666482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:19.672008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09cdebb4eb1142428aa9346d23b6304a', 'request_id': 'req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.683460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:19.689519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] The token cache is being invalidate because project 09cdebb4eb1142428aa9346d23b6304a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:19.689726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.691546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.696191 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2543/5082] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:19 2022] DELETE /identity/v3/projects/09cdebb4eb1142428aa9346d23b6304a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:19.698653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:19.700130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:19.738568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:19.739312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:19.739669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:19.740054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] PATH_INFO: `/v3/projects/caec118293b748cba41012d58f13573a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:19.741287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caec118293b748cba41012d58f13573a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:19.743324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:19.770740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd1c5-6ae0-4c93-b7f6-345f99e6e1c9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:19.777428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:19.778063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:19.778348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:19.778662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] PATH_INFO: `/v3/users/fa8a99b8555f4605850eb320944398c4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:19.779909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8a99b8555f4605850eb320944398c4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:19.781762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:19.801975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caec118293b748cba41012d58f13573a', 'request_id': 'req-34a07054-c573-47d4-8a91-66802f6b02e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.810187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caec118293b748cba41012d58f13573a', 'request_id': 'req-34a07054-c573-47d4-8a91-66802f6b02e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.817599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caec118293b748cba41012d58f13573a', 'request_id': 'req-34a07054-c573-47d4-8a91-66802f6b02e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.832499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] The token cache is being invalidate because project caec118293b748cba41012d58f13573a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:19.833045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.833985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-34a07054-c573-47d4-8a91-66802f6b02e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.835790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2540/5083] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:19 2022] DELETE /identity/v3/projects/caec118293b748cba41012d58f13573a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:19.841225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:19.841391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8a99b8555f4605850eb320944398c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.841502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:19.841879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:19.856482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8a99b8555f4605850eb320944398c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.857462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8a99b8555f4605850eb320944398c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.863577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:19.864815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:19.866715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8a99b8555f4605850eb320944398c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.867801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b2008fb6-8f96-4f6a-8ff4-5a5b682fee43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8a99b8555f4605850eb320944398c4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:19.883026 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2544/5084] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:19 2022] DELETE /identity/v3/users/fa8a99b8555f4605850eb320944398c4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:19.936850 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2541/5085] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:19.944603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:19.945140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:19.945431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:19.971204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:19.972737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:20.054733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2545/5086] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:20.059262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.079060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2bddc-b9b5-43a7-a2ca-b56f9f1b0fae None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.094321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.095197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.095690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.096155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.097150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:20.097673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.099502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.130395 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2542/5087] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:20.135482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.146689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4ed1-e7ec-4596-babb-fe033837bbc1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.153561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.154202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.154490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.155251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.155930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.157918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.164629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:20.201966 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2546/5088] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:20.202474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.215555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47468a0-b0a6-4ac9-bbc4-b3096f9c470c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.261567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:20.272162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.274483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:20.315466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.317480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.318229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.318668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.319604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.322159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.356745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2543/5089] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:20.361981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.369484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538e76-86a7-43bf-8d91-2683eed1d4ce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.375699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.376347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.376692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.377097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] PATH_INFO: `/v3/projects/7b8683dc60fe4cf8b77131e2fc9769cc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.378365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8683dc60fe4cf8b77131e2fc9769cc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.380631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.406794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce60435-9911-4072-b099-910621dea79c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.414310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.414605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.414894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.415175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.415833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.418459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.433909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2544/5090] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:20.435222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.445228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8683dc60fe4cf8b77131e2fc9769cc', 'request_id': 'req-02eaa134-54f1-4b37-b0bf-ee4cde741898'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:20.448217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11053d-4e10-499d-98a4-2e092b88a3d3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.457987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8683dc60fe4cf8b77131e2fc9769cc', 'request_id': 'req-02eaa134-54f1-4b37-b0bf-ee4cde741898'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:20.468683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8683dc60fe4cf8b77131e2fc9769cc', 'request_id': 'req-02eaa134-54f1-4b37-b0bf-ee4cde741898'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:20.485929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] The token cache is being invalidate because project 7b8683dc60fe4cf8b77131e2fc9769cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:20.486605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:20.488112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02eaa134-54f1-4b37-b0bf-ee4cde741898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:20.489975 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2547/5091] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:20 2022] DELETE /identity/v3/projects/7b8683dc60fe4cf8b77131e2fc9769cc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:20.497180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.497840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.498314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.522858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:20.524296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403493-99d8-413e-a67e-61edca5c3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.524796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:20.525141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403493-99d8-413e-a67e-61edca5c3dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.525442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403493-99d8-413e-a67e-61edca5c3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.526230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403493-99d8-413e-a67e-61edca5c3dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.526892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403493-99d8-413e-a67e-61edca5c3dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.529649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403493-99d8-413e-a67e-61edca5c3dbe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.543366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2548/5092] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:20.543571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2545/5093] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:20.544994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.545318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.546701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.558229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.560803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:20.570542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:20.571780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:20.577964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e57c3-a4f4-4937-a057-db9b24b1a038 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.580749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2546/5094] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:20.584465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.592083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.592929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.593644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.595000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] PATH_INFO: `/v3/projects/4f3fbab4a49e4ed68ace374adc28457a/users/de52931e8c404bbc834a852985513e88/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.606742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c928-b82f-464d-a68b-d86371babd43 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.617135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.618557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3fbab4a49e4ed68ace374adc28457a, user_id=de52931e8c404bbc834a852985513e88, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.619852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.620428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.621277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.622123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:20.622576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.622737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.624487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818f3f9-da76-4e46-a62c-dbe31e8111f4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.641485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2549/5095] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:20 2022] PUT /identity/v3/projects/4f3fbab4a49e4ed68ace374adc28457a/users/de52931e8c404bbc834a852985513e88/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:20.645690 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2547/5096] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:20.650003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.654108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.654636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.654918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.690751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] MFA Rules not processed for user `de52931e8c404bbc834a852985513e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:20.692018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:20.714937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:20.735507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf317236-26b0-40c0-8669-0f268d5304e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.740954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.741572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.741857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.742136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.742809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.745122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.781521 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2548/5097] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:20.783018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.789321 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2550/5098] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:20.791955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.796994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d524e-3cd5-42e2-9b95-b6c2a79b899e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.820672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:20.873131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.873877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.874178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.874548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.875267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.876013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a6a8f-9836-4f35-9206-492cff5dd997 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.877400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.881808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:20.882683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:20.883245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:20.883687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:20.884473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:20.890096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:20.916941 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2549/5099] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:20.920463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.928431 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2551/5100] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:20.933068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:20.943387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c47a-7eab-4afd-94b1-aa43f4fb46ec admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.993671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07975f2c-c3cd-4f22-95b2-9fc3da4a95f8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:20.999703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.000324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.000610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.000887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.001596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.003484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.012664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.013426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.013799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.014148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.014875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.016636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.032980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2552/5102] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:21.033200 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2550/5102] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:20 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:21.033311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.034083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.045070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3db69-8959-492d-8edb-96e6c00de3a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.045324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc35b-1863-4a94-8362-fe002d026329 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.050119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.050279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.050747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.050875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.051086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.051187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.051435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.051562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.052185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.052299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.053889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.054016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.065952 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2553/5103] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:21.069853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.074054 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2551/5104] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:21.074908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.083160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747f916-736d-46f9-b398-42d3e3f6f4f0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.085778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d63bc-e126-4c0e-a3f6-c3a36c33e986 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.091549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.091915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3cb2c-44f0-4a71-b88b-73676eca9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.092224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.092499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.092775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] PATH_INFO: `/v3/projects/e60645215a7244dc9b11038ccc4ee43c/users/6ffa3758ab6b48d4bac6be9cd60d10a5/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.092888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3cb2c-44f0-4a71-b88b-73676eca9fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.093200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3cb2c-44f0-4a71-b88b-73676eca9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.093553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3cb2c-44f0-4a71-b88b-73676eca9fff admin admin] PATH_INFO: `/v3/projects/e8928377287f4cae950702d413af6542/users/ef3901107d1542e39ff09de9f4b219a8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.110905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60645215a7244dc9b11038ccc4ee43c, user_id=6ffa3758ab6b48d4bac6be9cd60d10a5, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.113458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3cb2c-44f0-4a71-b88b-73676eca9fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8928377287f4cae950702d413af6542, user_id=ef3901107d1542e39ff09de9f4b219a8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.113812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.116103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3cb2c-44f0-4a71-b88b-73676eca9fff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.131432 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2554/5105] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:21 2022] PUT /identity/v3/projects/e60645215a7244dc9b11038ccc4ee43c/users/6ffa3758ab6b48d4bac6be9cd60d10a5/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:21.132870 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2552/5106] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:21 2022] PUT /identity/v3/projects/e8928377287f4cae950702d413af6542/users/ef3901107d1542e39ff09de9f4b219a8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:21.138144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.144942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.145454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.145588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.165551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:21.182742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] MFA Rules not processed for user `ef3901107d1542e39ff09de9f4b219a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:21.183972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:21.230466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd2789-b6ff-4c59-aafd-1e81038b48c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.238475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:21.262765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2553/5107] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:21.267425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.347864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.348758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.349252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.359438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec411ce0-d490-4f61-9e97-b2cc37a6820e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.360097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.361103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.366462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.366796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.367173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.367459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.367822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.368467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.372355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.394955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2555/5108] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:21.396099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.413253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bec65a-63fd-4147-a11b-9a2535225fc5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.421638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8617b-ee65-434c-a174-f155128c8535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.422332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8617b-ee65-434c-a174-f155128c8535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.422667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8617b-ee65-434c-a174-f155128c8535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.422951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8617b-ee65-434c-a174-f155128c8535 admin admin] PATH_INFO: `/v3/projects/e60645215a7244dc9b11038ccc4ee43c/users/6ffa3758ab6b48d4bac6be9cd60d10a5/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.425342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8617b-ee65-434c-a174-f155128c8535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60645215a7244dc9b11038ccc4ee43c, user_id=6ffa3758ab6b48d4bac6be9cd60d10a5, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.428188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8617b-ee65-434c-a174-f155128c8535 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.428862 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2554/5109] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:21 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:21.429827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.459871 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2556/5110] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:21 2022] PUT /identity/v3/projects/e60645215a7244dc9b11038ccc4ee43c/users/6ffa3758ab6b48d4bac6be9cd60d10a5/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:21.461743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.462117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.462407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.507093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] MFA Rules not processed for user `6ffa3758ab6b48d4bac6be9cd60d10a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:21.508419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:21.528820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2497947-54bf-43e6-be8c-262a6c430966 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.621836 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2557/5111] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:21.626503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.640968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c4991-5c37-4d4f-aaf9-8bac49c86ec6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.647058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.647948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.647948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.648254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.649251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.649954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.651943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.652182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.652670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.654147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.659685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.662543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.695602 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2558/5112] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:21 2022] POST /identity/v3/projects => generated 358 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:21.700635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.708481 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2555/5113] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:21 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:21.710140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.720507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:21.721185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e204a-ff22-4360-a59c-d3a109dd5f0e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.730234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:21.784217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd02f-91bc-4bbe-bce1-9b5fab3bd394 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.789306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.789941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.790317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.790457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.790607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.791577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.791715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.791815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.791815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.792935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.793768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.794307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.809601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2556/5114] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:21.810860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.822197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb81013-a976-4cf4-9b51-76afc286c417 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.828422 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2559/5115] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:21 2022] POST /identity/v3/users => generated 413 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:21.828608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.828608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.828805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.828936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] PATH_INFO: `/v3/projects/25f522e127af48e9a6aa0d613c855fb2/users/8419f4e464e545238d38f11952967b1d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.829826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.842437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3ac8c-c847-4184-ab0c-eee3ff19f19b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.848309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.848784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f522e127af48e9a6aa0d613c855fb2, user_id=8419f4e464e545238d38f11952967b1d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.849102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.849448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.849965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/users/cc1b0092c7f24502bbb967c794b862de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.852259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.868429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_user(user_id=cc1b0092c7f24502bbb967c794b862de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.872467 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2557/5116] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:21 2022] PUT /identity/v3/projects/25f522e127af48e9a6aa0d613c855fb2/users/8419f4e464e545238d38f11952967b1d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:21.872629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.876370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2560/5117] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:49:21 2022] GET /identity/v3/users/cc1b0092c7f24502bbb967c794b862de => generated 413 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:21.876524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.877369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.890111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070edd7-feaf-4331-9517-04b9629a08e6 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.943889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527795a3-19c2-4226-8c6c-c7f9c4443747 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.950229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.950850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.951132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.951408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.952235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.954207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.966336 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2558/5118] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:21.969138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.970663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.970824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:21.971785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.971785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/users/cc1b0092c7f24502bbb967c794b862de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.973023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cc1b0092c7f24502bbb967c794b862de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.975161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:21.985266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6619610-db97-4e31-96b8-bb4ddc1ca4c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:21.991497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a04f0-639f-432a-8c75-4117bd655c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:21.992169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a04f0-639f-432a-8c75-4117bd655c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:21.992448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a04f0-639f-432a-8c75-4117bd655c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:21.992784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a04f0-639f-432a-8c75-4117bd655c4b admin admin] PATH_INFO: `/v3/projects/25f522e127af48e9a6aa0d613c855fb2/users/8419f4e464e545238d38f11952967b1d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:21.995339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a04f0-639f-432a-8c75-4117bd655c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f522e127af48e9a6aa0d613c855fb2, user_id=8419f4e464e545238d38f11952967b1d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:21.998283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a04f0-639f-432a-8c75-4117bd655c4b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.014701 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2559/5119] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:21 2022] PUT /identity/v3/projects/25f522e127af48e9a6aa0d613c855fb2/users/8419f4e464e545238d38f11952967b1d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:22.024868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.026034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.026034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.042762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1b0092c7f24502bbb967c794b862de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.056712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] MFA Rules not processed for user `8419f4e464e545238d38f11952967b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:22.058036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:22.059346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1b0092c7f24502bbb967c794b862de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.060447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1b0092c7f24502bbb967c794b862de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.069292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1b0092c7f24502bbb967c794b862de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.070219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1b0092c7f24502bbb967c794b862de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.086226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2561/5120] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:21 2022] DELETE /identity/v3/users/cc1b0092c7f24502bbb967c794b862de => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:22.087097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.089585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:22.101309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:22.135918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:22.158959 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2560/5121] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:22.172436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.174712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:22.198991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2243d23-229a-425f-acdf-23dfb8f86187 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.204445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:22.205416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.205704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.205981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/c2bcb5b403e7497d8f69e7276d9b7ede` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.207569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c2bcb5b403e7497d8f69e7276d9b7ede)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:22.210025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.264356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cccbb-cbc2-4375-b5f7-3ffd3bbc50fa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.279536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bcb5b403e7497d8f69e7276d9b7ede', 'request_id': 'req-84e5df67-4886-4929-896c-36fce7f9aed7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.301407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bcb5b403e7497d8f69e7276d9b7ede', 'request_id': 'req-84e5df67-4886-4929-896c-36fce7f9aed7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.338950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bcb5b403e7497d8f69e7276d9b7ede', 'request_id': 'req-84e5df67-4886-4929-896c-36fce7f9aed7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.370147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:22.371766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.372057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.372463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.374838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:22.375682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project c2bcb5b403e7497d8f69e7276d9b7ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:22.376409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.377437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.401140 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2562/5122] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:22 2022] DELETE /identity/v3/projects/c2bcb5b403e7497d8f69e7276d9b7ede => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:22.406691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.410594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:22.458323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:22.459829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.483583 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2561/5123] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:49:22.558574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5df67-4886-4929-896c-36fce7f9aed7 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.574144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:22.575819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.577294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.577695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.580452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:22.585318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.611878 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2563/5124] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:22 2022] POST /identity/v3/projects => generated 347 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:22.615931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.628924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15621b-5a3c-480a-8862-1f41cd09354d service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.746396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:22.747764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.748284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.748759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.750692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:22.751416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:22.754401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.759417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:22.779265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2562/5125] 10.222.0.16 () {58 vars in 1160 bytes} [Wed Oct 5 02:49:22 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:22.784028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.797793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b211b9-ef94-4b12-80a0-95591581f53e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.803740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:22.804359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.804641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.805085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.805713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:22.807853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.832937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2564/5126] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:49:22 2022] GET /identity/v3/domains => generated 828 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:22.842249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.856763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ae0d-149d-4cbe-87a8-21b1fa9d4053 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.862560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:22.863247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:22.863533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:22.863858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/ac3c2a2630204b2fa15c6f5e62a3b579` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:22.866133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:update_project(project_id=ac3c2a2630204b2fa15c6f5e62a3b579)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:22.867370 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:22.867370 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:22.867370 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:22.868550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:22.883538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.884716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.945841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.946919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:22.952300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2563/5127] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 02:49:22 2022] PATCH /identity/v3/projects/ac3c2a2630204b2fa15c6f5e62a3b579 => generated 361 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:22.954508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:22.956246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:22.978440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a4f9d-a00d-4e61-aa98-bc53eccfc6e5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:22.997238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:23.058141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.058873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.059287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.059569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/ac3c2a2630204b2fa15c6f5e62a3b579` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.073965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac3c2a2630204b2fa15c6f5e62a3b579)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.075710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:23.102414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.106752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.163331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579', 'request_id': 'req-f2719f05-332f-477e-9c82-f76e2d300698'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.174037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579', 'request_id': 'req-f2719f05-332f-477e-9c82-f76e2d300698'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.180815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579', 'request_id': 'req-f2719f05-332f-477e-9c82-f76e2d300698'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.202037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project ac3c2a2630204b2fa15c6f5e62a3b579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:23.202881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.204753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.215153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579', 'request_id': 'req-f2719f05-332f-477e-9c82-f76e2d300698'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.216279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579', 'request_id': 'req-f2719f05-332f-477e-9c82-f76e2d300698'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.220515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ac3c2a2630204b2fa15c6f5e62a3b579', 'request_id': 'req-f2719f05-332f-477e-9c82-f76e2d300698'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.227615 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2565/5128] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:22 2022] DELETE /identity/v3/projects/ac3c2a2630204b2fa15c6f5e62a3b579 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:23.233451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:23.251028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1612f-eb46-4e42-831f-861cc8ba8ff0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:23.368612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.371852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.372309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.372672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.373452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.376465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:23.416953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2564/5129] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:23 2022] POST /identity/v3/projects => generated 359 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:23.420831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:23.422299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:23.437058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2719f05-332f-477e-9c82-f76e2d300698 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:23.504500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:23.507152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.508124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.508521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.509035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/e30cf14dc6c64de19dff7445c5383630` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.510532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=e30cf14dc6c64de19dff7445c5383630)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.513125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:23.519856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:23.521565 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2566/5130] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:23 2022] GET /identity/v3/projects/e30cf14dc6c64de19dff7445c5383630 => generated 359 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:23.536831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5a120-bb3f-4b8f-b4ea-760d1e18ba5f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:23.542560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.543351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.543639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.543919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/e30cf14dc6c64de19dff7445c5383630` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.545468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e30cf14dc6c64de19dff7445c5383630)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.547718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:23.602054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30cf14dc6c64de19dff7445c5383630', 'request_id': 'req-2a22965c-7dfc-4465-9865-82477a4c50da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.609213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30cf14dc6c64de19dff7445c5383630', 'request_id': 'req-2a22965c-7dfc-4465-9865-82477a4c50da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.625224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30cf14dc6c64de19dff7445c5383630', 'request_id': 'req-2a22965c-7dfc-4465-9865-82477a4c50da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.649116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project e30cf14dc6c64de19dff7445c5383630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:23.649698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.654318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:23.661120 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2565/5131] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:23 2022] DELETE /identity/v3/projects/e30cf14dc6c64de19dff7445c5383630 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:23.666492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:23.668398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:23.681347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b001c-9913-4186-85b8-439ce046a64e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:23.751172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.751811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.752147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.752430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.753124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.755356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:23.797420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2567/5132] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:23 2022] POST /identity/v3/projects => generated 361 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:23.800068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:23.814088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22965c-7dfc-4465-9865-82477a4c50da tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:23.856384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:23.897219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.897949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.898204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.898445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/41448ef60ed047b8a77659c32f5d39bd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.899836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=41448ef60ed047b8a77659c32f5d39bd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.902226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:23.904658 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2566/5133] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:23 2022] GET /identity/v3/projects/41448ef60ed047b8a77659c32f5d39bd => generated 361 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:23.908945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:23.922334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f526b-153e-41a3-b9dd-c6e71869eb11 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:23.927890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:23.928568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:23.928856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:23.929345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/41448ef60ed047b8a77659c32f5d39bd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:23.931414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41448ef60ed047b8a77659c32f5d39bd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:23.934954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.013844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41448ef60ed047b8a77659c32f5d39bd', 'request_id': 'req-3af0e0a5-869c-4392-93a9-f57eb21e116d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.022781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41448ef60ed047b8a77659c32f5d39bd', 'request_id': 'req-3af0e0a5-869c-4392-93a9-f57eb21e116d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.030153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41448ef60ed047b8a77659c32f5d39bd', 'request_id': 'req-3af0e0a5-869c-4392-93a9-f57eb21e116d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.043060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 41448ef60ed047b8a77659c32f5d39bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:24.043361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.044169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3af0e0a5-869c-4392-93a9-f57eb21e116d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.045830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2568/5134] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:23 2022] DELETE /identity/v3/projects/41448ef60ed047b8a77659c32f5d39bd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:24.050802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.052865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:24.070572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37cc1-bd35-4f9c-82c9-1b694f64984f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.142783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.143232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.143526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.171526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] MFA Rules not processed for user `ff170a5be8a04902b66e5f0e79fd47df`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:24.173007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:24.180231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.181173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.181845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.182715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.184189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.186447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.225236 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2567/5135] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:24 2022] POST /identity/v3/projects => generated 348 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:24.229980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.246150 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2569/5136] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:24.297976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53437a-feb7-4666-870f-ff1641454d0d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.302585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.303217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.303500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.303777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/4fc2ed7dda9c4e33b87b47678640bfa5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.305050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=4fc2ed7dda9c4e33b87b47678640bfa5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.307501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.309149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2568/5137] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:24 2022] GET /identity/v3/projects/4fc2ed7dda9c4e33b87b47678640bfa5 => generated 348 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:24.313259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.324729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3332f5-b804-40b8-bae3-56501209a83a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.329403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.330037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.330321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.330626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/4fc2ed7dda9c4e33b87b47678640bfa5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.332110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4fc2ed7dda9c4e33b87b47678640bfa5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.333694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.343453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:24.387800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc2ed7dda9c4e33b87b47678640bfa5', 'request_id': 'req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.396362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc2ed7dda9c4e33b87b47678640bfa5', 'request_id': 'req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.403377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc2ed7dda9c4e33b87b47678640bfa5', 'request_id': 'req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.415069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 4fc2ed7dda9c4e33b87b47678640bfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:24.415412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.416130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.417808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2570/5138] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:24 2022] DELETE /identity/v3/projects/4fc2ed7dda9c4e33b87b47678640bfa5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:24.422915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.424741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:24.438527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7441ee-4281-4058-a351-bece525e9460 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.542165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.543022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.543408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.543781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.544551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.546533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.560023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:24.576978 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2569/5139] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:49:24 2022] POST /identity/v3/domains => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:24.578554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.589952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e63aa-f58c-4518-aaf9-28e96ea1633f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.658294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.658881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.659168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.659444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.660090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.662363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.701830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2571/5140] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:24 2022] POST /identity/v3/projects => generated 404 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:24.705770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.717449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534cfa-1ac9-41fe-9ce8-4a899c0f4b97 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.779535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.780179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.780462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.780736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/0bace1ca11204c608e78b8357893fc77` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.782002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=0bace1ca11204c608e78b8357893fc77)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.784054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.785718 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2570/5141] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:24 2022] GET /identity/v3/projects/0bace1ca11204c608e78b8357893fc77 => generated 404 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:24.789869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.801155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232ab7c-2a05-4324-bc18-d6d789cb0e2f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.806126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.807398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.807690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.808051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/0bace1ca11204c608e78b8357893fc77` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.809267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0bace1ca11204c608e78b8357893fc77)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.811175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:24.859893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bace1ca11204c608e78b8357893fc77', 'request_id': 'req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.870277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bace1ca11204c608e78b8357893fc77', 'request_id': 'req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.877290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bace1ca11204c608e78b8357893fc77', 'request_id': 'req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.878834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:24.892670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 0bace1ca11204c608e78b8357893fc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:24.894473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.895333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:24.900155 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2572/5142] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:24 2022] DELETE /identity/v3/projects/0bace1ca11204c608e78b8357893fc77 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:24.901524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:24.903386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:24.918457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17477f23-8b11-4c23-8965-dcd56a0acd5a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:24.977841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:24.978405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:24.978722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:24.978999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains/927a843310f8405693353683cfc85766` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:24.980390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=927a843310f8405693353683cfc85766)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:24.982099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:25.006701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '927a843310f8405693353683cfc85766'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.007681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '927a843310f8405693353683cfc85766'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.039003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '927a843310f8405693353683cfc85766'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.039873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '927a843310f8405693353683cfc85766'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.053222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2571/5143] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:49:24 2022] PATCH /identity/v3/domains/927a843310f8405693353683cfc85766 => generated 276 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:25.054494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:25.076607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035a7d5-d1e9-4fd2-9cbf-69eb34ee4c02 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:25.145983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:25.146741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:25.147034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:25.147310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains/927a843310f8405693353683cfc85766` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:25.163833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=927a843310f8405693353683cfc85766)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:25.166741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:25.193776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '927a843310f8405693353683cfc85766'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.197167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '927a843310f8405693353683cfc85766'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.281384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927a843310f8405693353683cfc85766', 'request_id': 'req-8e54a6d6-401d-43c8-99f9-30094af00f6f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.290862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927a843310f8405693353683cfc85766', 'request_id': 'req-8e54a6d6-401d-43c8-99f9-30094af00f6f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.300998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927a843310f8405693353683cfc85766', 'request_id': 'req-8e54a6d6-401d-43c8-99f9-30094af00f6f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.314548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 927a843310f8405693353683cfc85766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:25.315678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.316670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.334149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '927a843310f8405693353683cfc85766', 'request_id': 'req-8e54a6d6-401d-43c8-99f9-30094af00f6f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.335110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '927a843310f8405693353683cfc85766', 'request_id': 'req-8e54a6d6-401d-43c8-99f9-30094af00f6f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.339809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '927a843310f8405693353683cfc85766', 'request_id': 'req-8e54a6d6-401d-43c8-99f9-30094af00f6f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:25.347062 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2573/5144] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:25 2022] DELETE /identity/v3/domains/927a843310f8405693353683cfc85766 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:25.352348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:25.354452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:25.368404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7e6e2-0143-4398-87da-236d393d29ad tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:25.442017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:25.442784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:25.443084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:25.443365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:25.444056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:25.445724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:25.459658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:25.473720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:25.475191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:25.476604 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2572/5145] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:49:25 2022] POST /identity/v3/domains => generated 277 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:25.489254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a6d6-401d-43c8-99f9-30094af00f6f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:25.526729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:25.568761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:25.569685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:25.570191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:25.570990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:25.571752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:25.576055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:25.637714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:25.638775 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2574/5146] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:25 2022] POST /identity/v3/projects => generated 409 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:25.663564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ebc25-3f6c-4ef6-b819-d5995bec8182 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:25.797577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff07f-36bf-46ac-9105-b459b6f87ba0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:25.798213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff07f-36bf-46ac-9105-b459b6f87ba0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:25.798533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff07f-36bf-46ac-9105-b459b6f87ba0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:25.798817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff07f-36bf-46ac-9105-b459b6f87ba0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:25.799473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff07f-36bf-46ac-9105-b459b6f87ba0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:25.801440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff07f-36bf-46ac-9105-b459b6f87ba0 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:25.855944 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2573/5147] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:25 2022] POST /identity/v3/projects => generated 405 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:25.856591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:25.874060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386d212-be07-4b1a-9c2b-2aa87340af99 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:25.954346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:25.955140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:25.955515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:25.955837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/ef023a025b684e16b27dd5aee913a536` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:25.957325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef023a025b684e16b27dd5aee913a536)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:25.959276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:26.017022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef023a025b684e16b27dd5aee913a536', 'request_id': 'req-fd0d020b-d196-4995-b2f4-a32105642ed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.029375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef023a025b684e16b27dd5aee913a536', 'request_id': 'req-fd0d020b-d196-4995-b2f4-a32105642ed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.040043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef023a025b684e16b27dd5aee913a536', 'request_id': 'req-fd0d020b-d196-4995-b2f4-a32105642ed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.053429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:26.053962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:26.053962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:26.055903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project ef023a025b684e16b27dd5aee913a536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:26.056207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.057507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.060405 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2575/5148] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:25 2022] DELETE /identity/v3/projects/ef023a025b684e16b27dd5aee913a536 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:26.067189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:26.070044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:26.093765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] MFA Rules not processed for user `728544ca5e164540b3c5395534542955`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:26.097437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:26.157913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:26.201222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d020b-d196-4995-b2f4-a32105642ed9 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:26.206617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:26.207306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:26.207895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:26.208035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/7c097b7a8fea412cb9479415ba4a763b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:26.213592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c097b7a8fea412cb9479415ba4a763b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:26.219376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:26.229746 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2574/5149] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:26.297096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c097b7a8fea412cb9479415ba4a763b', 'request_id': 'req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.313990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c097b7a8fea412cb9479415ba4a763b', 'request_id': 'req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.332013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c097b7a8fea412cb9479415ba4a763b', 'request_id': 'req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.349633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 7c097b7a8fea412cb9479415ba4a763b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:26.349943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.351759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.354889 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2576/5150] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:26 2022] DELETE /identity/v3/projects/7c097b7a8fea412cb9479415ba4a763b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:26.359763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:26.377814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564643e-f521-4216-a672-e5f996f59f63 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:26.451250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:26.452211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:26.452534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:26.452892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains/255360a1000c4130b0e5a4fb00b17282` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:26.454593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=255360a1000c4130b0e5a4fb00b17282)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:26.456434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:26.486123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '255360a1000c4130b0e5a4fb00b17282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.486979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '255360a1000c4130b0e5a4fb00b17282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.496468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:26.521746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '255360a1000c4130b0e5a4fb00b17282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.522507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '255360a1000c4130b0e5a4fb00b17282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.526002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2575/5151] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:49:26 2022] PATCH /identity/v3/domains/255360a1000c4130b0e5a4fb00b17282 => generated 278 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:26.531023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:26.537640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:26.560779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dfcdb-a519-4ebb-b449-ea5b0fa0302f tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:26.646576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:26.647249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:26.647539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:26.647823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains/255360a1000c4130b0e5a4fb00b17282` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:26.679439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=255360a1000c4130b0e5a4fb00b17282)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:26.681346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:26.774339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '255360a1000c4130b0e5a4fb00b17282'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.804112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '255360a1000c4130b0e5a4fb00b17282'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.916577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:26.938642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255360a1000c4130b0e5a4fb00b17282', 'request_id': 'req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.950179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255360a1000c4130b0e5a4fb00b17282', 'request_id': 'req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.960159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255360a1000c4130b0e5a4fb00b17282', 'request_id': 'req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.979197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 255360a1000c4130b0e5a4fb00b17282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:26.979992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.980767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.995039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '255360a1000c4130b0e5a4fb00b17282', 'request_id': 'req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:26.996337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '255360a1000c4130b0e5a4fb00b17282', 'request_id': 'req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.000765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '255360a1000c4130b0e5a4fb00b17282', 'request_id': 'req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.011614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2577/5152] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:26 2022] DELETE /identity/v3/domains/255360a1000c4130b0e5a4fb00b17282 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:27.013082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.017572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:27.049345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7b4c-7912-47b6-8b77-b69aeb6e37d5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.127252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.128150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.128593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.128870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.130155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.131941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.184991 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2576/5153] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:27 2022] POST /identity/v3/projects => generated 376 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:27.189010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.190715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:27.203604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8cdf-54b7-40b8-9663-be8c61565d4c tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.270322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.271246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.271369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.271636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/ab997f6cb14f46ab942a8ee6e7b91fa8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.272760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=ab997f6cb14f46ab942a8ee6e7b91fa8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.274780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.277279 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2578/5154] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:27 2022] GET /identity/v3/projects/ab997f6cb14f46ab942a8ee6e7b91fa8 => generated 376 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:27.282512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.297882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5bcef-c7c6-44d8-984e-107a8b4bd3cc tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.304056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.305640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.306208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.307255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.308141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.312261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.349586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.356330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2577/5155] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 02:49:27 2022] GET /identity/v3/projects => generated 6599 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:27.363020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343604f-6067-4d8c-b4f8-95566971cb56 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.367873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.368515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.368799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.369143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/ab997f6cb14f46ab942a8ee6e7b91fa8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.369390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.370563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab997f6cb14f46ab942a8ee6e7b91fa8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.371946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:27.373016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.444826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab997f6cb14f46ab942a8ee6e7b91fa8', 'request_id': 'req-3028aba2-2e98-47d2-8a25-7756fa32e4bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.453672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ef43b-822a-4873-a8ba-d0c1eb88722b tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.457621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab997f6cb14f46ab942a8ee6e7b91fa8', 'request_id': 'req-3028aba2-2e98-47d2-8a25-7756fa32e4bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.477310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab997f6cb14f46ab942a8ee6e7b91fa8', 'request_id': 'req-3028aba2-2e98-47d2-8a25-7756fa32e4bf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.506888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project ab997f6cb14f46ab942a8ee6e7b91fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:27.507379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.508310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:27.510441 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2579/5156] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:27 2022] DELETE /identity/v3/projects/ab997f6cb14f46ab942a8ee6e7b91fa8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:27.515703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.518605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:27.528279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.528935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.529214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.529496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.531629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:27.582782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:27.586254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:27.646907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.653100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.681489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aba2-2e98-47d2-8a25-7756fa32e4bf tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.682821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2578/5157] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:27.687548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.689054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.689054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.689054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.689710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.691961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.735704 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2580/5158] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:27 2022] POST /identity/v3/projects => generated 347 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:27.736878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.750088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987da920-e335-4a6e-b4e0-22df0d064a41 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.846336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.847386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.847856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.848289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/8eeba422dac44e4ca4d5b3023f608f5c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.851702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:update_project(project_id=8eeba422dac44e4ca4d5b3023f608f5c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.857023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.927979 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2579/5159] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 02:49:27 2022] PATCH /identity/v3/projects/8eeba422dac44e4ca4d5b3023f608f5c => generated 360 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:27.932964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:27.949715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45171892-a960-484c-bfb3-5a813e1b8a1d tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:27.956249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:27.957257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:27.957882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:27.958263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/8eeba422dac44e4ca4d5b3023f608f5c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:27.973832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=8eeba422dac44e4ca4d5b3023f608f5c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:27.976050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:27.992483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:28.006799 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2581/5160] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:27 2022] GET /identity/v3/projects/8eeba422dac44e4ca4d5b3023f608f5c => generated 347 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:28.013938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e72cc-596e-4487-b9de-de2a582f1695 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:28.069895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:28.070579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:28.070916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:28.074088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/8eeba422dac44e4ca4d5b3023f608f5c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:28.077895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8eeba422dac44e4ca4d5b3023f608f5c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:28.079819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:28.176469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeba422dac44e4ca4d5b3023f608f5c', 'request_id': 'req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.184252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeba422dac44e4ca4d5b3023f608f5c', 'request_id': 'req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.191868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeba422dac44e4ca4d5b3023f608f5c', 'request_id': 'req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.224404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 8eeba422dac44e4ca4d5b3023f608f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:28.224682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.225749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.232252 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2580/5161] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:27 2022] DELETE /identity/v3/projects/8eeba422dac44e4ca4d5b3023f608f5c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:28.233931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:28.237145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:28.265054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a75d-2ef6-4a68-bb72-4428041aade1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:28.449032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:28.449775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:28.450064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:28.450329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:28.452283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:28.457426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:28.508039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2582/5162] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:28 2022] POST /identity/v3/projects => generated 361 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:28.511896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:28.523179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d129aac-032e-4ad6-ab16-24bcaf4a32ec tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:28.578213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:28.677661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:28.678338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:28.678629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:28.678912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/a1e181c6789742b39f724f9808d2b854` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:28.681574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:update_project(project_id=a1e181c6789742b39f724f9808d2b854)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:28.683687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:28.774113 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2581/5163] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 02:49:28 2022] PATCH /identity/v3/projects/a1e181c6789742b39f724f9808d2b854 => generated 373 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:28.778555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:28.789701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a93cc-e922-4709-89c8-6621cda643f1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:28.797488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:28.798372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:28.798849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:28.799283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/a1e181c6789742b39f724f9808d2b854` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:28.812598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=a1e181c6789742b39f724f9808d2b854)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:28.814959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:28.817223 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2583/5164] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:28 2022] GET /identity/v3/projects/a1e181c6789742b39f724f9808d2b854 => generated 360 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:28.820888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:28.836747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750607fb-fb19-45df-ae3a-a86d2aa1dba2 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:28.848200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:28.849763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:28.850046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:28.850361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/a1e181c6789742b39f724f9808d2b854` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:28.856267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a1e181c6789742b39f724f9808d2b854)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:28.860726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:28.927343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e181c6789742b39f724f9808d2b854', 'request_id': 'req-0a63d768-925b-4cb9-a489-55a13b052d37'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.935629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e181c6789742b39f724f9808d2b854', 'request_id': 'req-0a63d768-925b-4cb9-a489-55a13b052d37'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.943793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e181c6789742b39f724f9808d2b854', 'request_id': 'req-0a63d768-925b-4cb9-a489-55a13b052d37'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.964352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project a1e181c6789742b39f724f9808d2b854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:28.964845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.966196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:28.972676 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2582/5165] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:28 2022] DELETE /identity/v3/projects/a1e181c6789742b39f724f9808d2b854 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:28.973309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:28.975325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:29.003461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224d964-f231-4f80-98ca-1de0b5554380 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.110997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.111526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.111813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.112091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.112743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:29.114906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:29.143863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:29.161259 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2584/5166] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:28 2022] POST /identity/v3/projects => generated 355 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:29.165397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:29.179956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d768-925b-4cb9-a489-55a13b052d37 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.301976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.302721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.302865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.303120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/73e612d84fea41078db4df8443e7eac8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.304606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:update_project(project_id=73e612d84fea41078db4df8443e7eac8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:29.307292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:29.321973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:29.377056 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2583/5167] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 02:49:29 2022] PATCH /identity/v3/projects/73e612d84fea41078db4df8443e7eac8 => generated 369 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:29.380771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:29.392364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1315938-0d74-42b5-bb65-4555f58ac6e1 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.397308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.397958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.398245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.398524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/73e612d84fea41078db4df8443e7eac8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.412334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:get_project(project_id=73e612d84fea41078db4df8443e7eac8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:29.414690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:29.419757 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2585/5168] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:29 2022] GET /identity/v3/projects/73e612d84fea41078db4df8443e7eac8 => generated 356 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:29.421191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:29.432413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ec7e-e6f6-48db-93d5-83dbee5f226a tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.437714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.439049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.439049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.439049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/projects/73e612d84fea41078db4df8443e7eac8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.440235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73e612d84fea41078db4df8443e7eac8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:29.442547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:29.498707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e612d84fea41078db4df8443e7eac8', 'request_id': 'req-590c88e7-0865-4bad-8ecc-2eb0b4760c15'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:29.511510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e612d84fea41078db4df8443e7eac8', 'request_id': 'req-590c88e7-0865-4bad-8ecc-2eb0b4760c15'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:29.527584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e612d84fea41078db4df8443e7eac8', 'request_id': 'req-590c88e7-0865-4bad-8ecc-2eb0b4760c15'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:29.544622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] The token cache is being invalidate because project 73e612d84fea41078db4df8443e7eac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:29.545063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:29.545828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:29.547866 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2584/5169] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:29 2022] DELETE /identity/v3/projects/73e612d84fea41078db4df8443e7eac8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:29.552518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:29.554588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:29.574333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d16a72-db55-4fef-bb78-bf6cfe95f1ce tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.716114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.716829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.717504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.717897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains/255360a1000c4130b0e5a4fb00b17282` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.726776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Could not find domain: 255360a1000c4130b0e5a4fb00b17282.: keystone.exception.DomainNotFound: Could not find domain: 255360a1000c4130b0e5a4fb00b17282. Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 255360a1000c4130b0e5a4fb00b17282. Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:29.733345 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:29.735144 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 255360a1000c4130b0e5a4fb00b17282. Oct 05 02:49:29.736809 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:29.741689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:29.745607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2586/5170] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:49:29 2022] PATCH /identity/v3/domains/255360a1000c4130b0e5a4fb00b17282 => generated 112 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:29.757095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c88e7-0865-4bad-8ecc-2eb0b4760c15 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.764870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c07be8-8d7c-431b-ab28-b30b147f664e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ffa3758ab6b48d4bac6be9cd60d10a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e60645215a7244dc9b11038ccc4ee43c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.765672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c07be8-8d7c-431b-ab28-b30b147f664e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.766109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c07be8-8d7c-431b-ab28-b30b147f664e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.766613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c07be8-8d7c-431b-ab28-b30b147f664e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] PATH_INFO: `/v3/domains/927a843310f8405693353683cfc85766` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.781883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c07be8-8d7c-431b-ab28-b30b147f664e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a7c07be8-8d7c-431b-ab28-b30b147f664e tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Could not find domain: 927a843310f8405693353683cfc85766.: keystone.exception.DomainNotFound: Could not find domain: 927a843310f8405693353683cfc85766. Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 927a843310f8405693353683cfc85766. Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:29.788703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:29.789789 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 927a843310f8405693353683cfc85766. Oct 05 02:49:29.790734 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:29.800273 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2585/5171] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:49:29 2022] PATCH /identity/v3/domains/927a843310f8405693353683cfc85766 => generated 112 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:29.801516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:29.804957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:29.946033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a29f25-cf76-4337-8cf8-5bd5b9c82ec5 tempest-ProjectsTestJSON-1445663730 tempest-ProjectsTestJSON-1445663730-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:29.952167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:29.953221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:29.955995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:29.956288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] PATH_INFO: `/v3/users/de52931e8c404bbc834a852985513e88` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:29.958753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de52931e8c404bbc834a852985513e88)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:29.964233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:30.089564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de52931e8c404bbc834a852985513e88'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.125893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de52931e8c404bbc834a852985513e88'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.127168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de52931e8c404bbc834a852985513e88'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.146465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de52931e8c404bbc834a852985513e88'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.147746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de52931e8c404bbc834a852985513e88'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.171303 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2587/5172] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:29 2022] DELETE /identity/v3/users/de52931e8c404bbc834a852985513e88 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:30.179622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:30.179622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:30.179622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:30.206032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:30.207187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:30.333412 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2586/5173] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:30.344588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:30.346289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:30.352253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:30.428567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5100c-da99-483a-b855-2ab78b4ce189 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:30.433526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:30.434163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:30.434448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:30.434729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:30.451722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:30.453677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:30.466420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2588/5174] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:30.842637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:30.844123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:30.856683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4cdf5-95b3-4738-8118-e165b6bf7579 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:30.865303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:30.866284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:30.866781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:30.867306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] PATH_INFO: `/v3/projects/4f3fbab4a49e4ed68ace374adc28457a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:30.868691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3fbab4a49e4ed68ace374adc28457a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:30.871734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:30.939930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3fbab4a49e4ed68ace374adc28457a', 'request_id': 'req-f3da20aa-6fe1-47d4-92f6-135ea5583804'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.946206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3fbab4a49e4ed68ace374adc28457a', 'request_id': 'req-f3da20aa-6fe1-47d4-92f6-135ea5583804'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.948372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:30.955494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3fbab4a49e4ed68ace374adc28457a', 'request_id': 'req-f3da20aa-6fe1-47d4-92f6-135ea5583804'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.980788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] The token cache is being invalidate because project 4f3fbab4a49e4ed68ace374adc28457a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:30.981180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.981919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:30.986507 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2587/5175] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:30 2022] DELETE /identity/v3/projects/4f3fbab4a49e4ed68ace374adc28457a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:30.987895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:31.002361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db09211-b88b-4110-9eb2-8f9cda80e421 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:31.068075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:31.068314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:31.068583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:31.068784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] PATH_INFO: `/v3/users/6ffa3758ab6b48d4bac6be9cd60d10a5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:31.069986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffa3758ab6b48d4bac6be9cd60d10a5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:31.072123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:31.130464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffa3758ab6b48d4bac6be9cd60d10a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.145140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffa3758ab6b48d4bac6be9cd60d10a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.145949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffa3758ab6b48d4bac6be9cd60d10a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.153617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffa3758ab6b48d4bac6be9cd60d10a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.154295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e719f46-56cd-4ea9-8069-c68fac72da9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffa3758ab6b48d4bac6be9cd60d10a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.168659 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2589/5176] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:30 2022] DELETE /identity/v3/users/6ffa3758ab6b48d4bac6be9cd60d10a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:31.559850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:31.561342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:31.578930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da20aa-6fe1-47d4-92f6-135ea5583804 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:31.679404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:31.680058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:31.680345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:31.680628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] PATH_INFO: `/v3/projects/e60645215a7244dc9b11038ccc4ee43c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:31.682529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60645215a7244dc9b11038ccc4ee43c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:31.684531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:31.740198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60645215a7244dc9b11038ccc4ee43c', 'request_id': 'req-0cee507d-4721-43eb-84ad-10f67255e2d0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.753356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60645215a7244dc9b11038ccc4ee43c', 'request_id': 'req-0cee507d-4721-43eb-84ad-10f67255e2d0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.763420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60645215a7244dc9b11038ccc4ee43c', 'request_id': 'req-0cee507d-4721-43eb-84ad-10f67255e2d0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.778858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] The token cache is being invalidate because project e60645215a7244dc9b11038ccc4ee43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:31.779206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.780273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cee507d-4721-43eb-84ad-10f67255e2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:31.785207 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2588/5177] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:31 2022] DELETE /identity/v3/projects/e60645215a7244dc9b11038ccc4ee43c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:31.787159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:31.787492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:31.788245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:31.811555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:31.812792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:31.834823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:31.904053 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2590/5178] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:31.907370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:31.907764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:31.908147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:31.951737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:31.952980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:31.974228 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2589/5179] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:31.979233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:31.989375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195cb9a-797e-4048-99fb-0065add1f244 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:31.995109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:31.995918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:31.996450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:31.996724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:31.997417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:31.997720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:31.999416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.018980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.021186 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2591/5180] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:32.030507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1af7e-d954-4705-aa10-01de5c8142a0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.035555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.036171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.036450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.036722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.037387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.039282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.087456 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2590/5181] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:32 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:32.092314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.107258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2214e-0939-4f1b-8817-71f5e3d83849 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.188654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.189355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.189750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.190612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.190787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.192838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.221942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2592/5182] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:32 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:32.225710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.246496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea688dd-e5ba-4cf2-9e64-bdf2ac2cbd65 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.252975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.254041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.254536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.256621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.257736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.260763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.285797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.286296 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2591/5183] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:32.299364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf727c-86b8-4355-8f72-aa2762beaaff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.316234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33213343-463d-4eab-833f-399ff1a65896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.317144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33213343-463d-4eab-833f-399ff1a65896 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.317580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33213343-463d-4eab-833f-399ff1a65896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.317869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33213343-463d-4eab-833f-399ff1a65896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.318534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33213343-463d-4eab-833f-399ff1a65896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.320149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33213343-463d-4eab-833f-399ff1a65896 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.339335 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2593/5184] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:32.343310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.357327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846f9f3-5047-4c6c-b246-a3271a5b1071 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.363037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.363718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.364053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.364474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] PATH_INFO: `/v3/projects/30cd8e4362e34765b595e59504a1d261/users/d97ea0408fc741b38224c24ce0d8eed9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.399916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cd8e4362e34765b595e59504a1d261, user_id=d97ea0408fc741b38224c24ce0d8eed9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.404152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.435929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2592/5185] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:32 2022] PUT /identity/v3/projects/30cd8e4362e34765b595e59504a1d261/users/d97ea0408fc741b38224c24ce0d8eed9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:32.437743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.438070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.438637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.476922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] MFA Rules not processed for user `d97ea0408fc741b38224c24ce0d8eed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:32.479161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:32.556408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2594/5186] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:32.561530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.586308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:32.666840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b8fdd-3da4-468c-b6a1-1c185294eb84 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.675176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.676222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.676683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.677106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.677870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.679940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.724463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2593/5187] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:32 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:32.729987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:32.752823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba57c4c-c6a2-486b-bb88-f0c70ff3d03e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:32.807190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:32.918992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:32.919943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:32.920357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:32.920733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:32.921681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:32.925772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:32.999086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.000338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2595/5188] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:32 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:33.015540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be6bb8-bc36-490f-a9e7-06d0a174f2f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.030788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.031426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.031708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.031984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.032764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.034430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.062457 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2594/5189] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:33.063799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.085643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f677f-134b-45f6-829a-dc982fb4d9cb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.102919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.105812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.105974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.106593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] PATH_INFO: `/v3/projects/69604a1826ab468da510d54542e0ed84/users/48a8842aed284d63bdc887a627f2aba4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.151072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69604a1826ab468da510d54542e0ed84, user_id=48a8842aed284d63bdc887a627f2aba4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.158374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.193229 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2596/5190] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:33 2022] PUT /identity/v3/projects/69604a1826ab468da510d54542e0ed84/users/48a8842aed284d63bdc887a627f2aba4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:33.193901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.205197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225dd7d-aa2a-4826-a700-af62d3c504df admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.303093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e9582-f57c-4c8b-af74-ad34937a0435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.303665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e9582-f57c-4c8b-af74-ad34937a0435 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.303996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e9582-f57c-4c8b-af74-ad34937a0435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.304276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e9582-f57c-4c8b-af74-ad34937a0435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.305157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e9582-f57c-4c8b-af74-ad34937a0435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.307961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e9582-f57c-4c8b-af74-ad34937a0435 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.322871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2595/5191] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:33.325400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.341316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a03365-99a6-4b7f-8cd0-7ef722636609 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.346691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.347508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.347883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.348255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] PATH_INFO: `/v3/projects/69604a1826ab468da510d54542e0ed84/users/48a8842aed284d63bdc887a627f2aba4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.351062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69604a1826ab468da510d54542e0ed84, user_id=48a8842aed284d63bdc887a627f2aba4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.354446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.371493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2597/5192] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:33 2022] PUT /identity/v3/projects/69604a1826ab468da510d54542e0ed84/users/48a8842aed284d63bdc887a627f2aba4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:33.387854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.389002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.389957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.439987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] MFA Rules not processed for user `48a8842aed284d63bdc887a627f2aba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:33.441837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:33.555046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.558795 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2596/5193] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:33.572038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacad8a-1e6a-405e-b4d6-7eceff195a90 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.579147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.580980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.581365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.581792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.582541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.583647 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:33.583647 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:49:33.583647 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:49:33.584931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.627561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.638006 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2598/5194] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:49:33 2022] POST /identity/v3/regions => generated 224 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:33.642639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a12e8-60b3-4d6a-b777-11bf0ba8381d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.677084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:33.688819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.689679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.690353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.690861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.691772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.692854 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:33.692854 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:33.692854 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:33.694024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.738123 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2597/5195] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:49:33 2022] POST /identity/v3/regions => generated 223 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:33.739390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.764859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38b9ff-9b7a-4973-92ee-b5b2ccc63792 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.787428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.787428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.787888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.788038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/a973ab7c-a41a-4ffe-aef0-9b5f8d3ac3e6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.788930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:create_region(region_id=a973ab7c-a41a-4ffe-aef0-9b5f8d3ac3e6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.790560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.828448 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2599/5196] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Oct 5 02:49:33 2022] PUT /identity/v3/regions/a973ab7c-a41a-4ffe-aef0-9b5f8d3ac3e6 => generated 231 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:33.829833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.847110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b415f8-a9eb-418e-bddf-c9545c782b82 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.868700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.870097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.870508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.870886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/a973ab7c-a41a-4ffe-aef0-9b5f8d3ac3e6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.871839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a973ab7c-a41a-4ffe-aef0-9b5f8d3ac3e6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.873081 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:33.873081 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:33.873081 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:33.874431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.908834 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2598/5197] 10.222.0.16 () {58 vars in 1242 bytes} [Wed Oct 5 02:49:33 2022] DELETE /identity/v3/regions/a973ab7c-a41a-4ffe-aef0-9b5f8d3ac3e6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:33.910339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.923047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fcb3d-9e60-4ba0-b1c4-156deb6dc0c7 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:33.940185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:33.940829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:33.941150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:33.941430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:33.942180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:33.943821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:33.973664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:33.980961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2600/5198] 10.222.0.16 () {60 vars in 1150 bytes} [Wed Oct 5 02:49:33 2022] POST /identity/v3/regions => generated 252 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:33.986167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addee77-7e18-4bc9-a471-dff77fee7a5e tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.006833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.008161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.008729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.009210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/a62a5cf68d934119aa2e78dd9969501d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.011050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:update_region(region_id=a62a5cf68d934119aa2e78dd9969501d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.012548 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:34.012548 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:49:34.012548 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:49:34.013517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.040948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2599/5199] 10.222.0.16 () {60 vars in 1250 bytes} [Wed Oct 5 02:49:33 2022] PATCH /identity/v3/regions/a62a5cf68d934119aa2e78dd9969501d => generated 254 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:34.044673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.056277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe9a29-43f1-463c-b5d0-abd57e4b51bc tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.075495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.076149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.076434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.076713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/a62a5cf68d934119aa2e78dd9969501d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.077340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:get_region(region_id=a62a5cf68d934119aa2e78dd9969501d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.078582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.101080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2601/5200] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:34 2022] GET /identity/v3/regions/a62a5cf68d934119aa2e78dd9969501d => generated 254 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:34.105391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.124935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5aa8-b00a-4dee-8233-0b0f4651d78d tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.130111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.130945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.131212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.131498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/a62a5cf68d934119aa2e78dd9969501d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.132162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a62a5cf68d934119aa2e78dd9969501d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.135458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.163970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.165079 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2600/5201] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:34 2022] DELETE /identity/v3/regions/a62a5cf68d934119aa2e78dd9969501d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:34.176524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd44b-93a5-446b-b528-b83bebd4aec9 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.203715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.204492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.204846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.205186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.205803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.206949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.218118 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2602/5202] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:49:34 2022] GET /identity/v3/regions => generated 669 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:34.219891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.239194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb5955-95af-4a2d-8c12-600d415d50ea tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.248278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.249384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.250196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.250768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/a62a5cf68d934119aa2e78dd9969501d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.251851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:delete_region(region_id=a62a5cf68d934119aa2e78dd9969501d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.253828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Could not find region: a62a5cf68d934119aa2e78dd9969501d.: keystone.exception.RegionNotFound: Could not find region: a62a5cf68d934119aa2e78dd9969501d. Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a62a5cf68d934119aa2e78dd9969501d. Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:34.275295 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: a62a5cf68d934119aa2e78dd9969501d. Oct 05 02:49:34.276331 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:34.282209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2601/5203] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:34 2022] DELETE /identity/v3/regions/a62a5cf68d934119aa2e78dd9969501d => generated 112 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:34.282303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.298257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88283-e1de-4949-94bd-cfec6f9e0079 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.305578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.306325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.307127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.307950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.308582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.309707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.321035 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2603/5204] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:49:34 2022] GET /identity/v3/regions => generated 669 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:34.321374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.342293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b17434-04af-453f-a090-4300a5a9000c tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.348674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.348946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.349231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.350045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.350722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.352335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.380373 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2602/5205] 10.222.0.16 () {60 vars in 1150 bytes} [Wed Oct 5 02:49:34 2022] POST /identity/v3/regions => generated 252 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:34.384217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.395115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566a6f-ac36-4238-bf34-64a0ad992c15 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.411477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.412081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.412354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.412629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.413285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Adding query filter params (parent_region_id=819379b6aac24b1c92039b99d1712dfa) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:34.413597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.414653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.416664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:34.426961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.427758 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2604/5206] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:49:34 2022] GET /identity/v3/regions?parent_region_id=819379b6aac24b1c92039b99d1712dfa => generated 398 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:34.440490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bdea7-224c-4b04-9a27-4667370b6257 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.445226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.445868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.446152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.446423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/f769b13f403349a68d64023547fb295d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.447017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f769b13f403349a68d64023547fb295d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.448790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.474367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.475241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2603/5207] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:34 2022] DELETE /identity/v3/regions/f769b13f403349a68d64023547fb295d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:34.485853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e174b3-18e6-4ad8-904c-887c00be76c1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.504215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.504863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.505302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.505440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/95ac43c0849444f99a70e528ff329140` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.506029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:delete_region(region_id=95ac43c0849444f99a70e528ff329140)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.507030 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:34.507030 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:49:34.507030 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:49:34.507913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.535976 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2605/5208] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:34 2022] DELETE /identity/v3/regions/95ac43c0849444f99a70e528ff329140 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:34.536966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.551138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94e8cf-ab92-4db1-9fc7-02beac998fc1 tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.569521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246d1bb-6111-4b5b-ada8-b9241eab3e1a tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a8842aed284d63bdc887a627f2aba4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69604a1826ab468da510d54542e0ed84', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.570468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246d1bb-6111-4b5b-ada8-b9241eab3e1a tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.570747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246d1bb-6111-4b5b-ada8-b9241eab3e1a tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.571024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246d1bb-6111-4b5b-ada8-b9241eab3e1a tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] PATH_INFO: `/v3/regions/819379b6aac24b1c92039b99d1712dfa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.571726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246d1bb-6111-4b5b-ada8-b9241eab3e1a tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorizing `identity:delete_region(region_id=819379b6aac24b1c92039b99d1712dfa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.573775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246d1bb-6111-4b5b-ada8-b9241eab3e1a tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.597235 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2604/5209] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:49:34 2022] DELETE /identity/v3/regions/819379b6aac24b1c92039b99d1712dfa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:34.599206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:34.709256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e1a1d-3146-41d6-adc4-159faccb5f7b tempest-RegionsTestJSON-1146328355 tempest-RegionsTestJSON-1146328355-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:34.730689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:34.732057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.732412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.732755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] PATH_INFO: `/v3/users/d97ea0408fc741b38224c24ce0d8eed9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.734090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97ea0408fc741b38224c24ce0d8eed9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:34.736697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:34.811750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97ea0408fc741b38224c24ce0d8eed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:34.834009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97ea0408fc741b38224c24ce0d8eed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:34.835077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97ea0408fc741b38224c24ce0d8eed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:34.847089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97ea0408fc741b38224c24ce0d8eed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:34.847849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97ea0408fc741b38224c24ce0d8eed9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:34.863743 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2606/5210] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:34 2022] DELETE /identity/v3/users/d97ea0408fc741b38224c24ce0d8eed9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:34.868357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:34.868872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:34.869702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:34.898692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:34.899944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:34.965529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:35.030651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2605/5211] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:35.048635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:35.053624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:35.092988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:35.135652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7373a-bd03-4389-be28-6211903a707c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:35.139930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:35.140599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:35.140886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:35.141221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:35.151948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:35.153384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:35.165029 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2607/5212] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:35.499810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:35.501357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:35.522473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4bd00-dcd2-4a0f-8848-d404ab3e2f6b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:35.529000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:35.530698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:35.530698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:35.530698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] PATH_INFO: `/v3/projects/30cd8e4362e34765b595e59504a1d261` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:35.532378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cd8e4362e34765b595e59504a1d261)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:35.536203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:35.615516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cd8e4362e34765b595e59504a1d261', 'request_id': 'req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.623436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cd8e4362e34765b595e59504a1d261', 'request_id': 'req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.633077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cd8e4362e34765b595e59504a1d261', 'request_id': 'req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.650953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] The token cache is being invalidate because project 30cd8e4362e34765b595e59504a1d261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:35.651552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.652400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.654968 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2606/5213] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:35 2022] DELETE /identity/v3/projects/30cd8e4362e34765b595e59504a1d261 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:35.662979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:35.678213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915ff81-ff6f-4850-bfcc-99c0c5e45695 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:35.750648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:35.751457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:35.751837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:35.752216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] PATH_INFO: `/v3/users/48a8842aed284d63bdc887a627f2aba4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:35.753506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a8842aed284d63bdc887a627f2aba4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:35.755545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:35.812217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a8842aed284d63bdc887a627f2aba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.827026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a8842aed284d63bdc887a627f2aba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.827757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a8842aed284d63bdc887a627f2aba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.838701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a8842aed284d63bdc887a627f2aba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.839578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-59d3f889-fb45-41af-bd2f-555e4fa8ec0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a8842aed284d63bdc887a627f2aba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:35.855776 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2608/5214] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:35 2022] DELETE /identity/v3/users/48a8842aed284d63bdc887a627f2aba4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:36.148806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.150898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:36.170077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cddbc-d0a5-4e3a-84c6-0306fd5ef0e3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.256761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.257461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.257744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.258222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] PATH_INFO: `/v3/projects/69604a1826ab468da510d54542e0ed84` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.259412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69604a1826ab468da510d54542e0ed84)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.261631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.317391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69604a1826ab468da510d54542e0ed84', 'request_id': 'req-42125839-9c01-4fdb-94ab-222407f90864'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:36.325531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69604a1826ab468da510d54542e0ed84', 'request_id': 'req-42125839-9c01-4fdb-94ab-222407f90864'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:36.332378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69604a1826ab468da510d54542e0ed84', 'request_id': 'req-42125839-9c01-4fdb-94ab-222407f90864'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:36.335625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:36.349764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] The token cache is being invalidate because project 69604a1826ab468da510d54542e0ed84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:36.349971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:36.350793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-42125839-9c01-4fdb-94ab-222407f90864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:36.356392 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2607/5215] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:36 2022] DELETE /identity/v3/projects/69604a1826ab468da510d54542e0ed84 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:36.358705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.359056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.360204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.383417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:36.385608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:36.451475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:36.493827 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2609/5216] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:36.495764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.496325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.496616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.523232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:36.525603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:36.549535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2608/5217] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:36.550460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.563487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33bcbb-e877-4ee1-8e13-c49f98dace3a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.569798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.574747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.575254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.575725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.576552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:36.577130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.579125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.593051 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2610/5218] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:36.597083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.609362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e62810-8f78-44e7-8403-5dc3d85ae7ea None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.620285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.621710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.622011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.622291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.622993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.628287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.685794 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2609/5219] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:36 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:36.687340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.699517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62726a-ef52-4487-861d-3385a9ace866 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.761390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.762269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.762530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.762902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.763705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.765852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.790915 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2611/5220] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:36 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:36.795498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.807712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141e5a-fdba-4fb0-96bd-adfd2d9f6b9a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.813749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.814377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.814667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.814946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.815605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.817570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.830196 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2610/5221] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:36.834291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.849929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a4fc9-0a03-4b32-876d-2d8f6003b3b4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.875550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947f48c-42b5-4f0d-be52-b129c3aa519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.876189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f48c-42b5-4f0d-be52-b129c3aa519f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.876469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f48c-42b5-4f0d-be52-b129c3aa519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.876758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947f48c-42b5-4f0d-be52-b129c3aa519f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.877492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947f48c-42b5-4f0d-be52-b129c3aa519f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.888140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947f48c-42b5-4f0d-be52-b129c3aa519f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.912141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2612/5222] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:36.917727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:36.930753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d74de-a70f-4542-ac9c-c459f33659dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:36.941918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:36.942630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.942904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.943180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] PATH_INFO: `/v3/projects/662936ac4c314afcbd9c29bbb3f65ac3/users/e8858430323848ce8f4c33839a29c8a8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:36.960807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=662936ac4c314afcbd9c29bbb3f65ac3, user_id=e8858430323848ce8f4c33839a29c8a8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:36.964404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:36.981710 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2611/5223] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:36 2022] PUT /identity/v3/projects/662936ac4c314afcbd9c29bbb3f65ac3/users/e8858430323848ce8f4c33839a29c8a8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:36.992126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:36.992462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:36.992746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.024382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] MFA Rules not processed for user `e8858430323848ce8f4c33839a29c8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:37.026993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:37.108697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2613/5224] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:37.113066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.186564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242600f-ad54-4241-b29f-fd48129a3a7a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.191550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.192363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.192652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.192964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.194380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.196018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.234194 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2612/5225] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:37 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:37.235799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.248030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dcd34-f29e-46b4-b081-80beb9e9b60d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.289424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:37.317795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.318409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.318693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.318968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.319615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.321596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.346275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2614/5226] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:37 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:37.350465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.362340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82593040-6044-4c95-aac8-574d15c55c52 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.367049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.367659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.367945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.368226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.369647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.371728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.382771 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2613/5227] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:37.387286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.397623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625bb3-3181-4db3-90a4-a02f03a478d5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.402675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.403291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.403572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.403848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] PATH_INFO: `/v3/projects/54ed9393c9af4f67ad75d96d6b385a89/users/ea0bb55a5d814ee183a8d4b8f7521330/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.421103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ed9393c9af4f67ad75d96d6b385a89, user_id=ea0bb55a5d814ee183a8d4b8f7521330, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.423807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.440479 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2615/5228] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:37 2022] PUT /identity/v3/projects/54ed9393c9af4f67ad75d96d6b385a89/users/ea0bb55a5d814ee183a8d4b8f7521330/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:37.443970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.455589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3e496-a9df-47ba-990d-b8daad7b2629 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.535807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c62a62-7480-4d6c-a59c-1966594d31f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.536477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62a62-7480-4d6c-a59c-1966594d31f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.536763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62a62-7480-4d6c-a59c-1966594d31f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.537070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c62a62-7480-4d6c-a59c-1966594d31f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.537714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c62a62-7480-4d6c-a59c-1966594d31f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.539300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c62a62-7480-4d6c-a59c-1966594d31f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.545442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:37.552251 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2614/5229] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:37.558692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.569189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb18e-0c91-4879-9280-ef7a4cde85f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.574004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.574662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.574940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.575212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] PATH_INFO: `/v3/projects/54ed9393c9af4f67ad75d96d6b385a89/users/ea0bb55a5d814ee183a8d4b8f7521330/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.577196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ed9393c9af4f67ad75d96d6b385a89, user_id=ea0bb55a5d814ee183a8d4b8f7521330, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.579964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.592349 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2616/5230] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:37 2022] PUT /identity/v3/projects/54ed9393c9af4f67ad75d96d6b385a89/users/ea0bb55a5d814ee183a8d4b8f7521330/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:37.604151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.604546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.604987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.633792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] MFA Rules not processed for user `ea0bb55a5d814ee183a8d4b8f7521330`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:37.635005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:37.724307 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2615/5231] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:37.730008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.747377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6e06-df8b-4fbe-a5b7-2e38779e95c5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.755737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.756447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.756735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.757118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.757943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.761058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.796951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2617/5232] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:37 2022] POST /identity/v3/projects => generated 329 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:37.800788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.811801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218de6-4937-4a3b-8273-d56d44122ffc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.883713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.885854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.886299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.886680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.888369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.891061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:37.945058 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2616/5233] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:37 2022] POST /identity/v3/users => generated 413 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:37.946295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:37.963975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb888-88ca-4fd8-bff8-0ba5b8cadb6f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:37.976041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:37.976672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:37.976983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:37.977267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:37.977973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:37.979629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.020946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2618/5234] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:37 2022] POST /identity/v3/roles => generated 243 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:38.026890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.040036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0764-dabf-45c3-815c-1668baf9cbd5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.046946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.049724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.049724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.049724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.050746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.067358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.090793 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2617/5235] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:38 2022] POST /identity/v3/roles => generated 247 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:38.094777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.105900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363f53-8c3a-45ed-8624-e6013df7c29e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.111717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.112679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.113017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.113302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/ffb122a388674179b26075037d3e5c0d/users/7e5a3ec65ddc43848a1ee45185af25c2/roles/60e12359b0a44c04a8f9d70e7214bc0f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.131967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ffb122a388674179b26075037d3e5c0d, user_id=7e5a3ec65ddc43848a1ee45185af25c2, role_id=60e12359b0a44c04a8f9d70e7214bc0f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.135513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.151784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2619/5236] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:38 2022] PUT /identity/v3/projects/ffb122a388674179b26075037d3e5c0d/users/7e5a3ec65ddc43848a1ee45185af25c2/roles/60e12359b0a44c04a8f9d70e7214bc0f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:38.155751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.169584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b6f0-4f59-4cd9-8e5a-0e2ce8672922 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.237549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005ac8-80d5-48da-bab1-89c5fff5f3a5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.238066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005ac8-80d5-48da-bab1-89c5fff5f3a5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.238315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005ac8-80d5-48da-bab1-89c5fff5f3a5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.238673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005ac8-80d5-48da-bab1-89c5fff5f3a5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/ffb122a388674179b26075037d3e5c0d/users/7e5a3ec65ddc43848a1ee45185af25c2/roles/8c127db092f046f7ad3b6e18a8ff6f23` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.246015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a005ac8-80d5-48da-bab1-89c5fff5f3a5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ffb122a388674179b26075037d3e5c0d, user_id=7e5a3ec65ddc43848a1ee45185af25c2, role_id=8c127db092f046f7ad3b6e18a8ff6f23)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.249699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a005ac8-80d5-48da-bab1-89c5fff5f3a5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.255679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:38.271109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2618/5237] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:38 2022] PUT /identity/v3/projects/ffb122a388674179b26075037d3e5c0d/users/7e5a3ec65ddc43848a1ee45185af25c2/roles/8c127db092f046f7ad3b6e18a8ff6f23 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:38.275897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.291903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bccc8b-a2d0-435e-b9f8-2ba447f18ae5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.364737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0768854-74f3-4660-8edf-a892642e7020 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.365969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768854-74f3-4660-8edf-a892642e7020 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.365969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768854-74f3-4660-8edf-a892642e7020 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.366270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0768854-74f3-4660-8edf-a892642e7020 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.366772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0768854-74f3-4660-8edf-a892642e7020 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.369287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0768854-74f3-4660-8edf-a892642e7020 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.414836 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2620/5238] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:38 2022] GET /identity/v3/users => generated 8354 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:38.420716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.421855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.423183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.519601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] MFA Rules not processed for user `7e5a3ec65ddc43848a1ee45185af25c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:38.522013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:38.613681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2619/5239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:38 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:38.624471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.624758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.625246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.653384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] MFA Rules not processed for user `7e5a3ec65ddc43848a1ee45185af25c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:38.654888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:38.672988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2621/5240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:38 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:38.678374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.693718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1a2e6-e7a1-48fc-be12-eb18074f78df None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.700728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5a3ec65ddc43848a1ee45185af25c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffb122a388674179b26075037d3e5c0d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-916396830', 'tempest-NotDelegatedRole-1722932891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.701931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.702224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.702771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.703925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: Authorizing `identity:create_trust()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.705657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.832780 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2620/5241] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:49:38 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:38.836535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.848840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be9bfe-a1d7-447f-80e4-091169709fe9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.854676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.855333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.855675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.856053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.856699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.857764 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:49:38.857764 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:49:38.857764 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:49:38.859223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.866500 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2622/5242] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Oct 5 02:49:38 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:38.870994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.884630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569a12-e223-409e-b7a9-0203a4bb87d8 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:38.899467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5a3ec65ddc43848a1ee45185af25c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffb122a388674179b26075037d3e5c0d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-916396830', 'tempest-NotDelegatedRole-1722932891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:38.900194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:38.900671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:38.901067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] PATH_INFO: `/v3/OS-TRUST/trusts/6f9edfda911e4fd08676b62a8cc87a71` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:38.917269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: Authorizing `identity:delete_trust(trust_id=6f9edfda911e4fd08676b62a8cc87a71)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:38.919027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:38.953492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6f9edfda911e4fd08676b62a8cc87a71', 'request_id': 'req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:38.954087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6f9edfda911e4fd08676b62a8cc87a71', 'request_id': 'req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:38.966592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6f9edfda911e4fd08676b62a8cc87a71', 'request_id': 'req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:38.973930 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2621/5243] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:49:38 2022] DELETE /identity/v3/OS-TRUST/trusts/6f9edfda911e4fd08676b62a8cc87a71 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:38.977726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:38.980495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:38.998446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012412d8-96de-41ad-8692-58ebac22dda9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:39.004575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e5a3ec65ddc43848a1ee45185af25c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffb122a388674179b26075037d3e5c0d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-916396830', 'tempest-NotDelegatedRole-1722932891'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:39.005552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:39.006051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:39.006559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] PATH_INFO: `/v3/OS-TRUST/trusts/6f9edfda911e4fd08676b62a8cc87a71` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Could not find trust: 6f9edfda911e4fd08676b62a8cc87a71.: keystone.exception.TrustNotFound: Could not find trust: 6f9edfda911e4fd08676b62a8cc87a71. Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 05 02:49:39.042610 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6f9edfda911e4fd08676b62a8cc87a71. Oct 05 02:49:39.043674 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:39.047868 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2623/5244] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:38 2022] GET /identity/v3/OS-TRUST/trusts/6f9edfda911e4fd08676b62a8cc87a71 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 05 02:49:39.048156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:39.049665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:39.077303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fd985-45a5-45d3-9ccb-3e4b5bdb1a88 tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:39.082161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:39.082862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:39.083154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:39.083429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/8c127db092f046f7ad3b6e18a8ff6f23` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:39.084968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8c127db092f046f7ad3b6e18a8ff6f23)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:39.086762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:39.151434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:39.179499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 8c127db092f046f7ad3b6e18a8ff6f23 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:39.179945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.180772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.187867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:39.188070 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2622/5245] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:39 2022] DELETE /identity/v3/roles/8c127db092f046f7ad3b6e18a8ff6f23 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:39.190022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:39.202903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:39.217881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc1db-95c4-4968-9e93-802d731bc95e tempest-TrustsV3TestJSON-1386477894 tempest-user-189440708] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:39.348797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:39.349596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:39.359518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:39.359518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/60e12359b0a44c04a8f9d70e7214bc0f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:39.363031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=60e12359b0a44c04a8f9d70e7214bc0f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:39.368402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:39.444861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 60e12359b0a44c04a8f9d70e7214bc0f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:39.445252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.447699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.457476 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2624/5246] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:39 2022] DELETE /identity/v3/roles/60e12359b0a44c04a8f9d70e7214bc0f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:39.458391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:39.485124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd9c32-0e42-4f9a-b8a7-d0eee723411e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:39.601645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:39.602217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:39.602509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:39.602845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users/7e5a3ec65ddc43848a1ee45185af25c2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:39.604780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7e5a3ec65ddc43848a1ee45185af25c2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:39.606778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:39.704435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5a3ec65ddc43848a1ee45185af25c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.724391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5a3ec65ddc43848a1ee45185af25c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.725676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5a3ec65ddc43848a1ee45185af25c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.757238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5a3ec65ddc43848a1ee45185af25c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.759049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5a3ec65ddc43848a1ee45185af25c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:39.854590 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2623/5247] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:39 2022] DELETE /identity/v3/users/7e5a3ec65ddc43848a1ee45185af25c2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:39.859133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:39.862413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:39.894965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9b86d-3be8-4b2b-b708-123ee297f04f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.014902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.015518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.015798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.016089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/ffb122a388674179b26075037d3e5c0d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.017300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffb122a388674179b26075037d3e5c0d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.019692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.112306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb122a388674179b26075037d3e5c0d', 'request_id': 'req-47a2e7f2-1135-478d-8014-aaaf922e14f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:40.122834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb122a388674179b26075037d3e5c0d', 'request_id': 'req-47a2e7f2-1135-478d-8014-aaaf922e14f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:40.129633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb122a388674179b26075037d3e5c0d', 'request_id': 'req-47a2e7f2-1135-478d-8014-aaaf922e14f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:40.132387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:40.145843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] The token cache is being invalidate because project ffb122a388674179b26075037d3e5c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:40.146262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:40.147057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:40.155690 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2625/5248] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:39 2022] DELETE /identity/v3/projects/ffb122a388674179b26075037d3e5c0d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:40.157041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.158946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:40.183940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef8342-0dca-417e-b5e5-60a224626533 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.261934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.262588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.263072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.263546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.264401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.266745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.283771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:40.312950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2624/5249] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:40 2022] POST /identity/v3/projects => generated 329 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:40.316297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.319632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:40.334157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2e7f2-1135-478d-8014-aaaf922e14f3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.405153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.406800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.406800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.406800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.407449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.409559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.445987 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2626/5250] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:40 2022] POST /identity/v3/users => generated 413 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:40.449644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.467579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e986ef-c2e6-40c7-aeab-ef2c5c81ffb9 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.474539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.475177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.475466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.475742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.476562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.479082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.517155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.533803 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2625/5251] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:40 2022] POST /identity/v3/roles => generated 243 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:40.545986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4848-da4a-4672-b979-4bd6d72b9367 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.562416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.563199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.564341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.564707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.565988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.571956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.610118 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2627/5252] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:40 2022] POST /identity/v3/roles => generated 247 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:40.614646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.639370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84538549-12bb-483b-b9f3-b76e4b70d5c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.653080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.654329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.654769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.655216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/128cfea6d2f4499592b1329706598ecc/users/6c3b7898096f417e99863457f3b1252e/roles/aa9b25f5d56648fe9aeba5f8a5011486` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.681216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=128cfea6d2f4499592b1329706598ecc, user_id=6c3b7898096f417e99863457f3b1252e, role_id=aa9b25f5d56648fe9aeba5f8a5011486)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.686471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.705939 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2626/5253] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:40 2022] PUT /identity/v3/projects/128cfea6d2f4499592b1329706598ecc/users/6c3b7898096f417e99863457f3b1252e/roles/aa9b25f5d56648fe9aeba5f8a5011486 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:40.710377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.724117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd2ec-19f0-4180-80df-fa19144553f2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.821847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f94da-7fcf-4ee8-b7cc-ff1fca3f9670 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.825264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f94da-7fcf-4ee8-b7cc-ff1fca3f9670 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.825831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f94da-7fcf-4ee8-b7cc-ff1fca3f9670 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.826475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f94da-7fcf-4ee8-b7cc-ff1fca3f9670 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/128cfea6d2f4499592b1329706598ecc/users/6c3b7898096f417e99863457f3b1252e/roles/f411df5eea3a4deb94c91804d01a1860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.832492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f94da-7fcf-4ee8-b7cc-ff1fca3f9670 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=128cfea6d2f4499592b1329706598ecc, user_id=6c3b7898096f417e99863457f3b1252e, role_id=f411df5eea3a4deb94c91804d01a1860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.835502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f94da-7fcf-4ee8-b7cc-ff1fca3f9670 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:40.861530 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2628/5254] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:40 2022] PUT /identity/v3/projects/128cfea6d2f4499592b1329706598ecc/users/6c3b7898096f417e99863457f3b1252e/roles/f411df5eea3a4deb94c91804d01a1860 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:40.865791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:40.879907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0fb1-f55c-47a8-b1ee-83ab37b313ba tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:40.980938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a079519-5640-46ef-9732-a1bbfd565554 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:40.980938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079519-5640-46ef-9732-a1bbfd565554 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:40.980938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079519-5640-46ef-9732-a1bbfd565554 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:40.981335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a079519-5640-46ef-9732-a1bbfd565554 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:40.981335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a079519-5640-46ef-9732-a1bbfd565554 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:40.981782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a079519-5640-46ef-9732-a1bbfd565554 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:41.026615 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2627/5255] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:40 2022] GET /identity/v3/users => generated 8354 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:41.033059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.033350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.033902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.099294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] MFA Rules not processed for user `6c3b7898096f417e99863457f3b1252e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:41.100577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:41.199814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:41.249252 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2629/5256] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:41 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:41.261645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.261939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.262221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.286571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] MFA Rules not processed for user `6c3b7898096f417e99863457f3b1252e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:41.287970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:41.305122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:41.317390 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2628/5257] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:41 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:41.322967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd7f4d-afeb-45d6-9fb9-3b495a9ab0c9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:41.331586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3b7898096f417e99863457f3b1252e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '128cfea6d2f4499592b1329706598ecc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-717605423', 'tempest-NotDelegatedRole-1553598982'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:41.332304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.332640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.332994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.333683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: Authorizing `identity:create_trust()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:41.335425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:41.518492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:41.524054 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2630/5258] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:49:41 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:41.529765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03385-6bb6-41a7-902c-f2598fe14e5d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:41.535848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3b7898096f417e99863457f3b1252e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '128cfea6d2f4499592b1329706598ecc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-717605423', 'tempest-NotDelegatedRole-1553598982'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:41.536765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.537090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.537476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.538178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:41.539591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:41.551552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:41.563210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2629/5259] 10.222.0.16 () {58 vars in 1252 bytes} [Wed Oct 5 02:49:41 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=6c3b7898096f417e99863457f3b1252e => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:41.564626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5644fc-c035-4bf5-a1ae-ffc233239a2a tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:41.571316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3b7898096f417e99863457f3b1252e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '128cfea6d2f4499592b1329706598ecc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-717605423', 'tempest-NotDelegatedRole-1553598982'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:41.572050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.573200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.573608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] PATH_INFO: `/v3/OS-TRUST/trusts/bb49faddc6f545bc90fde9204cc2c564` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.582618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: Authorizing `identity:delete_trust(trust_id=bb49faddc6f545bc90fde9204cc2c564)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:41.584458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:41.614537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bb49faddc6f545bc90fde9204cc2c564', 'request_id': 'req-de05f711-c466-40c5-a226-40e2a4ede8f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:41.616011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bb49faddc6f545bc90fde9204cc2c564', 'request_id': 'req-de05f711-c466-40c5-a226-40e2a4ede8f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:41.629910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bb49faddc6f545bc90fde9204cc2c564', 'request_id': 'req-de05f711-c466-40c5-a226-40e2a4ede8f0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:41.642859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2631/5260] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:49:41 2022] DELETE /identity/v3/OS-TRUST/trusts/bb49faddc6f545bc90fde9204cc2c564 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:41.655035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:41.655035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:41.676980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815845f-27dc-46bc-9806-379617b931f9 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:41.684768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c3b7898096f417e99863457f3b1252e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '128cfea6d2f4499592b1329706598ecc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-717605423', 'tempest-NotDelegatedRole-1553598982'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:41.685770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.686255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.687145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] PATH_INFO: `/v3/OS-TRUST/trusts/bb49faddc6f545bc90fde9204cc2c564` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Could not find trust: bb49faddc6f545bc90fde9204cc2c564.: keystone.exception.TrustNotFound: Could not find trust: bb49faddc6f545bc90fde9204cc2c564. Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 05 02:49:41.704648 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bb49faddc6f545bc90fde9204cc2c564. Oct 05 02:49:41.705738 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:41.708163 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2630/5261] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:41 2022] GET /identity/v3/OS-TRUST/trusts/bb49faddc6f545bc90fde9204cc2c564 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:41.712161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:41.713863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:41.731968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05f711-c466-40c5-a226-40e2a4ede8f0 tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:41.737897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:41.738691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.739483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.739603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/f411df5eea3a4deb94c91804d01a1860` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.741382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f411df5eea3a4deb94c91804d01a1860)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:41.743546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:41.810205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role f411df5eea3a4deb94c91804d01a1860 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:41.810553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:41.814213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:41.822288 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2632/5262] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:41 2022] DELETE /identity/v3/roles/f411df5eea3a4deb94c91804d01a1860 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:41.823629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:41.825433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:41.858516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae565ed-1795-443a-8ce3-7a86f846a6de tempest-TrustsV3TestJSON-1999514845 tempest-user-371374023] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:41.982351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:41.983166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:41.983555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:41.983940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/aa9b25f5d56648fe9aeba5f8a5011486` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:41.992357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aa9b25f5d56648fe9aeba5f8a5011486)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:42.002178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:42.068554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:42.093299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role aa9b25f5d56648fe9aeba5f8a5011486 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:42.093695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.094397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.096690 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2631/5263] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:41 2022] DELETE /identity/v3/roles/aa9b25f5d56648fe9aeba5f8a5011486 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:42.100949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:42.116997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4ab79-58d4-4ac3-a35c-5a8bbba599af tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:42.193617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:42.200695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:42.202039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:42.202639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:42.203223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users/6c3b7898096f417e99863457f3b1252e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:42.205557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6c3b7898096f417e99863457f3b1252e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:42.207673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:42.301846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3b7898096f417e99863457f3b1252e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.333283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3b7898096f417e99863457f3b1252e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.334487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3b7898096f417e99863457f3b1252e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.347725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3b7898096f417e99863457f3b1252e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.349181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3b7898096f417e99863457f3b1252e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.367662 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2633/5264] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:42 2022] DELETE /identity/v3/users/6c3b7898096f417e99863457f3b1252e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:42.371831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:42.373584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:42.392010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4f97b-9e20-43a4-a2cc-d7e79d54512c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:42.489426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:42.490285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:42.490869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:42.491259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/128cfea6d2f4499592b1329706598ecc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:42.493102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=128cfea6d2f4499592b1329706598ecc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:42.495983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:42.715996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128cfea6d2f4499592b1329706598ecc', 'request_id': 'req-65fec840-ee0f-48f5-b99d-a3b369386b7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.730369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128cfea6d2f4499592b1329706598ecc', 'request_id': 'req-65fec840-ee0f-48f5-b99d-a3b369386b7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.748318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128cfea6d2f4499592b1329706598ecc', 'request_id': 'req-65fec840-ee0f-48f5-b99d-a3b369386b7f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.776934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] The token cache is being invalidate because project 128cfea6d2f4499592b1329706598ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:42.777274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.778102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:42.786500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2632/5265] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:42 2022] DELETE /identity/v3/projects/128cfea6d2f4499592b1329706598ecc => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:42.787976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:42.789771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:42.818902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d8dde-fc76-4521-8d74-a73364d778cb tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:42.937846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:42.938633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:42.939024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:42.939408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:42.940173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:42.942394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:42.987287 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2634/5266] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:42 2022] POST /identity/v3/projects => generated 329 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:42.992211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:42.998953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:43.048015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec840-ee0f-48f5-b99d-a3b369386b7f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:43.166945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:43.167989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.168445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.169200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.170057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:43.172355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:43.223715 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2633/5267] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:42 2022] POST /identity/v3/users => generated 413 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:43.226307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:43.259619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aa75a-16c6-4b77-913c-3cb89533474f tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:43.277432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:43.278085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.278368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.278808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.280613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:43.287889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:43.327208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2635/5268] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:43 2022] POST /identity/v3/roles => generated 244 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:43.329369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:43.344277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349439-17e4-4e00-9abb-cc4abe625889 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:43.355278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:43.355911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.356197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.356471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.357173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:43.358781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:43.384702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:43.412830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2634/5269] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:43 2022] POST /identity/v3/roles => generated 247 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:43.413536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:43.432551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d46080-b0ba-4100-a6e6-6be73bcacb28 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:43.453043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:43.453924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.453924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.454241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/5a38eba9d36f4529892da9bd7c7d32f4/users/06badc28170b4a26a8cf74dd3efe479f/roles/d0ffab701b53433190c08d3d5481d272` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.488649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5a38eba9d36f4529892da9bd7c7d32f4, user_id=06badc28170b4a26a8cf74dd3efe479f, role_id=d0ffab701b53433190c08d3d5481d272)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:43.491539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:43.526972 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2636/5270] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:43 2022] PUT /identity/v3/projects/5a38eba9d36f4529892da9bd7c7d32f4/users/06badc28170b4a26a8cf74dd3efe479f/roles/d0ffab701b53433190c08d3d5481d272 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:43.531224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:43.549771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90737818-176e-4519-aa5b-f6b42cdaf5cd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:43.717615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edd95c-eaa2-4992-a98c-5fec55f286ad tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:43.718319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edd95c-eaa2-4992-a98c-5fec55f286ad tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.718580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edd95c-eaa2-4992-a98c-5fec55f286ad tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.718861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edd95c-eaa2-4992-a98c-5fec55f286ad tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/5a38eba9d36f4529892da9bd7c7d32f4/users/06badc28170b4a26a8cf74dd3efe479f/roles/3e9f5f873ae642b8a6ebd8cd499a43af` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.721849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edd95c-eaa2-4992-a98c-5fec55f286ad tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5a38eba9d36f4529892da9bd7c7d32f4, user_id=06badc28170b4a26a8cf74dd3efe479f, role_id=3e9f5f873ae642b8a6ebd8cd499a43af)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:43.724590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edd95c-eaa2-4992-a98c-5fec55f286ad tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:43.740677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2635/5271] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:43 2022] PUT /identity/v3/projects/5a38eba9d36f4529892da9bd7c7d32f4/users/06badc28170b4a26a8cf74dd3efe479f/roles/3e9f5f873ae642b8a6ebd8cd499a43af => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:43.745731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:43.757539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139ce3-f736-4022-8329-4c17e18ab4cf tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:43.785026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:43.838166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362e2d4-7868-4677-b082-a4152d396f31 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:43.838868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362e2d4-7868-4677-b082-a4152d396f31 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.839158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362e2d4-7868-4677-b082-a4152d396f31 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.839918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362e2d4-7868-4677-b082-a4152d396f31 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.840772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362e2d4-7868-4677-b082-a4152d396f31 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:43.843069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362e2d4-7868-4677-b082-a4152d396f31 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:43.880370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2637/5272] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:43 2022] GET /identity/v3/users => generated 8354 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:49:43.885903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:43.886621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:43.886621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:43.944188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] MFA Rules not processed for user `06badc28170b4a26a8cf74dd3efe479f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:43.945731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:44.047537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2636/5273] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:44.059657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.060006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.060217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.105660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] MFA Rules not processed for user `06badc28170b4a26a8cf74dd3efe479f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:44.106918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:44.115310 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2638/5274] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:44.121618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.131533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7cbdd-a820-49ab-89ad-3f1f7f452429 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.136565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.137364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.137648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.137925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.138621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:create_trust()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.139799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.233933 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2637/5275] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:49:44 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:44.238797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.249498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17e748-a1bd-4e87-9467-7b0e8b7d166f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.254460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.255270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.255553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.255826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.263873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:get_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.265662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.276951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2639/5276] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:44 2022] GET /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1 => generated 859 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:44.278679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.284236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:44.292225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcc8d-f000-4a29-9a20-36e7148d2aab tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.296896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.297572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.297857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.298131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.305362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.307062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.320089 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2638/5277] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:49:44 2022] GET /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles => generated 371 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:44.325868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.337226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d01ffb-a03c-4727-94c2-134da79d529d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.341974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.342831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.343177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.343529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/d0ffab701b53433190c08d3d5481d272` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.350280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1, role_id=d0ffab701b53433190c08d3d5481d272)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.351811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.359818 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2640/5278] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:49:44 2022] GET /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/d0ffab701b53433190c08d3d5481d272 => generated 244 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:44.364636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.376279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5721-f0a2-478d-a9de-8bdaf238c52d tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.381319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.382090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.382377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.382843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/d0ffab701b53433190c08d3d5481d272` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.391472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1, role_id=d0ffab701b53433190c08d3d5481d272)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.393777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.409749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2639/5279] 10.222.0.16 () {58 vars in 1369 bytes} [Wed Oct 5 02:49:44 2022] HEAD /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/d0ffab701b53433190c08d3d5481d272 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 05 02:49:44.414210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.434297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf664f0-37c6-4b21-a158-af52793629d7 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.440037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.440707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.441031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.441300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/3e9f5f873ae642b8a6ebd8cd499a43af` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.450339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1, role_id=3e9f5f873ae642b8a6ebd8cd499a43af)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.469948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Could not find role: 3e9f5f873ae642b8a6ebd8cd499a43af.: keystone.exception.RoleNotFound: Could not find role: 3e9f5f873ae642b8a6ebd8cd499a43af. Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:49:44.484982 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3e9f5f873ae642b8a6ebd8cd499a43af. Oct 05 02:49:44.486247 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:44.488181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2641/5280] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:49:44 2022] GET /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/3e9f5f873ae642b8a6ebd8cd499a43af => generated 110 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:44.492394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.504014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd0868-bd84-4bde-9781-f958974098e1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.509177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.510534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.511270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.511270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/3e9f5f873ae642b8a6ebd8cd499a43af` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.519781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1, role_id=3e9f5f873ae642b8a6ebd8cd499a43af)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.522893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Could not find role: 3e9f5f873ae642b8a6ebd8cd499a43af.: keystone.exception.RoleNotFound: Could not find role: 3e9f5f873ae642b8a6ebd8cd499a43af. Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:49:44.533310 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3e9f5f873ae642b8a6ebd8cd499a43af. Oct 05 02:49:44.534515 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:44.534892 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2640/5281] 10.222.0.16 () {58 vars in 1369 bytes} [Wed Oct 5 02:49:44 2022] HEAD /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1/roles/3e9f5f873ae642b8a6ebd8cd499a43af => generated 0 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 05 02:49:44.538927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.550273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a77fe5-9a03-4eae-bafc-efa639d144e3 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.556025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.557629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.557966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.558406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.566826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorizing `identity:delete_trust(trust_id=6a16e54ad94a4216a0b11d40f2df64d1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.568283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.589050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6a16e54ad94a4216a0b11d40f2df64d1', 'request_id': 'req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:44.589882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6a16e54ad94a4216a0b11d40f2df64d1', 'request_id': 'req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:44.598785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6a16e54ad94a4216a0b11d40f2df64d1', 'request_id': 'req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:44.606249 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2642/5282] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:49:44 2022] DELETE /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:44.610117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.612081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:44.627029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c72db8-1acb-4cac-aadd-f74b3919807e tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.631356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06badc28170b4a26a8cf74dd3efe479f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38eba9d36f4529892da9bd7c7d32f4', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2135412900', 'tempest-DelegatedRole-1125926068'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.631983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.632269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.632828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] PATH_INFO: `/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Could not find trust: 6a16e54ad94a4216a0b11d40f2df64d1.: keystone.exception.TrustNotFound: Could not find trust: 6a16e54ad94a4216a0b11d40f2df64d1. Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 05 02:49:44.643209 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6a16e54ad94a4216a0b11d40f2df64d1. Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:44.644563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2641/5283] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:44 2022] GET /identity/v3/OS-TRUST/trusts/6a16e54ad94a4216a0b11d40f2df64d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:44.648753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.662051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:44.699009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde89e88-0a7b-4d3a-8a9b-8b3d483d56f1 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.713613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.714826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.715474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.716337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/3e9f5f873ae642b8a6ebd8cd499a43af` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.719078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3e9f5f873ae642b8a6ebd8cd499a43af)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.720885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:44.825900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 3e9f5f873ae642b8a6ebd8cd499a43af has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:44.826210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:44.827452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:44.831134 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2643/5284] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:44 2022] DELETE /identity/v3/roles/3e9f5f873ae642b8a6ebd8cd499a43af => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:44.835088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:44.836935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:44.856362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0c190-6a38-4293-b8d6-ad308362d646 tempest-TrustsV3TestJSON-1975997520 tempest-user-569842879] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:44.967021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:44.967877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:44.968311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:44.968768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/d0ffab701b53433190c08d3d5481d272` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:44.970656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d0ffab701b53433190c08d3d5481d272)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:44.972973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:45.044343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role d0ffab701b53433190c08d3d5481d272 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:45.044652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.046945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.050811 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2642/5285] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:44 2022] DELETE /identity/v3/roles/d0ffab701b53433190c08d3d5481d272 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:45.054674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:45.068003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c75652-bdcd-4a51-bf34-e446c3f5a8c0 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:45.201842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:45.242059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:45.243136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:45.243284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:45.244926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users/06badc28170b4a26a8cf74dd3efe479f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:45.247241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_user(user_id=06badc28170b4a26a8cf74dd3efe479f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:45.249650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:45.358274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06badc28170b4a26a8cf74dd3efe479f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.375156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06badc28170b4a26a8cf74dd3efe479f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.376152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06badc28170b4a26a8cf74dd3efe479f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.393587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06badc28170b4a26a8cf74dd3efe479f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.394711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06badc28170b4a26a8cf74dd3efe479f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.415128 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2644/5286] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:45 2022] DELETE /identity/v3/users/06badc28170b4a26a8cf74dd3efe479f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:45.415942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:45.417668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:45.435826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1dc68-7a1d-40ea-a285-a20d5e7e7061 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:45.564617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:45.565297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:45.565578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:45.565856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/5a38eba9d36f4529892da9bd7c7d32f4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:45.568226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a38eba9d36f4529892da9bd7c7d32f4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:45.572126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:45.585047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:45.696296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a38eba9d36f4529892da9bd7c7d32f4', 'request_id': 'req-9b2a324a-6153-4164-9613-2e448f8a3f77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.712643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a38eba9d36f4529892da9bd7c7d32f4', 'request_id': 'req-9b2a324a-6153-4164-9613-2e448f8a3f77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.730753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a38eba9d36f4529892da9bd7c7d32f4', 'request_id': 'req-9b2a324a-6153-4164-9613-2e448f8a3f77'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.755567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] The token cache is being invalidate because project 5a38eba9d36f4529892da9bd7c7d32f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:45.756440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.757319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:45.760945 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2643/5287] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:45 2022] DELETE /identity/v3/projects/5a38eba9d36f4529892da9bd7c7d32f4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:45.769901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:45.771398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:45.805614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5998-eb43-4423-bff2-4a71df5791c3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:45.975549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:45.976667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:45.977166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:45.977729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:45.979567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:45.982520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.027413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2645/5288] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:45 2022] POST /identity/v3/projects => generated 328 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:46.031651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:46.033700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:46.047961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a324a-6153-4164-9613-2e448f8a3f77 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:46.111010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:46.111861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.112414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.112414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.115834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:46.115834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.142169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2644/5289] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:46 2022] POST /identity/v3/users => generated 410 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:46.145782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:46.162959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865e90-d3d6-4337-af39-b2f087ad37b4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:46.168745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:46.169570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.170039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.170168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.171051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:46.172738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.192953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2646/5290] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:46 2022] POST /identity/v3/roles => generated 243 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:46.196423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:46.209057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475a21-e361-47f9-a405-421cd20f1c24 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:46.214558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:46.215201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.215561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.215849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.216574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:46.218296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.239358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2645/5291] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:46 2022] POST /identity/v3/roles => generated 247 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:46.242575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:46.255531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1405e-2991-4121-b720-62bdc12d8bc7 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:46.264172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:46.265763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.266663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.267173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/76313f8cac084a3a870187900207ba48/users/d92b882093bb4deb9b3173d8c8207f28/roles/8ef66cc7c6704a97ac29379daf94d7ce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.296675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=76313f8cac084a3a870187900207ba48, user_id=d92b882093bb4deb9b3173d8c8207f28, role_id=8ef66cc7c6704a97ac29379daf94d7ce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:46.309201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.345707 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2647/5292] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:46 2022] PUT /identity/v3/projects/76313f8cac084a3a870187900207ba48/users/d92b882093bb4deb9b3173d8c8207f28/roles/8ef66cc7c6704a97ac29379daf94d7ce => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:46.350100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:46.368445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64116e-a2c7-4296-b20d-3bcaf2409f12 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:46.482379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028fcb0-d94f-4ec2-a7e4-72827e5b209d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:46.483235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028fcb0-d94f-4ec2-a7e4-72827e5b209d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.483522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028fcb0-d94f-4ec2-a7e4-72827e5b209d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.483804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028fcb0-d94f-4ec2-a7e4-72827e5b209d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/76313f8cac084a3a870187900207ba48/users/d92b882093bb4deb9b3173d8c8207f28/roles/7aa58be9bca1403481de1e7961caf925` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.486076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028fcb0-d94f-4ec2-a7e4-72827e5b209d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=76313f8cac084a3a870187900207ba48, user_id=d92b882093bb4deb9b3173d8c8207f28, role_id=7aa58be9bca1403481de1e7961caf925)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:46.488708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028fcb0-d94f-4ec2-a7e4-72827e5b209d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.507413 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2646/5293] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:46 2022] PUT /identity/v3/projects/76313f8cac084a3a870187900207ba48/users/d92b882093bb4deb9b3173d8c8207f28/roles/7aa58be9bca1403481de1e7961caf925 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:46.511889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:46.523294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d9318-c9ad-4f1c-b757-1db702a87703 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:46.528496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:46.590406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c1fbd-0a4d-4102-8f0c-9f95179ae8a1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:46.591056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1fbd-0a4d-4102-8f0c-9f95179ae8a1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.591400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1fbd-0a4d-4102-8f0c-9f95179ae8a1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.591745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1fbd-0a4d-4102-8f0c-9f95179ae8a1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.592477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1fbd-0a4d-4102-8f0c-9f95179ae8a1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:46.594664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1fbd-0a4d-4102-8f0c-9f95179ae8a1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:46.645769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2648/5294] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:46 2022] GET /identity/v3/users => generated 8351 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:46.647442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.647749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.648034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.700325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:46.776104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] MFA Rules not processed for user `d92b882093bb4deb9b3173d8c8207f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:46.777737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:46.910300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2647/5295] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:46 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:46.920967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:46.921316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:46.921664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:46.950753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] MFA Rules not processed for user `d92b882093bb4deb9b3173d8c8207f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:46.952311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:46.986263 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2649/5296] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:46 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:46.987534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:47.011305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c41c6-e881-4e0b-b443-921d7cb9c7ce None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:47.039581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd92b882093bb4deb9b3173d8c8207f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76313f8cac084a3a870187900207ba48', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-827428747', 'tempest-NotDelegatedRole-1719322646'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:47.040480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:47.041518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:47.041909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:47.042708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] RBAC: Authorizing `identity:create_trust()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:47.049728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 05 02:49:47.363571 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 05 02:49:47.364590 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:47.367121 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2648/5297] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:49:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 378 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:49:47.373387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:47.375844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:47.381151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:47.413757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816701e2-a576-494a-8796-1d4acf4cf1fd tempest-TrustsV3TestJSON-212149307 tempest-user-74300819] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:47.427058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:47.431868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:47.434222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:47.434758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/7aa58be9bca1403481de1e7961caf925` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:47.440710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7aa58be9bca1403481de1e7961caf925)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:47.444432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:47.542628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded823-0d9b-44b6-8896-636b1017a4b8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:47.546630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 7aa58be9bca1403481de1e7961caf925 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:47.546977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.547664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.548183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:47.548914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:47.549304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:47.549655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] PATH_INFO: `/v3/users/569a3db98b7a44aeb902f7956af5a710` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:47.549783 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2649/5298] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:47 2022] DELETE /identity/v3/roles/7aa58be9bca1403481de1e7961caf925 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:47.552970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=569a3db98b7a44aeb902f7956af5a710)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:47.553320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:47.554934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:47.557268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:47.628349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569a3db98b7a44aeb902f7956af5a710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.631330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:47.651831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569a3db98b7a44aeb902f7956af5a710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.652752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569a3db98b7a44aeb902f7956af5a710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.659948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2f68e-0916-40f5-b1af-9cfca91abeb1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:47.665093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569a3db98b7a44aeb902f7956af5a710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.665245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:47.665800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:47.666085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:47.666369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/8ef66cc7c6704a97ac29379daf94d7ce` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:47.666601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569a3db98b7a44aeb902f7956af5a710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.667804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ef66cc7c6704a97ac29379daf94d7ce)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:47.669496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:47.686512 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2650/5299] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:47 2022] DELETE /identity/v3/users/569a3db98b7a44aeb902f7956af5a710 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:47.745352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 8ef66cc7c6704a97ac29379daf94d7ce has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:47.745942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.747311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:47.754399 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2650/5300] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:47 2022] DELETE /identity/v3/roles/8ef66cc7c6704a97ac29379daf94d7ce => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:47.758305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:47.761881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:47.797700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:48.019339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb064-965a-462f-beb9-3c48218f8edf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:48.095648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:48.097450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:48.130115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:48.131030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.131431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.131802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users/d92b882093bb4deb9b3173d8c8207f28` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.133297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d92b882093bb4deb9b3173d8c8207f28)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:48.136754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:48.206623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92b882093bb4deb9b3173d8c8207f28'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.221590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92b882093bb4deb9b3173d8c8207f28'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.222885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92b882093bb4deb9b3173d8c8207f28'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.223964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd791b5-f5b0-4911-ad36-e7776e627033 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:48.232252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:48.233019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.233358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.233922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] PATH_INFO: `/v3/projects/a2a0fa4883254728921c0c49aa4e60b1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.235425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a0fa4883254728921c0c49aa4e60b1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:48.235896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92b882093bb4deb9b3173d8c8207f28'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.237441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92b882093bb4deb9b3173d8c8207f28'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.237564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:48.260997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2651/5301] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:47 2022] DELETE /identity/v3/users/d92b882093bb4deb9b3173d8c8207f28 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:48.265096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:48.266859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:48.329046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a0fa4883254728921c0c49aa4e60b1', 'request_id': 'req-8b055f1d-c445-4b92-81dd-d3171b6e1458'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.346800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a0fa4883254728921c0c49aa4e60b1', 'request_id': 'req-8b055f1d-c445-4b92-81dd-d3171b6e1458'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.363172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a0fa4883254728921c0c49aa4e60b1', 'request_id': 'req-8b055f1d-c445-4b92-81dd-d3171b6e1458'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.374471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:48.391907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] The token cache is being invalidate because project a2a0fa4883254728921c0c49aa4e60b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:48.392168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.394100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b055f1d-c445-4b92-81dd-d3171b6e1458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.395689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2651/5302] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:48 2022] DELETE /identity/v3/projects/a2a0fa4883254728921c0c49aa4e60b1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:48.423594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcee172-968c-4825-9e48-e649c6a8d65a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.430258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcee172-968c-4825-9e48-e649c6a8d65a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.430611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcee172-968c-4825-9e48-e649c6a8d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.439305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9982a11-1cc4-4071-9e7c-fad916c79d64 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:48.468605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ddcee172-968c-4825-9e48-e649c6a8d65a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:48.470490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ddcee172-968c-4825-9e48-e649c6a8d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:48.536104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:48.599921 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2652/5303] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:48.608501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:48.609201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.609490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.609771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/76313f8cac084a3a870187900207ba48` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.610772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.612867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.613324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.613644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76313f8cac084a3a870187900207ba48)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:48.615598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:48.671613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:48.672852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:48.695921 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2653/5304] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:48.702654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:48.711011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76313f8cac084a3a870187900207ba48', 'request_id': 'req-e9220052-fe2f-4540-b543-7ed896ac33d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.734532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bb297-dc26-4283-ac54-6aa681b5b0e8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:48.739406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76313f8cac084a3a870187900207ba48', 'request_id': 'req-e9220052-fe2f-4540-b543-7ed896ac33d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.753892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76313f8cac084a3a870187900207ba48', 'request_id': 'req-e9220052-fe2f-4540-b543-7ed896ac33d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.798461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] The token cache is being invalidate because project 76313f8cac084a3a870187900207ba48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:48.799831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.801689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:48.807100 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2652/5305] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:48 2022] DELETE /identity/v3/projects/76313f8cac084a3a870187900207ba48 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:48.816420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:48.818529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:48.902438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:48.903069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.903355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.903633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.904297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:48.904602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:48.906257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:48.915448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220052-fe2f-4540-b543-7ed896ac33d3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:48.926338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:48.927443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:48.927898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:48.928340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:48.929439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:48.931576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:48.937741 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2654/5306] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:48.941885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:48.943677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:48.996647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6999bdf-6dd3-4092-a0fe-a8c050c7e45c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.001874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.002744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.003208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.003642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.004428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.006666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.017356 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2653/5307] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:48 2022] POST /identity/v3/projects => generated 328 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:49.022308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.034988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:49.087749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2655/5308] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:48 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:49.091680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.166308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d286c-4dea-4b18-b37a-e19f4d8aa1ac tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.239259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde744ff-a546-4ff8-90b0-4293e722675c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.250380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.251801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.252336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.254254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.254735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.255301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.255533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.255821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.256164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.256727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.260176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.262663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.314047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2656/5309] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:49 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:49.317882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.319639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2654/5310] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:49 2022] POST /identity/v3/users => generated 416 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:49.324262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.339606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100311-6f3c-4f9e-b94e-5f9eabd27de3 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.341635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa0658-d8e1-4c0d-8d7e-09b1ca65339a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.347008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.347871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.348302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.348596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.349380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.351323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.356261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.357287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.357980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.358256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.359150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.361560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.378610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2655/5311] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:49 2022] POST /identity/v3/roles => generated 244 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:49.385733 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2657/5312] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:49 2022] GET /identity/v3/roles => generated 1655 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:49.386469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.390281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.417979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40115-6048-42cb-9943-31cb875f4efa tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.422124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d176f-879b-4b10-b882-6836ebb18cc2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.428536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.430710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.432426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.432781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.433846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.434694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.435944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.438242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.438609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.438905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.444476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.449530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.481392 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2656/5313] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:49 2022] POST /identity/v3/roles => generated 246 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:49.482786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2658/5314] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:49 2022] GET /identity/v3/roles => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:49.486553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.493406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.512092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9df4fb-5cdb-470d-9ee0-d83375d7ad36 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.514589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c120da9-790d-4b09-8f6c-6225d196636a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.526860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.528070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.528849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494823e3-3004-499b-899f-243fd49a3b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.529348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.530080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494823e3-3004-499b-899f-243fd49a3b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.530427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/c9d0005e6b89424c92f72912871821dd/users/dccb0bd2511c498f909105fe56eb5f13/roles/fd24b9fe38a34eae94b1191bf26afa2a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.531284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494823e3-3004-499b-899f-243fd49a3b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.531625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494823e3-3004-499b-899f-243fd49a3b6c admin admin] PATH_INFO: `/v3/projects/80fc825cf1534094bab87cebb75a7d2e/users/7cee670a08f94ba7aa95dbb46ef2eb45/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.558056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:49.561819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c9d0005e6b89424c92f72912871821dd, user_id=dccb0bd2511c498f909105fe56eb5f13, role_id=fd24b9fe38a34eae94b1191bf26afa2a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.562300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494823e3-3004-499b-899f-243fd49a3b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fc825cf1534094bab87cebb75a7d2e, user_id=7cee670a08f94ba7aa95dbb46ef2eb45, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.565923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.566086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494823e3-3004-499b-899f-243fd49a3b6c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.587800 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2657/5315] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:49 2022] PUT /identity/v3/projects/c9d0005e6b89424c92f72912871821dd/users/dccb0bd2511c498f909105fe56eb5f13/roles/fd24b9fe38a34eae94b1191bf26afa2a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:49.588326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2659/5316] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:49 2022] PUT /identity/v3/projects/80fc825cf1534094bab87cebb75a7d2e/users/7cee670a08f94ba7aa95dbb46ef2eb45/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:49.591829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.593470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.594328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.594768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.644659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:49.646873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:49.684181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:49.705744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4596b8-e4a8-4ef6-8c83-4a34231737e6 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.715085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.716727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.717343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.717838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/c9d0005e6b89424c92f72912871821dd/users/dccb0bd2511c498f909105fe56eb5f13/roles/6c5b695e1db14f31b7ae038dbecd96d7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.722263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c9d0005e6b89424c92f72912871821dd, user_id=dccb0bd2511c498f909105fe56eb5f13, role_id=6c5b695e1db14f31b7ae038dbecd96d7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.727131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.767463 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2658/5317] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:49 2022] PUT /identity/v3/projects/c9d0005e6b89424c92f72912871821dd/users/dccb0bd2511c498f909105fe56eb5f13/roles/6c5b695e1db14f31b7ae038dbecd96d7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:49.769868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.799266 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2660/5318] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:49.809765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:49.816127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:49.898344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd16b-a113-4129-9ca9-0a6cb2b7de98 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.914767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29a0f-d4f6-44df-a0ba-05bc9e4770e8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:49.915395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29a0f-d4f6-44df-a0ba-05bc9e4770e8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.916219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29a0f-d4f6-44df-a0ba-05bc9e4770e8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.916675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29a0f-d4f6-44df-a0ba-05bc9e4770e8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:49.917376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29a0f-d4f6-44df-a0ba-05bc9e4770e8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:49.919484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29a0f-d4f6-44df-a0ba-05bc9e4770e8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:49.932836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f895fb-cf2a-45cf-8a13-47a71d02f629 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:49.956002 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2659/5319] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:49 2022] GET /identity/v3/users => generated 8357 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:49.960717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67198ec-7e9d-4918-879f-a0537111c501 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:49.961113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67198ec-7e9d-4918-879f-a0537111c501 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:49.961458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67198ec-7e9d-4918-879f-a0537111c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.001661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.002432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.002721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.003000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.010845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e67198ec-7e9d-4918-879f-a0537111c501 None None] MFA Rules not processed for user `dccb0bd2511c498f909105fe56eb5f13`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:50.011113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e67198ec-7e9d-4918-879f-a0537111c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:50.106465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.112797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.130063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:50.147741 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2660/5320] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:49 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:50.147950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2661/5321] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:50.150396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.150855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.151309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.177586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] MFA Rules not processed for user `dccb0bd2511c498f909105fe56eb5f13`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:50.179071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:50.191372 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2661/5322] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:50 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:50.196546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.214264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4e0d-0032-436e-94d4-fe4886f83b0b service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.220424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.221416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.221902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.222191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.224127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:create_trust()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.225629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.338119 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2662/5323] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:49:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:50.341623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.358109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2603-3791-4113-af12-68da97915f3e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.364326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.365563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.365861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.366145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.376710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:get_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.378816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.392300 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2662/5324] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:50 2022] GET /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5 => generated 834 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:50.393679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.424132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc62fb6-52e9-4e8b-aa09-42103adaed74 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.446499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.448507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.449214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.452012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.479576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.484089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.511182 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2663/5325] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:49:50 2022] GET /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles => generated 371 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:50.515244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.533348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d024c-5a46-4083-8889-5a2994c8c689 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.542736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.544245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.544595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.544930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/fd24b9fe38a34eae94b1191bf26afa2a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.572498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5, role_id=fd24b9fe38a34eae94b1191bf26afa2a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.574369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.597545 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2663/5326] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:49:50 2022] GET /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/fd24b9fe38a34eae94b1191bf26afa2a => generated 244 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:50.598962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.609552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804ca1-8d31-4be0-9b7e-bd84a9d1c22d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.614934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.616122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.616422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.616770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/fd24b9fe38a34eae94b1191bf26afa2a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.626593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5, role_id=fd24b9fe38a34eae94b1191bf26afa2a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.630628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.645421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2664/5327] 10.222.0.16 () {58 vars in 1369 bytes} [Wed Oct 5 02:49:50 2022] HEAD /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/fd24b9fe38a34eae94b1191bf26afa2a => generated 0 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 05 02:49:50.652169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.663620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abbd09-8a5f-42d5-b9f0-105008cf571d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.670490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.671230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.671577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.671974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/6c5b695e1db14f31b7ae038dbecd96d7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.686531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5, role_id=6c5b695e1db14f31b7ae038dbecd96d7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.687948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Could not find role: 6c5b695e1db14f31b7ae038dbecd96d7.: keystone.exception.RoleNotFound: Could not find role: 6c5b695e1db14f31b7ae038dbecd96d7. Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:49:50.707990 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6c5b695e1db14f31b7ae038dbecd96d7. Oct 05 02:49:50.709245 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:50.729764 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2664/5328] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:49:50 2022] GET /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/6c5b695e1db14f31b7ae038dbecd96d7 => generated 110 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:50.738123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.785540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e60b-98f3-4c0d-b8c1-312fa5f37a49 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.793426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.794427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.794895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.801695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/6c5b695e1db14f31b7ae038dbecd96d7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.812207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5, role_id=6c5b695e1db14f31b7ae038dbecd96d7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.814165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Could not find role: 6c5b695e1db14f31b7ae038dbecd96d7.: keystone.exception.RoleNotFound: Could not find role: 6c5b695e1db14f31b7ae038dbecd96d7. Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:49:50.831095 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6c5b695e1db14f31b7ae038dbecd96d7. Oct 05 02:49:50.832197 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:50.836829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:50.844877 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2665/5329] 10.222.0.16 () {58 vars in 1369 bytes} [Wed Oct 5 02:49:50 2022] HEAD /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5/roles/6c5b695e1db14f31b7ae038dbecd96d7 => generated 0 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 05 02:49:50.846906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:50.850712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08822f-e1ee-4667-a5ae-68e691a3fb2d tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:50.858859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:50.859679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:50.861015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:50.868715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:50.920677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorizing `identity:delete_trust(trust_id=ff1b7a367965447b9324ec15863bd4e5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:50.922870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:50.964010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ff1b7a367965447b9324ec15863bd4e5', 'request_id': 'req-4adefbcb-014d-45a1-b11f-6135e12f08c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:50.967441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ff1b7a367965447b9324ec15863bd4e5', 'request_id': 'req-4adefbcb-014d-45a1-b11f-6135e12f08c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:50.990888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ff1b7a367965447b9324ec15863bd4e5', 'request_id': 'req-4adefbcb-014d-45a1-b11f-6135e12f08c0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.029148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:51.031497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:51.034813 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2665/5330] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:49:50 2022] DELETE /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:51.050567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2787d3c-049d-4610-ba8a-b44ca8f6d6cb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:51.063877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dccb0bd2511c498f909105fe56eb5f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9d0005e6b89424c92f72912871821dd', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1286196011', 'tempest-NotDelegatedRole-972707024'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:51.065345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:51.066046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:51.066563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] PATH_INFO: `/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Could not find trust: ff1b7a367965447b9324ec15863bd4e5.: keystone.exception.TrustNotFound: Could not find trust: ff1b7a367965447b9324ec15863bd4e5. Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 05 02:49:51.077886 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ff1b7a367965447b9324ec15863bd4e5. Oct 05 02:49:51.079045 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:51.082463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2666/5331] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:51 2022] GET /identity/v3/OS-TRUST/trusts/ff1b7a367965447b9324ec15863bd4e5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:51.086577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:51.088775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:51.119185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adefbcb-014d-45a1-b11f-6135e12f08c0 tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:51.132398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:51.133786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:51.134329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:51.134596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/6c5b695e1db14f31b7ae038dbecd96d7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:51.137192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6c5b695e1db14f31b7ae038dbecd96d7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:51.139635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:51.201301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 6c5b695e1db14f31b7ae038dbecd96d7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:51.201714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.203684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.207695 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2666/5332] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:51 2022] DELETE /identity/v3/roles/6c5b695e1db14f31b7ae038dbecd96d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:51.212044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:51.214620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:51.231756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d1380-f2bb-4ca3-9821-649ac8e709bb tempest-TrustsV3TestJSON-891902667 tempest-user-1991787764] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:51.319575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:51.320235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:51.320658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:51.320965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/fd24b9fe38a34eae94b1191bf26afa2a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:51.322563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fd24b9fe38a34eae94b1191bf26afa2a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:51.324268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:51.383646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:51.418814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role fd24b9fe38a34eae94b1191bf26afa2a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:51.419510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.420489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.426312 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2667/5333] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:51 2022] DELETE /identity/v3/roles/fd24b9fe38a34eae94b1191bf26afa2a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:51.427203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:51.454091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0ad21-a4ac-4eb0-a931-cb1bc236309c tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:51.588471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:51.589234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:51.589571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:51.589849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users/dccb0bd2511c498f909105fe56eb5f13` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:51.592991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dccb0bd2511c498f909105fe56eb5f13)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:51.595098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:51.684970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dccb0bd2511c498f909105fe56eb5f13'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.719918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dccb0bd2511c498f909105fe56eb5f13'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.720816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dccb0bd2511c498f909105fe56eb5f13'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.733377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dccb0bd2511c498f909105fe56eb5f13'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.734426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dccb0bd2511c498f909105fe56eb5f13'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.762109 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2667/5334] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:51 2022] DELETE /identity/v3/users/dccb0bd2511c498f909105fe56eb5f13 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:51.765341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:51.767227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:51.785232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e330-43f4-43c0-8238-58fee54086d8 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:51.876356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:51.877383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:51.877590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:51.878008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/c9d0005e6b89424c92f72912871821dd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:51.879810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c9d0005e6b89424c92f72912871821dd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:51.882790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:51.957817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d0005e6b89424c92f72912871821dd', 'request_id': 'req-f9074507-1c40-4a0b-9221-c7633285eed4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.967004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d0005e6b89424c92f72912871821dd', 'request_id': 'req-f9074507-1c40-4a0b-9221-c7633285eed4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:51.975083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d0005e6b89424c92f72912871821dd', 'request_id': 'req-f9074507-1c40-4a0b-9221-c7633285eed4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:52.001892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] The token cache is being invalidate because project c9d0005e6b89424c92f72912871821dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:52.002302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:52.003346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f9074507-1c40-4a0b-9221-c7633285eed4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:52.010226 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2668/5335] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:51 2022] DELETE /identity/v3/projects/c9d0005e6b89424c92f72912871821dd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:52.013587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:52.015205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:52.029345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:52.039455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a12c22-b29b-410f-8cca-024782677124 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:52.076260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.076553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.076963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.104038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] MFA Rules not processed for user `728544ca5e164540b3c5395534542955`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:52.106427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:52.192392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:52.193197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.193480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.193757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.196400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:52.198414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:52.221423 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2669/5336] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:52.258498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2668/5337] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:49:52 2022] POST /identity/v3/projects => generated 329 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:52.263281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:52.265058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:52.286539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb28d9-60df-488e-84ef-212c9b0953ef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:52.303012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:52.372416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:52.373497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.373971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.374360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.375234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:52.378185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:52.415216 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2670/5338] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:52 2022] POST /identity/v3/users => generated 416 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:52.419906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:52.434645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827f035-28a4-496f-b639-1b285161c3bd tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:52.463129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:52.464365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.467035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.468352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.469409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:52.471272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:52.513315 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2669/5339] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:52 2022] POST /identity/v3/roles => generated 244 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:52.518541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:52.532789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afa464-f2dc-48cd-b23d-947ca9f1548d tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:52.546409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:52.547215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.547514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.549356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.550061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:52.554843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:52.610894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2671/5340] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:49:52 2022] POST /identity/v3/roles => generated 246 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:52.611542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:52.631214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba019c-0542-4438-a606-1137b4e26e97 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:52.653472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:52.654522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.655063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.655644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/a075d939a75e4c9cb464911515b6e4de/users/a0addfc9ede54029898882bf74c6ae85/roles/ff8e115f3f144c3480f2423e78d06fbe` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.718260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a075d939a75e4c9cb464911515b6e4de, user_id=a0addfc9ede54029898882bf74c6ae85, role_id=ff8e115f3f144c3480f2423e78d06fbe)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:52.731519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:52.773854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:52.775731 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2670/5341] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:52 2022] PUT /identity/v3/projects/a075d939a75e4c9cb464911515b6e4de/users/a0addfc9ede54029898882bf74c6ae85/roles/ff8e115f3f144c3480f2423e78d06fbe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:52.793477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ca5b-dc7a-4fb3-a9cf-336b10908a7a tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:52.966801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b7e19-60df-46f6-9e45-a019818a69a2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:52.967475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b7e19-60df-46f6-9e45-a019818a69a2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:52.967759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b7e19-60df-46f6-9e45-a019818a69a2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:52.968037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b7e19-60df-46f6-9e45-a019818a69a2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/a075d939a75e4c9cb464911515b6e4de/users/a0addfc9ede54029898882bf74c6ae85/roles/60351d07113c4b3e8ccf1d22c69540d3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:52.970573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b7e19-60df-46f6-9e45-a019818a69a2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a075d939a75e4c9cb464911515b6e4de, user_id=a0addfc9ede54029898882bf74c6ae85, role_id=60351d07113c4b3e8ccf1d22c69540d3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:52.973317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b7e19-60df-46f6-9e45-a019818a69a2 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:52.993031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2672/5342] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:52 2022] PUT /identity/v3/projects/a075d939a75e4c9cb464911515b6e4de/users/a0addfc9ede54029898882bf74c6ae85/roles/60351d07113c4b3e8ccf1d22c69540d3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:52.998184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:53.012102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2200e-172e-44f5-b0e9-54a0498a1cf5 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:53.121249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132214c-f578-4178-b2b9-3f6f8d86eb88 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:53.128659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132214c-f578-4178-b2b9-3f6f8d86eb88 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.129127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132214c-f578-4178-b2b9-3f6f8d86eb88 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.129417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132214c-f578-4178-b2b9-3f6f8d86eb88 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.130251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132214c-f578-4178-b2b9-3f6f8d86eb88 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:53.132854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132214c-f578-4178-b2b9-3f6f8d86eb88 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:53.178352 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2671/5343] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:52 2022] GET /identity/v3/users => generated 8357 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:53.186025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.186385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.186697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.248249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] MFA Rules not processed for user `a0addfc9ede54029898882bf74c6ae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:53.249522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:53.340693 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2673/5344] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:53.341646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.341941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.342243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.373482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] MFA Rules not processed for user `a0addfc9ede54029898882bf74c6ae85`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:53.374750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:53.382629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2672/5345] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:53.386807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:53.398566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674acf2-2f8d-4be9-a046-48a72631969c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:53.403629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:53.404264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.404548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.404824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.405611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:create_trust()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:53.406766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:53.411900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:53.638572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2674/5346] 10.222.0.16 () {60 vars in 1174 bytes} [Wed Oct 5 02:49:53 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:53.640359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:53.654660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af1a93-1260-4f5e-8035-4194c47b51f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:53.677258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:53.678141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.678583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.679303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.699534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:get_trust(trust_id=d38a5a86da374492b8b8b67963db9006)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:53.701294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:53.725876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2673/5347] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:53 2022] GET /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006 => generated 835 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:53.727364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:53.746950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fb004-62c3-4ac3-9158-53f1b8f6aca0 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:53.759117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:53.761967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.763452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.763452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.786096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d38a5a86da374492b8b8b67963db9006)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:53.787752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:53.823440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2675/5348] 10.222.0.16 () {58 vars in 1269 bytes} [Wed Oct 5 02:49:53 2022] GET /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles => generated 371 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:49:53.828053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:53.842788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4a51-f369-403d-b94e-83a3a4c5bf85 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:53.882341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:53.883366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:53.883646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:53.883977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/ff8e115f3f144c3480f2423e78d06fbe` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:53.919731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d38a5a86da374492b8b8b67963db9006, role_id=ff8e115f3f144c3480f2423e78d06fbe)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:53.921246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:53.962375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:53.963887 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2674/5349] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:49:53 2022] GET /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/ff8e115f3f144c3480f2423e78d06fbe => generated 244 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:53.979009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833e3d6-dd2c-4c79-82c5-0af82943b9cf tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:53.997529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.002682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.005753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.006188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/ff8e115f3f144c3480f2423e78d06fbe` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.031517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d38a5a86da374492b8b8b67963db9006, role_id=ff8e115f3f144c3480f2423e78d06fbe)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:54.033466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:54.053035 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2676/5350] 10.222.0.16 () {58 vars in 1369 bytes} [Wed Oct 5 02:49:53 2022] HEAD /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/ff8e115f3f144c3480f2423e78d06fbe => generated 0 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 05 02:49:54.057836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:54.070174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:54.093128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aadeb7-376e-47e6-8986-b2de9f9615c8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:54.101419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.102286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.102962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.107669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/60351d07113c4b3e8ccf1d22c69540d3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.145028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d38a5a86da374492b8b8b67963db9006, role_id=60351d07113c4b3e8ccf1d22c69540d3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:54.146754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Could not find role: 60351d07113c4b3e8ccf1d22c69540d3.: keystone.exception.RoleNotFound: Could not find role: 60351d07113c4b3e8ccf1d22c69540d3. Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:49:54.180691 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 60351d07113c4b3e8ccf1d22c69540d3. Oct 05 02:49:54.182374 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:49:54.187009 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2675/5351] 10.222.0.16 () {58 vars in 1368 bytes} [Wed Oct 5 02:49:54 2022] GET /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/60351d07113c4b3e8ccf1d22c69540d3 => generated 110 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:54.188500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:54.203182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73164d5-0878-486a-ae85-35eba9bc88b8 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:54.229840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.230529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.230820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.231562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/60351d07113c4b3e8ccf1d22c69540d3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.244983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d38a5a86da374492b8b8b67963db9006, role_id=60351d07113c4b3e8ccf1d22c69540d3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:54.247861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Could not find role: 60351d07113c4b3e8ccf1d22c69540d3.: keystone.exception.RoleNotFound: Could not find role: 60351d07113c4b3e8ccf1d22c69540d3. Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 05 02:49:54.276093 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 60351d07113c4b3e8ccf1d22c69540d3. Oct 05 02:49:54.277662 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:54.282487 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2677/5352] 10.222.0.16 () {58 vars in 1369 bytes} [Wed Oct 5 02:49:54 2022] HEAD /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006/roles/60351d07113c4b3e8ccf1d22c69540d3 => generated 0 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 05 02:49:54.286787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:54.302525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c529-5310-4e2a-9ec8-3f2eb20f664b tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:54.316599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.317302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.317584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.317863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.332361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorizing `identity:delete_trust(trust_id=d38a5a86da374492b8b8b67963db9006)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:54.335203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:54.376117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd38a5a86da374492b8b8b67963db9006', 'request_id': 'req-677e50d6-deb7-467c-ba17-f785fa9c6199'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:54.377497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd38a5a86da374492b8b8b67963db9006', 'request_id': 'req-677e50d6-deb7-467c-ba17-f785fa9c6199'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:54.403456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd38a5a86da374492b8b8b67963db9006', 'request_id': 'req-677e50d6-deb7-467c-ba17-f785fa9c6199'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:54.439629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2676/5353] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Oct 5 02:49:54 2022] DELETE /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:54.440983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:54.442798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:54.487316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cbab1-78d4-4010-9a0e-12d07cb6b127 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:54.518242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0addfc9ede54029898882bf74c6ae85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a075d939a75e4c9cb464911515b6e4de', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-528406088', 'tempest-DelegatedRole-1281294176'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.518916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.519203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.519480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] PATH_INFO: `/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Could not find trust: d38a5a86da374492b8b8b67963db9006.: keystone.exception.TrustNotFound: Could not find trust: d38a5a86da374492b8b8b67963db9006. Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 05 02:49:54.564037 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d38a5a86da374492b8b8b67963db9006. Oct 05 02:49:54.570473 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:49:54.571502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:54.573091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:54.574253 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2678/5354] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Oct 5 02:49:54 2022] GET /identity/v3/OS-TRUST/trusts/d38a5a86da374492b8b8b67963db9006 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:49:54.592601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e50d6-deb7-467c-ba17-f785fa9c6199 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:54.599780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.613719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.614191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.614881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/60351d07113c4b3e8ccf1d22c69540d3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.627527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=60351d07113c4b3e8ccf1d22c69540d3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:54.630714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:54.713420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role 60351d07113c4b3e8ccf1d22c69540d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:54.714074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:54.716307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:54.722114 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2677/5355] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:54 2022] DELETE /identity/v3/roles/60351d07113c4b3e8ccf1d22c69540d3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:54.726224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:54.730180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:54.794723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c43c-6c3a-4fc4-83b7-e10ff587ce64 tempest-TrustsV3TestJSON-1153451060 tempest-user-1123935303] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:54.960193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:54.960933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:54.961455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:54.961709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/roles/ff8e115f3f144c3480f2423e78d06fbe` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:54.964357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ff8e115f3f144c3480f2423e78d06fbe)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:54.966341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:55.052184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invalidating the token cache because role ff8e115f3f144c3480f2423e78d06fbe has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:55.064086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.065851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.075004 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2679/5356] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:54 2022] DELETE /identity/v3/roles/ff8e115f3f144c3480f2423e78d06fbe => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:55.076220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:55.089279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7806-c41c-46f3-986d-d88ee04b01e4 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:55.149579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:55.151945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:55.178544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:55.254933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:55.255985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:55.256651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:55.257223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/users/a0addfc9ede54029898882bf74c6ae85` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:55.260452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a0addfc9ede54029898882bf74c6ae85)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:55.268652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:55.391923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0addfc9ede54029898882bf74c6ae85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.425194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0addfc9ede54029898882bf74c6ae85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.427524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0addfc9ede54029898882bf74c6ae85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.432845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:55.450213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0addfc9ede54029898882bf74c6ae85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.451414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0addfc9ede54029898882bf74c6ae85'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.476967 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2678/5357] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:55 2022] DELETE /identity/v3/users/a0addfc9ede54029898882bf74c6ae85 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:55.481517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:55.483344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:55.702060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6743a7-ec1d-4df0-97dd-848b28e6638e tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:55.718284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea0bb55a5d814ee183a8d4b8f7521330', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ed9393c9af4f67ad75d96d6b385a89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:55.718965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:55.719207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:55.719489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] PATH_INFO: `/v3/projects/a075d939a75e4c9cb464911515b6e4de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:55.725218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a075d939a75e4c9cb464911515b6e4de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:55.727182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:55.770563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef44bb1-8dd7-4d0d-9c4a-7088f6edf058 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:55.872876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a075d939a75e4c9cb464911515b6e4de', 'request_id': 'req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.914953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a075d939a75e4c9cb464911515b6e4de', 'request_id': 'req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:55.944358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a075d939a75e4c9cb464911515b6e4de', 'request_id': 'req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.010532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] The token cache is being invalidate because project a075d939a75e4c9cb464911515b6e4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:56.012700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.016339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.027297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:56.029264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:56.029609 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2679/5358] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:55 2022] DELETE /identity/v3/projects/a075d939a75e4c9cb464911515b6e4de => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:56.035509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:56.039989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:56.040874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] PATH_INFO: `/v3/users/4660830930074af2905b664500feefe6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:56.042441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4660830930074af2905b664500feefe6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:56.045657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:56.048787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:56.171228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c3b78-db57-4b5c-aa67-e4981c51c2e1 tempest-TrustsV3TestJSON-2092617435 tempest-TrustsV3TestJSON-2092617435-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:56.185703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:56.188478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:56.189444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:56.190651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] PATH_INFO: `/v3/users/e8858430323848ce8f4c33839a29c8a8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:56.198744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8858430323848ce8f4c33839a29c8a8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:56.204987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:56.242470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4660830930074af2905b664500feefe6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.249229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:56.306426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4660830930074af2905b664500feefe6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.307450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4660830930074af2905b664500feefe6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.324666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4660830930074af2905b664500feefe6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.325855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a009d2e-0021-4af6-88dd-7e9f86e77a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4660830930074af2905b664500feefe6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.374394 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2680/5359] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:55 2022] DELETE /identity/v3/users/4660830930074af2905b664500feefe6 => generated 0 bytes in 1225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:56.389800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8858430323848ce8f4c33839a29c8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.434950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8858430323848ce8f4c33839a29c8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.436803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8858430323848ce8f4c33839a29c8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.471126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8858430323848ce8f4c33839a29c8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.471848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8858430323848ce8f4c33839a29c8a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:56.496149 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2680/5360] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:56 2022] DELETE /identity/v3/users/e8858430323848ce8f4c33839a29c8a8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:56.498444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:56.498721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:56.498997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:56.570377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:56.576329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:56.705996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:56.803135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2681/5361] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:49:56.832772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:56.834874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:56.893043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:56.895040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:56.924382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194ed74-5452-4031-95c0-2c1867ffd9e8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:56.937467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:56.939199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:56.940191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:56.940694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] PATH_INFO: `/v3/projects/1eab97ab9390449da800dab7d39217da` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:56.943626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eab97ab9390449da800dab7d39217da)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:56.947139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:56.984341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105de88-9b77-41c9-8053-3f6a039450fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:56.990590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf2c2-9fe5-4d86-8c7a-70a40fd4bfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:56.991581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf2c2-9fe5-4d86-8c7a-70a40fd4bfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:56.991581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf2c2-9fe5-4d86-8c7a-70a40fd4bfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:56.991893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf2c2-9fe5-4d86-8c7a-70a40fd4bfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.018382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf2c2-9fe5-4d86-8c7a-70a40fd4bfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:57.019835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf2c2-9fe5-4d86-8c7a-70a40fd4bfb7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:57.057261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eab97ab9390449da800dab7d39217da', 'request_id': 'req-041fc270-eee2-4082-85bf-5ce47da40512'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:57.064185 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2681/5362] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:57.071101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eab97ab9390449da800dab7d39217da', 'request_id': 'req-041fc270-eee2-4082-85bf-5ce47da40512'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:57.083508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eab97ab9390449da800dab7d39217da', 'request_id': 'req-041fc270-eee2-4082-85bf-5ce47da40512'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:57.111094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] The token cache is being invalidate because project 1eab97ab9390449da800dab7d39217da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:57.111467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:57.131352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-041fc270-eee2-4082-85bf-5ce47da40512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:57.140067 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2682/5363] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:56 2022] DELETE /identity/v3/projects/1eab97ab9390449da800dab7d39217da => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:49:57.141781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.142069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.142341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.193624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:57.194837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:57.357678 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2682/5364] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:57.358253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.358547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.358868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.405641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:57.408263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:57.437603 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2683/5365] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:57.441324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:57.456674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc7273-1221-424c-a576-ab9595a44d9f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:57.487489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:57.488248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.488626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.488932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.489658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:49:57.489984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:57.491647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:57.510767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:57.516401 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2683/5366] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:49:57.527802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975578b5-146f-47c6-a81f-5ab7261ae70a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:57.538272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:57.539894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.540275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.543383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.546053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:57.548259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:57.616779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:57.617875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2684/5367] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:49:57 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:49:57.633336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b31305-3229-4353-a9c7-210cf7a89aa9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:57.699422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:57.797834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:57.798485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.798774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.799053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.799855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:57.801890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:57.858020 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2684/5368] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:49:57 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:49:57.862383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:57.877013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976ce30-1d31-49e8-b378-92c880683ecf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:57.883663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:57.885495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.886071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.886570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.887537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:57.889606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:57.906469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2685/5369] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:57.911267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:57.926677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dd6b-50d2-42d5-b674-c284d95312ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:57.935822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba209ef-7a87-4dd7-ac27-e25c5a4763e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:57.936827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba209ef-7a87-4dd7-ac27-e25c5a4763e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.937411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba209ef-7a87-4dd7-ac27-e25c5a4763e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.937907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba209ef-7a87-4dd7-ac27-e25c5a4763e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:57.938778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba209ef-7a87-4dd7-ac27-e25c5a4763e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:57.941132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba209ef-7a87-4dd7-ac27-e25c5a4763e3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:57.956461 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2685/5370] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:49:57.961177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:57.977068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb08f22-24ff-4bdf-998a-d9cb22971309 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:57.985327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:57.986493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:57.987006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:57.987509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] PATH_INFO: `/v3/projects/4a47a087cd7b4713a6ad1391eda4f4a3/users/effef5f66f5644fab19ecd3f862d7daa/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:58.036522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a47a087cd7b4713a6ad1391eda4f4a3, user_id=effef5f66f5644fab19ecd3f862d7daa, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:58.039221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:58.072756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2686/5371] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:49:57 2022] PUT /identity/v3/projects/4a47a087cd7b4713a6ad1391eda4f4a3/users/effef5f66f5644fab19ecd3f862d7daa/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:58.078201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:58.078603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:58.079018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:58.119534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:49:58.123740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:58.265425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2686/5372] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:49:58.299906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:58.304939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:58.473739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:49:58.490588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449c9b-b4d7-4e98-b92d-f906600aea43 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:58.501695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:58.505827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:58.506216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:58.510012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:58.529836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:58.531404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:58.568527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:58.570001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:49:58.577318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2687/5373] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:49:58.606022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c6b12-f680-48ad-b064-812a0432dfb4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:58.622895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:58.623708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:58.625023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:58.625549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] PATH_INFO: `/v3/projects/662936ac4c314afcbd9c29bbb3f65ac3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:58.629522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=662936ac4c314afcbd9c29bbb3f65ac3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:58.631799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:58.831003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662936ac4c314afcbd9c29bbb3f65ac3', 'request_id': 'req-29382e52-2528-4b74-9481-953b8c298f1a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:58.854864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662936ac4c314afcbd9c29bbb3f65ac3', 'request_id': 'req-29382e52-2528-4b74-9481-953b8c298f1a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:58.865601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662936ac4c314afcbd9c29bbb3f65ac3', 'request_id': 'req-29382e52-2528-4b74-9481-953b8c298f1a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:58.917597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] The token cache is being invalidate because project 662936ac4c314afcbd9c29bbb3f65ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:49:58.917958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:58.923179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29382e52-2528-4b74-9481-953b8c298f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:58.929442 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2687/5374] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:49:58 2022] DELETE /identity/v3/projects/662936ac4c314afcbd9c29bbb3f65ac3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:49:58.934123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:49:58.947162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb6471-d72d-4dab-8739-1712e85c8e09 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:49:59.108426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:49:59.111080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:49:59.111534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:49:59.111982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] PATH_INFO: `/v3/users/ea0bb55a5d814ee183a8d4b8f7521330` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:49:59.115275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0bb55a5d814ee183a8d4b8f7521330)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:49:59.121866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:49:59.220550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0bb55a5d814ee183a8d4b8f7521330'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:59.266096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0bb55a5d814ee183a8d4b8f7521330'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:59.270241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0bb55a5d814ee183a8d4b8f7521330'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:59.298103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0bb55a5d814ee183a8d4b8f7521330'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:59.299082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0bb55a5d814ee183a8d4b8f7521330'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:49:59.323848 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2688/5375] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:49:58 2022] DELETE /identity/v3/users/ea0bb55a5d814ee183a8d4b8f7521330 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:01.047162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454565b-bac4-4105-bbfc-654300914a03 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.047989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454565b-bac4-4105-bbfc-654300914a03 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.048431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454565b-bac4-4105-bbfc-654300914a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:01.093779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:01.095917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.136509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f454565b-bac4-4105-bbfc-654300914a03 None None] MFA Rules not processed for user `7cee670a08f94ba7aa95dbb46ef2eb45`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:01.139143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f454565b-bac4-4105-bbfc-654300914a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.161778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:01.283784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2688/5376] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:01.297329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.297882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.298263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:01.327322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563064-5bfa-4514-ba86-f1c5744439be admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:01.337101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] MFA Rules not processed for user `7cee670a08f94ba7aa95dbb46ef2eb45`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:01.339719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.358885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:01.358885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.358885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.359440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] PATH_INFO: `/v3/projects/54ed9393c9af4f67ad75d96d6b385a89` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:01.361578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2689/5377] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:01.362570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ed9393c9af4f67ad75d96d6b385a89)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:01.364537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:01.376445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:01.378102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.404674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:01.488685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ed9393c9af4f67ad75d96d6b385a89', 'request_id': 'req-10d7b0c6-907b-422b-86d3-4033f921d5a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:01.517905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ed9393c9af4f67ad75d96d6b385a89', 'request_id': 'req-10d7b0c6-907b-422b-86d3-4033f921d5a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:01.553241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ed9393c9af4f67ad75d96d6b385a89', 'request_id': 'req-10d7b0c6-907b-422b-86d3-4033f921d5a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:01.553535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b9ac3-460d-4249-b545-d3914b6bac9b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:01.595249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] The token cache is being invalidate because project 54ed9393c9af4f67ad75d96d6b385a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:01.595515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:01.597533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:01.602614 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2689/5378] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:01 2022] DELETE /identity/v3/projects/54ed9393c9af4f67ad75d96d6b385a89 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:01.607271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:01.613144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.654594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:01.655278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.656361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.656361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:01.658115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.774522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:01.833883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:01.836313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2776f-398a-483d-8bb1-e10b528904b4 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:01.855075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7b0c6-907b-422b-86d3-4033f921d5a4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:01.859656 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2690/5379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:01.861804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896e237-68fe-4af7-9c49-c3e376ad0702 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.862109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896e237-68fe-4af7-9c49-c3e376ad0702 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.862390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896e237-68fe-4af7-9c49-c3e376ad0702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:01.877654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:01.878323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.878606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.878882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] PATH_INFO: `/v3/users/ef3901107d1542e39ff09de9f4b219a8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:01.886286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3901107d1542e39ff09de9f4b219a8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:01.888259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:01.909954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9896e237-68fe-4af7-9c49-c3e376ad0702 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:01.913217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9896e237-68fe-4af7-9c49-c3e376ad0702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:01.939378 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2691/5380] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:01.948106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:01.948313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:01.948486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.014100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:02.015436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:02.039294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3901107d1542e39ff09de9f4b219a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:02.047293 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2692/5381] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:02.052481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.072152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83175ddb-0c39-477e-b6d1-3b26ee8c28e7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:02.078202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3901107d1542e39ff09de9f4b219a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:02.079012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3901107d1542e39ff09de9f4b219a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:02.095151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3901107d1542e39ff09de9f4b219a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:02.095839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:02.095973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66385273-9803-40ec-aa57-304f1272b640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3901107d1542e39ff09de9f4b219a8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:02.096218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.096504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.096831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.104222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:02.104744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:02.107791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:02.116978 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2690/5382] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:01 2022] DELETE /identity/v3/users/ef3901107d1542e39ff09de9f4b219a8 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:02.121449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.122228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.122771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.155046 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2693/5383] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:02.161960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.163335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:02.167200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:02.168771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:02.200584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:02.203478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d127786-23e9-498b-aedc-42e5a1818e6a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:02.313976 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2691/5384] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:02.379675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.380393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:02.381058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.381199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:02.381383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.381666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.382332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:02.386874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:02.448633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2694/5385] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:02 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:02.453328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.501710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64dff4-a607-48f3-ae2e-4d27c30f129a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:02.631760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297649a7-5556-4414-bca5-83e751df16b8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:02.645782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:02.646434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.646994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.647459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.647636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:02.657552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.657887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.660618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.661508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:02.663476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:02.671873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:02.682366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:02.716493 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2692/5386] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:02.748362 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2695/5387] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:02 2022] POST /identity/v3/users => generated 300 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:02.749387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.767940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8f12-0449-452a-ab15-ce819da8f79d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:02.779823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:02.780601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.780911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.781204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.781869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:02.783723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:02.815726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2693/5388] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:02.818266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.839536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9778-483f-4e55-8253-9b6ba0f192fa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:02.852378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:02.853139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:02.853427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:02.855826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] PATH_INFO: `/v3/projects/6f1cb43a841f45ca9840fb069c965f5e/users/d75b66f14f7f49d4881c06e81b2a9918/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:02.935343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1cb43a841f45ca9840fb069c965f5e, user_id=d75b66f14f7f49d4881c06e81b2a9918, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:02.938274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:02.964668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:02.970452 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2696/5389] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:02 2022] PUT /identity/v3/projects/6f1cb43a841f45ca9840fb069c965f5e/users/d75b66f14f7f49d4881c06e81b2a9918/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:50:02.975676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:02.999996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63dfff-27ed-4c46-aae0-83c44da1dca8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:03.261802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:03.263235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:03.263679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:03.264200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:03.265059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:03.266850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:03.291097 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2694/5390] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:03.292204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:03.310533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ef3c9-a5e5-4957-beb8-6ef4c40db9ac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:03.318646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14586d9-83f4-4ff1-ab9c-bc4cabe0fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:03.319496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14586d9-83f4-4ff1-ab9c-bc4cabe0fedf admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:03.319745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14586d9-83f4-4ff1-ab9c-bc4cabe0fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:03.319971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14586d9-83f4-4ff1-ab9c-bc4cabe0fedf admin admin] PATH_INFO: `/v3/projects/6f1cb43a841f45ca9840fb069c965f5e/users/d75b66f14f7f49d4881c06e81b2a9918/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:03.327461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14586d9-83f4-4ff1-ab9c-bc4cabe0fedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f1cb43a841f45ca9840fb069c965f5e, user_id=d75b66f14f7f49d4881c06e81b2a9918, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:03.336727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14586d9-83f4-4ff1-ab9c-bc4cabe0fedf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:03.350210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:03.357923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:03.362528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2697/5391] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:03 2022] PUT /identity/v3/projects/6f1cb43a841f45ca9840fb069c965f5e/users/d75b66f14f7f49d4881c06e81b2a9918/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:03.376860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:03.377276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:03.378039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:03.458017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] MFA Rules not processed for user `d75b66f14f7f49d4881c06e81b2a9918`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:03.462042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:03.531591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4b7ef-2d45-40e5-88e6-94ae8c8c2c94 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:03.643030 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2698/5392] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:03.645650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:03.724687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:03.725586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:03.725939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:03.726217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:03.729796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:03.882933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae539-8dde-4519-8074-e12ea64d165f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:03.885930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:03.887740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:03.892228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:03.893102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:03.895230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:03.895689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:03.897441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:03.916410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:03.917103 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2695/5393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:03.919536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:03.922441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:03.950734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffff06-ce24-4d30-a172-0afbb8e50291 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:03.965503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:03.965868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:03.966304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:03.966908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] PATH_INFO: `/v3/projects/e8928377287f4cae950702d413af6542` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:03.970227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8928377287f4cae950702d413af6542)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:03.975587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:03.981819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2699/5394] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:03 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:03.985894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:04.102786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8928377287f4cae950702d413af6542', 'request_id': 'req-bdb9b437-7bf0-4816-a934-5158d97e801c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.117986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8928377287f4cae950702d413af6542', 'request_id': 'req-bdb9b437-7bf0-4816-a934-5158d97e801c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.148553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:04.158483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8928377287f4cae950702d413af6542', 'request_id': 'req-bdb9b437-7bf0-4816-a934-5158d97e801c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.166030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a83a71-9eac-48a9-b175-fd1dca131931 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:04.170507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:04.201918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] The token cache is being invalidate because project e8928377287f4cae950702d413af6542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:04.202539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.205004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.221669 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2696/5395] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:03 2022] DELETE /identity/v3/projects/e8928377287f4cae950702d413af6542 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:04.225804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:04.230078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:04.348336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:04.350258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:04.350549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:04.350835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:04.351543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:04.360199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:04.407280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2700/5396] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:03 2022] POST /identity/v3/users => generated 293 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:04.410241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:04.412392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:04.420024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9b437-7bf0-4816-a934-5158d97e801c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:04.441144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:04.441799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:04.442081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:04.442357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] PATH_INFO: `/v3/users/8419f4e464e545238d38f11952967b1d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:04.442471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa4c17-67ac-404f-b393-be8d118960be admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:04.448043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8419f4e464e545238d38f11952967b1d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:04.450423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:04.453299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:04.453939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:04.454227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:04.454510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:04.455166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:04.456786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:04.486316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2701/5397] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:04.490439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:04.504350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3fa9-6ec2-4a8c-bed8-5bc7fa8c2c91 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:04.511378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:04.512198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:04.512491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:04.512776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:04.514090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:04.515107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:04.538746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2702/5398] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:50:04.544530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:04.567618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943a30e-baf7-47a1-95f8-ecdd4865a4ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:04.584356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:04.585010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:04.585303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:04.585581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] PATH_INFO: `/v3/projects/7dd0de383ce7412595a5364a390b08a0/users/296c7a885b674cf3bac18dcdfe4b5bf2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:04.588773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8419f4e464e545238d38f11952967b1d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.613720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8419f4e464e545238d38f11952967b1d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.614706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8419f4e464e545238d38f11952967b1d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.626740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd0de383ce7412595a5364a390b08a0, user_id=296c7a885b674cf3bac18dcdfe4b5bf2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:04.630650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:04.634801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8419f4e464e545238d38f11952967b1d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.635495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b46d9ea7-d26c-4e18-8b19-06772457afce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8419f4e464e545238d38f11952967b1d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:04.691642 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2697/5399] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:04 2022] DELETE /identity/v3/users/8419f4e464e545238d38f11952967b1d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:04.696805 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2703/5400] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:04 2022] PUT /identity/v3/projects/7dd0de383ce7412595a5364a390b08a0/users/296c7a885b674cf3bac18dcdfe4b5bf2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:04.706646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:04.706940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:04.707274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:04.772586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] MFA Rules not processed for user `296c7a885b674cf3bac18dcdfe4b5bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:04.773858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:05.001042 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2698/5401] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:05.120892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:05.123037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:05.360682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b2264-a918-4f38-9287-d939f0063527 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:05.435238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:05.449441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:05.450344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:05.450628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:05.450992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:05.457717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:05.604787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:05.607787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:05.621089 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2704/5402] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:05.770899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:05.776642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:05.785118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:05.928632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d136-2fff-40d9-950f-736b51034ee4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:05.934621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:05.935279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:05.935560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:05.935888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] PATH_INFO: `/v3/projects/25f522e127af48e9a6aa0d613c855fb2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:05.937368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f522e127af48e9a6aa0d613c855fb2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:05.939380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:06.023970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:06.025915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:06.085790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f522e127af48e9a6aa0d613c855fb2', 'request_id': 'req-c98adeb1-4867-4be6-b55a-7272e8c27d5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:06.112291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f522e127af48e9a6aa0d613c855fb2', 'request_id': 'req-c98adeb1-4867-4be6-b55a-7272e8c27d5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:06.140716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f522e127af48e9a6aa0d613c855fb2', 'request_id': 'req-c98adeb1-4867-4be6-b55a-7272e8c27d5e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:06.176262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3bd92-d094-44f6-9887-ebf9f4790f0a service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:06.178502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] The token cache is being invalidate because project 25f522e127af48e9a6aa0d613c855fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:06.179053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:06.183205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c98adeb1-4867-4be6-b55a-7272e8c27d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:06.202318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2699/5403] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:05 2022] DELETE /identity/v3/projects/25f522e127af48e9a6aa0d613c855fb2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:06.208969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:06.209505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:06.210034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:06.276719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:06.281131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:06.366812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:06.368057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:06.370710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:06.371255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:06.389153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:06.426034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:06.432925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad2d57-a0d1-4eca-8c6d-297176cba9b9 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:06.478889 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2705/5404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:06.490036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2700/5405] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:06.499508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:06.499811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:06.500098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:06.523549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:06.524966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:06.533658 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2706/5406] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:06.538192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:06.549776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a5772-882c-44a8-bd4c-e747879db65f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:06.589879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:06.597546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:06.598207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:06.598631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:06.599502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:06.599821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:06.604359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:06.666067 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2701/5407] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:06.670456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:06.684532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442c736-ce90-4ad4-9f32-c69081e82666 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:06.698802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:06.700947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:06.702751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:06.704400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:06.706865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:06.709910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:06.721635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:06.770679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:06.770900 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2707/5408] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:06 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:06.798797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed1b8e-d095-4a78-8877-d6f160a0a845 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:06.872073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:06.957970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:06.959890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:07.023254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.024180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.024667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.025326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.026380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.029532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.080762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2702/5409] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:06 2022] POST /identity/v3/users => generated 290 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:07.084835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.110873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47df800-1ad4-47b2-8382-4465e6070dca admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.120882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.121537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.123330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.123624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.124294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.128786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949a223-1ba3-4999-a2bd-6400c07b2929 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.129813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.145442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.145735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.146018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.146730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] PATH_INFO: `/v3/users/d75b66f14f7f49d4881c06e81b2a9918` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.148212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75b66f14f7f49d4881c06e81b2a9918)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.150241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.154298 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2703/5410] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:07.156388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.174190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91d030-aec2-44ee-8ddc-1369d6c294a8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.179274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.179899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.180179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.180453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.181204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.183825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.204371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2704/5411] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:07.210556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.224850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39275-7217-40f7-8bdb-34f3c315fde4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.233782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1cd84-6ad7-4112-bedc-8164bcb488f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.234743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1cd84-6ad7-4112-bedc-8164bcb488f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.235169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1cd84-6ad7-4112-bedc-8164bcb488f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.235568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1cd84-6ad7-4112-bedc-8164bcb488f7 admin admin] PATH_INFO: `/v3/projects/57b1416153994694bbb696a4b86e4577/users/054db4ae01c742dd89b31e7be3519534/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.262676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75b66f14f7f49d4881c06e81b2a9918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:07.268514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1cd84-6ad7-4112-bedc-8164bcb488f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b1416153994694bbb696a4b86e4577, user_id=054db4ae01c742dd89b31e7be3519534, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.274098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1cd84-6ad7-4112-bedc-8164bcb488f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.288271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75b66f14f7f49d4881c06e81b2a9918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:07.288271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75b66f14f7f49d4881c06e81b2a9918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:07.304519 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2705/5412] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:07 2022] PUT /identity/v3/projects/57b1416153994694bbb696a4b86e4577/users/054db4ae01c742dd89b31e7be3519534/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:07.316092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.316443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.316797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.333675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75b66f14f7f49d4881c06e81b2a9918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:07.336685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a1aff8f8-26a7-4ef2-9f5e-59dc38302d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75b66f14f7f49d4881c06e81b2a9918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:07.372877 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2708/5413] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:06 2022] DELETE /identity/v3/users/d75b66f14f7f49d4881c06e81b2a9918 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:07.374644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.374886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.375174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.392370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] MFA Rules not processed for user `054db4ae01c742dd89b31e7be3519534`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:07.394790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:07.413341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:07.416343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:07.523645 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2709/5414] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:07.570931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2706/5415] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:07.575947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.577489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:07.585692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.587723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:07.597699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4b19a-3633-4770-907e-ce780e3a4e4c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.610740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.611363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.611645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.611920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.612581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.614530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.628803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:07.695364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2710/5416] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:07 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:07.696274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.701853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8756b1-2292-451b-886e-333576a81c70 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.709895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:07.792630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.793853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.794358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.794826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.795046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635433-b622-4204-a6aa-a443014fc479 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.802450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.803089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.803479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.803768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.804501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.807609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.816584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.819609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.838559 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2707/5417] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:07.842739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2711/5418] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:07 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:07.846661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.858725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e0fe-ab15-4c6b-bf11-4beb9373af6e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.863900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.864508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.864794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.865402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.866240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.868180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.880034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2708/5419] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:50:07.884824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.895970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7486805-045c-47b6-a690-a1aafc632721 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:07.904654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:07.905715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:07.906058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:07.906346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] PATH_INFO: `/v3/projects/3e6abadf85834e1ba7bc8c0467607840/users/4260b3c7accc4940b1e8cb46f68a8ea6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:07.930458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6abadf85834e1ba7bc8c0467607840, user_id=4260b3c7accc4940b1e8cb46f68a8ea6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:07.936799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:07.966845 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2712/5420] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:07 2022] PUT /identity/v3/projects/3e6abadf85834e1ba7bc8c0467607840/users/4260b3c7accc4940b1e8cb46f68a8ea6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:50:07.970803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:07.984089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ae0a1-5200-4387-9c55-ac9cce36c2b5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:08.109631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12215a-75ad-44f6-bb5d-66c81775febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:08.111200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12215a-75ad-44f6-bb5d-66c81775febb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:08.111529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12215a-75ad-44f6-bb5d-66c81775febb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:08.112074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12215a-75ad-44f6-bb5d-66c81775febb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:08.113302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12215a-75ad-44f6-bb5d-66c81775febb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:08.115789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12215a-75ad-44f6-bb5d-66c81775febb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:08.133840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2709/5421] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:08.138084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:08.167629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23744607-e000-4346-9c45-a6389abf2ee9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:08.183167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:08.185740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:08.187365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:08.187824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] PATH_INFO: `/v3/projects/3e6abadf85834e1ba7bc8c0467607840/users/4260b3c7accc4940b1e8cb46f68a8ea6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:08.193555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6abadf85834e1ba7bc8c0467607840, user_id=4260b3c7accc4940b1e8cb46f68a8ea6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:08.199116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:08.233241 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2713/5422] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:08 2022] PUT /identity/v3/projects/3e6abadf85834e1ba7bc8c0467607840/users/4260b3c7accc4940b1e8cb46f68a8ea6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:08.245547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:08.245865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:08.246153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:08.314495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] MFA Rules not processed for user `4260b3c7accc4940b1e8cb46f68a8ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:08.316684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:08.429456 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2710/5423] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:08.442766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:08.445477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:08.567865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002f99-ba0e-4df6-964b-1aec56eaaa9b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:08.576209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:08.576932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:08.579523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:08.579831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:08.692407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:08.729414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:08.733243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:08.760415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2714/5424] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:08.926543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:08.928443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:08.989793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:09.091175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81f3c-d6b5-4020-9d6b-d1b518fd6acd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:09.101904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:09.104233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:09.104844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:09.105673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] PATH_INFO: `/v3/projects/6f1cb43a841f45ca9840fb069c965f5e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:09.109453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f1cb43a841f45ca9840fb069c965f5e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:09.116473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:09.235768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f1cb43a841f45ca9840fb069c965f5e', 'request_id': 'req-64fe2c19-30db-4f65-950e-0c4bee97a122'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.252222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f1cb43a841f45ca9840fb069c965f5e', 'request_id': 'req-64fe2c19-30db-4f65-950e-0c4bee97a122'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.270068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f1cb43a841f45ca9840fb069c965f5e', 'request_id': 'req-64fe2c19-30db-4f65-950e-0c4bee97a122'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.300684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] The token cache is being invalidate because project 6f1cb43a841f45ca9840fb069c965f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:09.301234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.301986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.306157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2711/5425] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:08 2022] DELETE /identity/v3/projects/6f1cb43a841f45ca9840fb069c965f5e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:09.310542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:09.335535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a704cd8-cf35-486d-99db-d0b3740f8a42 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:09.521963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:09.522772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:09.523184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:09.523564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] PATH_INFO: `/v3/users/296c7a885b674cf3bac18dcdfe4b5bf2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:09.525372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=296c7a885b674cf3bac18dcdfe4b5bf2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:09.527420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:09.652175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296c7a885b674cf3bac18dcdfe4b5bf2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.688626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296c7a885b674cf3bac18dcdfe4b5bf2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.690419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296c7a885b674cf3bac18dcdfe4b5bf2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.716013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296c7a885b674cf3bac18dcdfe4b5bf2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.716750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0a1276b7-e94d-42d0-a1ef-2aba75b88b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296c7a885b674cf3bac18dcdfe4b5bf2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:09.737478 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2715/5426] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:09 2022] DELETE /identity/v3/users/296c7a885b674cf3bac18dcdfe4b5bf2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:10.767993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:10.770430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:10.838951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe2c19-30db-4f65-950e-0c4bee97a122 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:11.105903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:11.109142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:11.109651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:11.110075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] PATH_INFO: `/v3/projects/7dd0de383ce7412595a5364a390b08a0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:11.112546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd0de383ce7412595a5364a390b08a0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:11.116852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:11.262561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd0de383ce7412595a5364a390b08a0', 'request_id': 'req-ef633f55-2fbb-45a5-9bef-ed75868868ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:11.271148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:11.277301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd0de383ce7412595a5364a390b08a0', 'request_id': 'req-ef633f55-2fbb-45a5-9bef-ed75868868ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:11.309449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd0de383ce7412595a5364a390b08a0', 'request_id': 'req-ef633f55-2fbb-45a5-9bef-ed75868868ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:11.350642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] The token cache is being invalidate because project 7dd0de383ce7412595a5364a390b08a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:11.351090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:11.351636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef633f55-2fbb-45a5-9bef-ed75868868ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:11.354183 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2712/5427] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:10 2022] DELETE /identity/v3/projects/7dd0de383ce7412595a5364a390b08a0 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:11.358896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:11.359395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:11.359797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:11.399970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:11.405386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:11.520758 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2716/5428] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:11.528677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:11.528886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:11.529522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:11.570331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:11.573027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:11.584643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2713/5429] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:11.590266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:11.596553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:11.605173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457c049-ea0c-4b0c-b78f-c8b21ecbd166 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:11.632509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:11.633649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:11.634606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:11.635079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:11.637338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:11.638229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:11.640027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:11.695383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2717/5430] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:50:11.699774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:11.713145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90156-1d3e-467b-a8f5-9d1c3726258b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:11.723648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcad24-e4c3-4b2b-a5cc-d59e044315d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:11.724324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcad24-e4c3-4b2b-a5cc-d59e044315d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:11.724781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcad24-e4c3-4b2b-a5cc-d59e044315d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:11.725124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcad24-e4c3-4b2b-a5cc-d59e044315d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:11.725780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcad24-e4c3-4b2b-a5cc-d59e044315d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:11.728377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:11.729903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:11.738891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcad24-e4c3-4b2b-a5cc-d59e044315d1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:11.829766 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2714/5431] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:11 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:11.831900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:11.832325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:11.832723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:11.918136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] MFA Rules not processed for user `effef5f66f5644fab19ecd3f862d7daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:11.919369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:11.941134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195e4a-79ba-4ae4-94fc-a88e600a5994 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.026030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.027117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.027117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.027462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.029894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:12.049917 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2715/5432] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:12.050647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:12.158845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.160706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9f030-96a5-4a44-98c9-12586b9d6a84 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.172724 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2718/5433] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:12.174303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.174568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.174851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.196013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6bac-50d9-462f-a7e8-23a072bf24dc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.197135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] MFA Rules not processed for user `effef5f66f5644fab19ecd3f862d7daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:12.199970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:12.201699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.202589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.202939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.203290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.204143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.207886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.215944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2719/5434] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:12.232474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:12.234548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:12.245747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2716/5435] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:12 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:12.250343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:12.278287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef9715-2c68-45e9-b919-af7b15179945 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.286774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.287438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.287719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.287999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.288653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.290957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.316737 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2717/5436] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:12.317716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:12.331951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5a640-bc83-4ce0-a083-0f221193fb59 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.338479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.339181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.339560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.339967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.340458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:12.340811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.343829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.360388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2718/5437] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:12.361495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:12.373902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd666-d261-4dea-8db0-e112d39ecf0a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.381233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0450b6-c491-44ec-87e4-5e5c141c57a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.382181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0450b6-c491-44ec-87e4-5e5c141c57a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.382828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0450b6-c491-44ec-87e4-5e5c141c57a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.383213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0450b6-c491-44ec-87e4-5e5c141c57a4 admin admin] PATH_INFO: `/v3/projects/bc5d0ff7a0bd4c409e21ed7c808f52cd/users/91f4e572932d49768171d141f2e78b61/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.397013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:12.409723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0450b6-c491-44ec-87e4-5e5c141c57a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5d0ff7a0bd4c409e21ed7c808f52cd, user_id=91f4e572932d49768171d141f2e78b61, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.412997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0450b6-c491-44ec-87e4-5e5c141c57a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.443193 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2719/5438] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:12 2022] PUT /identity/v3/projects/bc5d0ff7a0bd4c409e21ed7c808f52cd/users/91f4e572932d49768171d141f2e78b61/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:12.447060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.447604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.448219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.453590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4a9d-2bd4-4549-a369-af092e579c1f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.485043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] MFA Rules not processed for user `91f4e572932d49768171d141f2e78b61`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:12.487108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:12.668540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.669634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.670687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.671042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.680350 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2720/5439] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:12.693727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:12.695465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:12.893469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.903223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db8760-bf19-47b2-8c6a-7bcfac3e9fa4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:12.908513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.918986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:12.919978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:12.920469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:12.921062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:12.941889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:12.943234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2720/5440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:12.944394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:12.966840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2721/5441] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:13.941467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:13.946138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:14.139897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8e173-fb47-47f3-ab3e-0c1c891623de service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:14.150772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:14.151427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:14.151714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:14.151988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] PATH_INFO: `/v3/users/ff170a5be8a04902b66e5f0e79fd47df` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:14.161689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff170a5be8a04902b66e5f0e79fd47df)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:14.163642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:14.252039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:14.322676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff170a5be8a04902b66e5f0e79fd47df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:14.377443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff170a5be8a04902b66e5f0e79fd47df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:14.379573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff170a5be8a04902b66e5f0e79fd47df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:14.404175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff170a5be8a04902b66e5f0e79fd47df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:14.405467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff170a5be8a04902b66e5f0e79fd47df'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:14.434870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2721/5442] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:13 2022] DELETE /identity/v3/users/ff170a5be8a04902b66e5f0e79fd47df => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:14.628736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:14.658261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3ace-c1df-4460-b451-55844425b50a service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:14.794724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:14.796050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:14.836028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:14.837595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:14.837956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:14.838308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] PATH_INFO: `/v3/users/91f4e572932d49768171d141f2e78b61` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:14.840316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f4e572932d49768171d141f2e78b61)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:14.842445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:14.936687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:15.000602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a1052-6b67-48d8-ab5f-ac752700dea0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:15.004439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f4e572932d49768171d141f2e78b61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.021547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:15.032451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.033187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.033893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] PATH_INFO: `/v3/projects/d797c0058e8c456290081d056df79292` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.036377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f4e572932d49768171d141f2e78b61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.037166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d797c0058e8c456290081d056df79292)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:15.037679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f4e572932d49768171d141f2e78b61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.060676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f4e572932d49768171d141f2e78b61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.061895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3726bd98-7111-4daa-95b8-1850c6ded598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f4e572932d49768171d141f2e78b61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.077031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:15.106867 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2722/5443] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:14 2022] DELETE /identity/v3/users/91f4e572932d49768171d141f2e78b61 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:15.110969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.112388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.113118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.168085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:15.169861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:15.263489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd797c0058e8c456290081d056df79292', 'request_id': 'req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.282860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd797c0058e8c456290081d056df79292', 'request_id': 'req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.295456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd797c0058e8c456290081d056df79292', 'request_id': 'req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.320788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] The token cache is being invalidate because project d797c0058e8c456290081d056df79292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:15.321114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.325054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-17b8afc3-dacb-447f-86d9-ec0d5ec0f8e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:15.329409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2722/5444] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:14 2022] DELETE /identity/v3/projects/d797c0058e8c456290081d056df79292 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:50:15.334643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49442-4f39-4798-984e-c7990c1e9a18 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.335425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49442-4f39-4798-984e-c7990c1e9a18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.335860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca49442-4f39-4798-984e-c7990c1e9a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.359652 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2723/5445] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:15.373127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:15.376394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:15.385186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4ca49442-4f39-4798-984e-c7990c1e9a18 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:15.393727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ca49442-4f39-4798-984e-c7990c1e9a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:15.513161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:15.593450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e0ae5-708e-4fee-93a1-5d8b78f80a05 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:15.608353 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2723/5446] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:15.609888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.610188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.610449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.634686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:15.636256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:15.654747 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2724/5447] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:15.657763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:15.674090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34613a-965f-4867-9fc9-ff9e9f9dd786 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:15.682365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:15.683216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.683533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.683822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.684957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:15.685329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:15.699100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:15.729782 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2725/5448] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:15.734101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:15.747759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80d1b7-9540-4dcf-8747-992d890aef12 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:15.752766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:15.754575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.755805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.756776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.761494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:15.763276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.764035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.765245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.766540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:15.768686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:15.772853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:15.776841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:15.783110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:15.804317 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2724/5449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:15.828981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2726/5450] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:15 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:15.830624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:15.841507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ca36e-9ede-44d1-a0f3-23e58b75c4cc service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:15.972217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:15.974521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:15.974793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:15.976166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:15.978047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:15.981784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.034132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.034621 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2725/5451] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:15 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:16.052871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfb184-4680-4be3-9657-bbed18cb6d7b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.063869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.068098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.068389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.068672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.069945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.074854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.104173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.114486 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2727/5452] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:16.120307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f349ef5-4fef-470b-a243-44ce94128e6a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.131266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.133285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.135263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.135769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.137226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.141288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.168629 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2726/5453] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:50:16.173997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.191322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67bd7d-36f6-4313-8e87-c483d3ce1bd1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.205783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684f0cd-a354-4eae-84d7-089e171992a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.206526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684f0cd-a354-4eae-84d7-089e171992a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.206975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684f0cd-a354-4eae-84d7-089e171992a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.207254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684f0cd-a354-4eae-84d7-089e171992a5 admin admin] PATH_INFO: `/v3/projects/df7f497ef84645d3bead6c2e54a7603d/users/ef5ed582f9d74e2f9bd5ea39f41a5017/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.260482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684f0cd-a354-4eae-84d7-089e171992a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7f497ef84645d3bead6c2e54a7603d, user_id=ef5ed582f9d74e2f9bd5ea39f41a5017, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.263763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684f0cd-a354-4eae-84d7-089e171992a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.283593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.286521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:16.301641 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2728/5454] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:16 2022] PUT /identity/v3/projects/df7f497ef84645d3bead6c2e54a7603d/users/ef5ed582f9d74e2f9bd5ea39f41a5017/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:50:16.308817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.309207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.309497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.311899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6400a1-43da-4d4d-aab4-1ef0e07eecee admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.386421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:16.387950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:16.405656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.406461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.406877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.407262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] PATH_INFO: `/v3/projects/bc5d0ff7a0bd4c409e21ed7c808f52cd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.408523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5d0ff7a0bd4c409e21ed7c808f52cd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.410579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.473912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5d0ff7a0bd4c409e21ed7c808f52cd', 'request_id': 'req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:16.481117 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2729/5455] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:16.490572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5d0ff7a0bd4c409e21ed7c808f52cd', 'request_id': 'req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:16.500484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.509814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5d0ff7a0bd4c409e21ed7c808f52cd', 'request_id': 'req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:16.544363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] The token cache is being invalidate because project bc5d0ff7a0bd4c409e21ed7c808f52cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:16.544660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:16.545740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c14ff39-814f-4934-9d0e-a5c0aea2b0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:16.550590 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2727/5456] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:16 2022] DELETE /identity/v3/projects/bc5d0ff7a0bd4c409e21ed7c808f52cd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:16.556456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1c095-3bdd-4d8e-a533-c9067e848fa3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.556804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1c095-3bdd-4d8e-a533-c9067e848fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.557382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1c095-3bdd-4d8e-a533-c9067e848fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.596157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:16.611325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-58c1c095-3bdd-4d8e-a533-c9067e848fa3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:16.611496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5fd15-2938-4212-be6f-fa6ab77bb7bd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.614508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-58c1c095-3bdd-4d8e-a533-c9067e848fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:16.624526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:16.711134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.712488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.713416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.714138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.717119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:16.741774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2728/5457] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:16.755381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.756411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.756936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.807033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:16.808331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:16.821689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2729/5458] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:16.827070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.853314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf06eb-705b-40ab-b870-45c1be2880ef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.857348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.858599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.871810 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2730/5459] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:16.880975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.886712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.887132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.887478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.889221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:16.890858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.894929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:16.950073 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2730/5460] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:50:16.954232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:16.978317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf5d5-7ea9-4358-8516-35fe69c0f4cf service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:16.984532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:16.985377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:16.985925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:16.986267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:16.986920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:16.991049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:17.095274 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2731/5461] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:16 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:17.096672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:17.116350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5d47d-d81e-4f38-9a95-2b191cc49347 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:17.328099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:17.328620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:17.328927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:17.329223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:17.329922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:17.332734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:17.379361 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2731/5462] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:17 2022] POST /identity/v3/users => generated 283 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:17.380522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:17.398090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e209-f6f0-4188-a4c1-e9af236485da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:17.424436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:17.425309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:17.426485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:17.427284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:17.429930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:17.440211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:17.485676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:17.486417 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2732/5463] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:17.507729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16023dfd-1465-45e9-aa04-cd7fd43bba81 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:17.521868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8a95-c53a-4e43-82bb-c86db21ae40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:17.522507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8a95-c53a-4e43-82bb-c86db21ae40a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:17.522847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8a95-c53a-4e43-82bb-c86db21ae40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:17.523137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8a95-c53a-4e43-82bb-c86db21ae40a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:17.523799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8a95-c53a-4e43-82bb-c86db21ae40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:17.526178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8a95-c53a-4e43-82bb-c86db21ae40a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:17.562414 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2732/5464] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:17.563598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:17.576273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3d115-d021-46ef-a817-bc173e311f80 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:17.601661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:17.602611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:17.603301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:17.603566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] PATH_INFO: `/v3/projects/1ab63ab0346f4e0d9f8ae40158fcc4ea/users/90d6a7a62eb0421eac85e21f074a5380/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:17.672491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab63ab0346f4e0d9f8ae40158fcc4ea, user_id=90d6a7a62eb0421eac85e21f074a5380, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:17.685112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:17.717925 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2733/5465] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:17 2022] PUT /identity/v3/projects/1ab63ab0346f4e0d9f8ae40158fcc4ea/users/90d6a7a62eb0421eac85e21f074a5380/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:17.730809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:17.731099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:17.731399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:17.798536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] MFA Rules not processed for user `90d6a7a62eb0421eac85e21f074a5380`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:17.799971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:17.952575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:17.968812 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2733/5466] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:17.969721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:18.083740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a8634-3dde-4f43-81a6-646d26c284ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:18.101952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:18.103547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.104129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.104755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.106233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:18.109015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:18.132035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:18.190334 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2734/5467] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:17 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:18.195761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:18.218317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8f84-eab6-4e67-8010-b529fa66857d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:18.341897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:18.342923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.343618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.344230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.345450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:18.348304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:18.382553 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2734/5468] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:18 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:18.387043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:18.407412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3728-c49d-4340-93e0-21e5b9a6c6e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:18.422758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:18.424709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.426981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.427563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.428720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:18.433862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:18.461608 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2735/5469] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:18.466387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:18.482742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82b86b-55db-437c-85df-9c82199962f8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:18.492322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:18.493086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.493961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.494231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] PATH_INFO: `/v3/projects/bc93da209a404a48b79fa29c99814e00/users/52433ce3ab424736ba3ac354993afbdd/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.571155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc93da209a404a48b79fa29c99814e00, user_id=52433ce3ab424736ba3ac354993afbdd, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:18.574366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:18.617215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2735/5470] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:18 2022] PUT /identity/v3/projects/bc93da209a404a48b79fa29c99814e00/users/52433ce3ab424736ba3ac354993afbdd/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:18.621254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:18.646786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e3a7-0e5b-43cd-a0f4-31ebd8c293d7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:18.830980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581cb7f-fa05-4832-b004-b63383299015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:18.831797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581cb7f-fa05-4832-b004-b63383299015 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.832266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581cb7f-fa05-4832-b004-b63383299015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.832718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581cb7f-fa05-4832-b004-b63383299015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.833569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581cb7f-fa05-4832-b004-b63383299015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:18.835681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581cb7f-fa05-4832-b004-b63383299015 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:18.847123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2736/5471] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:18.851064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:18.865457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cde650-9ff2-4db9-84ab-a0fd9097c306 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:18.873781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:18.874719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.875093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.875460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] PATH_INFO: `/v3/projects/bc93da209a404a48b79fa29c99814e00/users/52433ce3ab424736ba3ac354993afbdd/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.877781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc93da209a404a48b79fa29c99814e00, user_id=52433ce3ab424736ba3ac354993afbdd, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:18.881115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:18.906412 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2736/5472] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:18 2022] PUT /identity/v3/projects/bc93da209a404a48b79fa29c99814e00/users/52433ce3ab424736ba3ac354993afbdd/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:18.917233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:18.917567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:18.917885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:18.980216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] MFA Rules not processed for user `52433ce3ab424736ba3ac354993afbdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:18.984030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:19.218167 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2737/5473] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:19.232402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:19.234297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:19.361385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddbfb6-c13e-4325-8a5d-82e5819864a2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:19.370253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:19.371119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:19.371460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:19.372261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:19.397414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:19.397414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:19.404438 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2737/5474] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:24.423780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:24.584427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d273894-e511-4b81-8326-4983bc87ec75 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:24.595639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:24.597519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:24.598138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:24.599519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] PATH_INFO: `/v3/users/90d6a7a62eb0421eac85e21f074a5380` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:24.601646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d6a7a62eb0421eac85e21f074a5380)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:24.605734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:24.611397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:24.724024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:24.725587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:24.758294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223de17-5716-4e69-9298-d70bef916ed3 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:24.777841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:24.778703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:24.780722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:24.781967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] PATH_INFO: `/v3/users/054db4ae01c742dd89b31e7be3519534` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:24.784149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d6a7a62eb0421eac85e21f074a5380'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.788512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=054db4ae01c742dd89b31e7be3519534)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:24.794624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:24.799152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d6a7a62eb0421eac85e21f074a5380'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.800063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d6a7a62eb0421eac85e21f074a5380'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.818131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d6a7a62eb0421eac85e21f074a5380'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.819677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75250eb4-ef1e-4eec-a557-e4c62781a219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d6a7a62eb0421eac85e21f074a5380'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.860607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2738/5475] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:24 2022] DELETE /identity/v3/users/90d6a7a62eb0421eac85e21f074a5380 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:24.878888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:24.880381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:24.881519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:24.934402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:24.938534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054db4ae01c742dd89b31e7be3519534'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.952444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:24.957418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:24.980760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054db4ae01c742dd89b31e7be3519534'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:24.988708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054db4ae01c742dd89b31e7be3519534'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:25.027145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054db4ae01c742dd89b31e7be3519534'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:25.028345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-709a8651-0926-44b6-91ff-d83ecc1b3492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054db4ae01c742dd89b31e7be3519534'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:25.076497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2738/5476] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:24 2022] DELETE /identity/v3/users/054db4ae01c742dd89b31e7be3519534 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:25.078484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:25.078782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:25.079067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:25.136157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:25.141743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:25.151499 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2739/5477] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:25.295330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:25.297600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:25.438883 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2739/5478] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:25.448592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:25.454082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:25.495201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea8402-c2fb-440e-aace-564fba90a79e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:25.568707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933af17a-0baa-4779-9f4d-f58f4ce05d2c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:25.588399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d8b29-cd51-4e25-ba64-04d47e54d256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:25.589298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8b29-cd51-4e25-ba64-04d47e54d256 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:25.589620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8b29-cd51-4e25-ba64-04d47e54d256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:25.590739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8b29-cd51-4e25-ba64-04d47e54d256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:25.619028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d8b29-cd51-4e25-ba64-04d47e54d256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:25.621468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d8b29-cd51-4e25-ba64-04d47e54d256 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:25.634972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:25.675385 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2740/5479] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:25.679643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f018a-dc1d-4fb7-89c0-89f03538b8a9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:25.680180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f018a-dc1d-4fb7-89c0-89f03538b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:25.680976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f018a-dc1d-4fb7-89c0-89f03538b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:25.685351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:25.686058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:25.686401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:25.686743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:25.696837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:25.698496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:25.716450 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2740/5480] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:25.723583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4b6f018a-dc1d-4fb7-89c0-89f03538b8a9 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:25.724873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b6f018a-dc1d-4fb7-89c0-89f03538b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:25.854377 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2741/5481] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:50:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:25.933839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:25.938114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:26.095619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5725bb-7b39-48d4-98fc-7218e31b098a service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:26.101967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:26.104244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:26.104647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:26.105065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:26.120064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:26.122287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:26.132874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2741/5482] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:50:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:50:27.236007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.236424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.236566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:27.249318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:27.322093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] MFA Rules not processed for user `ef5ed582f9d74e2f9bd5ea39f41a5017`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:27.323440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:27.486219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:27.489646 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2742/5483] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:27.495733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:27.496782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:27.501162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:27.529618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cc901-2833-4f69-9492-2a776d27d2f6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:27.530627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c067d-f03f-4f0a-be42-5acaf3c328bd service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:27.540655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:27.541697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:27.542686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.543127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.543791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.544011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.544379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:27.544764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] PATH_INFO: `/v3/projects/1ab63ab0346f4e0d9f8ae40158fcc4ea` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:27.545798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:27.548143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:27.549070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab63ab0346f4e0d9f8ae40158fcc4ea)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:27.551215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:27.613447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2743/5484] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:27 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:27.621763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:27.641347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab63ab0346f4e0d9f8ae40158fcc4ea', 'request_id': 'req-5c657769-e73b-40c2-9d90-8b2ee08ff262'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:27.691801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab63ab0346f4e0d9f8ae40158fcc4ea', 'request_id': 'req-5c657769-e73b-40c2-9d90-8b2ee08ff262'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:27.705151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab63ab0346f4e0d9f8ae40158fcc4ea', 'request_id': 'req-5c657769-e73b-40c2-9d90-8b2ee08ff262'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:27.729237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] The token cache is being invalidate because project 1ab63ab0346f4e0d9f8ae40158fcc4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:27.730147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:27.732156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:27.734609 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2742/5485] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:27 2022] DELETE /identity/v3/projects/1ab63ab0346f4e0d9f8ae40158fcc4ea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:27.741101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:27.744450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:27.766327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599680e-d1bc-4d42-ba6b-58dc40e3ede5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:27.783035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:27.785001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.785289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.785569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:27.786229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:27.792871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:27.847860 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2744/5486] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:27 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:27.851865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:27.857330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:27.879779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:27.888832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fa704-7b6b-4773-b35e-f2ff6a64cb1a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:27.905632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:27.906459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.907047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.908342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:27.909191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:27.914440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:27.933943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c657769-e73b-40c2-9d90-8b2ee08ff262 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:27.941632 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2745/5487] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:27.948527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:27.950153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:27.951095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.952471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.953403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] PATH_INFO: `/v3/users/52433ce3ab424736ba3ac354993afbdd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:27.956059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=52433ce3ab424736ba3ac354993afbdd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:27.960210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:27.980223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef826-b1ff-4c47-944f-5b72ced0713e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:27.992811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:27.997816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:27.998176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:27.998779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] PATH_INFO: `/v3/projects/08356cdfc83e4d13a0e0db4b4f5f80c0/users/5d9af0269a6b459ca7f74d5a0ed18ffb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:28.038514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08356cdfc83e4d13a0e0db4b4f5f80c0, user_id=5d9af0269a6b459ca7f74d5a0ed18ffb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:28.056458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:28.115584 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2746/5488] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:27 2022] PUT /identity/v3/projects/08356cdfc83e4d13a0e0db4b4f5f80c0/users/5d9af0269a6b459ca7f74d5a0ed18ffb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:28.120553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:28.130881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52433ce3ab424736ba3ac354993afbdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.152095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52433ce3ab424736ba3ac354993afbdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.152928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52433ce3ab424736ba3ac354993afbdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.198210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52433ce3ab424736ba3ac354993afbdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.199752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52433ce3ab424736ba3ac354993afbdd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.210018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:28.234900 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2743/5489] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:27 2022] DELETE /identity/v3/users/52433ce3ab424736ba3ac354993afbdd => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:28.235431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:28.237058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:28.373499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357652d-aa02-4234-ac58-c32e1241b377 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:28.380119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:28.380808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:28.381089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:28.381310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:28.382069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:28.383830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:28.388836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf20412-f987-4525-8a32-d28a371ef1db admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:28.413918 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2747/5490] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:28.414713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:28.415423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:28.418004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:28.420142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:28.421496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:28.423372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] PATH_INFO: `/v3/projects/57b1416153994694bbb696a4b86e4577` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:28.428020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b1416153994694bbb696a4b86e4577)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:28.439061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:28.451149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3cb21-e13d-4979-9b9b-e620b8065bd9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:28.457913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:28.458599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:28.458802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:28.459237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] PATH_INFO: `/v3/projects/08356cdfc83e4d13a0e0db4b4f5f80c0/users/5d9af0269a6b459ca7f74d5a0ed18ffb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:28.461579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08356cdfc83e4d13a0e0db4b4f5f80c0, user_id=5d9af0269a6b459ca7f74d5a0ed18ffb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:28.466691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:28.491461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2748/5491] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:28 2022] PUT /identity/v3/projects/08356cdfc83e4d13a0e0db4b4f5f80c0/users/5d9af0269a6b459ca7f74d5a0ed18ffb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:28.590788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b1416153994694bbb696a4b86e4577', 'request_id': 'req-aa99ed3c-f3f4-4d14-a836-017e575edd7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.629492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b1416153994694bbb696a4b86e4577', 'request_id': 'req-aa99ed3c-f3f4-4d14-a836-017e575edd7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.639708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b1416153994694bbb696a4b86e4577', 'request_id': 'req-aa99ed3c-f3f4-4d14-a836-017e575edd7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.641465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:28.669055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] The token cache is being invalidate because project 57b1416153994694bbb696a4b86e4577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:28.669428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.670083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:28.674121 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2744/5492] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:28 2022] DELETE /identity/v3/projects/57b1416153994694bbb696a4b86e4577 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:28.677892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:28.683464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:28.906054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad23f0-3425-48cb-9de5-2d9c5ad34120 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:29.016241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:29.017334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:29.017854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:29.018350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] PATH_INFO: `/v3/users/4260b3c7accc4940b1e8cb46f68a8ea6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:29.019848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4260b3c7accc4940b1e8cb46f68a8ea6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:29.022112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:29.156179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4260b3c7accc4940b1e8cb46f68a8ea6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.181034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:29.193660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4260b3c7accc4940b1e8cb46f68a8ea6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.197030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4260b3c7accc4940b1e8cb46f68a8ea6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.222465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4260b3c7accc4940b1e8cb46f68a8ea6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.223697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4517bfb-fffc-42d3-b4cb-28027a8bf0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4260b3c7accc4940b1e8cb46f68a8ea6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.246754 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2749/5493] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:28 2022] DELETE /identity/v3/users/4260b3c7accc4940b1e8cb46f68a8ea6 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:29.512069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:29.513860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:29.543425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99ed3c-f3f4-4d14-a836-017e575edd7e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:29.681961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:29.682708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:29.682890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:29.683160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] PATH_INFO: `/v3/projects/bc93da209a404a48b79fa29c99814e00` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:29.688333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc93da209a404a48b79fa29c99814e00)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:29.690387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:29.800354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc93da209a404a48b79fa29c99814e00', 'request_id': 'req-135e2eb8-8130-4d90-a1d5-544c7247e094'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.823636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc93da209a404a48b79fa29c99814e00', 'request_id': 'req-135e2eb8-8130-4d90-a1d5-544c7247e094'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.831494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc93da209a404a48b79fa29c99814e00', 'request_id': 'req-135e2eb8-8130-4d90-a1d5-544c7247e094'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.856745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] The token cache is being invalidate because project bc93da209a404a48b79fa29c99814e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:29.860135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.860941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-135e2eb8-8130-4d90-a1d5-544c7247e094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:29.867329 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2745/5494] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:29 2022] DELETE /identity/v3/projects/bc93da209a404a48b79fa29c99814e00 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:29.869767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:29.870278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:29.870368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:29.932154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:29.936641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:30.100591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2750/5495] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:30.102355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.102651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.102937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.141875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:30.142887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:30.174003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2746/5496] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:30.176134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.193264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b19e06-f01b-4562-afcd-097b04ab00c7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.202490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.203481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.203481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.203708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.204305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:30.204611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.206435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.234721 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2751/5497] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:30.241747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.253715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287394d-7854-44a0-a55f-065fcba54a49 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.270273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.273253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.275448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.275448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.276413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.284930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.290525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.292329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:30.320598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3aad6-2159-4960-9379-e903931f8f86 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.329238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.329693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.330014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.330291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] PATH_INFO: `/v3/projects/3e6abadf85834e1ba7bc8c0467607840` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.334898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6abadf85834e1ba7bc8c0467607840)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.338076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.356955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2747/5498] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:30 2022] POST /identity/v3/projects => generated 407 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:30.358258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.483236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:30.495424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a478a-87c9-4afe-9754-d37f97289f93 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.504608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6abadf85834e1ba7bc8c0467607840', 'request_id': 'req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:30.519345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6abadf85834e1ba7bc8c0467607840', 'request_id': 'req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:30.533274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6abadf85834e1ba7bc8c0467607840', 'request_id': 'req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:30.561157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] The token cache is being invalidate because project 3e6abadf85834e1ba7bc8c0467607840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:30.561576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:30.562876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e63d98-e5ac-4aa8-a400-d9ab9c62c85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:30.567838 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2752/5499] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:30 2022] DELETE /identity/v3/projects/3e6abadf85834e1ba7bc8c0467607840 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:30.569375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea71aa-edfd-4655-9ed7-be80a14795f0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.569661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea71aa-edfd-4655-9ed7-be80a14795f0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.570080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea71aa-edfd-4655-9ed7-be80a14795f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.641286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-55ea71aa-edfd-4655-9ed7-be80a14795f0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:30.641825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55ea71aa-edfd-4655-9ed7-be80a14795f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:30.727013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.731744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:30.733279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.733279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.733525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.734594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.736575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.785330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2753/5500] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:30.794189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.794405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.796612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.832936 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2748/5501] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:30 2022] POST /identity/v3/users => generated 304 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:30.836137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.840422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:30.841758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:30.843234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:30.857829 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2754/5502] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:30.858793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.874526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b433-cb85-4771-ac12-16e9e72804d7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.880040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.880660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.881005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.881286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.885138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:30.885452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.888375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.896639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d750d0c-926c-4778-894d-afbc9444a7b4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.921867 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2755/5503] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:30.928060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.931320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.932381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.932888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.933415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.934311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.936160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.952022 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2749/5504] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:30.959361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18b5b7-bdbd-4c23-ae7f-a76fdbf748f9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.964779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:30.975831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.978196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.978528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.978992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.982647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.984193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeab866-18b9-4e57-acd9-ad8742bf5e17 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:30.984785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:30.990981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:30.991964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:30.992464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:30.993600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:30.994738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:30.996855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:31.017619 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2750/5505] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:31.052578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:31.090717 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2756/5506] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:30 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:31.098965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:31.105515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8e0e-911a-456c-b775-efcaa49e3026 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:31.414649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464e967-dc3c-47b0-8dad-4895db187bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:31.416051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464e967-dc3c-47b0-8dad-4895db187bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.417227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464e967-dc3c-47b0-8dad-4895db187bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:31.417710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464e967-dc3c-47b0-8dad-4895db187bb3 admin admin] PATH_INFO: `/v3/projects/4b27f4de8bf440789c4c3b1eb6dd3024/users/6e677396505849deb9306775d4d508e2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:31.449794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cc3d1-d381-4c64-a269-da05aa8aa510 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:31.454977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464e967-dc3c-47b0-8dad-4895db187bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27f4de8bf440789c4c3b1eb6dd3024, user_id=6e677396505849deb9306775d4d508e2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:31.457878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464e967-dc3c-47b0-8dad-4895db187bb3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:31.460379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:31.461051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.461339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:31.463356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:31.465329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:31.467317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:31.491834 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2751/5507] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:31 2022] PUT /identity/v3/projects/4b27f4de8bf440789c4c3b1eb6dd3024/users/6e677396505849deb9306775d4d508e2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:31.503646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.504095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:31.504626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:31.568440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2757/5508] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:31 2022] POST /identity/v3/users => generated 305 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:31.569687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:31.585393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] MFA Rules not processed for user `6e677396505849deb9306775d4d508e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:31.588028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:31.599482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed7b98-1417-4097-9e7c-ca544d8ce2e4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:31.698781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:31.772765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2752/5509] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:31 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:31.777385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:31.798485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:31.799122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.799409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:31.799688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:31.803730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:31.809644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:31.834771 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2758/5510] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:31.840125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:31.866753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2b22-796d-4198-aa19-5e57b4914b85 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:31.878442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:31.879121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.879345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:31.881995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:31.882716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:31.888012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:31.921405 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2759/5511] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:31.926323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:31.959864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5159c1-af96-4392-aa6f-7d6651164fc3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:31.979894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d75f5-0f98-4301-a78f-c62e7e574e0c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:31.991936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec3eb6-4cfc-481a-8874-c31147da5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:31.992625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec3eb6-4cfc-481a-8874-c31147da5f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.995686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:31.996499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:31.997063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:31.997750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:31.998516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.001163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec3eb6-4cfc-481a-8874-c31147da5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.001548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec3eb6-4cfc-481a-8874-c31147da5f43 admin admin] PATH_INFO: `/v3/projects/071338cbeced46bd8866dd82f29f250c/users/7cae5deb3ddb4625ab2624ce98fad7fb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.002604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.050929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec3eb6-4cfc-481a-8874-c31147da5f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071338cbeced46bd8866dd82f29f250c, user_id=7cae5deb3ddb4625ab2624ce98fad7fb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.059587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec3eb6-4cfc-481a-8874-c31147da5f43 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.067166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:32.085755 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2753/5512] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:31 2022] POST /identity/v3/projects => generated 405 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:32.087932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.119906 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2760/5513] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:31 2022] PUT /identity/v3/projects/071338cbeced46bd8866dd82f29f250c/users/7cae5deb3ddb4625ab2624ce98fad7fb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:32.121976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:32.122532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.122927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.185309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] MFA Rules not processed for user `7cae5deb3ddb4625ab2624ce98fad7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:32.186931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:32.272203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02dd8d-7b82-4f6f-b8d5-bb054dbf7625 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:32.306640 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2761/5514] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:32 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:32.313032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.394474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:32.395423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:32.395703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.395977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.396640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.402200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.469709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2754/5515] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:32 2022] POST /identity/v3/users => generated 309 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:32.475737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.480711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a64ca-3efe-4450-b6af-ecb6a08256e4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:32.496104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:32.496741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:32.499389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:32.501058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.501344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.502198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.505064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99c577-8ddb-4bed-b612-66e7d415a85b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:32.507871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.518655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:32.520148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:32.520858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.522816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.527086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.528763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.573891 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2755/5516] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:32.575284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.601559 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2762/5517] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:32 2022] POST /identity/v3/projects => generated 409 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:32.605067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.613663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29746db-b2a3-45ab-b078-0b67eba544a8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:32.828477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:32.829548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:32.831448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.831728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] PATH_INFO: `/v3/projects/554e6b6d003448a8bc99b68eacaf9a9e/users/e39b92c5123e4bd3b2b6157d0dbb50c2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.843107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b43dd0-4a0e-4aaa-b5f7-f7fe9bc01b43 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:32.859029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:32.859729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:32.860012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:32.860286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:32.863580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.869032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.880536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=554e6b6d003448a8bc99b68eacaf9a9e, user_id=e39b92c5123e4bd3b2b6157d0dbb50c2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:32.884510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:32.920965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:32.934235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2756/5518] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:32 2022] PUT /identity/v3/projects/554e6b6d003448a8bc99b68eacaf9a9e/users/e39b92c5123e4bd3b2b6157d0dbb50c2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:32.939705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.941199 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2763/5519] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:32 2022] POST /identity/v3/users => generated 311 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:32.945078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:32.991208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966a9fd-8501-4925-ac25-25a393125a6c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:33.242309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5c29d-4cdc-4f8d-94c7-0d7aca83a35d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:33.261571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:33.263087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.263296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.263576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.264283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:33.265470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:33.265979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.266254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.266521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.267268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:33.270576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:33.272756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:33.298455 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2764/5520] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:33.302169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:33.315646 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2757/5521] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:33.317379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:33.329672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bb619-e38d-423f-86b0-f4201f97b6ab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:33.337614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73af38-4b8b-489d-a51e-f9449b8d67b7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:33.345044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:33.346106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.346672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.347542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] PATH_INFO: `/v3/projects/8ea4e4aaef5349699870e5ad8b73551c/users/7320b9dc329141138f5052fe0bce0e0d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.354043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560efc-976f-47c8-afdb-7b142a1ad980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:33.357441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560efc-976f-47c8-afdb-7b142a1ad980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.357441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560efc-976f-47c8-afdb-7b142a1ad980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.357441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560efc-976f-47c8-afdb-7b142a1ad980 admin admin] PATH_INFO: `/v3/projects/554e6b6d003448a8bc99b68eacaf9a9e/users/e39b92c5123e4bd3b2b6157d0dbb50c2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.363093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c560efc-976f-47c8-afdb-7b142a1ad980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554e6b6d003448a8bc99b68eacaf9a9e, user_id=e39b92c5123e4bd3b2b6157d0dbb50c2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:33.370779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c560efc-976f-47c8-afdb-7b142a1ad980 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:33.391663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea4e4aaef5349699870e5ad8b73551c, user_id=7320b9dc329141138f5052fe0bce0e0d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:33.398389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:33.412683 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2758/5522] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:33 2022] PUT /identity/v3/projects/554e6b6d003448a8bc99b68eacaf9a9e/users/e39b92c5123e4bd3b2b6157d0dbb50c2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:33.416555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93f750-2e0e-4b06-8795-a158ae022dba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.417347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93f750-2e0e-4b06-8795-a158ae022dba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.417768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93f750-2e0e-4b06-8795-a158ae022dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.446607 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2765/5523] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:33 2022] PUT /identity/v3/projects/8ea4e4aaef5349699870e5ad8b73551c/users/7320b9dc329141138f5052fe0bce0e0d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:33.451304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:33.529523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ac93f750-2e0e-4b06-8795-a158ae022dba None None] MFA Rules not processed for user `e39b92c5123e4bd3b2b6157d0dbb50c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:33.533440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac93f750-2e0e-4b06-8795-a158ae022dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:33.638908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904f761-4dd1-4a48-95bf-baca73fe6868 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:33.660081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:33.660707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.661048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.671629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.672381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:33.681972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:33.707525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:33.717302 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2766/5524] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:33.717853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:33.735514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67914f-5536-46c4-b2d1-75c1fdc5752d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:33.753606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:33.754289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.754657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.754874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] PATH_INFO: `/v3/projects/8ea4e4aaef5349699870e5ad8b73551c/users/7320b9dc329141138f5052fe0bce0e0d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.756868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea4e4aaef5349699870e5ad8b73551c, user_id=7320b9dc329141138f5052fe0bce0e0d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:33.759926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:33.791927 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2759/5525] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:33 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:33.802145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2767/5526] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:33 2022] PUT /identity/v3/projects/8ea4e4aaef5349699870e5ad8b73551c/users/7320b9dc329141138f5052fe0bce0e0d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:33.803152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:33.803447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:33.803729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:33.872452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:33.875133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:33.882319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] MFA Rules not processed for user `7320b9dc329141138f5052fe0bce0e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:33.888841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:34.036362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531a9a-6159-484e-b1f2-90714cf6d76c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:34.047518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:34.048565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:34.049120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:34.049631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:34.060766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:34.153559 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2760/5527] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:33 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:34.154560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:34.160443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:34.218060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:34.219682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:34.242091 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2768/5528] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:33 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:34.387375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730cd32-36bf-4ceb-a844-99d898f97704 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:34.391895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:34.393350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:34.393647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:34.393927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:34.426534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:34.429199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:34.451876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2761/5529] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:34.744612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:34.769215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75333ffb-87bc-4ed1-8082-faa44f581ff6 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:34.777314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422f269-9480-4101-9e9f-b2bca237d99b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:34.778815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f269-9480-4101-9e9f-b2bca237d99b service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:34.779176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f269-9480-4101-9e9f-b2bca237d99b service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:34.779461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422f269-9480-4101-9e9f-b2bca237d99b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:34.963329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422f269-9480-4101-9e9f-b2bca237d99b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:34.973495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422f269-9480-4101-9e9f-b2bca237d99b service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:35.033260 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2769/5530] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:36.814271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:36.815827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:37.092056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aa5e0-ee99-47f5-9836-99129257782d service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:37.115941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:37.115941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:37.117212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:37.119274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:37.155048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:37.356687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:37.360999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:37.416108 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2762/5531] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:40.170930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:40.171486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:40.171486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:40.253898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] MFA Rules not processed for user `5d9af0269a6b459ca7f74d5a0ed18ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:40.255428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:40.463191 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2770/5532] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:40.476354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:40.480142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:40.511411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb71723-bd25-4d09-bcdb-f8ea6b38aa7d service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:40.522926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:40.523591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:40.524126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:40.525791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:40.530298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:40.689823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:40.691528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:40.715287 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2763/5533] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:47.779277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:47.780960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:47.927385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:48.035218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100c807-e20d-4f8c-a679-f790a1f43bf8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:48.047524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:48.051744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:48.052385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:48.052881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:48.059023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:48.119008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:48.126126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:48.181950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2771/5534] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:50.709308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=53 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:51.550033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:51.552287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:51.697754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdefdfe-9210-4876-a613-cc7728a05853 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:51.702864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:51.703522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:51.703947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:51.704235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] PATH_INFO: `/v3/users/7cee670a08f94ba7aa95dbb46ef2eb45` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:51.705420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cee670a08f94ba7aa95dbb46ef2eb45)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:51.707425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:51.789904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cee670a08f94ba7aa95dbb46ef2eb45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:51.813456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cee670a08f94ba7aa95dbb46ef2eb45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:51.814704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cee670a08f94ba7aa95dbb46ef2eb45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:51.826608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cee670a08f94ba7aa95dbb46ef2eb45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:51.826991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-554ecd46-5874-442d-9e47-5746f97e3e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cee670a08f94ba7aa95dbb46ef2eb45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:51.852947 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2764/5535] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:51 2022] DELETE /identity/v3/users/7cee670a08f94ba7aa95dbb46ef2eb45 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:52.250980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:52.268949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fdb22-9713-4f41-ac9e-b944f87d1cd7 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:52.436167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:52.437796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:52.438931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:52.440001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] PATH_INFO: `/v3/projects/80fc825cf1534094bab87cebb75a7d2e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:52.442111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fc825cf1534094bab87cebb75a7d2e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:52.444297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:52.557102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fc825cf1534094bab87cebb75a7d2e', 'request_id': 'req-c96aecc6-4906-4c30-8e6f-0bae7d042af9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:52.568184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fc825cf1534094bab87cebb75a7d2e', 'request_id': 'req-c96aecc6-4906-4c30-8e6f-0bae7d042af9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:52.588724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fc825cf1534094bab87cebb75a7d2e', 'request_id': 'req-c96aecc6-4906-4c30-8e6f-0bae7d042af9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:52.633879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] The token cache is being invalidate because project 80fc825cf1534094bab87cebb75a7d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:52.634200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:52.636097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c96aecc6-4906-4c30-8e6f-0bae7d042af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:52.648039 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2772/5536] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:52 2022] DELETE /identity/v3/projects/80fc825cf1534094bab87cebb75a7d2e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:52.650155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:52.650541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:52.650934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:52.698257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:52.703879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:53.010629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2765/5537] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:53.015035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.017293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.017634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.085086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:53.090923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:53.148431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2773/5538] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:53.155435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:53.181012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4d8f-29af-42d4-9cc7-2a24f8bd86db None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:53.199435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:53.200197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.200485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.200769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.201474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:53.207532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:53.209179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:53.230276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2766/5539] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:53.232140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:53.242437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abfd1d-c779-447b-8a25-68f1fbabf668 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:53.248018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:53.248630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.248921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.249220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.250152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:53.252050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:53.302219 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2774/5540] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:53 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:53.303631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:53.317406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7342d7-7d5f-4162-b2ba-9cf33a8b446b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:53.324542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:53.427073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:53.431211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.431492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.431796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.432421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:53.439692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:53.511368 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2767/5541] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:53 2022] POST /identity/v3/users => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:50:53.511965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:53.542042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561bb2-f370-49d9-9014-a9691ad32a0a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:53.568574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:53.569253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.569535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.569811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.573313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:53.575514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:53.611349 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2775/5542] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:53.613059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:53.632604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8705a86-faa8-4c52-bc4d-7fc089bbd29e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:53.647767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945efff-7dbe-4111-8902-a5ae0c6a1586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:53.649343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945efff-7dbe-4111-8902-a5ae0c6a1586 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.649653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945efff-7dbe-4111-8902-a5ae0c6a1586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.649926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945efff-7dbe-4111-8902-a5ae0c6a1586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.650646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945efff-7dbe-4111-8902-a5ae0c6a1586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:53.652265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945efff-7dbe-4111-8902-a5ae0c6a1586 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:53.694530 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2768/5543] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:50:53.695940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:53.713051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31348-3bf5-447f-9edb-c921d2d25a74 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:53.728035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:53.728736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.729050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.729587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] PATH_INFO: `/v3/projects/4b3d6c52d8d7470bae763a2bb3de1dc1/users/e39d2b685a3647dda2dfc248e79a5dca/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.757308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:53.783473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3d6c52d8d7470bae763a2bb3de1dc1, user_id=e39d2b685a3647dda2dfc248e79a5dca, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:53.787445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:53.833656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2776/5544] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:53 2022] PUT /identity/v3/projects/4b3d6c52d8d7470bae763a2bb3de1dc1/users/e39d2b685a3647dda2dfc248e79a5dca/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:53.844621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a6c7-d19c-413c-baf3-906131585a2a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:53.844828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a6c7-d19c-413c-baf3-906131585a2a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:53.845141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37a6c7-d19c-413c-baf3-906131585a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:53.893427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0d37a6c7-d19c-413c-baf3-906131585a2a None None] MFA Rules not processed for user `e39d2b685a3647dda2dfc248e79a5dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:53.894739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d37a6c7-d19c-413c-baf3-906131585a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:54.116928 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2769/5545] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:54.133779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:54.353411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc90a3f-cbf7-4bba-89fb-b5c340244cc8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:54.360270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:54.361038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:54.361321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:54.361604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] PATH_INFO: `/v3/users/e39d2b685a3647dda2dfc248e79a5dca` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:54.368205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39d2b685a3647dda2dfc248e79a5dca)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:54.370232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:54.483145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39d2b685a3647dda2dfc248e79a5dca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:54.524620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39d2b685a3647dda2dfc248e79a5dca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:54.525456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39d2b685a3647dda2dfc248e79a5dca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:54.547848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39d2b685a3647dda2dfc248e79a5dca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:54.548498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39d2b685a3647dda2dfc248e79a5dca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:54.580856 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2777/5546] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:54 2022] DELETE /identity/v3/users/e39d2b685a3647dda2dfc248e79a5dca => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:54.583395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:54.583682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:54.583962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:54.647382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:54.652469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:54.799414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2770/5547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:54.819425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:54.827408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:54.999920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23753ad1-8578-4956-8717-86ce77c859f1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:55.006207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:55.006845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:55.007119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:55.008631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:55.018014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:55.029036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:55.030824 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2778/5548] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:55.501640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:55.503463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:55.532299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c06399-273c-4cac-b2cd-4e3d9d649df6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:55.550308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:55.551059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:55.551350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:55.551629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] PATH_INFO: `/v3/users/6e677396505849deb9306775d4d508e2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:55.562620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e677396505849deb9306775d4d508e2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:55.564594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:55.591747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:55.721406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e677396505849deb9306775d4d508e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:55.745232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:55.762895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:55.778350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e677396505849deb9306775d4d508e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:55.779366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e677396505849deb9306775d4d508e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:55.802127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed3c8b-7545-4490-8850-b463cfe08965 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:55.803163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e677396505849deb9306775d4d508e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:55.803973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bca53267-b319-4802-995b-19cfdc21de4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e677396505849deb9306775d4d508e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:55.824169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:55.825035 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2771/5549] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:55 2022] DELETE /identity/v3/users/6e677396505849deb9306775d4d508e2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:55.826032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:55.827560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:55.828668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] PATH_INFO: `/v3/users/7cae5deb3ddb4625ab2624ce98fad7fb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:55.829429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:55.829900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:55.830347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:55.836632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cae5deb3ddb4625ab2624ce98fad7fb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:55.839806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:55.849331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:55.879025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:55.882432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:55.984760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cae5deb3ddb4625ab2624ce98fad7fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.028610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cae5deb3ddb4625ab2624ce98fad7fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.029175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2772/5550] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:50:56.029785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cae5deb3ddb4625ab2624ce98fad7fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.059211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cae5deb3ddb4625ab2624ce98fad7fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.060531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4e33cc7e-d4ac-4f0d-86b9-cacbaf517459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cae5deb3ddb4625ab2624ce98fad7fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.082231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:56.084061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.099974 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2779/5551] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:55 2022] DELETE /identity/v3/users/7cae5deb3ddb4625ab2624ce98fad7fb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:50:56.105417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:56.107323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:56.107708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:56.175035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:56.176434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.277462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf086d-1598-4518-9ae2-612302c7221b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:56.383602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:56.394034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2780/5552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:56.394034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:56.397733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:56.398358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:56.399217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:56.399622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:56.402849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.407585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.418008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b44b6-4ee6-4bcc-8242-5ee736c55137 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:56.423106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:56.423858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:56.424137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:56.424610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] PATH_INFO: `/v3/projects/4b3d6c52d8d7470bae763a2bb3de1dc1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:56.425888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3d6c52d8d7470bae763a2bb3de1dc1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:56.428119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:56.433955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:56.435993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:56.462568 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2773/5553] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:50:56.463736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:56.481259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.523781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc1b1a-9d6e-48dc-83eb-a3784254497d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:56.526743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3d6c52d8d7470bae763a2bb3de1dc1', 'request_id': 'req-22fc106f-6563-4701-a2ed-00a3738c0715'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.550200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3d6c52d8d7470bae763a2bb3de1dc1', 'request_id': 'req-22fc106f-6563-4701-a2ed-00a3738c0715'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.563950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3d6c52d8d7470bae763a2bb3de1dc1', 'request_id': 'req-22fc106f-6563-4701-a2ed-00a3738c0715'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.603268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] The token cache is being invalidate because project 4b3d6c52d8d7470bae763a2bb3de1dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:56.603680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.604237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-22fc106f-6563-4701-a2ed-00a3738c0715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:56.609226 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2781/5554] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:56 2022] DELETE /identity/v3/projects/4b3d6c52d8d7470bae763a2bb3de1dc1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:56.614256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:56.614544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:56.614820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:56.649547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:56.713565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:56.714416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:56.714635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:56.714898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:56.721409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.728094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:56.729491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:56.915965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:56.917881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b0f84-6747-474f-8744-079f2cc3ffe0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:56.943994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2774/5555] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:56.963543 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2782/5556] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:56.975027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:56.975622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:56.976081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.003399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:57.005600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:57.027879 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2775/5557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:57.032892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.039362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.053452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36dc7b-dfcc-4096-99a2-19dc385f178e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.055395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:57.071706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.072355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.072643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.072952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.073624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:57.073926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.075731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.083531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b9338-b8f6-404d-94e9-ef423f600013 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.097952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.100361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.100818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.103476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] PATH_INFO: `/v3/projects/4b27f4de8bf440789c4c3b1eb6dd3024` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.107810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b27f4de8bf440789c4c3b1eb6dd3024)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.110102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.110563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2783/5558] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:57.113381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.140303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81d1be-d8ee-4e95-b88f-c964da7111c5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.160282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.161036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.161392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.161736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.162461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.169920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.232959 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2784/5559] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:57 2022] POST /identity/v3/projects => generated 357 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:57.237012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.244333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b27f4de8bf440789c4c3b1eb6dd3024', 'request_id': 'req-87538dbf-75fc-456a-8b74-3b51cb7c4038'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.272234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b27f4de8bf440789c4c3b1eb6dd3024', 'request_id': 'req-87538dbf-75fc-456a-8b74-3b51cb7c4038'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.296635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b27f4de8bf440789c4c3b1eb6dd3024', 'request_id': 'req-87538dbf-75fc-456a-8b74-3b51cb7c4038'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.329611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] The token cache is being invalidate because project 4b27f4de8bf440789c4c3b1eb6dd3024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:57.330547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.335562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.339659 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2776/5560] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:57 2022] DELETE /identity/v3/projects/4b27f4de8bf440789c4c3b1eb6dd3024 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:57.343766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.361302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:57.392956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:57.427297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bfebe-e252-4f43-84db-718517fbeaff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.439729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.442957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.444806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.448194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.448194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.455734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.507704 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2785/5561] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:57 2022] POST /identity/v3/users => generated 279 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:57.512299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.514983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:57.530261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538dbf-75fc-456a-8b74-3b51cb7c4038 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.547320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403043d0-1707-4825-b1bc-d1b1e0678137 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.554698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.558243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.558944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.559534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] PATH_INFO: `/v3/users/e39b92c5123e4bd3b2b6157d0dbb50c2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.561145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39b92c5123e4bd3b2b6157d0dbb50c2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.563035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.563662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.564351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.564351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.565085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.565309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.568291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.585394 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2786/5562] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:57.589450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.605413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be78821-3b83-4626-b790-cc24c87bdf9b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.621859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.622496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.623033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.623570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.624230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.626087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.644144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2787/5563] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:50:57.647430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.660404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbada21-1d60-4bf1-984a-cb057afa97d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:57.677755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:57.678576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.678970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.679495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] PATH_INFO: `/v3/projects/c3f7e786bd1f46e199dab7e7c71c6d23/users/2075d1bdef004f1fa9ab87280e254f52/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.700461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39b92c5123e4bd3b2b6157d0dbb50c2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.722627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f7e786bd1f46e199dab7e7c71c6d23, user_id=2075d1bdef004f1fa9ab87280e254f52, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:57.724443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39b92c5123e4bd3b2b6157d0dbb50c2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.725882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39b92c5123e4bd3b2b6157d0dbb50c2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.727528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:57.751345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39b92c5123e4bd3b2b6157d0dbb50c2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.752021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b294db6-f858-436e-a562-581375c8741c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39b92c5123e4bd3b2b6157d0dbb50c2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:57.753483 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2788/5564] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:50:57 2022] PUT /identity/v3/projects/c3f7e786bd1f46e199dab7e7c71c6d23/users/2075d1bdef004f1fa9ab87280e254f52/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:57.765204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:57.767385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:57.790151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2777/5565] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:57 2022] DELETE /identity/v3/users/e39b92c5123e4bd3b2b6157d0dbb50c2 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:57.792817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:57.794743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:57.795117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:57.802401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:57.898730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] MFA Rules not processed for user `2075d1bdef004f1fa9ab87280e254f52`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:57.898730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:57.929184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783a2f8-f5f9-479f-b812-dd5e9fc17160 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:58.051735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:58.052421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:58.052668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:58.053012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] PATH_INFO: `/v3/projects/071338cbeced46bd8866dd82f29f250c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:58.054420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] RBAC: Authorizing `identity:delete_project(project_id=071338cbeced46bd8866dd82f29f250c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:58.058681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:58.132319 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2778/5566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:58.148128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071338cbeced46bd8866dd82f29f250c', 'request_id': 'req-65f53bcd-77ce-4d46-ab3f-93f956f0115e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.156404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071338cbeced46bd8866dd82f29f250c', 'request_id': 'req-65f53bcd-77ce-4d46-ab3f-93f956f0115e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.169287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071338cbeced46bd8866dd82f29f250c', 'request_id': 'req-65f53bcd-77ce-4d46-ab3f-93f956f0115e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.183153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:58.184647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:58.195872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] The token cache is being invalidate because project 071338cbeced46bd8866dd82f29f250c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:58.196338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.197785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.203384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2789/5567] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:57 2022] DELETE /identity/v3/projects/071338cbeced46bd8866dd82f29f250c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:58.203565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c875-fd6a-4354-875c-275a2d124ca2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:58.205539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:58.207435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:58.240120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:58.314185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:58.339654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f53bcd-77ce-4d46-ab3f-93f956f0115e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:58.347114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:58.348284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:58.354923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:58.356258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] PATH_INFO: `/v3/users/7320b9dc329141138f5052fe0bce0e0d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:58.358636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7320b9dc329141138f5052fe0bce0e0d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:58.362785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:58.363246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:58.364479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:58.365260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:58.366274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] PATH_INFO: `/v3/users/2075d1bdef004f1fa9ab87280e254f52` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:58.372237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2075d1bdef004f1fa9ab87280e254f52)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:58.379773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:58.475139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7320b9dc329141138f5052fe0bce0e0d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.501201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2075d1bdef004f1fa9ab87280e254f52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.522954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7320b9dc329141138f5052fe0bce0e0d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.526362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7320b9dc329141138f5052fe0bce0e0d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.544889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2075d1bdef004f1fa9ab87280e254f52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.547094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2075d1bdef004f1fa9ab87280e254f52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.557969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7320b9dc329141138f5052fe0bce0e0d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.559065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7320b9dc329141138f5052fe0bce0e0d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.560297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2075d1bdef004f1fa9ab87280e254f52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.561732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f627062-e57a-4cd0-b249-4d781b71030c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2075d1bdef004f1fa9ab87280e254f52'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:58.581393 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2790/5568] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:58 2022] DELETE /identity/v3/users/7320b9dc329141138f5052fe0bce0e0d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:50:58.583183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:58.585337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:58.593591 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2779/5569] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:58 2022] DELETE /identity/v3/users/2075d1bdef004f1fa9ab87280e254f52 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:58.597042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:58.598718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:58.599037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:58.686672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:58.688087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:58.783434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed9940-6143-4255-a715-f8f9e0a4c276 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:58.792249 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2780/5570] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:58.803034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:58.804589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:58.893370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:58.894135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:58.895087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:58.895589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] PATH_INFO: `/v3/projects/554e6b6d003448a8bc99b68eacaf9a9e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:58.897191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=554e6b6d003448a8bc99b68eacaf9a9e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:58.899401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:58.900206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:58.919366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1686d-afcc-4e5c-b833-b42c6fe57246 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:58.925919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4fa57-c076-46b5-a88d-9e2be965cfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:58.926985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4fa57-c076-46b5-a88d-9e2be965cfde service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:58.928319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4fa57-c076-46b5-a88d-9e2be965cfde service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:58.928786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4fa57-c076-46b5-a88d-9e2be965cfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:58.941792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4fa57-c076-46b5-a88d-9e2be965cfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:58.943896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4fa57-c076-46b5-a88d-9e2be965cfde service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:58.956513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:58.962657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2781/5571] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:50:59.019564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554e6b6d003448a8bc99b68eacaf9a9e', 'request_id': 'req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.045907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554e6b6d003448a8bc99b68eacaf9a9e', 'request_id': 'req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.053076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554e6b6d003448a8bc99b68eacaf9a9e', 'request_id': 'req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.076095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] The token cache is being invalidate because project 554e6b6d003448a8bc99b68eacaf9a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:59.076404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.077181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cc96139a-330b-4b9b-a1b9-d645f8f29b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.083720 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2791/5572] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:58 2022] DELETE /identity/v3/projects/554e6b6d003448a8bc99b68eacaf9a9e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:59.086716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.087528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.088101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.152263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:59.155452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.313194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.313486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.314120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.320336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2782/5573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:59.373728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:59.375614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.395871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2792/5574] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:59.401143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.425823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd7aac-d2bd-46df-9d94-520336dc6a48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:59.438706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:59.441905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.442793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.444120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.446972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:50:59.448710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:59.454219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:59.491969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2783/5575] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:50:59.493719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.514559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e981b-0595-490a-bf62-d44f87f119c7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:59.517174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.520112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.531572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:59.535664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.535664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.535664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.536341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:59.540448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:59.553493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d245-f3d1-47f1-9a35-5bdea8bb0026 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:59.566686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:59.566686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.566686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.567146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] PATH_INFO: `/v3/projects/8ea4e4aaef5349699870e5ad8b73551c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.568022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea4e4aaef5349699870e5ad8b73551c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:59.571452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:59.608374 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2793/5576] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:50:59 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:59.609895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.614267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.695048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea4e4aaef5349699870e5ad8b73551c', 'request_id': 'req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.710421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea4e4aaef5349699870e5ad8b73551c', 'request_id': 'req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.721416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280843-929b-46da-b05d-1560762d0ea2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:59.722445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea4e4aaef5349699870e5ad8b73551c', 'request_id': 'req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.742436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] The token cache is being invalidate because project 8ea4e4aaef5349699870e5ad8b73551c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:59.743257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.744165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.746647 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2784/5577] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:59 2022] DELETE /identity/v3/projects/8ea4e4aaef5349699870e5ad8b73551c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:59.747921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.749549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.814600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:59.815583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.815929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.816272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] PATH_INFO: `/v3/projects/c3f7e786bd1f46e199dab7e7c71c6d23` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.817591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f7e786bd1f46e199dab7e7c71c6d23)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:59.819615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:59.837868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:59.844382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5325b-d5c0-484a-b7d1-a9c53738e3ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:50:59.855265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fbc29-7b3b-451e-a8ec-ce98ba02e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:50:59.856175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fbc29-7b3b-451e-a8ec-ce98ba02e2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.856609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fbc29-7b3b-451e-a8ec-ce98ba02e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.857017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fbc29-7b3b-451e-a8ec-ce98ba02e2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.857958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fbc29-7b3b-451e-a8ec-ce98ba02e2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:50:59.859160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:50:59.860218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fbc29-7b3b-451e-a8ec-ce98ba02e2a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:50:59.878171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f7e786bd1f46e199dab7e7c71c6d23', 'request_id': 'req-7fc42ed9-8068-4e04-9d29-e2e76189a302'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.886969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2785/5578] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:50:59 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:50:59.887257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f7e786bd1f46e199dab7e7c71c6d23', 'request_id': 'req-7fc42ed9-8068-4e04-9d29-e2e76189a302'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.890396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:50:59.890685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:50:59.890986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:50:59.897806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f7e786bd1f46e199dab7e7c71c6d23', 'request_id': 'req-7fc42ed9-8068-4e04-9d29-e2e76189a302'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.912822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:50:59.913426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] The token cache is being invalidate because project c3f7e786bd1f46e199dab7e7c71c6d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:50:59.913827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.914063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.914692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:50:59.916478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2794/5579] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:50:59 2022] DELETE /identity/v3/projects/c3f7e786bd1f46e199dab7e7c71c6d23 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:50:59.917775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.919538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.997446 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2786/5580] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:50:59.997446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:50:59.997446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:50:59.998134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42ed9-8068-4e04-9d29-e2e76189a302 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.001930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.002564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.002845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.003124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] PATH_INFO: `/v3/users/effef5f66f5644fab19ecd3f862d7daa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.004384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=effef5f66f5644fab19ecd3f862d7daa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.006348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.012195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449ec9-2560-4d88-9323-a87c7a84d08e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.018793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480e442-54d3-46af-9c2e-a7423d8ad2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.019542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e442-54d3-46af-9c2e-a7423d8ad2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.020451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e442-54d3-46af-9c2e-a7423d8ad2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.020451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480e442-54d3-46af-9c2e-a7423d8ad2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.021225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480e442-54d3-46af-9c2e-a7423d8ad2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.023558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480e442-54d3-46af-9c2e-a7423d8ad2a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.034980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2787/5581] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:00.036487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d1f25-bd46-4771-9d70-7e23884e5d81 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.036782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d1f25-bd46-4771-9d70-7e23884e5d81 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.037107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d1f25-bd46-4771-9d70-7e23884e5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.061727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-510d1f25-bd46-4771-9d70-7e23884e5d81 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:00.063186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-510d1f25-bd46-4771-9d70-7e23884e5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.065190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effef5f66f5644fab19ecd3f862d7daa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.072282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2788/5582] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:00.073580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.073864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.074140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.085777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effef5f66f5644fab19ecd3f862d7daa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.087006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effef5f66f5644fab19ecd3f862d7daa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.096221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:00.096542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effef5f66f5644fab19ecd3f862d7daa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.097250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d97705-4d68-46d1-8c4e-541702cb1e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effef5f66f5644fab19ecd3f862d7daa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.097511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.108025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2789/5583] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:00.108982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.110152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.112680 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2795/5584] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:50:59 2022] DELETE /identity/v3/users/effef5f66f5644fab19ecd3f862d7daa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:00.114176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.114472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.114751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.123557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563b53e-313b-49ac-bb45-a2f06360814b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.160630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:00.161976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.214230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:00.219402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.220703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.220958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.221315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.222449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.224103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.235709 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2790/5585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:00.236508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.248538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec619b-36db-48dd-8677-31dc16f4530b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.253959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.254563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.254861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.255120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.255777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:00.256080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.259467 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2796/5586] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:00.259646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.259752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.271418 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2791/5587] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:00.272231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.272952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17dbde-a36a-400c-9048-3307ccfff7d5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.279222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.280046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.280826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.280826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] PATH_INFO: `/v3/projects/98263dd132a142038221381ade9a9a7f/users/5b580546757f45c69892b4411f9ab3ce/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.285975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66595-5626-4109-9a2e-5a5bac1884b6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.292429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.293338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.293631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.293908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.294555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:00.294864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.296453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.299124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98263dd132a142038221381ade9a9a7f, user_id=5b580546757f45c69892b4411f9ab3ce, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.302252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.315504 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2792/5588] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:00.315504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.321039 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2797/5589] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:00 2022] PUT /identity/v3/projects/98263dd132a142038221381ade9a9a7f/users/5b580546757f45c69892b4411f9ab3ce/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:00.322318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.324480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6a4f6-6f4b-4fb4-b735-78f826fd0cc8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.358212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:00.403507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926bd8-dc21-4d9f-b8a0-43b327c08b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.404130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926bd8-dc21-4d9f-b8a0-43b327c08b81 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.404415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926bd8-dc21-4d9f-b8a0-43b327c08b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.404824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926bd8-dc21-4d9f-b8a0-43b327c08b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.405502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57926bd8-dc21-4d9f-b8a0-43b327c08b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.408799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57926bd8-dc21-4d9f-b8a0-43b327c08b81 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.431006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e255c0d-1232-4085-955b-9760e35f074f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.436756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.437493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.437827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.438066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.438686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.441245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.449975 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2793/5590] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:00.451405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.452098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.452379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.489083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] MFA Rules not processed for user `5b580546757f45c69892b4411f9ab3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:00.490277 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2798/5591] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:00.490435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.491934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.494424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.597486 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2794/5592] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:00.598629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.614759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9f190-f74b-4a07-a326-8676e5263807 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.621276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.621931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.622211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.622485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] PATH_INFO: `/v3/projects/4a47a087cd7b4713a6ad1391eda4f4a3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.624168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a47a087cd7b4713a6ad1391eda4f4a3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.627203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.688893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:00.697576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a47a087cd7b4713a6ad1391eda4f4a3', 'request_id': 'req-a8ea180e-938d-4ebf-a36f-aed1d461aaff'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.707572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a47a087cd7b4713a6ad1391eda4f4a3', 'request_id': 'req-a8ea180e-938d-4ebf-a36f-aed1d461aaff'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.720704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a47a087cd7b4713a6ad1391eda4f4a3', 'request_id': 'req-a8ea180e-938d-4ebf-a36f-aed1d461aaff'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.728836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444407-1a76-48a3-9878-6485a15a3fb7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.740650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] The token cache is being invalidate because project 4a47a087cd7b4713a6ad1391eda4f4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:00.741004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.741689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:00.743555 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2799/5593] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:00 2022] DELETE /identity/v3/projects/4a47a087cd7b4713a6ad1391eda4f4a3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:00.744857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.746292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.830088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:00.835160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea180e-938d-4ebf-a36f-aed1d461aaff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.839211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a0949-44d4-4531-bf0e-a6d04a361854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.840157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a0949-44d4-4531-bf0e-a6d04a361854 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.840314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.840832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.841197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.841366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a0949-44d4-4531-bf0e-a6d04a361854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.841475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.841727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a0949-44d4-4531-bf0e-a6d04a361854 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.842095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.842798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a0949-44d4-4531-bf0e-a6d04a361854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.844317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.845347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a0949-44d4-4531-bf0e-a6d04a361854 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.867760 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2800/5594] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:00.868851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.873046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.874055 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2795/5595] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:00.878354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.878816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.879260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.886919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaa400-a9a8-4f9a-b67f-83b97c9ac789 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.893645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.894275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.894578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.894855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.895499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.902816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:00.904405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.906331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.915660 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2796/5596] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:00.916781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.932348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283a9c-8ea6-4636-bd0b-35ad63aa408f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:00.937431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8f391-a293-4a35-a25b-aa7d72660b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:00.937965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f391-a293-4a35-a25b-aa7d72660b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.938260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f391-a293-4a35-a25b-aa7d72660b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.938529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f391-a293-4a35-a25b-aa7d72660b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.939195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8f391-a293-4a35-a25b-aa7d72660b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:00.940791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8f391-a293-4a35-a25b-aa7d72660b43 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:00.951694 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2801/5597] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:00.951694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:00.951694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:00.957708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2797/5598] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:00.959813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:00.961799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:00.962239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:00.984014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:00.986221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:01.029525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb6ebc-65ae-4070-b30d-c52a66fc34f7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.035181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.035965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.036308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.036823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.037955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.041579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.056488 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2802/5599] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:01.057939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.063863 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2798/5600] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:01.064779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.071499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd90a-c028-4ed1-8e8d-d5fde765ea33 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.078053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.078916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.079368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.079795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.080183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d28d9-9381-49d7-bde6-b8c5d8242820 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.080687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.082987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.091554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.093135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.094365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.094943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.096437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.100343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.109082 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2803/5601] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/users => generated 299 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:01.110126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.121676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c86c-05dc-43d8-8d48-c21eed497573 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.125037 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2799/5602] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:01.125037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.131865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.132679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.133716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.133911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.134527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.136220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.142157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3fb8-d99d-4de5-b6d9-20b06d95da76 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.150690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.151013 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2804/5603] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:01.151987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.153648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.154401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.154686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.155903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:01.156288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.158163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.161848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:01.166595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78082cec-f1de-49d2-9be1-3effa056b098 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.172800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.173671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.174043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.174252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.174423 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2800/5604] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:01.174894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.175378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.176488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.188251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef3ac-ca4c-4cc0-b7f7-0d73812ac5ea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.192525 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2805/5605] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:01.193125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.202662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.203574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.204012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.204461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] PATH_INFO: `/v3/projects/583adaf42d094836aacdb757606a85eb/users/31bc02ed83e146bbbb3d8b6c929e8ff9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.206891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac6c5e-05f5-4697-afaf-faff216016e5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.212548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.213311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.213660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.214009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] PATH_INFO: `/v3/projects/8f09de3948454627b5d2cfffb1c93144/users/c32341d3cbbf424cb97d263b1c0667a6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.224046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=583adaf42d094836aacdb757606a85eb, user_id=31bc02ed83e146bbbb3d8b6c929e8ff9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.227344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.236500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f09de3948454627b5d2cfffb1c93144, user_id=c32341d3cbbf424cb97d263b1c0667a6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.243409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.256700 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2801/5606] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:01 2022] PUT /identity/v3/projects/583adaf42d094836aacdb757606a85eb/users/31bc02ed83e146bbbb3d8b6c929e8ff9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:01.257695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.260289 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2806/5607] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:01 2022] PUT /identity/v3/projects/8f09de3948454627b5d2cfffb1c93144/users/c32341d3cbbf424cb97d263b1c0667a6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:01.261556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.336871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dd27f-08cb-466f-8503-1e775cf7cd0d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.341055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d6ec-6b3b-41cf-ad52-c23d222b826f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.342619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90965bd-fb64-4048-8e3e-a12a552a68e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.343245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90965bd-fb64-4048-8e3e-a12a552a68e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.343524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90965bd-fb64-4048-8e3e-a12a552a68e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.343807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90965bd-fb64-4048-8e3e-a12a552a68e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.344455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90965bd-fb64-4048-8e3e-a12a552a68e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.346553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90965bd-fb64-4048-8e3e-a12a552a68e3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.346750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97863753-778e-40de-be58-0c4230afd765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.347420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97863753-778e-40de-be58-0c4230afd765 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.347702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97863753-778e-40de-be58-0c4230afd765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.347983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97863753-778e-40de-be58-0c4230afd765 admin admin] PATH_INFO: `/v3/projects/376d737fc5ae4c838c172d76fa6315bc/users/b9d2d67746ea48e6affdcf5ed24eb767/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.364461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97863753-778e-40de-be58-0c4230afd765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376d737fc5ae4c838c172d76fa6315bc, user_id=b9d2d67746ea48e6affdcf5ed24eb767, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.367926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97863753-778e-40de-be58-0c4230afd765 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.381062 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2802/5608] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:01.385099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.385451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.385740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.386687 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2807/5609] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:01 2022] PUT /identity/v3/projects/376d737fc5ae4c838c172d76fa6315bc/users/b9d2d67746ea48e6affdcf5ed24eb767/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:01.388201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.388486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.388762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.393924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:01.423022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] MFA Rules not processed for user `c32341d3cbbf424cb97d263b1c0667a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:01.424649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:01.424820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] MFA Rules not processed for user `31bc02ed83e146bbbb3d8b6c929e8ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:01.426117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:01.516190 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2803/5610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:01.519683 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2808/5611] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:01.520301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.520417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.574831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:01.603726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe243fbc-bd13-49d2-870e-5e775fcb7d10 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.614982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.614982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.614982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.614982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.615708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.619649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.629259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03dac6-76b0-4dbe-a95d-2f1fa04fdf39 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.632697 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2809/5612] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:01.634043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.636340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.637099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.637446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.637823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.638552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.640564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.660182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4920e6-cc3d-4345-8261-36be956e4ad7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.670453 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2804/5613] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:01.670610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.670751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.670853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.670853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.670853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.671136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.671539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:01.673616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.715529 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2810/5614] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:01.715529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.758890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1362e44-345e-45d7-b796-2072cdc5f974 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.799187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092262bc-0179-4ba3-bf0d-f9b9b1019701 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.804253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.805671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.806048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.806438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] PATH_INFO: `/v3/projects/376d737fc5ae4c838c172d76fa6315bc/users/b9d2d67746ea48e6affdcf5ed24eb767/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.808406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376d737fc5ae4c838c172d76fa6315bc, user_id=b9d2d67746ea48e6affdcf5ed24eb767, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.811165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.818673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:01.828256 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2811/5615] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:01 2022] PUT /identity/v3/projects/376d737fc5ae4c838c172d76fa6315bc/users/b9d2d67746ea48e6affdcf5ed24eb767/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:01.829249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.853224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.854160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.854456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.855078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.930864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.932323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.932553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0a60e-f2ce-4979-bf4c-baf07da46223 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.940117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c983e-2c36-4860-9976-28aabcb92147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.940831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c983e-2c36-4860-9976-28aabcb92147 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.941147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c983e-2c36-4860-9976-28aabcb92147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.941566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c983e-2c36-4860-9976-28aabcb92147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.942226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c983e-2c36-4860-9976-28aabcb92147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.942730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2805/5616] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:01.944766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:01.952326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c983e-2c36-4860-9976-28aabcb92147 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.956758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53500b-3515-4927-8eed-c63962baffe1 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:01.962397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:01.963192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.963697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.964073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:01.964821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:01.967016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:01.976109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2812/5617] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:01.978416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:01.978708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:01.978978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.009489 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2806/5618] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/users => generated 294 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:02.010554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.032706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] MFA Rules not processed for user `b9d2d67746ea48e6affdcf5ed24eb767`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:02.032706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:02.033121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e579dc-06e6-46e2-9dba-5a91fd5703e2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.037736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.037736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.037736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.038136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.038581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.040717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.052583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2807/5619] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:02.057275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.072063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b978b-5156-4f3c-a2b4-1a93dd6a3f23 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.080717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.081491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.081846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.082188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.082999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.084666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.087958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:02.105142 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2808/5620] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:02.106481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.127292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73e515-72b9-4fea-8ed6-a80cca3e4894 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.146899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.149239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.149239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.149239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] PATH_INFO: `/v3/projects/c76521b0c2f8465b866756ccc9c299e4/users/fa65476b76e749cdab6ad9e7e77e79b7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.153870 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2813/5621] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:02.153870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.172531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db708cd-9ef5-4a77-b0da-a559e2fc7146 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.179812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b18d5-409a-49bc-927f-e29fbe89ff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.180945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76521b0c2f8465b866756ccc9c299e4, user_id=fa65476b76e749cdab6ad9e7e77e79b7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.181439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b18d5-409a-49bc-927f-e29fbe89ff2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.182552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b18d5-409a-49bc-927f-e29fbe89ff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.183065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b18d5-409a-49bc-927f-e29fbe89ff2c admin admin] PATH_INFO: `/v3/projects/463b73ea7b684c1aa14ad01fa27e18e0/users/04740203208b4e05a981b61d406161d1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.183614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.207210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b18d5-409a-49bc-927f-e29fbe89ff2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=463b73ea7b684c1aa14ad01fa27e18e0, user_id=04740203208b4e05a981b61d406161d1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.210396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b18d5-409a-49bc-927f-e29fbe89ff2c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.214611 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2809/5622] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:02 2022] PUT /identity/v3/projects/c76521b0c2f8465b866756ccc9c299e4/users/fa65476b76e749cdab6ad9e7e77e79b7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:02.214611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.216401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:02.239763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2814/5623] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:02 2022] PUT /identity/v3/projects/463b73ea7b684c1aa14ad01fa27e18e0/users/04740203208b4e05a981b61d406161d1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:02.239763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.239763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.239763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.268845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:02.270360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:02.329802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175462f-6b39-4b6d-aeac-6d87120ec78f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.409435 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2815/5624] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:02.410877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.415372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:02.427780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b059d-261b-4f16-b103-c9b98e5daf98 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.435261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.436215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.436697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.437010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.440673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.446347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.448778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.449113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.451052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.452688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.477572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2816/5625] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:02.477572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.481933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:02.558644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.561012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.575246 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2810/5626] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:02.575866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.593411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d05e8-854b-4c80-82e3-15d6f85bd57c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.597058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cb6c9-8e41-42be-823d-1accc05e7763 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.598096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf7a8-dd1b-4a9b-9dda-faa52df84a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.598460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf7a8-dd1b-4a9b-9dda-faa52df84a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.598733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf7a8-dd1b-4a9b-9dda-faa52df84a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.599151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf7a8-dd1b-4a9b-9dda-faa52df84a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.610007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf7a8-dd1b-4a9b-9dda-faa52df84a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.611679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf7a8-dd1b-4a9b-9dda-faa52df84a12 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.619414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.620307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.620593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.621364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] PATH_INFO: `/v3/projects/463b73ea7b684c1aa14ad01fa27e18e0/users/04740203208b4e05a981b61d406161d1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.625400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=463b73ea7b684c1aa14ad01fa27e18e0, user_id=04740203208b4e05a981b61d406161d1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.631465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.640713 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2817/5627] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:02.659745 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2811/5628] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:02 2022] PUT /identity/v3/projects/463b73ea7b684c1aa14ad01fa27e18e0/users/04740203208b4e05a981b61d406161d1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:02.670708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.671001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.671305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.705017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.712840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] MFA Rules not processed for user `04740203208b4e05a981b61d406161d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:02.714428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:02.751223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:02.830934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64736ab-7677-4238-b392-01b88a355c5b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.843858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.845070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.845359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.845645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] PATH_INFO: `/v3/users/5b580546757f45c69892b4411f9ab3ce` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.851273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b580546757f45c69892b4411f9ab3ce)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.855740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.885094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2818/5629] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:02.886787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.913874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effccd-8e15-4375-af3e-887432f8b58f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:02.926069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:02.928500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:02.928966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:02.929430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:02.930552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:02.932641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:02.965966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b580546757f45c69892b4411f9ab3ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:02.978823 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2819/5630] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:51:02 2022] POST /identity/v3/domains => generated 245 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:02.985656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:02.999967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b580546757f45c69892b4411f9ab3ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:03.003905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b580546757f45c69892b4411f9ab3ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:03.026726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b580546757f45c69892b4411f9ab3ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:03.027624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-685a32c7-a671-48e7-8ca6-71f958eda590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b580546757f45c69892b4411f9ab3ce'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:03.056604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:03.080852 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2812/5631] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:02 2022] DELETE /identity/v3/users/5b580546757f45c69892b4411f9ab3ce => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:03.092307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.093530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.094726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.183710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:03.185044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:03.186671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bced01-055e-4749-8669-6dc5eb39716c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:03.297187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:03.299202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.299524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.299927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.300733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:03.302803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:03.352343 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2813/5632] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:03.362261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:03.371444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:03.394156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2820/5633] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:02 2022] POST /identity/v3/projects => generated 408 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:03.397198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:03.402823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:03.458345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac71b-14e5-489e-9a24-e88637179c6e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:03.491366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:03.546928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fe84-ce01-478b-b9df-01e5a570df0c tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:03.563683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:03.564457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.564839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.565318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.566788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:03.569184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:03.574218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67577c-f5ad-4614-88f8-fa33797720b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:03.574844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67577c-f5ad-4614-88f8-fa33797720b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.575133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67577c-f5ad-4614-88f8-fa33797720b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.575403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67577c-f5ad-4614-88f8-fa33797720b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.613285 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2821/5634] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:03 2022] POST /identity/v3/users => generated 347 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:03.617513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:03.635343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b5bf5-d694-4adb-bb92-697cd627d8e2 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:03.652084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:03.653382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.654036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.655893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.657537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:03.661330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:03.686698 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2822/5635] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:03.691607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:03.722689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67577c-f5ad-4614-88f8-fa33797720b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:03.724698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadea4f-432b-4e73-a4de-9d3bfcfed3bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:03.725153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67577c-f5ad-4614-88f8-fa33797720b1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:03.741862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e1f0-0b99-45b6-81b7-636385e9f3ca tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:03.742602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e1f0-0b99-45b6-81b7-636385e9f3ca tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.743089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e1f0-0b99-45b6-81b7-636385e9f3ca tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.743441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e1f0-0b99-45b6-81b7-636385e9f3ca tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/projects/f70d912fc1434fe9ab3adad60ea8adf5/users/3171f4baa109450795d1e0476f626d8d/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.780871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e1f0-0b99-45b6-81b7-636385e9f3ca tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f70d912fc1434fe9ab3adad60ea8adf5, user_id=3171f4baa109450795d1e0476f626d8d, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:03.786375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e1f0-0b99-45b6-81b7-636385e9f3ca tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:03.787434 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2814/5636] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:03.841054 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2823/5637] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:03 2022] PUT /identity/v3/projects/f70d912fc1434fe9ab3adad60ea8adf5/users/3171f4baa109450795d1e0476f626d8d/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:03.846331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:03.846637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:03.847395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:03.862548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:04.057274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] MFA Rules not processed for user `3171f4baa109450795d1e0476f626d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:04.060595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:04.114833 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2815/5638] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:03 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:04.127389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:04.127949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:04.128420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:04.177319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] MFA Rules not processed for user `3171f4baa109450795d1e0476f626d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:04.178497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:04.188742 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2824/5639] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:04 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:04.193012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:04.210629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7559fe-aa8e-4aef-a140-ab76d61c1bd4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:04.232015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3171f4baa109450795d1e0476f626d8d', 'user_domain_id': '2ad538d80aa8419984ccce21a450b04b', 'system_scope': None, 'project_id': 'f70d912fc1434fe9ab3adad60ea8adf5', 'project_domain_id': '2ad538d80aa8419984ccce21a450b04b', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:04.232015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:04.232015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:04.232440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:04.243462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:04.245679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:04.266508 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2816/5640] 10.222.0.16 () {56 vars in 1284 bytes} [Wed Oct 5 02:51:04 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:04.267106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:04.267942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:04.268691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:04.387218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999418c-527d-4044-bd34-aa6956aa5e62 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:04.395650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca3c20-959a-46ed-8ea6-05b866d135c2 tempest-test_project-966302896 tempest-user-111420133] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:04.401874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:04.404893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:04.406104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:04.408057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:04.408442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:04.408829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/users/3171f4baa109450795d1e0476f626d8d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:04.410385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:04.412564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3171f4baa109450795d1e0476f626d8d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:04.414123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] PATH_INFO: `/v3/projects/98263dd132a142038221381ade9a9a7f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:04.418146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98263dd132a142038221381ade9a9a7f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:04.421215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:04.422250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:04.537693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3171f4baa109450795d1e0476f626d8d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.540554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98263dd132a142038221381ade9a9a7f', 'request_id': 'req-2375dca0-7ccc-43b6-b91b-f252838255e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.558472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98263dd132a142038221381ade9a9a7f', 'request_id': 'req-2375dca0-7ccc-43b6-b91b-f252838255e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.560859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3171f4baa109450795d1e0476f626d8d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.561661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3171f4baa109450795d1e0476f626d8d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.563555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:04.569234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98263dd132a142038221381ade9a9a7f', 'request_id': 'req-2375dca0-7ccc-43b6-b91b-f252838255e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.577755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3171f4baa109450795d1e0476f626d8d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.578401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3171f4baa109450795d1e0476f626d8d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.592337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] The token cache is being invalidate because project 98263dd132a142038221381ade9a9a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:04.592852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.593615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.596061 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2825/5641] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:04 2022] DELETE /identity/v3/projects/98263dd132a142038221381ade9a9a7f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:51:04.600062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:04.601789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:04.605705 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2817/5642] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:04 2022] DELETE /identity/v3/users/3171f4baa109450795d1e0476f626d8d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:04.610194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:04.612706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:04.623273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:04.778132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375dca0-7ccc-43b6-b91b-f252838255e7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:04.790385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f8d95-d933-46a2-8b6a-1dc71fc39fdc tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:04.809612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:04.810273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:04.810554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:04.813741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/projects/f70d912fc1434fe9ab3adad60ea8adf5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:04.815278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f70d912fc1434fe9ab3adad60ea8adf5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:04.817678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:04.901609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70d912fc1434fe9ab3adad60ea8adf5', 'request_id': 'req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.905233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:04.905903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:04.907182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:04.907318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] PATH_INFO: `/v3/users/b9d2d67746ea48e6affdcf5ed24eb767` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:04.910753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d2d67746ea48e6affdcf5ed24eb767)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:04.912843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:04.917087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70d912fc1434fe9ab3adad60ea8adf5', 'request_id': 'req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.930277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70d912fc1434fe9ab3adad60ea8adf5', 'request_id': 'req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.954532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] The token cache is being invalidate because project f70d912fc1434fe9ab3adad60ea8adf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:04.956772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.959309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:04.964617 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2818/5643] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:04 2022] DELETE /identity/v3/projects/f70d912fc1434fe9ab3adad60ea8adf5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:04.968983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:04.971006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:05.036542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d2d67746ea48e6affdcf5ed24eb767'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.051707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d2d67746ea48e6affdcf5ed24eb767'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.052493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d2d67746ea48e6affdcf5ed24eb767'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.062733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d2d67746ea48e6affdcf5ed24eb767'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.063567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d2d67746ea48e6affdcf5ed24eb767'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.084031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2826/5644] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:04 2022] DELETE /identity/v3/users/b9d2d67746ea48e6affdcf5ed24eb767 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:05.143172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52e56-63fc-4a58-86ba-a0dfd3a76377 tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:05.225372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:05.374692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:05.375362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:05.375737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:05.376153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/domains/2ad538d80aa8419984ccce21a450b04b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:05.381829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2ad538d80aa8419984ccce21a450b04b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:05.384006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:05.474789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2ad538d80aa8419984ccce21a450b04b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.475609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2ad538d80aa8419984ccce21a450b04b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.546318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2ad538d80aa8419984ccce21a450b04b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.548862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2ad538d80aa8419984ccce21a450b04b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.557884 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2819/5645] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:51:04 2022] PATCH /identity/v3/domains/2ad538d80aa8419984ccce21a450b04b => generated 246 bytes in 589 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:05.561949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:05.564002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:05.584367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:05.588787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:05.611662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ff4e-803e-4165-98e5-eac64d6e5406 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:05.727822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:05.796047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04740203208b4e05a981b61d406161d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '463b73ea7b684c1aa14ad01fa27e18e0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:05.796751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:05.797012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:05.797283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] PATH_INFO: `/v3/domains/2ad538d80aa8419984ccce21a450b04b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:05.797912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93581a6-b5ef-4cfb-a6cd-7d312a14d6bb tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:05.802816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:05.803428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:05.804067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:05.804350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] PATH_INFO: `/v3/projects/376d737fc5ae4c838c172d76fa6315bc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:05.805721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376d737fc5ae4c838c172d76fa6315bc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:05.807878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:05.827641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2ad538d80aa8419984ccce21a450b04b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:05.829349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:05.897860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2ad538d80aa8419984ccce21a450b04b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.907257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376d737fc5ae4c838c172d76fa6315bc', 'request_id': 'req-3b99771c-23b8-48f9-bb34-c77b9219f8b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.908109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2ad538d80aa8419984ccce21a450b04b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.937296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376d737fc5ae4c838c172d76fa6315bc', 'request_id': 'req-3b99771c-23b8-48f9-bb34-c77b9219f8b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.947749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376d737fc5ae4c838c172d76fa6315bc', 'request_id': 'req-3b99771c-23b8-48f9-bb34-c77b9219f8b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.969084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] The token cache is being invalidate because project 376d737fc5ae4c838c172d76fa6315bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:05.969805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.970896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b99771c-23b8-48f9-bb34-c77b9219f8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.973732 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2820/5646] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:05 2022] DELETE /identity/v3/projects/376d737fc5ae4c838c172d76fa6315bc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:05.980131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6a4e-d5ac-420e-ae49-0ee4fe9268e3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:05.980745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6a4e-d5ac-420e-ae49-0ee4fe9268e3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:05.981851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6a4e-d5ac-420e-ae49-0ee4fe9268e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:05.990541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad538d80aa8419984ccce21a450b04b', 'request_id': 'req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:05.999982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad538d80aa8419984ccce21a450b04b', 'request_id': 'req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.008508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad538d80aa8419984ccce21a450b04b', 'request_id': 'req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.015219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2eaa6a4e-d5ac-420e-ae49-0ee4fe9268e3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:06.016753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2eaa6a4e-d5ac-420e-ae49-0ee4fe9268e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:06.029034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] The token cache is being invalidate because project 2ad538d80aa8419984ccce21a450b04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:06.029409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.030589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.034898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:06.047936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2ad538d80aa8419984ccce21a450b04b', 'request_id': 'req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.048740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2ad538d80aa8419984ccce21a450b04b', 'request_id': 'req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.054653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2ad538d80aa8419984ccce21a450b04b', 'request_id': 'req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.074653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2827/5647] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:51:05 2022] DELETE /identity/v3/domains/2ad538d80aa8419984ccce21a450b04b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:06.076296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.081091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:06.150809 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2821/5648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:06.159859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.160269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.160623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.192279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a734-3a2b-4c2c-9033-2dfd0a6bd8ce tempest-TestDefaultProjectId-593663012 tempest-TestDefaultProjectId-593663012-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.196760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:06.198822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.198980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:06.199492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.199776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.200549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] PATH_INFO: `/v3/users/31bc02ed83e146bbbb3d8b6c929e8ff9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.202954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bc02ed83e146bbbb3d8b6c929e8ff9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.205905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.208382 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2822/5649] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:06.215165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.224879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:06.227174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04da706-54b2-42a4-8289-eff5c7491214 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.234162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.234905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.235304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.235633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.236374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:06.236780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.238584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.266241 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2823/5650] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:06.269667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.275007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bc02ed83e146bbbb3d8b6c929e8ff9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.285546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7011-88bc-4c1d-9122-7c55be7bcc0b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.297024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.298264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bc02ed83e146bbbb3d8b6c929e8ff9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.298865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.299696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bc02ed83e146bbbb3d8b6c929e8ff9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.300853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.301171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.302733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.306505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.323062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bc02ed83e146bbbb3d8b6c929e8ff9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.324766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-341a5705-caa6-4b8f-ba34-79cb453f40b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bc02ed83e146bbbb3d8b6c929e8ff9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:06.348949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2828/5651] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:06 2022] DELETE /identity/v3/users/31bc02ed83e146bbbb3d8b6c929e8ff9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:06.353428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.353834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.354220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.384106 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2824/5652] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:06 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:06.388231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.389972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:06.391706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:06.392305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:06.521172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7785-51a5-4c51-a8be-d20f74290588 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.526659 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2829/5653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:06.537369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.537674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.538557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.539697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:06.539834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.539834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.541210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.543871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.581337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2825/5654] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:06 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:06.585695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.620682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffccb6c-9fb1-4def-af5d-77084659c267 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.633629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.634220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.634507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.634789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.637708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.642445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.672681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2250-25c5-4e62-8916-8c899c62fa76 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.689838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcef70c-93e6-4573-81d7-142340b67182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.692042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef70c-93e6-4573-81d7-142340b67182 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.703906 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2826/5655] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:06.704462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef70c-93e6-4573-81d7-142340b67182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.705287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.706143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcef70c-93e6-4573-81d7-142340b67182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.721879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0c7b1-a0fb-4397-8b31-ce24ef772a8b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.729094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.730169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.730529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.730881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.731174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcef70c-93e6-4573-81d7-142340b67182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.731676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.732886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcef70c-93e6-4573-81d7-142340b67182 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.734245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.758496 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2827/5656] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:06.764113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:06.764318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2830/5657] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:06.799174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95292d-6d16-4003-bd8e-87383e9f173d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:06.829714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:06.831443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.831443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.831443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] PATH_INFO: `/v3/projects/a6b85f9370a14315860bf2494a748b63/users/96c24915d2714994a10b4e30971c07af/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:06.869143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b85f9370a14315860bf2494a748b63, user_id=96c24915d2714994a10b4e30971c07af, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:06.872218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:06.920724 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2828/5658] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:06 2022] PUT /identity/v3/projects/a6b85f9370a14315860bf2494a748b63/users/96c24915d2714994a10b4e30971c07af/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:06.934437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:06.934987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:06.935402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:07.007635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] MFA Rules not processed for user `96c24915d2714994a10b4e30971c07af`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:07.009505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:07.075389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:07.187051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:07.196524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2831/5659] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:07.232688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:07.339186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9523-327e-4240-98c3-6c949cc78ab7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:07.344830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:07.345486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:07.345770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:07.346044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:07.346693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:07.348732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:07.429280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:07.443622 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2829/5660] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:07 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:07.457329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d26939-43a7-478a-88c7-4901d740e1aa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:07.589209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:07.591122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:07.644593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:07.649531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:07.652230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:07.654205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:07.657537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:07.664879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:07.729346 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2832/5661] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:07 2022] POST /identity/v3/users => generated 289 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:07.731603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:07.772954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b20e89-db59-4902-9bda-439b5f6ac175 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:07.800841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:07.806165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:07.806915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:07.807272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:07.807993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:07.815605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:07.842334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d896fae-8ff0-41c1-8602-a3759dd22b46 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:07.845030 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2833/5662] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:07.849169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:07.854388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:07.856275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:07.856275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:07.856275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] PATH_INFO: `/v3/projects/583adaf42d094836aacdb757606a85eb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:07.860935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=583adaf42d094836aacdb757606a85eb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:07.860935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:07.891198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d19eb-2b4a-47d7-8b5a-87d4733056fc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:07.906737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:07.907368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:07.907711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:07.907989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:07.908642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:07.910286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:07.932607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583adaf42d094836aacdb757606a85eb', 'request_id': 'req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:07.943032 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2834/5663] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:07.950417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:07.950633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583adaf42d094836aacdb757606a85eb', 'request_id': 'req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:07.967332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583adaf42d094836aacdb757606a85eb', 'request_id': 'req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:07.998166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] The token cache is being invalidate because project 583adaf42d094836aacdb757606a85eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:08.006493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd1519-6178-460d-891a-74832b45c097 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:08.006732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.008515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.040408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2830/5664] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:07 2022] DELETE /identity/v3/projects/583adaf42d094836aacdb757606a85eb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:08.042191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:08.052163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:08.226067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:08.291667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca10df-5cb6-4e3b-9768-3afdb013a5bd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:08.298191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c27b94-4108-4827-95bf-46935c167104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:08.299054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:08.299221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27b94-4108-4827-95bf-46935c167104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:08.299411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27b94-4108-4827-95bf-46935c167104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:08.299686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c27b94-4108-4827-95bf-46935c167104 admin admin] PATH_INFO: `/v3/projects/6c4b486b97a14bf2a9aac44d217059c7/users/448c528e38b944acbc4226501c046e5a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:08.300463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:08.300956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:08.301860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] PATH_INFO: `/v3/users/04740203208b4e05a981b61d406161d1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:08.303249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04740203208b4e05a981b61d406161d1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:08.308336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:08.368522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27b94-4108-4827-95bf-46935c167104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4b486b97a14bf2a9aac44d217059c7, user_id=448c528e38b944acbc4226501c046e5a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:08.376980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c27b94-4108-4827-95bf-46935c167104 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:08.408630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2835/5665] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:07 2022] PUT /identity/v3/projects/6c4b486b97a14bf2a9aac44d217059c7/users/448c528e38b944acbc4226501c046e5a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:08.424184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:08.424480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:08.424760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:08.428204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04740203208b4e05a981b61d406161d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.453017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04740203208b4e05a981b61d406161d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.453765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04740203208b4e05a981b61d406161d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.465770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] MFA Rules not processed for user `448c528e38b944acbc4226501c046e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:08.467314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:08.473174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04740203208b4e05a981b61d406161d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.474308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04740203208b4e05a981b61d406161d1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:08.490846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:08.494329 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2831/5666] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:08 2022] DELETE /identity/v3/users/04740203208b4e05a981b61d406161d1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:08.611935 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2836/5667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:08.612770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:08.614375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:08.768675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44ffc0-63bb-446f-bdc6-76806a7054e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:08.773971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:08.774649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:08.774939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:08.775556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:08.775927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:08.778783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:08.851533 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2832/5668] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:08 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:08.856496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:08.979316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdca20-b2ea-4e0c-8e4a-64cbfbbd2429 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.202304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:09.204867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.206960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.207346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.208617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:09.222397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:09.316949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2837/5669] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:08 2022] POST /identity/v3/users => generated 294 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:09.317129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:09.334847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7971-865b-4992-8906-35c1c6cc1d89 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.347991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:09.348623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.348927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.349213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.349872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:09.351519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:09.391381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2833/5670] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:09.406090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:09.427932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542e80a-8b57-4269-a2c7-cee49cd4b834 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.440683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:09.442642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:09.443133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:09.443649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.443948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.444283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] PATH_INFO: `/v3/projects/4e0eb3adca544894803f122bf964fdfd/users/6448716cf2ab4ffd8d0c3d06d3a1693f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.469967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243007aa-2c23-4de7-8ec8-a6d8cd72456a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.502401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:09.503388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.503684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.504533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] PATH_INFO: `/v3/projects/463b73ea7b684c1aa14ad01fa27e18e0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.507048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=463b73ea7b684c1aa14ad01fa27e18e0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:09.511755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0eb3adca544894803f122bf964fdfd, user_id=6448716cf2ab4ffd8d0c3d06d3a1693f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:09.512225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:09.518091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:09.567434 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2838/5671] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:09 2022] PUT /identity/v3/projects/4e0eb3adca544894803f122bf964fdfd/users/6448716cf2ab4ffd8d0c3d06d3a1693f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:09.567989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:09.605649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:09.633828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:09.689742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463b73ea7b684c1aa14ad01fa27e18e0', 'request_id': 'req-f727a044-282b-4630-95f7-593311be0f2d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:09.723584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8467-2216-4ea9-8fb2-507342c4b0af admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.730074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463b73ea7b684c1aa14ad01fa27e18e0', 'request_id': 'req-f727a044-282b-4630-95f7-593311be0f2d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:09.741719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463b73ea7b684c1aa14ad01fa27e18e0', 'request_id': 'req-f727a044-282b-4630-95f7-593311be0f2d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:09.797317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] The token cache is being invalidate because project 463b73ea7b684c1aa14ad01fa27e18e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:09.797684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:09.800055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f727a044-282b-4630-95f7-593311be0f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:09.807494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2834/5672] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:09 2022] DELETE /identity/v3/projects/463b73ea7b684c1aa14ad01fa27e18e0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:09.810183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cb5c-2008-4813-96af-dfa8b3a5a50e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.811160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cb5c-2008-4813-96af-dfa8b3a5a50e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.811895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7cb5c-2008-4813-96af-dfa8b3a5a50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.846761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2bd7cb5c-2008-4813-96af-dfa8b3a5a50e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:09.848826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2bd7cb5c-2008-4813-96af-dfa8b3a5a50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:09.862382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:09.873449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.873744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.877733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2835/5673] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:09.879489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.880149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.880529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.882041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.882843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:09.886425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:09.906028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2839/5674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:09.909668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:09.909827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:09.912888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:09.918839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:09.931748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f6a7-e4be-4a6c-b8df-412bca19f65a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.933627 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2836/5675] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:09.938004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:09.939471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d53c32-2f04-4f94-98f3-06ec84257279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:09.940265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d53c32-2f04-4f94-98f3-06ec84257279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.940648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d53c32-2f04-4f94-98f3-06ec84257279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.941063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d53c32-2f04-4f94-98f3-06ec84257279 admin admin] PATH_INFO: `/v3/projects/4e0eb3adca544894803f122bf964fdfd/users/6448716cf2ab4ffd8d0c3d06d3a1693f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:09.944053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d53c32-2f04-4f94-98f3-06ec84257279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0eb3adca544894803f122bf964fdfd, user_id=6448716cf2ab4ffd8d0c3d06d3a1693f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:09.948073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d53c32-2f04-4f94-98f3-06ec84257279 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:09.952660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6935a-9614-4dd2-a40d-d7f03c825a09 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:09.967071 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2840/5676] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:09 2022] PUT /identity/v3/projects/4e0eb3adca544894803f122bf964fdfd/users/6448716cf2ab4ffd8d0c3d06d3a1693f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:09.984539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:09.984727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:09.985221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.022967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] MFA Rules not processed for user `6448716cf2ab4ffd8d0c3d06d3a1693f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:10.027750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:10.075041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.076394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.077520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.078031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.081764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:10.082613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.083971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.122115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2837/5677] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:10.128501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:10.160015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd7d19-cb10-40a5-a0ef-5544e5b2b59b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:10.174396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.174922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.175212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.176128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.178961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.181196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.211760 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2841/5678] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:10.264238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:10.266435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:10.271330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2838/5679] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:10 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:10.275365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:10.332821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:10.390906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c993025-8d06-4f76-b602-5e7d7f41940e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:10.431526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae804c-fd78-451c-aadb-137612b7d0e9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:10.438092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.439089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.439317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.439598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.440251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.452026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.477453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:10.478135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.486194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.486564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.486923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.489227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:10.489534 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2839/5680] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:10 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:10.495163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:10.516232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9344ba-60a7-4893-a883-7959fa82c0b5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:10.529628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.530276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.530629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.531560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.532333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.537555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.568413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2840/5681] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:10.572973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:10.590017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.591400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.605945 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2842/5682] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:10.614076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd660ef-2561-45e4-a209-1265d89813cd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:10.635647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f243853-1e9d-429c-99fa-a1d084b810f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.636423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243853-1e9d-429c-99fa-a1d084b810f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.636976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243853-1e9d-429c-99fa-a1d084b810f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.642066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243853-1e9d-429c-99fa-a1d084b810f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.642886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243853-1e9d-429c-99fa-a1d084b810f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.647808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243853-1e9d-429c-99fa-a1d084b810f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.700677 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2841/5683] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:10.705774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:10.727163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036beb-0cf8-47da-8f8a-71e663dbe671 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:10.740845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:10.741560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.741842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.743121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] PATH_INFO: `/v3/projects/2f645d161e0140fd8237dc1c21d486dc/users/93736477c9b1498c91160937740d8eb8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.788686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f645d161e0140fd8237dc1c21d486dc, user_id=93736477c9b1498c91160937740d8eb8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:10.793197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:10.847155 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2843/5684] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:10 2022] PUT /identity/v3/projects/2f645d161e0140fd8237dc1c21d486dc/users/93736477c9b1498c91160937740d8eb8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:10.860836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb3983-8e08-4640-9e96-cde08e529d35 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:10.861402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb3983-8e08-4640-9e96-cde08e529d35 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:10.861623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb3983-8e08-4640-9e96-cde08e529d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:10.969149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-01cb3983-8e08-4640-9e96-cde08e529d35 None None] MFA Rules not processed for user `93736477c9b1498c91160937740d8eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:10.973034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-01cb3983-8e08-4640-9e96-cde08e529d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:11.194412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.206132 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2842/5685] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:11.351257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18aaf-7dd8-48fc-8842-a8dd97f67845 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.364892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.365153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.365276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.365608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.366190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:11.376232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:11.431523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b5ae-6787-4f79-9943-1f8f424fa2ef None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.432137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b5ae-6787-4f79-9943-1f8f424fa2ef None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.432660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b5ae-6787-4f79-9943-1f8f424fa2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.466799 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2844/5686] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:11 2022] POST /identity/v3/projects => generated 369 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:11.468892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.483669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-66c6b5ae-6787-4f79-9943-1f8f424fa2ef None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:11.485166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66c6b5ae-6787-4f79-9943-1f8f424fa2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:11.496037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:11.582032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b0236-60dc-42ec-a94f-fb41b80559af admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.588165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.588959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.589596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.589891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.590730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:11.593747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:11.625180 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2843/5687] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:11.636721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.637022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.637310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.639208 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2845/5688] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:11 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:11.643687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.659886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aaec3-bc22-4e6d-bed8-cead0787dc10 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.662841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:11.664791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:11.667555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.669171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.669611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.670039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.670849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:11.672714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:11.688337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2844/5689] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:11.696967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.697572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:11.698210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2846/5690] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:11.699492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.711715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5e85-b241-41e7-b28e-2ef0df59863e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.716996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.718417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.719017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.719464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] PATH_INFO: `/v3/projects/ca8e906013ad43a7ae7916e1ba43f03c/users/eb3853663a7f41a7aa8b60d32dfc5d73/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.758644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8e906013ad43a7ae7916e1ba43f03c, user_id=eb3853663a7f41a7aa8b60d32dfc5d73, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:11.762358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:11.776227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:11.798222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2847/5691] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:11 2022] PUT /identity/v3/projects/ca8e906013ad43a7ae7916e1ba43f03c/users/eb3853663a7f41a7aa8b60d32dfc5d73/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:11.799277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.839835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edcbd7-d1d9-430f-9555-d0c31b262e85 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.906372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d2b04-e289-42e5-959f-a6b082c2b2b5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.911352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.912046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.916001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.916390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.917254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:11.919592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:11.923655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.924629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.925123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.925648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.939516 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2848/5692] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:51:11.944002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:11.964095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021aaf3-7783-4552-ac50-e7d1149ed22d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:11.970852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25cf46-a079-4a3f-90ce-d36f12dfe4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:11.971555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25cf46-a079-4a3f-90ce-d36f12dfe4db admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:11.971912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25cf46-a079-4a3f-90ce-d36f12dfe4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:11.972263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25cf46-a079-4a3f-90ce-d36f12dfe4db admin admin] PATH_INFO: `/v3/projects/ca8e906013ad43a7ae7916e1ba43f03c/users/eb3853663a7f41a7aa8b60d32dfc5d73/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:11.975030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25cf46-a079-4a3f-90ce-d36f12dfe4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8e906013ad43a7ae7916e1ba43f03c, user_id=eb3853663a7f41a7aa8b60d32dfc5d73, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:11.978553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25cf46-a079-4a3f-90ce-d36f12dfe4db admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:12.005559 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2849/5693] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:11 2022] PUT /identity/v3/projects/ca8e906013ad43a7ae7916e1ba43f03c/users/eb3853663a7f41a7aa8b60d32dfc5d73/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:12.017685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fbae9-a107-4a04-9185-024198a66116 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:12.018704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fbae9-a107-4a04-9185-024198a66116 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:12.019627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fbae9-a107-4a04-9185-024198a66116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:12.075007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-659fbae9-a107-4a04-9185-024198a66116 None None] MFA Rules not processed for user `eb3853663a7f41a7aa8b60d32dfc5d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:12.077219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-659fbae9-a107-4a04-9185-024198a66116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:12.081984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:12.083815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:12.100550 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2845/5694] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:12.124348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:12.181570 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2850/5695] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:12.185327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:12.419665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cffd81-804b-4a68-8f70-037c4cd0a11a service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:12.447674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:12.448458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:12.449234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:12.450155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:12.450907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:12.452090 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:12.452090 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:12.452090 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:12.452862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:12.538090 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2846/5696] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:12 2022] POST /identity/v3/services => generated 289 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:12.542701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fbae9-a107-4a04-9185-024198a66116 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:12.564725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fbae9-a107-4a04-9185-024198a66116 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:12.615496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:12.618739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:12.619401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:12.620879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:12.622699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:12.625194 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:12.625194 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:51:12.625194 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:12.626917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:12.706379 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2008059332. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:12.706379 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:12.706379 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:12.779277 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2851/5697] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:12 2022] POST /identity/v3/endpoints => generated 360 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:12.784278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:12.802970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c5229-dd8e-4103-bf08-0386ab42949a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:12.880036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:12.881313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:12.881313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:12.881574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-2008059332` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:12.882327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2008059332)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:12.884166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:12.887430 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2847/5698] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:12 2022] GET /identity/v3/regions/tempest-region-2008059332 => generated 180 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:12.892053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:12.917321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c7e74-8293-403a-bba8-e97f668e65f7 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:12.927084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:12.927994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:12.933476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:12.934636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:12.942048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:12.943449 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:12.943449 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:51:12.943449 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:12.944469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:12.955170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:12.959966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:12.972770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:12.974837 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2852/5699] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:12 2022] POST /identity/v3/services => generated 290 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:12.980740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.021703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123aaf7-a1c7-43af-b5a7-eca682905cc0 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.030801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.031569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.031907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.032253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.033003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.035152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.061627 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-496719050. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:13.061627 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:13.061627 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:13.157495 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2853/5700] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:12 2022] POST /identity/v3/endpoints => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:13.161578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.184424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85cc11-d1cb-48eb-8fda-55e856cc5edd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.198912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9647b-2f85-447a-ab1f-416e22222b78 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.218642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.219276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.219569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.219855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-496719050` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.223079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-496719050)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.224326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.230430 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2854/5701] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 5 02:51:13 2022] GET /identity/v3/regions/tempest-region-496719050 => generated 178 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:13.233748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.234737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.235181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.235353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.235782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.246110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:13.253374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a95da-038b-4698-a517-43a1ef08e0fb tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.262819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.263810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.264279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.264761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.265551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.267467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.276040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.278094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.292495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2848/5702] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:12 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:13.309361 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-576578468. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:13.309361 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:13.309361 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:13.389428 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2855/5703] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:13 2022] POST /identity/v3/endpoints => generated 358 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:13.392517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.411173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fe2ed-f293-4e37-bd52-fe786ec53540 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.504743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.505509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.505812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.506093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-576578468` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.506704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-576578468)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.508309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.512985 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2849/5704] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 5 02:51:13 2022] GET /identity/v3/regions/tempest-region-576578468 => generated 178 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:13.517416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.536690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e419f-201f-4e57-b180-609e9a0684cf tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.563872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.564639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.565065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.565275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.565920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.566967 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:13.566967 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:51:13.566967 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:13.568034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.584895 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2856/5705] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 02:51:13 2022] GET /identity/v3/endpoints => generated 4393 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:13.589449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.606152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7317407-66da-4c94-bb41-b2d54b807cc2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.611762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.612694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.613204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.613706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/34ade7f415da478c897eaca36de265ac` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.622458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=34ade7f415da478c897eaca36de265ac)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.624019 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:13.624019 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:13.624019 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:13.625544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.631224 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2850/5706] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:13 2022] GET /identity/v3/endpoints/34ade7f415da478c897eaca36de265ac => generated 358 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:13.633659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.675765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d4877-c629-4481-94d1-831c3d0d735e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.684436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.686321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.686609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.687263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/34ade7f415da478c897eaca36de265ac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.690897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=34ade7f415da478c897eaca36de265ac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.694261 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:13.694261 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:51:13.694261 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:13.695938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.716207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '34ade7f415da478c897eaca36de265ac', 'request_id': 'req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:13.730418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2857/5707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:13 2022] DELETE /identity/v3/endpoints/34ade7f415da478c897eaca36de265ac => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:13.735287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.758317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698643-56d7-4e47-82e0-118ea84737bd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.772747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.773912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.774196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.774472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.775105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.776137 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:13.776137 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:13.776137 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:13.777069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:13.787348 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2851/5708] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 02:51:13 2022] GET /identity/v3/endpoints => generated 4048 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:13.792071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.798015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:13.805133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faaddf-28c8-4e11-92f5-c0c82c32bea6 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.817809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.818567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.818916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.819376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/34ade7f415da478c897eaca36de265ac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.834902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:51:13.841672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.843486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Could not find endpoint: 34ade7f415da478c897eaca36de265ac.: keystone.exception.EndpointNotFound: Could not find endpoint: 34ade7f415da478c897eaca36de265ac. Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._iter().one() Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._only_one_row( Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:13.854196 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 34ade7f415da478c897eaca36de265ac. Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:51:13.855427 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:51:13.856567 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 34ade7f415da478c897eaca36de265ac. Oct 05 02:51:13.857937 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:13.866668 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2858/5709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:13 2022] DELETE /identity/v3/endpoints/34ade7f415da478c897eaca36de265ac => generated 114 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:51:13.880132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:13.956360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f74096-754e-4412-9dbc-5f34b58cef02 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:13.980709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:13.981498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:13.981977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:13.982211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-576578468` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:13.982809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-576578468)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:13.990905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.008389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f1dec-0352-40af-b3fc-40c034d21832 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.025182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.026140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.026713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.027282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.039514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:14.053012 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2859/5710] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:13 2022] DELETE /identity/v3/regions/tempest-region-576578468 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:14.058827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.119915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f96ce2-8b23-4b1d-8ad0-775d0321cb79 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.144247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.145233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.145687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.146164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.147768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.150878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.164677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2860/5711] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/endpoints => generated 4048 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:14.168996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.175097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:14.180866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.182887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.185259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7060-9d97-46ce-9e12-893ecde04618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.191044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.191778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.192072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.192511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.193844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Adding query filter params (service_id=66c11a05c87f477f8ab923664429348e) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:14.194161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.197884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.206853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2861/5712] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/endpoints?service_id=66c11a05c87f477f8ab923664429348e => generated 502 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:14.210659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.241917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2852/5713] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:13 2022] GET /identity/v3/auth/tokens => generated 3886 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:14.243081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8793568-ecbb-408d-b1fc-decdc00f5c0d tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.250766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.251456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.251753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.252132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.252822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Adding query filter params (service_id=cf29b8cb019a4ea1adf646569051005c) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:14.253137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.254816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.266008 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2862/5714] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/endpoints?service_id=cf29b8cb019a4ea1adf646569051005c => generated 503 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:14.267097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.282048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6316d2-dde4-4ea5-8f37-be751e297d55 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.294123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.295501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.297584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.298074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.300729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:14.301158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.303485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.333196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2853/5715] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:51:14.340807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.377301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29739-2045-4e1b-b700-783424752e82 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.390553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.391478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.393073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.393670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.394361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:14.395038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.400629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.423005 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2863/5716] 10.222.0.16 () {58 vars in 1171 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:14.423219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.436725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5c89-4e74-4c84-a0b6-5e92ad4bb992 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.449453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.450167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.450549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.450915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.451652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.453372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.499910 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2854/5717] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:14 2022] POST /identity/v3/services => generated 288 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:14.504887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.520143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdd2dd-6bd6-4dd3-bd34-75bb8520e2f2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.589164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.590081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.593226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.593620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.594422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.598094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.673629 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-797257403. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:14.673629 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:14.673629 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:14.725505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2864/5718] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:14 2022] POST /identity/v3/endpoints => generated 358 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:14.729507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.752542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bf13-af28-4e2c-b3fb-60d8411cc0cd tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.793577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.796310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.796532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.796794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-797257403` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.798772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-797257403)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.804301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.806647 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2855/5719] 10.222.0.16 () {58 vars in 1203 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/regions/tempest-region-797257403 => generated 178 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:14.811581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:14.827248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79733a-012c-463d-b639-5b571e6cec71 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:14.832862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:14.833535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:14.833815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:14.834093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/1583d4df9c454690a4026ce0260d7bbf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:14.843166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=1583d4df9c454690a4026ce0260d7bbf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:14.844208 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:14.844208 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:51:14.844208 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:14.846249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:14.890343 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1946527231. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:14.890343 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:14.890343 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:14.968889 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2865/5720] 10.222.0.16 () {60 vars in 1256 bytes} [Wed Oct 5 02:51:14 2022] PATCH /identity/v3/endpoints/1583d4df9c454690a4026ce0260d7bbf => generated 363 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:14.973816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.021570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267c97-7964-4dfd-8de0-b0808a2c611e tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.107682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.109491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.110681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.111955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-1946527231` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.112991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1946527231)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.116343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.121653 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2856/5721] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:14 2022] GET /identity/v3/regions/tempest-region-1946527231 => generated 180 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:15.128017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.151024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1efda-951a-49d5-a57d-65f07adfb1f5 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.157406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.158159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.158449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.159268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/1583d4df9c454690a4026ce0260d7bbf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.170676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=1583d4df9c454690a4026ce0260d7bbf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.173758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.186344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '1583d4df9c454690a4026ce0260d7bbf', 'request_id': 'req-620e722a-0e85-44c7-b8c6-dc7b2dde070f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:15.205613 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2866/5722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/endpoints/1583d4df9c454690a4026ce0260d7bbf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:15.209913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.232317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf2039-5656-4bf7-9637-2324d1d581d3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.266410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.267872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.268357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.268811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-1946527231` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.269678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1946527231)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.275121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.310077 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1946527231. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:15.310077 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:15.310077 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:15.328756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2857/5723] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/regions/tempest-region-1946527231 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:15.332355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.369443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e722a-0e85-44c7-b8c6-dc7b2dde070f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.381514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.382354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.383370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.384437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-797257403` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.385474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-797257403)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.387327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.416213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2867/5724] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/regions/tempest-region-797257403 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:15.432146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.454273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e69f5-13ee-4774-ba43-b6b664c30c69 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.499878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.500855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.501754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.502049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/services/c291eea85b584038b9117ac68ade1fab` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.502659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c291eea85b584038b9117ac68ade1fab)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.504728 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:15.504728 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:15.504728 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:15.506470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.526312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.532944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:15.551401 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2858/5725] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/services/c291eea85b584038b9117ac68ade1fab => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:51:15.552539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.589387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58411-e7f6-484e-8f56-fc75dcfde146 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.595775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115652d-74bb-40ad-9207-81f3dddb8618 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.600245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.603494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.603787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.604072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/c8341de4a1844613b7c3d0375d1688cf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.619887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c8341de4a1844613b7c3d0375d1688cf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.623581 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:15.623581 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:15.623581 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:15.624566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.646064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.647330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.647762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.648089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.651137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c8341de4a1844613b7c3d0375d1688cf', 'request_id': 'req-8330145e-dd15-4212-9916-356e110464d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:15.670429 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2859/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/endpoints/c8341de4a1844613b7c3d0375d1688cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:15.674772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.730263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330145e-dd15-4212-9916-356e110464d2 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.770486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.771151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.771750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.771750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-496719050` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.772300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-496719050)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.774582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.808202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.810094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.811389 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-496719050. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:15.811389 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:15.811389 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:15.828606 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2860/5727] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/regions/tempest-region-496719050 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:15.831191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:15.840673 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2868/5728] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:15 2022] GET /identity/v3/auth/tokens => generated 3768 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:15.891181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b277208-731d-411e-860d-8dc9b640860b tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:15.905646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:15.908684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:15.909917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:15.910348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/services/cf29b8cb019a4ea1adf646569051005c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:15.911617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_service(service_id=cf29b8cb019a4ea1adf646569051005c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:15.925307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:15.970319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:15.986227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2861/5729] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/services/cf29b8cb019a4ea1adf646569051005c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:15.987621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:16.011024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bc12f-268c-49a6-b4df-254594d53d87 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:16.038941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:16.039578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:16.040019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:16.040498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/endpoints/06ed9b43cb474a57a1c9ea01e0f3c7b2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:16.047842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=06ed9b43cb474a57a1c9ea01e0f3c7b2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:16.049641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:16.091487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '06ed9b43cb474a57a1c9ea01e0f3c7b2', 'request_id': 'req-7fe24a43-932f-46d4-928e-69f01a83258f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:16.123479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:16.124346 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2869/5730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:15 2022] DELETE /identity/v3/endpoints/06ed9b43cb474a57a1c9ea01e0f3c7b2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:16.140996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8cbe7-10bf-42ab-8c35-7effa37bcf0a tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:16.183604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:16.184641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:16.185345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:16.191915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/regions/tempest-region-2008059332` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:16.197990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2008059332)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:16.199704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:16.228215 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2008059332. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:16.228215 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:16.228215 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:16.246353 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2862/5731] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:51:16 2022] DELETE /identity/v3/regions/tempest-region-2008059332 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:16.250322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:16.265929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24a43-932f-46d4-928e-69f01a83258f tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:16.328976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3853663a7f41a7aa8b60d32dfc5d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca8e906013ad43a7ae7916e1ba43f03c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:16.328976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:16.328976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:16.329712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] PATH_INFO: `/v3/services/66c11a05c87f477f8ab923664429348e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:16.329712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorizing `identity:delete_service(service_id=66c11a05c87f477f8ab923664429348e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:16.329712 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:16.329712 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:51:16.329712 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:16.332726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f4c31-2965-4250-b171-5f7bed075ead tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:16.396530 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2870/5732] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:16 2022] DELETE /identity/v3/services/66c11a05c87f477f8ab923664429348e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:16.400499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:16.629534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee022c-6db9-44e8-a134-f395f267d6b3 tempest-EndPointsTestJSON-540520465 tempest-EndPointsTestJSON-540520465-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:16.695483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:16.696357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:16.696642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:16.696944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] PATH_INFO: `/v3/users/93736477c9b1498c91160937740d8eb8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:16.703418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93736477c9b1498c91160937740d8eb8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:16.707973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:16.855644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93736477c9b1498c91160937740d8eb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:16.890786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93736477c9b1498c91160937740d8eb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:16.891721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93736477c9b1498c91160937740d8eb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:16.921674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93736477c9b1498c91160937740d8eb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:16.922326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93736477c9b1498c91160937740d8eb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:16.978151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2863/5733] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:16 2022] DELETE /identity/v3/users/93736477c9b1498c91160937740d8eb8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:16.983703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:16.984630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:16.985170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:17.040089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:17.050060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:17.259912 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2871/5734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:17.280224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:17.281780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:17.351311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:17.427695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14218dee-cbb6-4b24-aab9-1271a7547e99 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:17.437097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:17.437738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:17.438024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:17.438357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:17.459651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:17.461709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:17.519733 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2864/5735] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:18.163057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:18.164968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:18.182618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:18.184099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:18.189395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:18.199720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45a81-0269-4e8f-95a7-bfb84d086596 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:18.210951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:18.210951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:18.210951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:18.210951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:18.213304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:18.217418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7897d99-22e9-4a8e-9007-3d8979b7b6b3 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:18.234722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:18.235382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:18.235681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:18.235943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] PATH_INFO: `/v3/projects/2f645d161e0140fd8237dc1c21d486dc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:18.237781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f645d161e0140fd8237dc1c21d486dc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:18.246598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:18.420846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:18.421096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f645d161e0140fd8237dc1c21d486dc', 'request_id': 'req-5dffe51f-803c-4006-a2b0-800b0d76ea64'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.422891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:18.444225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f645d161e0140fd8237dc1c21d486dc', 'request_id': 'req-5dffe51f-803c-4006-a2b0-800b0d76ea64'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.456591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f645d161e0140fd8237dc1c21d486dc', 'request_id': 'req-5dffe51f-803c-4006-a2b0-800b0d76ea64'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.487825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] The token cache is being invalidate because project 2f645d161e0140fd8237dc1c21d486dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:18.488137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.489472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.491952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2872/5736] 10.222.0.16 () {60 vars in 1396 bytes} [Wed Oct 5 02:51:18 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:18.496276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2865/5737] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:18 2022] DELETE /identity/v3/projects/2f645d161e0140fd8237dc1c21d486dc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:51:18.501178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:18.533437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997e8a-6340-47cc-878f-b0dc8b462219 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:18.722789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:18.723462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:18.723747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:18.724026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] PATH_INFO: `/v3/users/eb3853663a7f41a7aa8b60d32dfc5d73` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:18.731539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3853663a7f41a7aa8b60d32dfc5d73)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:18.731539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:18.856659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3853663a7f41a7aa8b60d32dfc5d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.880235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3853663a7f41a7aa8b60d32dfc5d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.881615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3853663a7f41a7aa8b60d32dfc5d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.902811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3853663a7f41a7aa8b60d32dfc5d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.903985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3853663a7f41a7aa8b60d32dfc5d73'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:18.932356 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2873/5738] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:18 2022] DELETE /identity/v3/users/eb3853663a7f41a7aa8b60d32dfc5d73 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:19.645647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:19.647422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:19.731309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe51f-803c-4006-a2b0-800b0d76ea64 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:19.755061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:19.757198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:19.798157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:19.895835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:19.896504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:19.898584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:19.899966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] PATH_INFO: `/v3/projects/ca8e906013ad43a7ae7916e1ba43f03c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:19.903479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8e906013ad43a7ae7916e1ba43f03c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:19.909191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:19.922396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c16db8-7a61-44e9-9bc4-5c93e641f8da admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:19.934119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:19.935373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:19.936015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:19.937355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] PATH_INFO: `/v3/users/c32341d3cbbf424cb97d263b1c0667a6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:19.942461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32341d3cbbf424cb97d263b1c0667a6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:19.944835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:20.005464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:20.009977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8e906013ad43a7ae7916e1ba43f03c', 'request_id': 'req-01d2548f-78ba-493d-9452-88f3aca12d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.034880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8e906013ad43a7ae7916e1ba43f03c', 'request_id': 'req-01d2548f-78ba-493d-9452-88f3aca12d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.057101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8e906013ad43a7ae7916e1ba43f03c', 'request_id': 'req-01d2548f-78ba-493d-9452-88f3aca12d16'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.074986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32341d3cbbf424cb97d263b1c0667a6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.083890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] The token cache is being invalidate because project ca8e906013ad43a7ae7916e1ba43f03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:20.084220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.084854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-01d2548f-78ba-493d-9452-88f3aca12d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.087465 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2866/5739] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:19 2022] DELETE /identity/v3/projects/ca8e906013ad43a7ae7916e1ba43f03c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:20.092846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61aa0f-e662-46ad-ba97-9129e57e72db None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.093411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61aa0f-e662-46ad-ba97-9129e57e72db None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.093858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61aa0f-e662-46ad-ba97-9129e57e72db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.094543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32341d3cbbf424cb97d263b1c0667a6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.097605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32341d3cbbf424cb97d263b1c0667a6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.119503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32341d3cbbf424cb97d263b1c0667a6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.120204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5bb1e5a8-dd25-4f0f-a612-11a2879d4612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32341d3cbbf424cb97d263b1c0667a6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:20.154270 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2874/5740] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:19 2022] DELETE /identity/v3/users/c32341d3cbbf424cb97d263b1c0667a6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:20.159384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.159588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.159872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.182306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7c61aa0f-e662-46ad-ba97-9129e57e72db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:20.188681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7c61aa0f-e662-46ad-ba97-9129e57e72db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:20.206089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:20.207400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:20.339708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2867/5741] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:20.348041 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2875/5742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:20.358303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.360096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:20.363185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.364263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:20.364891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.448827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:20.457278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:20.478771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2868/5743] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:20.482952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:20.485871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:20.502810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef009399-ebb1-456c-bc9e-6050e92f149e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:20.518153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:20.518698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.518979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.519254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.519906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:20.520211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:20.521976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:20.559221 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2869/5744] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:51:20.560143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:20.568755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225632-7489-4ccc-aa42-4c8aa68e7ab7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:20.579594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:20.580538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.580765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.581040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.600918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f459f-2f65-4bc2-b8fd-eb3e80003a83 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:20.609823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:20.611289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:20.636256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:20.636937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.637168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.637444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.638089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:20.640311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:20.641274 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2876/5745] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:20.724170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2870/5746] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:20 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:20.729025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:20.747754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df20178-7b6b-4fe4-be87-2d16919749d6 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:20.897970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:20.898667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:20.899245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:20.899726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:20.900452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:20.902649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:20.947550 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2877/5747] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:20 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:20.953015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:20.983484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eff08-3be8-4937-9dfe-a5a4a61deda1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:21.009708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:21.011007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.011447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.011880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.012931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:21.014706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:21.058624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2871/5748] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:21.060403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:21.084933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f93d-ac4f-4bf0-a134-1a2fc403c106 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:21.104313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf52b6e-cc6c-4988-b8aa-06fe696aac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:21.107000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf52b6e-cc6c-4988-b8aa-06fe696aac52 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.107317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf52b6e-cc6c-4988-b8aa-06fe696aac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.121034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf52b6e-cc6c-4988-b8aa-06fe696aac52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.121034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf52b6e-cc6c-4988-b8aa-06fe696aac52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:21.121034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf52b6e-cc6c-4988-b8aa-06fe696aac52 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:21.169172 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2878/5749] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:21.170558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:21.194315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a339c62-bb27-4c7e-a594-2324d943d107 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:21.216160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:21.216843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.217220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.217542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] PATH_INFO: `/v3/projects/7ad043a93241485aa7c82434c4aab3d4/users/d87fb1025c1345238e2aa17795b10db3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.272262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad043a93241485aa7c82434c4aab3d4, user_id=d87fb1025c1345238e2aa17795b10db3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:21.275768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:21.308183 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2872/5750] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:21 2022] PUT /identity/v3/projects/7ad043a93241485aa7c82434c4aab3d4/users/d87fb1025c1345238e2aa17795b10db3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:21.319288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.319579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.319862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.379283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] MFA Rules not processed for user `d87fb1025c1345238e2aa17795b10db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:21.380542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:21.511963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:21.514061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:21.515834 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2879/5751] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:21.522972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:21.616361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:21.687834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4961ce0-783d-40ea-a0c8-abca0313f592 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:21.694140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86163d-0aaa-47dc-9c87-c60e9a39fd30 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:21.706899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:21.707647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:21.708504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.708984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.709444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] PATH_INFO: `/v3/projects/8f09de3948454627b5d2cfffb1c93144` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.711102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.711519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.711899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.712100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f09de3948454627b5d2cfffb1c93144)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:21.712458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:21.714666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:21.716713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:21.732441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:21.812944 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2880/5752] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:21 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:21.814894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:21.822849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f09de3948454627b5d2cfffb1c93144', 'request_id': 'req-a6680c02-8a03-45aa-9492-fbe9bf3b205d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:21.842633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f09de3948454627b5d2cfffb1c93144', 'request_id': 'req-a6680c02-8a03-45aa-9492-fbe9bf3b205d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:21.850852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f09de3948454627b5d2cfffb1c93144', 'request_id': 'req-a6680c02-8a03-45aa-9492-fbe9bf3b205d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:21.895252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] The token cache is being invalidate because project 8f09de3948454627b5d2cfffb1c93144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:21.895479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:21.896109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a6680c02-8a03-45aa-9492-fbe9bf3b205d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:21.901812 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2873/5753] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:21 2022] DELETE /identity/v3/projects/8f09de3948454627b5d2cfffb1c93144 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:21.903270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05d4af-f6eb-4310-9529-1903260909cc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:21.903541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05d4af-f6eb-4310-9529-1903260909cc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:21.903822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05d4af-f6eb-4310-9529-1903260909cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:21.926958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dd05d4af-f6eb-4310-9529-1903260909cc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:21.928188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd05d4af-f6eb-4310-9529-1903260909cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:22.006662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995edd4-093d-48bb-ae25-cc687f624ccd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.024183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.024949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.025880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.025880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.026323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.034155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.057790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2874/5754] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:22.062469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.062967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.063412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.094750 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2881/5755] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:21 2022] POST /identity/v3/users => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:22.094949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:22.095233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:22.098210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.100473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:22.108446 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2875/5756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:22.109651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.131520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2131-10ba-4348-a6d1-3ee3848e02bf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.136972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09dd2f-5544-4074-96e3-5dc9be3e35cb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.137859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.138485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.138769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.139048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.139891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.141537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.150258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.151244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.151540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.151827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.153073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:22.153394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.155245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.158887 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2882/5757] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:22.160202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.174816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb533bf3-7b05-4271-aff7-64fcec2ddc1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.191416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.192322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.192775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.193229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] PATH_INFO: `/v3/projects/0d38c644d4054ec1b8cc89069c7e60fa/users/e31ce39c152c4893b5f701191525164e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.200837 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2876/5758] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:22.209081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.230888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d38c644d4054ec1b8cc89069c7e60fa, user_id=e31ce39c152c4893b5f701191525164e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.233994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.238421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a8486-a16d-44ed-8237-8111386d3428 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.261786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.262419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.262705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.262986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.263776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.266128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.274863 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2883/5759] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:22 2022] PUT /identity/v3/projects/0d38c644d4054ec1b8cc89069c7e60fa/users/e31ce39c152c4893b5f701191525164e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:22.276706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.353194 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2877/5760] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:22 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:22.356723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.411209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9fa9b-7943-45b8-9538-1731c48cb015 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.463260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:22.475998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:22.509558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092243-c05b-4e4d-a4d5-9373dbf4923d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.510605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.511356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.511734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.512055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.512775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.514684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.526071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.529133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.529492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.529839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.532049 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2884/5761] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:22.536702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.537228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.542838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.564768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0344e4-0bc6-4c3c-9abb-3d1c1cf81923 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.577914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d18ba-50fc-49d1-ac28-74efdff3d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.580078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d18ba-50fc-49d1-ac28-74efdff3d76e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.581274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d18ba-50fc-49d1-ac28-74efdff3d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.581905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d18ba-50fc-49d1-ac28-74efdff3d76e admin admin] PATH_INFO: `/v3/projects/0d38c644d4054ec1b8cc89069c7e60fa/users/e31ce39c152c4893b5f701191525164e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.584324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d18ba-50fc-49d1-ac28-74efdff3d76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d38c644d4054ec1b8cc89069c7e60fa, user_id=e31ce39c152c4893b5f701191525164e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.590389 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2878/5762] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:22 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:22.592809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.593301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d18ba-50fc-49d1-ac28-74efdff3d76e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.610206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b390ff-3839-4b6d-9bc0-29a15ff4c9bb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.611774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2885/5763] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:22 2022] PUT /identity/v3/projects/0d38c644d4054ec1b8cc89069c7e60fa/users/e31ce39c152c4893b5f701191525164e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:22.623413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.624585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.625498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.703042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.703954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.704548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.705025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.705947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.717682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.721366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] MFA Rules not processed for user `e31ce39c152c4893b5f701191525164e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:22.722722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:22.732236 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2879/5764] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:22.736248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.794797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad60bd-592a-495b-9833-ef06d268f843 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.807680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.808540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.808894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.809301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.810033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.818245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:22.843600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2880/5765] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:22.844288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.855124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:22.942361 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2886/5766] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:22.942361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:22.958719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc1cd-b1a8-4310-ab28-124c63b69f5f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:22.964559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:22.965292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:22.965583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:22.965862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] PATH_INFO: `/v3/projects/00b6f5d3340b496dbc870607d603f228/users/78476105e663420dad70b383e1fab660/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:22.984887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b6f5d3340b496dbc870607d603f228, user_id=78476105e663420dad70b383e1fab660, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:22.987481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.028110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49615a1-cacf-4fe5-8ef1-0b1af8ae7ac6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.028540 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2887/5767] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:22 2022] PUT /identity/v3/projects/00b6f5d3340b496dbc870607d603f228/users/78476105e663420dad70b383e1fab660/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:23.029720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.104512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:23.123353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364492a-2111-4a38-bb93-91665cc671fb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.129072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53115661-3eae-4bdf-bf7e-321688354046 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.130100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53115661-3eae-4bdf-bf7e-321688354046 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.130555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53115661-3eae-4bdf-bf7e-321688354046 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.131059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53115661-3eae-4bdf-bf7e-321688354046 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.132297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53115661-3eae-4bdf-bf7e-321688354046 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.133906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.134486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.134771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.135048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53115661-3eae-4bdf-bf7e-321688354046 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.135714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.139036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:23.197779 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2888/5768] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:23 2022] POST /identity/v3/services => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:23.200332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.201044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.201696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.229076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:23.244365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] MFA Rules not processed for user `78476105e663420dad70b383e1fab660`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:23.246675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:23.278742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.281880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.313552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2881/5769] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:22 2022] GET /identity/v3/auth/tokens => generated 3388 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:23.314679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.329660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78cd0e-f88a-4bb1-b84e-9c54e600c848 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.362182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.363836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.364940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.366090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.366486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.368379 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:23.368379 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:23.368379 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:23.372539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.390322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2889/5770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:23 2022] POST /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: On instance['enabled']: Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: On instance['enabled']: Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: 'False' Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise error Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application 'False' Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.390657 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:51:23.392218 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application 'False' Oct 05 02:51:23.393332 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:23.398417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.400408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2882/5771] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:23 2022] POST /identity/v3/endpoints => generated 283 bytes in 85 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:51:23.404973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.410189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:23.422915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bb59a-b2fa-40ad-be38-5d5c77ddf413 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.436267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.437233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.438813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.439262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.442040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.449380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: On instance['enabled']: Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: On instance['enabled']: Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: 'True' Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise error Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application 'True' Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.478314 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:51:23.480279 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application 'True' Oct 05 02:51:23.481635 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.497884 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2890/5772] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:23 2022] POST /identity/v3/endpoints => generated 281 bytes in 100 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:51:23.498867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.506737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e433a1-201f-48df-a003-9b9f63955cf8 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.512744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b889e-bb8c-47ff-9374-4fa440f0f9f5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.529147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.529147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.529147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.529147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.536193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.537161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.537626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.538059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.539113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.541633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.542299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.547663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.581415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2883/5773] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:23 2022] GET /identity/v3/auth/tokens => generated 3382 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:23.619173 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1747539620. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:23.619173 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:23.619173 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:51:23.675135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2891/5774] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:23 2022] POST /identity/v3/endpoints => generated 360 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:23.680572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.697354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b387e-24d8-4d2a-a195-2ebb73ee6bf7 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.753799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.754440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.754724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.754998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/regions/tempest-region-1747539620` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.755585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1747539620)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.756641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.767409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.774650 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2884/5775] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:23 2022] GET /identity/v3/regions/tempest-region-1747539620 => generated 180 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:23.783136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc94a-9f2b-43fd-8caf-a855b2b912e1 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.804172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.805484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.805769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.806472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints/4bc95c8923a945d5a12f402ef11c6a66` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.824800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=4bc95c8923a945d5a12f402ef11c6a66)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.826590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: On instance['enabled']: Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: On instance['enabled']: Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: 'False' Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise error Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application 'False' Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.857084 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:51:23.862617 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application 'False' Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:51:23.863703 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2892/5776] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 5 02:51:23 2022] PATCH /identity/v3/endpoints/4bc95c8923a945d5a12f402ef11c6a66 => generated 283 bytes in 95 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:51:23.864341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.880381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a29e-fc7d-4b1a-973d-1963bf5784fe tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:23.897382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:23.898068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:23.898367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:23.898833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints/4bc95c8923a945d5a12f402ef11c6a66` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:23.901064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4bc95c8923a945d5a12f402ef11c6a66)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:23.902679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:23.937534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4bc95c8923a945d5a12f402ef11c6a66', 'request_id': 'req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:23.965337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2885/5777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:23 2022] DELETE /identity/v3/endpoints/4bc95c8923a945d5a12f402ef11c6a66 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:23.968114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:23.979368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff5c5-edcf-467e-a8c1-793730e5f050 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.011086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.011737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.012025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.012301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/regions/tempest-region-1747539620` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.013071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1747539620)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.014688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.061032 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2893/5778] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:51:23 2022] DELETE /identity/v3/regions/tempest-region-1747539620 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:24.062420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.082819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4911bb-8e01-4acc-beb8-6e504c63f6b5 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.100732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:24.120647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.121299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.121589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.121896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.122585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.124498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.170541 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1185173910. To ensure interoperability, identifiers should be a valid uuid. Oct 05 02:51:24.170541 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 02:51:24.170541 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:24.254423 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2886/5779] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Oct 5 02:51:24 2022] POST /identity/v3/endpoints => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:24.258557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.282414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c6b47-dfdd-4a9c-aa7a-659d3d0ad56a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.332986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.333739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.334327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.334651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/regions/tempest-region-1185173910` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.335267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1185173910)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.336978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.339173 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2894/5780] 10.222.0.16 () {58 vars in 1206 bytes} [Wed Oct 5 02:51:24 2022] GET /identity/v3/regions/tempest-region-1185173910 => generated 180 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:24.343594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.361641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d642-be3a-4db6-8905-a6fe5581af5b tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.377955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.378615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.378898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.379170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints/e645ea401e46422ab77170f92abbd7f8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.387577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=e645ea401e46422ab77170f92abbd7f8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.388613 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:51:24.388613 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:51:24.388613 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:51:24.389695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: On instance['enabled']: Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: On instance['enabled']: Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: 'True' Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise error Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application 'True' Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.397538 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 05 02:51:24.403393 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application On instance['enabled']: Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application 'True' Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:51:24.404673 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2887/5781] 10.222.0.16 () {60 vars in 1255 bytes} [Wed Oct 5 02:51:24 2022] PATCH /identity/v3/endpoints/e645ea401e46422ab77170f92abbd7f8 => generated 281 bytes in 57 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:51:24.405479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.419528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14a13-1d76-485c-be5d-113b4bc942bf tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.436846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.439785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.442375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.443023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/endpoints/e645ea401e46422ab77170f92abbd7f8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.447987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e645ea401e46422ab77170f92abbd7f8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.453155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.470571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e645ea401e46422ab77170f92abbd7f8', 'request_id': 'req-76dd0445-d896-4d18-86bf-f4e06b353b71'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:24.504626 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2895/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Oct 5 02:51:24 2022] DELETE /identity/v3/endpoints/e645ea401e46422ab77170f92abbd7f8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:51:24.508778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.527337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881354f-10f7-4ee0-8094-de889b7072a7 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.582246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.582915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.583187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.583463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/regions/tempest-region-1185173910` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.584057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1185173910)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.585882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.646726 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2888/5783] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Oct 5 02:51:24 2022] DELETE /identity/v3/regions/tempest-region-1185173910 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:24.653479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.675738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd0445-d896-4d18-86bf-f4e06b353b71 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.733958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41795-62c9-4891-9e9e-95f188af9624 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31ce39c152c4893b5f701191525164e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d38c644d4054ec1b8cc89069c7e60fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.741247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41795-62c9-4891-9e9e-95f188af9624 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.741659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41795-62c9-4891-9e9e-95f188af9624 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.743708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41795-62c9-4891-9e9e-95f188af9624 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] PATH_INFO: `/v3/services/73c76396562345dabfeffe37877dec14` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.744360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41795-62c9-4891-9e9e-95f188af9624 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorizing `identity:delete_service(service_id=73c76396562345dabfeffe37877dec14)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.746098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41795-62c9-4891-9e9e-95f188af9624 tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:24.813756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2896/5784] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:24 2022] DELETE /identity/v3/services/73c76396562345dabfeffe37877dec14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:24.817890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:24.932820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ade99c-e714-4e7c-a835-f2986a7f703a tempest-EndpointsNegativeTestJSON-1984299163 tempest-EndpointsNegativeTestJSON-1984299163-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:24.952615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:24.953609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:24.954171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:24.954673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] PATH_INFO: `/v3/users/d87fb1025c1345238e2aa17795b10db3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:24.956562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87fb1025c1345238e2aa17795b10db3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:24.958989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:25.130015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87fb1025c1345238e2aa17795b10db3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:25.175082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87fb1025c1345238e2aa17795b10db3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:25.177261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87fb1025c1345238e2aa17795b10db3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:25.184643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:25.196625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87fb1025c1345238e2aa17795b10db3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:25.199644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87fb1025c1345238e2aa17795b10db3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:25.234342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2889/5785] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:24 2022] DELETE /identity/v3/users/d87fb1025c1345238e2aa17795b10db3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:25.239046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:25.239748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:25.239748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:25.285254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:25.286645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:25.302107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:25.488096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2897/5786] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:25.594624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:25.596304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:25.783903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ebda6-1c0f-4f9a-92bd-f214c6a06e15 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:25.787837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:25.788359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:25.789028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:25.789028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:25.818175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:25.819652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:25.840866 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2890/5787] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:28.223564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:28.226053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:28.270010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c601d8-f85c-44f1-892b-02fe6e2215c6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:28.302731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:28.303640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:28.305182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:28.305618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] PATH_INFO: `/v3/projects/7ad043a93241485aa7c82434c4aab3d4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:28.310110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad043a93241485aa7c82434c4aab3d4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:28.312400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:28.523552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad043a93241485aa7c82434c4aab3d4', 'request_id': 'req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:28.541827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad043a93241485aa7c82434c4aab3d4', 'request_id': 'req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:28.559497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad043a93241485aa7c82434c4aab3d4', 'request_id': 'req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:28.592624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] The token cache is being invalidate because project 7ad043a93241485aa7c82434c4aab3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:28.592624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:28.594156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:28.599655 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2898/5788] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:28 2022] DELETE /identity/v3/projects/7ad043a93241485aa7c82434c4aab3d4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:28.600546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:28.617363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f5626-df36-494f-aa47-85649f9dde72 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:28.797139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:28.798978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:28.800675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:28.801253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] PATH_INFO: `/v3/users/e31ce39c152c4893b5f701191525164e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:28.813957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31ce39c152c4893b5f701191525164e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:28.820067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:28.940276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:28.942252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:29.011363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31ce39c152c4893b5f701191525164e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.019068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45e65-75d1-41e7-a513-b26b7b8d7a02 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:29.038401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:29.040670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:29.042008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:29.042710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] PATH_INFO: `/v3/users/96c24915d2714994a10b4e30971c07af` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:29.044970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c24915d2714994a10b4e30971c07af)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:29.047506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:29.078546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31ce39c152c4893b5f701191525164e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.080884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31ce39c152c4893b5f701191525164e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.111906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31ce39c152c4893b5f701191525164e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.113165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ef971e28-9f1d-42d9-9ed8-003c7eac1f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31ce39c152c4893b5f701191525164e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.152520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:29.168410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2891/5789] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:28 2022] DELETE /identity/v3/users/e31ce39c152c4893b5f701191525164e => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:29.228611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c24915d2714994a10b4e30971c07af'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.267196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c24915d2714994a10b4e30971c07af'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.270289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c24915d2714994a10b4e30971c07af'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.295882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c24915d2714994a10b4e30971c07af'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.308446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c24915d2714994a10b4e30971c07af'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:29.415865 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2899/5790] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:28 2022] DELETE /identity/v3/users/96c24915d2714994a10b4e30971c07af => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:29.421403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:29.422683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:29.423843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:29.506627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:29.510219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:29.679288 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2892/5791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:29.738894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:29.745248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:29.759159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:29.913418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6728f-212d-44f8-bfbb-030d299fc10f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:29.925964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e828f8-6f13-4c85-9e45-400c8121fc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:29.927472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e828f8-6f13-4c85-9e45-400c8121fc0a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:29.928513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e828f8-6f13-4c85-9e45-400c8121fc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:29.929016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e828f8-6f13-4c85-9e45-400c8121fc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:29.954763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e828f8-6f13-4c85-9e45-400c8121fc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:29.956929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e828f8-6f13-4c85-9e45-400c8121fc0a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:29.981657 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2900/5792] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:31.193564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:31.196624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:31.220153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e547730-b066-4b67-a451-8411322a9a9a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:31.234598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:31.235208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:31.235495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:31.236365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] PATH_INFO: `/v3/projects/0d38c644d4054ec1b8cc89069c7e60fa` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:31.237938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d38c644d4054ec1b8cc89069c7e60fa)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:31.247181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:31.421723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d38c644d4054ec1b8cc89069c7e60fa', 'request_id': 'req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:31.439102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d38c644d4054ec1b8cc89069c7e60fa', 'request_id': 'req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:31.450125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d38c644d4054ec1b8cc89069c7e60fa', 'request_id': 'req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:31.474968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] The token cache is being invalidate because project 0d38c644d4054ec1b8cc89069c7e60fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:31.475192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:31.478698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0d69c616-36eb-4d43-8d4a-6aa19e0d63b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:31.485276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2893/5793] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:31 2022] DELETE /identity/v3/projects/0d38c644d4054ec1b8cc89069c7e60fa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:31.486751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:31.487215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:31.487365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:31.527546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:31.528767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:31.703701 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2901/5794] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:31.713884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:31.714178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:31.714462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:31.752785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:31.753403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:31.769509 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2894/5795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:31.775020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:31.816020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18164c-e34f-433f-83a5-058c8843af8c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:31.833917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:31.835094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:31.835986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:31.836339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:31.837277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:31.838192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:31.841208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:31.896367 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2902/5796] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:31.897238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:31.911490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6764ed0-160e-4324-8e3f-b4f7d467e179 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:31.935591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:31.936386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:31.939262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:31.939620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:31.940348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:31.948515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.035738 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2895/5797] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:31 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:32.036516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.057851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc0ade-84dd-4859-9518-285efcdb87f5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:32.198456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.200314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.219624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:32.222352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.222641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.222920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.223577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:32.225576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.270133 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2903/5798] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:32 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:32.272768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.291785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f34d50-1772-4321-900c-03a76d9369b1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:32.312381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:32.312976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8825-9e41-4162-99c1-0c3be7bcfc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:32.313647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8825-9e41-4162-99c1-0c3be7bcfc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.313932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8825-9e41-4162-99c1-0c3be7bcfc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.314254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8825-9e41-4162-99c1-0c3be7bcfc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.316161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8825-9e41-4162-99c1-0c3be7bcfc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:32.317816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8825-9e41-4162-99c1-0c3be7bcfc1a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.319992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6183a-658e-4ce2-98ed-e9ed069c7745 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:32.334613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:32.336122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.336861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.337404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] PATH_INFO: `/v3/projects/a6b85f9370a14315860bf2494a748b63` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.339624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b85f9370a14315860bf2494a748b63)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:32.341945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.351389 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2904/5799] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:32.354057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.357342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.357813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.394742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] MFA Rules not processed for user `ef5ed582f9d74e2f9bd5ea39f41a5017`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:32.396045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.408355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:32.435074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b85f9370a14315860bf2494a748b63', 'request_id': 'req-77eadd49-e297-439c-a8c6-6d085ea4275b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.450936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b85f9370a14315860bf2494a748b63', 'request_id': 'req-77eadd49-e297-439c-a8c6-6d085ea4275b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.459944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b85f9370a14315860bf2494a748b63', 'request_id': 'req-77eadd49-e297-439c-a8c6-6d085ea4275b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.478139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] The token cache is being invalidate because project a6b85f9370a14315860bf2494a748b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:32.478438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.479344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.486643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2896/5800] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:32 2022] DELETE /identity/v3/projects/a6b85f9370a14315860bf2494a748b63 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:32.487700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.489433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.497764 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2905/5801] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:32.499208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.500633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.614110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eadd49-e297-439c-a8c6-6d085ea4275b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:32.623143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aff46-2bd5-4901-bce1-371ff3530c16 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:32.626925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:32.628372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.629534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.630538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.631328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:32.634729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.636293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:32.637081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.637474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.639272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] PATH_INFO: `/v3/users/78476105e663420dad70b383e1fab660` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.640584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78476105e663420dad70b383e1fab660)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:32.643510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.665080 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2897/5802] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:32.667825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.671611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.698117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf11a0-eaf3-421a-8bcb-1a7a173909d1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:32.710969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:32.712714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.713329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.715026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] PATH_INFO: `/v3/users/448c528e38b944acbc4226501c046e5a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.717366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448c528e38b944acbc4226501c046e5a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:32.719179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:32.731585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78476105e663420dad70b383e1fab660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.754388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78476105e663420dad70b383e1fab660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.755756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78476105e663420dad70b383e1fab660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.769217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78476105e663420dad70b383e1fab660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.769727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-439a2470-a2d6-4172-aafc-d1696b2cd98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78476105e663420dad70b383e1fab660'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.784398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448c528e38b944acbc4226501c046e5a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.800577 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2906/5803] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:32 2022] DELETE /identity/v3/users/78476105e663420dad70b383e1fab660 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:32.806507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299eb63-f4cb-441b-b98b-73e7b8a435e6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:32.807276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299eb63-f4cb-441b-b98b-73e7b8a435e6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:32.807936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299eb63-f4cb-441b-b98b-73e7b8a435e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:32.809099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448c528e38b944acbc4226501c046e5a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.809576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448c528e38b944acbc4226501c046e5a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.825378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448c528e38b944acbc4226501c046e5a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.832634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448c528e38b944acbc4226501c046e5a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:32.838409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0299eb63-f4cb-441b-b98b-73e7b8a435e6 None None] MFA Rules not processed for user `ef5ed582f9d74e2f9bd5ea39f41a5017`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:32.839842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0299eb63-f4cb-441b-b98b-73e7b8a435e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.840488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:32.865633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2898/5804] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:32 2022] DELETE /identity/v3/users/448c528e38b944acbc4226501c046e5a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:32.866718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:32.869611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:32.916738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:33.021011 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2907/5805] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:33.022431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.022729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.023564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.042016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c163851-afaf-4fae-b3e9-d71cbdd66b50 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:33.066882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd43f-4671-4241-a7b4-a4a9ae92406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:33.067593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd43f-4671-4241-a7b4-a4a9ae92406c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.067759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd43f-4671-4241-a7b4-a4a9ae92406c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.068008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd43f-4671-4241-a7b4-a4a9ae92406c admin admin] PATH_INFO: `/v3/projects/46cf611fc617419288fdfe2f6c1ccfd6/users/84657215f88c4a59b2951f27cd2e11a3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.069741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:33.071644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:33.094579 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2908/5806] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:33.105217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:33.106356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:33.122601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd43f-4671-4241-a7b4-a4a9ae92406c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cf611fc617419288fdfe2f6c1ccfd6, user_id=84657215f88c4a59b2951f27cd2e11a3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:33.125778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd43f-4671-4241-a7b4-a4a9ae92406c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:33.173086 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2899/5807] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:32 2022] PUT /identity/v3/projects/46cf611fc617419288fdfe2f6c1ccfd6/users/84657215f88c4a59b2951f27cd2e11a3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:33.178983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.184315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.184852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.249053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b884464-d026-48e1-837e-2a59836b6a98 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:33.263411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] MFA Rules not processed for user `84657215f88c4a59b2951f27cd2e11a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:33.264930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:33.345690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:33.346329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.346611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.346890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.403728 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2900/5808] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:33.409875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:33.421511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e12c35-8798-475e-b7e1-eb134056d675 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:33.426677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed1e8b-c013-4fd7-b2bf-9ed85e905b97 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:33.427331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1e8b-c013-4fd7-b2bf-9ed85e905b97 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.427615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1e8b-c013-4fd7-b2bf-9ed85e905b97 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.427910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed1e8b-c013-4fd7-b2bf-9ed85e905b97 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.428558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed1e8b-c013-4fd7-b2bf-9ed85e905b97 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:33.429857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed1e8b-c013-4fd7-b2bf-9ed85e905b97 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:33.491187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:33.495371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:33.528954 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2909/5809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:33.575336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2901/5810] 10.222.0.16 () {60 vars in 1314 bytes} [Wed Oct 5 02:51:33 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 788 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:33.576045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:33.595681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b726a-7edc-4c6b-abc0-47a5a051551d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:33.605630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:33.607250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.609641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.610001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/2bf119085b904f0ebab1b7aed4f0c7aa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.645230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:get_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=2bf119085b904f0ebab1b7aed4f0c7aa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:33.647762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:33.655800 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2910/5811] 10.222.0.16 () {58 vars in 1392 bytes} [Wed Oct 5 02:51:33 2022] GET /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/2bf119085b904f0ebab1b7aed4f0c7aa => generated 688 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:33.659806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:33.660112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:33.660396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:33.676596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:33.709713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] MFA Rules not processed for user `84657215f88c4a59b2951f27cd2e11a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:33.721659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:33.979945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2902/5812] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:33 2022] POST /identity/v3/auth/tokens => generated 3426 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 05 02:51:33.984192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.002163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0aa63-6b50-4b59-a270-aa97166987ff tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.017012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.017706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.018000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.018290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/2bf119085b904f0ebab1b7aed4f0c7aa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.021533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=2bf119085b904f0ebab1b7aed4f0c7aa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.027015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.065106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:34.072369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2911/5813] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:33 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/2bf119085b904f0ebab1b7aed4f0c7aa => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:34.080001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.093506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ed3c-1dc8-49c7-a282-75403ef723da None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.104317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.105832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.106319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.106954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.108359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.109957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.157040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.159111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.198988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a5d75-f2e7-4e4f-b6d2-aebb97b56e2e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.205483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.206549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.207882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.208365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] PATH_INFO: `/v3/projects/00b6f5d3340b496dbc870607d603f228` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.230647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b6f5d3340b496dbc870607d603f228)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.237189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.287402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2903/5814] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 5 02:51:34 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 919 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:34.287402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.290275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.307752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e240c5e-d53f-4d12-bf04-82b206485dcc tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.310209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b6f5d3340b496dbc870607d603f228', 'request_id': 'req-179a9637-1808-45f3-8dee-c9faff81dd8b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.319145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b6f5d3340b496dbc870607d603f228', 'request_id': 'req-179a9637-1808-45f3-8dee-c9faff81dd8b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.326720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b6f5d3340b496dbc870607d603f228', 'request_id': 'req-179a9637-1808-45f3-8dee-c9faff81dd8b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.359962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] The token cache is being invalidate because project 00b6f5d3340b496dbc870607d603f228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:34.360735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.361480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:34.362115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.366027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2912/5815] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:34 2022] DELETE /identity/v3/projects/00b6f5d3340b496dbc870607d603f228 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:34.373055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.376806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.403028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.403741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.404031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.404623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] PATH_INFO: `/v3/projects/6c4b486b97a14bf2a9aac44d217059c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.405810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4b486b97a14bf2a9aac44d217059c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.407825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.476868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4b486b97a14bf2a9aac44d217059c7', 'request_id': 'req-8f47d670-d882-4d04-ba3e-b66cd2e3639f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.477443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9637-1808-45f3-8dee-c9faff81dd8b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.484803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4b486b97a14bf2a9aac44d217059c7', 'request_id': 'req-8f47d670-d882-4d04-ba3e-b66cd2e3639f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.493927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4b486b97a14bf2a9aac44d217059c7', 'request_id': 'req-8f47d670-d882-4d04-ba3e-b66cd2e3639f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.509401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] The token cache is being invalidate because project 6c4b486b97a14bf2a9aac44d217059c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:34.509911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.510718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8f47d670-d882-4d04-ba3e-b66cd2e3639f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.512925 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2904/5816] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:34 2022] DELETE /identity/v3/projects/6c4b486b97a14bf2a9aac44d217059c7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:34.514330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.514609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.515025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.544767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:34.546305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.549937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.551180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.551473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.551757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/55ac2bbf493546b8a155478102641753` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.567078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=55ac2bbf493546b8a155478102641753)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.569072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.597881 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2913/5817] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:34 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/55ac2bbf493546b8a155478102641753 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:34.598738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.606591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.622565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:34.629094 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2905/5818] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:34.630632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.633121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.662127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a38af-8e1f-4e9a-8d13-7c7c479fcf0e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.673067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7799e5-b25f-4831-b931-4a0ba568455e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.673732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7799e5-b25f-4831-b931-4a0ba568455e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.674466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7799e5-b25f-4831-b931-4a0ba568455e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.674466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7799e5-b25f-4831-b931-4a0ba568455e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.675210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7799e5-b25f-4831-b931-4a0ba568455e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.676105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7799e5-b25f-4831-b931-4a0ba568455e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.705085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627ce69-18af-43ab-89e3-1ef4960614e4 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.713478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.714256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.714611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.714965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] PATH_INFO: `/v3/users/6448716cf2ab4ffd8d0c3d06d3a1693f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.716252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6448716cf2ab4ffd8d0c3d06d3a1693f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.719107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:34.768280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2906/5819] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 5 02:51:34 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 812 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:34.770265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.770636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.770982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.801598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6448716cf2ab4ffd8d0c3d06d3a1693f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.823588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:34.825721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.828700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6448716cf2ab4ffd8d0c3d06d3a1693f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.830724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6448716cf2ab4ffd8d0c3d06d3a1693f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.844248 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2907/5820] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:34.844710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6448716cf2ab4ffd8d0c3d06d3a1693f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.847200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.847379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6448716cf2ab4ffd8d0c3d06d3a1693f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:34.848375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.863163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:34.871100 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2914/5821] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:34 2022] DELETE /identity/v3/users/6448716cf2ab4ffd8d0c3d06d3a1693f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:34.873615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:34.875808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:34.966648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2765-1475-477e-8394-7661577af760 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.971974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:34.972636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:34.972947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:34.973249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/d1b32a2b7d6f497bbbe96fd8c8e28a16` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:34.973869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e0fc-7a58-4126-ab84-8fcd81fad050 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:34.984389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=d1b32a2b7d6f497bbbe96fd8c8e28a16)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:34.985948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.010842 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2915/5822] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:34 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/d1b32a2b7d6f497bbbe96fd8c8e28a16 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:35.012149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.027837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:35.048753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.049291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.049564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.049844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.052988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:35.066634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.068127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.080941 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2908/5823] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:35.081747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.093592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b90d7-bef7-4683-bf03-6d3f0386f711 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.098847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.099765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.100265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.100564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88daaa-4c0a-4150-b8fc-702b8aa4b4fe tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.101770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.106889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.107503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.107784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.108057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.108864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:35.109204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.110009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.110810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.111775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.131445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2916/5824] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:35.133058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.145649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e608-e1e0-4274-98e0-d6f59a8cb028 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.153801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.155907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.156209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.156493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.157224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.159164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.194453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2917/5825] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:35.196553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.214222 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2909/5826] 10.222.0.16 () {60 vars in 1314 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 788 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:35.215334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.230997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965231cd-ecbd-4a52-930e-aff564af5694 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.306473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4a318-f321-432d-b983-a174372c0260 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.325826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.326640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.326826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.327265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.327950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.328841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.330229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.330694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.331140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.331282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.332108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.334505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.342870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:35.377326 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2918/5827] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:35.378957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.392678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d87-01d6-4df9-a8e5-21744ff7f1a0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.409183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.409183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.409183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.409183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.409624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.409624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.418554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2919/5828] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:35.418554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.435359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac46ed7-54ba-4a56-a712-fa1a84bedd27 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.445751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.446460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.446809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.447201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.448545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.452084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.483141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2910/5829] 10.222.0.16 () {60 vars in 1314 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 788 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:35.483899 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2920/5830] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:35.484800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.485796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.504855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb011b-ea69-48d3-9ed9-1cd63d877c40 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.508371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66ae6-35f8-40d2-96bb-424b34f5fe2a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.514798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.515469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.515755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.516039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.516672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:list_application_credentials(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.518358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.522028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6695-9079-48fa-b603-b7b12e2b4b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.523489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6695-9079-48fa-b603-b7b12e2b4b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.524240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6695-9079-48fa-b603-b7b12e2b4b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.524678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6695-9079-48fa-b603-b7b12e2b4b77 admin admin] PATH_INFO: `/v3/projects/cfa67de433dc46a595baea99d927d156/users/f23b56d519224b22802f978442c7289f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.534298 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2911/5831] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 02:51:35 2022] GET /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 1500 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:35.539163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.545542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a6695-9079-48fa-b603-b7b12e2b4b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa67de433dc46a595baea99d927d156, user_id=f23b56d519224b22802f978442c7289f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.548360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a6695-9079-48fa-b603-b7b12e2b4b77 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.550551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206d0d6-b4c4-4499-ad92-e5cdd525f19c tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.555956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.556766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.557217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.557568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/ac23eac6b7014d0891ca66d22d65ddd0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.566275 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2921/5832] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:35 2022] PUT /identity/v3/projects/cfa67de433dc46a595baea99d927d156/users/f23b56d519224b22802f978442c7289f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:35.568292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=ac23eac6b7014d0891ca66d22d65ddd0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.570515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.571452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.571747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.572029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.597177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:35.599133 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2912/5833] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:35 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/ac23eac6b7014d0891ca66d22d65ddd0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:35.604408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.609406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:35.619651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d17dbe-bcd5-4315-a39d-032e25dc496a tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.647753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:35.722962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.723426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.723710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.724267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/5eb767f74ff34f788c96756c838bc2cd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.738250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=5eb767f74ff34f788c96756c838bc2cd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.746182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.753232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2922/5834] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:35.771309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.773806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:35.778984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2913/5835] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:35 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/5eb767f74ff34f788c96756c838bc2cd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:35.783798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.800158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70099ed-7d67-40e7-8cd9-2d6fcc23dea1 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.814434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.815042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.815335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.815677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.816584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.817924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.896331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:35.912490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca25e-4268-4698-b287-93400524dfc4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.919145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.919897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.920250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.920619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.932479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.934305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.947240 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2914/5836] 10.222.0.16 () {60 vars in 1314 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 789 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:35.948406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.950228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:35.957193 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2923/5837] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:35.958041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:35.969807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2446-25e0-434b-ba92-7763969e2a5d tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.970165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9631d-03f1-436c-aa2b-2c28d08f39cb service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:35.975397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.976727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.977151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.977527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.977778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:35.978386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:create_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.979683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:35.982268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:35.982463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:35.984937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] PATH_INFO: `/v3/projects/4e0eb3adca544894803f122bf964fdfd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:35.986532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0eb3adca544894803f122bf964fdfd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:35.988928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.062336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0eb3adca544894803f122bf964fdfd', 'request_id': 'req-c9504189-fd63-43af-9a2b-d54ff2d22d7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.072322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0eb3adca544894803f122bf964fdfd', 'request_id': 'req-c9504189-fd63-43af-9a2b-d54ff2d22d7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.082716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0eb3adca544894803f122bf964fdfd', 'request_id': 'req-c9504189-fd63-43af-9a2b-d54ff2d22d7f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.099188 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2924/5838] 10.222.0.16 () {60 vars in 1314 bytes} [Wed Oct 5 02:51:35 2022] POST /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials => generated 789 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:36.102713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.103234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] The token cache is being invalidate because project 4e0eb3adca544894803f122bf964fdfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:36.103608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.106379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c9504189-fd63-43af-9a2b-d54ff2d22d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.112643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2915/5839] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:35 2022] DELETE /identity/v3/projects/4e0eb3adca544894803f122bf964fdfd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:36.116418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7747-4cf6-4b23-a74d-bef3448cc256 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.116863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7747-4cf6-4b23-a74d-bef3448cc256 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.117470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad7747-4cf6-4b23-a74d-bef3448cc256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.118594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859f84-8e46-4a48-bf84-df8cdef037bb tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.151315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a2ad7747-4cf6-4b23-a74d-bef3448cc256 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:36.156627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a2ad7747-4cf6-4b23-a74d-bef3448cc256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.191583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.192406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.192878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.193406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.194190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Adding query filter params (name=tempest-application_credential-1096238869) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:36.194784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:list_application_credentials(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.197201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.216599 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2925/5840] 10.222.0.16 () {58 vars in 1386 bytes} [Wed Oct 5 02:51:36 2022] GET /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials?name=tempest-application_credential-1096238869 => generated 887 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:36.217586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.221236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.232438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:36.241018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072d810-6050-4a2f-97d9-bb6f21f4985e tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.246723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.247765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.247923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.248120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/67d092f902fb4ebf810dc3d488170120` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.256727 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2916/5841] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:36.262643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=67d092f902fb4ebf810dc3d488170120)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.264187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.265810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.266106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.266385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.302898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:36.304690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.316942 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2926/5842] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:36 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/67d092f902fb4ebf810dc3d488170120 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:36.317923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.336759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dc847-d15f-413f-b2aa-2c92fd7b4db6 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.337951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2917/5843] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:36.342476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.347300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84657215f88c4a59b2951f27cd2e11a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46cf611fc617419288fdfe2f6c1ccfd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.348619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.348619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.348619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/55e6a097a25d4b4d9b70a7fd9925bc3e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.357615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1b8d6-0bb6-4367-bfd8-b104334d4393 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.368597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.369924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.369924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.370152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.371265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorizing `identity:delete_application_credential(user_id=84657215f88c4a59b2951f27cd2e11a3, application_credential_id=55e6a097a25d4b4d9b70a7fd9925bc3e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.377459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:36.378454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.378970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.383602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.407596 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2918/5844] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:51:36.416759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.438187 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2927/5845] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:51:36 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3/application_credentials/55e6a097a25d4b4d9b70a7fd9925bc3e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:36.443831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.449563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.454774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd22485-c7a0-402e-ae32-d0a928e375a7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.470257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04d55f-4d88-4754-a4a4-6b38d71e4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.470940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04d55f-4d88-4754-a4a4-6b38d71e4b54 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.471221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04d55f-4d88-4754-a4a4-6b38d71e4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.471501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04d55f-4d88-4754-a4a4-6b38d71e4b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.472526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04d55f-4d88-4754-a4a4-6b38d71e4b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.478225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04d55f-4d88-4754-a4a4-6b38d71e4b54 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.486224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682d55d-ed6a-4f70-a2df-f56914e78238 tempest-ApplicationCredentialsV3Test-1802567007 tempest-ApplicationCredentialsV3Test-1802567007-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.492198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.493470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.493755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.494035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] PATH_INFO: `/v3/users/84657215f88c4a59b2951f27cd2e11a3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.495469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84657215f88c4a59b2951f27cd2e11a3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.497585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.578653 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2919/5846] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:36 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:36.580392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c440817-8cb4-4187-b865-81f6bc307d3b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.580686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c440817-8cb4-4187-b865-81f6bc307d3b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.581055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c440817-8cb4-4187-b865-81f6bc307d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.610329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5c440817-8cb4-4187-b865-81f6bc307d3b None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:36.611562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5c440817-8cb4-4187-b865-81f6bc307d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.620068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84657215f88c4a59b2951f27cd2e11a3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.625838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:36.670195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84657215f88c4a59b2951f27cd2e11a3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.672320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84657215f88c4a59b2951f27cd2e11a3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.689165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84657215f88c4a59b2951f27cd2e11a3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.690523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84657215f88c4a59b2951f27cd2e11a3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:36.708101 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2928/5847] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:36 2022] DELETE /identity/v3/users/84657215f88c4a59b2951f27cd2e11a3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:36.709367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.712264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.751154 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2920/5848] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:36.753001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.753377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.753755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.790791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:36.795459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.805622 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2921/5849] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:36.816726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613b85-fdf4-43cd-a438-7fd11eb67a5f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.822767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.824251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.831010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.832190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.832551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.832844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:36.834021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:36.838901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:36.883007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:36.894521 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2929/5850] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:36 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:36.895513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:36.901370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:36.953109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8376c-7fda-4b98-830b-bdebca088263 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:36.958860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:36.959995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:36.959995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:36.959995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.004132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89696ac5-27b5-4388-a94a-27e8650c03be admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:37.010717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:37.012263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:37.012625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:37.013787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.043066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:37.044026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:37.045368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:37.046450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:37.064381 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2930/5851] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:37.064583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2922/5852] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:51:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:51:37.073953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:37.087169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e5e2-1c82-4592-9416-cc8a1f1260f6 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:37.094329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:37.095080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:37.095464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:37.095857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.096793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:37.099014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:37.124381 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2931/5853] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:37.128534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:37.146219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b996901-b4c0-4ad9-bf06-4bae21aeacd0 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:37.157976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac9b40-e897-4969-b3cb-ee2de207e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:37.159429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9b40-e897-4969-b3cb-ee2de207e238 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:37.159429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9b40-e897-4969-b3cb-ee2de207e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:37.159429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9b40-e897-4969-b3cb-ee2de207e238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.159848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9b40-e897-4969-b3cb-ee2de207e238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:37.161466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac9b40-e897-4969-b3cb-ee2de207e238 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:37.180484 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2923/5854] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:37.184727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:37.198342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94419c4d-a2d2-4023-85ab-d3e6402f73d2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:37.224649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:37.225440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:37.225667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:37.226400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] PATH_INFO: `/v3/projects/5160c21a40184c2eb544cdfe7d9c6e49/users/4a7a6f789e254ee18f45a9017a92c200/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.249886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5160c21a40184c2eb544cdfe7d9c6e49, user_id=4a7a6f789e254ee18f45a9017a92c200, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:37.252970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:37.277917 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2932/5855] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:37 2022] PUT /identity/v3/projects/5160c21a40184c2eb544cdfe7d9c6e49/users/4a7a6f789e254ee18f45a9017a92c200/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:37.294272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:37.294913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:37.295456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.358727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] MFA Rules not processed for user `4a7a6f789e254ee18f45a9017a92c200`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:37.380569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:37.419155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:37.512985 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2924/5856] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:37.526966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:37.529192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:37.687121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2179e6b-d00b-4dce-9ea9-0ca09d7e7a16 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:37.700272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb4b3a-e47c-4766-89f2-e85828509ab5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:37.701213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4b3a-e47c-4766-89f2-e85828509ab5 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:37.703421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4b3a-e47c-4766-89f2-e85828509ab5 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:37.703894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb4b3a-e47c-4766-89f2-e85828509ab5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:37.728269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb4b3a-e47c-4766-89f2-e85828509ab5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:37.729799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb4b3a-e47c-4766-89f2-e85828509ab5 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:37.753475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2933/5857] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:38.864114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:38.866050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:39.035192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907330a7-54f1-418b-ae2f-d497ad57d867 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:39.044404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:39.044404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:39.044404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:39.044404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] PATH_INFO: `/v3/projects/46cf611fc617419288fdfe2f6c1ccfd6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:39.046915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cf611fc617419288fdfe2f6c1ccfd6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:39.049076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:39.262607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cf611fc617419288fdfe2f6c1ccfd6', 'request_id': 'req-20f32f79-b2f8-420d-a85a-7fc50816a9e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:39.294511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cf611fc617419288fdfe2f6c1ccfd6', 'request_id': 'req-20f32f79-b2f8-420d-a85a-7fc50816a9e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:39.312525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cf611fc617419288fdfe2f6c1ccfd6', 'request_id': 'req-20f32f79-b2f8-420d-a85a-7fc50816a9e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:39.346550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] The token cache is being invalidate because project 46cf611fc617419288fdfe2f6c1ccfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:39.347129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:39.352164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20f32f79-b2f8-420d-a85a-7fc50816a9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:39.356509 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2925/5858] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:38 2022] DELETE /identity/v3/projects/46cf611fc617419288fdfe2f6c1ccfd6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:39.363262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:39.363812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:39.364861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:39.478859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:39.486384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:39.686739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:39.716486 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2934/5859] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:39.724519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:39.724896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:39.725359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:39.762418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:39.763833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:39.799487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:39.801455 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2926/5860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:39.817466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103716b-dede-4d88-a0ff-c138bdcf55fa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:39.841860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:39.842691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:39.843043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:39.843397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:39.844131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:39.844503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:39.848450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:39.885407 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2935/5861] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:51:39.889544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:39.889747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:39.890962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:39.915155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d7ccd-6032-47dd-aa1d-4ec4e5010d14 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:39.936388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:39.937130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:39.937991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:39.938986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:39.940437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:39.949559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:40.026218 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2936/5862] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:39 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:40.030431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:40.032795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:40.173741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e843b6-c8ad-4ad7-a40d-2e80d6bc391e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:40.242804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ebf90-bc76-4e33-a413-1c3d509f62ed admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:40.259719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:40.261187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:40.261473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:40.261754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:40.263208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:40.269000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:40.308132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:40.311051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:40.311663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:40.313377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:40.318377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:40.333191 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2937/5863] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:40 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:40.334596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:40.357250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:40.360609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:40.375385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4920a-4187-45c4-bb0f-084a7d6fa8cb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:40.391411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:40.392150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:40.392327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:40.392581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:40.392981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2927/5864] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:40.395962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:40.397698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:40.430453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2938/5865] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:40.434677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:40.446832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f1232-ca4e-42f0-9d7f-3a638dbc280b service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:40.458352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4d67a-ebbd-47b8-9b53-6b1ee638f1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:40.458982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d67a-ebbd-47b8-9b53-6b1ee638f1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:40.459269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d67a-ebbd-47b8-9b53-6b1ee638f1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:40.459550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4d67a-ebbd-47b8-9b53-6b1ee638f1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:40.460231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4d67a-ebbd-47b8-9b53-6b1ee638f1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:40.462094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4d67a-ebbd-47b8-9b53-6b1ee638f1e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:40.493055 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2928/5866] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:40.497370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:40.514382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b969d1-f8df-4de6-99ab-d0f6c7cb321f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:40.539525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:40.540740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:40.542622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:40.542916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] PATH_INFO: `/v3/projects/2b0ab7460286441bb43cd2ac0a2ea5fc/users/959b42436ee443d4a04c32133406055d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:40.584780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0ab7460286441bb43cd2ac0a2ea5fc, user_id=959b42436ee443d4a04c32133406055d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:40.587435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:40.624037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2939/5867] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:40 2022] PUT /identity/v3/projects/2b0ab7460286441bb43cd2ac0a2ea5fc/users/959b42436ee443d4a04c32133406055d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:40.635287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:40.635892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:40.636344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:40.734625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] MFA Rules not processed for user `959b42436ee443d4a04c32133406055d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:40.741967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:40.979823 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2929/5868] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:40.984735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:41.003181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991ae1f-41e8-4ca1-8ab7-4b9f116199d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:41.016602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d81952-7529-46a0-8918-6db4987d099b tempest-DefaultDomainTestJSON-990948093 tempest-DefaultDomainTestJSON-990948093-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '959b42436ee443d4a04c32133406055d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0ab7460286441bb43cd2ac0a2ea5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:41.017287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81952-7529-46a0-8918-6db4987d099b tempest-DefaultDomainTestJSON-990948093 tempest-DefaultDomainTestJSON-990948093-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:41.017571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81952-7529-46a0-8918-6db4987d099b tempest-DefaultDomainTestJSON-990948093 tempest-DefaultDomainTestJSON-990948093-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:41.017851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d81952-7529-46a0-8918-6db4987d099b tempest-DefaultDomainTestJSON-990948093 tempest-DefaultDomainTestJSON-990948093-project] PATH_INFO: `/v3/domains/default` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:41.021918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81952-7529-46a0-8918-6db4987d099b tempest-DefaultDomainTestJSON-990948093 tempest-DefaultDomainTestJSON-990948093-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:41.024081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d81952-7529-46a0-8918-6db4987d099b tempest-DefaultDomainTestJSON-990948093 tempest-DefaultDomainTestJSON-990948093-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:41.032095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:41.055563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2940/5869] 10.222.0.16 () {58 vars in 1152 bytes} [Wed Oct 5 02:51:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:51:41.162295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:41.233889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1df72-dd1f-4413-9e6b-9a6529706aee None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:41.254103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:41.254772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:41.255054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:41.255329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] PATH_INFO: `/v3/users/959b42436ee443d4a04c32133406055d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:41.259240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959b42436ee443d4a04c32133406055d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:41.275160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:41.308535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:41.308859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:41.309361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:41.410908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:41.418094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:41.528638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959b42436ee443d4a04c32133406055d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:41.607760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959b42436ee443d4a04c32133406055d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:41.612708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959b42436ee443d4a04c32133406055d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:41.682809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959b42436ee443d4a04c32133406055d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:41.683647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-67c3ce61-375a-4637-a8a7-aab9a48a94d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959b42436ee443d4a04c32133406055d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:41.764781 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2930/5870] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:41 2022] DELETE /identity/v3/users/959b42436ee443d4a04c32133406055d => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:41.766338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:41.766889 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2941/5871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:41.775553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:41.776487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:41.829502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:41.835975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:42.151773 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2931/5872] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:42.170905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:42.173085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:42.232533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:42.367143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0e4cb-3bc0-4a0b-96dc-f8354b5ee1bc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:42.556684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1f232-9efc-4f10-8e80-b1beb7cce2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:42.557664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f232-9efc-4f10-8e80-b1beb7cce2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:42.558162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f232-9efc-4f10-8e80-b1beb7cce2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:42.558162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1f232-9efc-4f10-8e80-b1beb7cce2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:42.594705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1f232-9efc-4f10-8e80-b1beb7cce2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:42.598084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1f232-9efc-4f10-8e80-b1beb7cce2c7 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:42.633405 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2942/5873] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:44.172384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:44.175236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:44.198613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008695fe-d399-4baf-b431-1bf6489fc07d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:44.241193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:44.243482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:44.243924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:44.244394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] PATH_INFO: `/v3/projects/2b0ab7460286441bb43cd2ac0a2ea5fc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:44.246188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0ab7460286441bb43cd2ac0a2ea5fc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:44.253682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:44.411864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0ab7460286441bb43cd2ac0a2ea5fc', 'request_id': 'req-3fb99c46-bd53-4097-979d-047fee1bdc2a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:44.439738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0ab7460286441bb43cd2ac0a2ea5fc', 'request_id': 'req-3fb99c46-bd53-4097-979d-047fee1bdc2a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:44.443433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:44.452525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0ab7460286441bb43cd2ac0a2ea5fc', 'request_id': 'req-3fb99c46-bd53-4097-979d-047fee1bdc2a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:44.483291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] The token cache is being invalidate because project 2b0ab7460286441bb43cd2ac0a2ea5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:44.486557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:44.487769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fb99c46-bd53-4097-979d-047fee1bdc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:44.493828 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2932/5874] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:44 2022] DELETE /identity/v3/projects/2b0ab7460286441bb43cd2ac0a2ea5fc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:44.500272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:44.500786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:44.501350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:44.579192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:44.581473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:44.789084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2943/5875] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:44.798749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:44.799141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:44.799370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:44.846463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:44.853611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:44.886252 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2933/5876] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:44.887620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:44.914410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbada5-5543-4d26-a9c4-08b93ae4198e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:44.925039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:44.925982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:44.927013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:44.927542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:44.929179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:44.943952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:44.951245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:45.026205 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2944/5877] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:45.030062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:45.057805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5669-08b8-4652-83a6-9cfe8c29254d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:45.070066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:45.070725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:45.071096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:45.071260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:45.073382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:45.073981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:45.159886 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2934/5878] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:45 2022] POST /identity/v3/projects => generated 359 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:45.163828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:45.186035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c1bd9-da23-4bfa-95e0-98c5cbb6be6a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:45.475697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:45.505062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:45.506885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:45.509897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:45.510215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:45.510923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:45.513708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:45.593272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:45.594029 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2945/5879] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:45 2022] POST /identity/v3/users => generated 280 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:45.615336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7a84-206f-4428-bb63-91e818da16cb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:45.658147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:45.665396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:45.670455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:45.670760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:45.671496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:45.682990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:45.718682 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2935/5880] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:51:45.723056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:45.753523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2edd68-c56d-4405-9f2e-2d9bf76e5f57 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:45.772143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164251b4-26b2-4d87-ba6b-51d98ee70a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:45.778436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164251b4-26b2-4d87-ba6b-51d98ee70a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:45.778804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164251b4-26b2-4d87-ba6b-51d98ee70a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:45.779084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164251b4-26b2-4d87-ba6b-51d98ee70a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:45.785756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164251b4-26b2-4d87-ba6b-51d98ee70a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:45.794932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164251b4-26b2-4d87-ba6b-51d98ee70a85 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:45.838237 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2946/5881] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:45.839424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:45.852533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc6ea6-6ea7-4175-b221-32f208695ae8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:45.868082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbf708-f2f9-4985-bd53-c5537cccbe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:45.868761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbf708-f2f9-4985-bd53-c5537cccbe5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:45.869077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbf708-f2f9-4985-bd53-c5537cccbe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:45.869361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbf708-f2f9-4985-bd53-c5537cccbe5d admin admin] PATH_INFO: `/v3/projects/d368049a04b5498a8aa82a3c3841910f/users/dea2ecc393694f73b29dc66921a811c6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:45.905232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbf708-f2f9-4985-bd53-c5537cccbe5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d368049a04b5498a8aa82a3c3841910f, user_id=dea2ecc393694f73b29dc66921a811c6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:45.911095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbf708-f2f9-4985-bd53-c5537cccbe5d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:45.939847 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2936/5882] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:45 2022] PUT /identity/v3/projects/d368049a04b5498a8aa82a3c3841910f/users/dea2ecc393694f73b29dc66921a811c6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:45.951351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:45.951943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:45.952553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:46.003825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:46.004132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:46.004391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:46.023970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] MFA Rules not processed for user `dea2ecc393694f73b29dc66921a811c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:46.026697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:46.074520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] MFA Rules not processed for user `f23b56d519224b22802f978442c7289f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:46.075984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:46.232745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2947/5883] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:46.242553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:46.262776 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2937/5884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:46.265806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:46.268490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:46.395723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b62c7-1950-4c3a-9c99-e4434c6455dc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:46.408402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:46.410088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:46.410775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:46.411030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] PATH_INFO: `/v3/users/dea2ecc393694f73b29dc66921a811c6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:46.412510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea2ecc393694f73b29dc66921a811c6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:46.416282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:46.463826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46ad85-cef7-4d6e-90ff-a9e54611bf22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:46.473941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:46.475542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:46.477444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:46.477965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:46.479357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:46.482513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:46.518828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:46.544727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea2ecc393694f73b29dc66921a811c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:46.553675 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2938/5885] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:46 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:46.555202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:46.576172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea2ecc393694f73b29dc66921a811c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:46.577943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea2ecc393694f73b29dc66921a811c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:46.587813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:46.619300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea2ecc393694f73b29dc66921a811c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:46.620424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1090bc76-3ba4-410b-a266-6ddb2f5c9512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea2ecc393694f73b29dc66921a811c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:46.700328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2948/5886] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:51:46 2022] DELETE /identity/v3/users/dea2ecc393694f73b29dc66921a811c6 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:46.703691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:46.704868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:46.705190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:46.775886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c5cf8-637a-424f-a60b-c8cb12c3325c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:46.776397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:46.777728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:46.942142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:46.943125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:46.943620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:46.944195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:46.946251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:46.951359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2949/5887] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:51:46.954198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:46.969019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:46.970906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:47.000258 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2939/5888] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:46 2022] POST /identity/v3/users => generated 293 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:47.004737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:47.008994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:47.023956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f1dc-fd3d-4fe3-ba2b-1d18163bced8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:47.059252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:47.079398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:47.089325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:47.090594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:47.119599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:47.126505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:47.140298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f780-13a3-4772-9b0e-023266fe3bab None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:47.151745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:47.152947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:47.153845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:47.156249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:47.161799 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2940/5889] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:47.168576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:47.196535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:47.199224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:47.218859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87016ea5-be8a-4075-99e9-f9f3093e26e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:47.252140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:47.259579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:47.259926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:47.260162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] PATH_INFO: `/v3/projects/126daf070e3e43478d08a02f39e6abda/users/81392d1632f64d5f90cd9cd0836110f1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:47.278048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2950/5890] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:51:47.356528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=126daf070e3e43478d08a02f39e6abda, user_id=81392d1632f64d5f90cd9cd0836110f1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:47.358897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:47.439607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2941/5891] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:47 2022] PUT /identity/v3/projects/126daf070e3e43478d08a02f39e6abda/users/81392d1632f64d5f90cd9cd0836110f1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:47.440288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:47.452844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0260c9e-af73-4dd9-90f8-8a6908085000 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:47.708326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:47.709748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:47.710050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:47.712129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:47.712821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:47.714617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:47.740265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2951/5892] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:47.742828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:47.762960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8e015-6e91-411f-9b55-6fc26a713dc8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:47.776824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25838a19-90f3-4f25-9c11-ad4ae45cd7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:47.777587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838a19-90f3-4f25-9c11-ad4ae45cd7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:47.777962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838a19-90f3-4f25-9c11-ad4ae45cd7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:47.778329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25838a19-90f3-4f25-9c11-ad4ae45cd7ae admin admin] PATH_INFO: `/v3/projects/126daf070e3e43478d08a02f39e6abda/users/81392d1632f64d5f90cd9cd0836110f1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:47.781789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25838a19-90f3-4f25-9c11-ad4ae45cd7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=126daf070e3e43478d08a02f39e6abda, user_id=81392d1632f64d5f90cd9cd0836110f1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:47.788314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25838a19-90f3-4f25-9c11-ad4ae45cd7ae admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:47.821410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2942/5893] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:47 2022] PUT /identity/v3/projects/126daf070e3e43478d08a02f39e6abda/users/81392d1632f64d5f90cd9cd0836110f1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:47.880982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:47.885665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:47.921489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e87c2-5b10-4d69-abf3-ec42a8ca54f8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:48.007808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:48.168293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:48.168999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.171337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.174094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] PATH_INFO: `/v3/projects/d368049a04b5498a8aa82a3c3841910f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.176645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d368049a04b5498a8aa82a3c3841910f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:48.181798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:48.315949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd368049a04b5498a8aa82a3c3841910f', 'request_id': 'req-d5d8cd42-1530-4e4f-ae85-723c159dcadf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:48.322822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd368049a04b5498a8aa82a3c3841910f', 'request_id': 'req-d5d8cd42-1530-4e4f-ae85-723c159dcadf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:48.331632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd368049a04b5498a8aa82a3c3841910f', 'request_id': 'req-d5d8cd42-1530-4e4f-ae85-723c159dcadf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:48.364675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] The token cache is being invalidate because project d368049a04b5498a8aa82a3c3841910f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:51:48.365036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:48.365660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5d8cd42-1530-4e4f-ae85-723c159dcadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:51:48.368395 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2952/5894] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:51:47 2022] DELETE /identity/v3/projects/d368049a04b5498a8aa82a3c3841910f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:48.373977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.375243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.375546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.416684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:48.418864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:48.493121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:48.524729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2943/5895] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:48.531965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.532420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.532796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.570075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:48.573332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:48.591549 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2953/5896] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:48.596080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:48.608351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9604b2-d05f-4a7c-b94b-35ed3e78e029 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:48.625810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:48.625810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.625810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.625810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.627111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:51:48.628956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:48.631338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:48.671035 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2944/5897] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:51:48.672704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:48.692467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c55132-e2fe-455f-88bd-e56963182d50 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:48.711229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:48.711909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.712149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.712392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.713088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:48.715008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:48.764473 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2954/5898] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:48 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:48.768570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:48.782321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ed1ff-9631-44ed-8340-7a9ec25ed3a6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:48.890626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:48.891529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.891817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.892099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.892734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:48.894689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:48.920721 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2945/5899] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:48 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:48.924570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:48.935867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad2fa2-e3c9-44d6-8703-68974f910541 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:48.946479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:48.949025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:48.950552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:48.950945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:48.951743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:48.955697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:48.985996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2955/5900] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:48.986424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:48.998032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e246db5-29fb-4930-96d6-4bc589d1ab13 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.014905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59a22b-1775-4f76-b731-ddcec153bc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.016625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a22b-1775-4f76-b731-ddcec153bc00 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.017288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a22b-1775-4f76-b731-ddcec153bc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.018057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59a22b-1775-4f76-b731-ddcec153bc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.019456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59a22b-1775-4f76-b731-ddcec153bc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.024804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59a22b-1775-4f76-b731-ddcec153bc00 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:49.053263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.065811 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2946/5901] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:51:49.068621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6c3ab-95a6-4bed-a51a-a2de4cf54ab9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.080113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.085795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.086465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.086854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] PATH_INFO: `/v3/projects/3b9aa0bd477e49fd9120cfb881b95c1e/users/5216a4ba597f4516b94edba99930c130/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.109495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9aa0bd477e49fd9120cfb881b95c1e, user_id=5216a4ba597f4516b94edba99930c130, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.113315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:49.156402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.156402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.156747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.160822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2956/5902] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:49 2022] PUT /identity/v3/projects/3b9aa0bd477e49fd9120cfb881b95c1e/users/5216a4ba597f4516b94edba99930c130/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:49.201062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] MFA Rules not processed for user `5216a4ba597f4516b94edba99930c130`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:49.202679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:49.329217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.344153 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2947/5903] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:49.399628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:49.414481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c70e-e2df-4fab-b1c9-ee5d98e65f24 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.422094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.422928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.423380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.423738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.425625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.428122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:49.474090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.495588 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2957/5904] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:49 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:51:49.506306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612bcab-75f3-4000-a3f1-e8d2f73fa397 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.595934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:49.667811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.668460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.668736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.669038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.681444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.683563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:49.723371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2948/5905] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:49 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:49.724884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.751034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d87b9-c271-42de-89f2-541ec988daf7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.763128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.764039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.765645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.766094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.768213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.771348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:49.830190 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2958/5906] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:49.830813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.843025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a6e2-0123-4a91-8795-047435a0afaf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.848253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.848875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.849201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.849482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.850129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.852665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:49.868009 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2949/5907] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:51:49.869626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.881735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cf0de-acbc-4515-92cd-aa5f36e13a0e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:49.894031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:49.897266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:49.904117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a707bfe-16f1-48db-85cc-5013d78e647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:49.904795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a707bfe-16f1-48db-85cc-5013d78e647e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:49.906199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a707bfe-16f1-48db-85cc-5013d78e647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:49.906485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a707bfe-16f1-48db-85cc-5013d78e647e admin admin] PATH_INFO: `/v3/projects/74c652fc644e4ed09e1a401ffb353d27/users/b455d320a1d0495b89815328ef164460/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:49.974910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a707bfe-16f1-48db-85cc-5013d78e647e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c652fc644e4ed09e1a401ffb353d27, user_id=b455d320a1d0495b89815328ef164460, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:49.979890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a707bfe-16f1-48db-85cc-5013d78e647e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:50.017680 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2959/5908] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:49 2022] PUT /identity/v3/projects/74c652fc644e4ed09e1a401ffb353d27/users/b455d320a1d0495b89815328ef164460/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:51:50.027935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:50.028113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:50.028329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:50.105032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c698db-a2a6-48fb-8288-80aca9f9feec admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:50.124681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] MFA Rules not processed for user `b455d320a1d0495b89815328ef164460`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:50.126648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:50.223330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:50.223906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:50.224188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:50.224461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:50.227987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:50.342002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2960/5909] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:50.342002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:50.370162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255077a-b171-49e9-82c6-0300a56abec1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:50.380980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:50.382793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:50.385949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:50.386509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:50.389138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:50.433245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:50.437126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:50.495848 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2950/5910] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:50.496840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:50.537080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:50.660433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:50.682081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:50.743874 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2961/5911] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:50.747866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dc1fa-0073-4c25-82fa-12ed7acc1b2a service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:50.779911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:50.780563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:50.780850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:50.786009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:50.786876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:50.797787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:50.889641 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2951/5912] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:51:50 2022] POST /identity/v3/projects => generated 381 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:50.893434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:50.916739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfba6f-b3a4-4c54-b4ec-28a284818f8b service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:50.958372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:51.100220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:51.101327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:51.101679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:51.102099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:51.102861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:51.107085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:51.180836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2962/5913] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:51:50 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:51:51.183108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:51.199401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5c432-3b74-41c7-adb7-8d34be150763 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:51.214179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:51.214817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:51.215608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:51.215900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:51.217053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:51.218673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:51.243971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2952/5914] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:51.245112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:51.261967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09111731-32af-4e52-8c19-6a3bb4839d44 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:51.273308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:51.274179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:51.274465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:51.274743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] PATH_INFO: `/v3/projects/2a34cfbdc71c4729bd685b62ab38f05b/users/1b8f76c352c34eea81589547a84a5e44/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:51.311237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a34cfbdc71c4729bd685b62ab38f05b, user_id=1b8f76c352c34eea81589547a84a5e44, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:51.315239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:51.354483 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2963/5915] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:51 2022] PUT /identity/v3/projects/2a34cfbdc71c4729bd685b62ab38f05b/users/1b8f76c352c34eea81589547a84a5e44/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:51.355861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:51.373153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398f76d-88c7-4d89-97cd-5a4def97177e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:51.551842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784eb62-7559-4274-82b4-acbc35918131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:51.555198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784eb62-7559-4274-82b4-acbc35918131 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:51.556290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784eb62-7559-4274-82b4-acbc35918131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:51.557393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784eb62-7559-4274-82b4-acbc35918131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:51.558991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784eb62-7559-4274-82b4-acbc35918131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:51.563108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784eb62-7559-4274-82b4-acbc35918131 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:51.589727 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2953/5916] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:51:51.593134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:51.611620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ff99f-d575-4903-b8d3-c444a1d18510 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:51.626881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:51.629478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:51.630406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:51.630781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] PATH_INFO: `/v3/projects/2a34cfbdc71c4729bd685b62ab38f05b/users/1b8f76c352c34eea81589547a84a5e44/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:51.636635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a34cfbdc71c4729bd685b62ab38f05b, user_id=1b8f76c352c34eea81589547a84a5e44, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:51.640494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:51.697547 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2964/5917] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:51:51 2022] PUT /identity/v3/projects/2a34cfbdc71c4729bd685b62ab38f05b/users/1b8f76c352c34eea81589547a84a5e44/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:51:51.708837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4160-48ba-4043-856f-1af49b5ae594 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:51.709322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4160-48ba-4043-856f-1af49b5ae594 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:51.709777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4160-48ba-4043-856f-1af49b5ae594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:51.813843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b36e4160-48ba-4043-856f-1af49b5ae594 None None] MFA Rules not processed for user `1b8f76c352c34eea81589547a84a5e44`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:51.815807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b36e4160-48ba-4043-856f-1af49b5ae594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:51.979974 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2954/5918] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:51:52.063263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:51:52.190217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fde470-b917-430b-9ea5-e7d20f76eb36 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:51:52.195577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:51:52.196659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:52.197156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:52.197798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:52.271212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:51:52.272887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:51:52.286593 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2965/5919] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:51:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:51:58.509050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fe40e-36de-46e3-829d-c2f62bc010dc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:51:58.509596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fe40e-36de-46e3-829d-c2f62bc010dc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:51:58.509596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fe40e-36de-46e3-829d-c2f62bc010dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:51:58.550574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:51:58.633777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-126fe40e-36de-46e3-829d-c2f62bc010dc None None] MFA Rules not processed for user `81392d1632f64d5f90cd9cd0836110f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:51:58.639941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-126fe40e-36de-46e3-829d-c2f62bc010dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:51:58.890146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2955/5920] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:00.486977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:00.489304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:00.527453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:00.594296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80fba7-5a2b-428a-95fc-ab0c4cc9a0c0 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:00.601344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:00.602089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:00.602378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:00.602660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:00.604815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:00.744316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:00.747900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:00.769186 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2966/5921] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:06.628490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:06.628490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:06.629140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:06.711381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] MFA Rules not processed for user `f23b56d519224b22802f978442c7289f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:06.713307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:06.734803 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2956/5922] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:10.759874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=46 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:12.383840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:12.403203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3a1e-6fbe-4f8b-8afa-5ad59741060d service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:12.420402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:12.423687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:12.424016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:12.427009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:12.435486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:12.470943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:12.472424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:12.502044 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2967/5923] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:13.540617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:13.542219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:13.567118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ebb37-9763-49ff-a922-dcf09d71db03 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:13.571882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:13.572748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:13.573186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:13.575593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:13.577644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:13.690582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:13.692293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:13.708799 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2957/5924] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:52:16.720004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:16.741997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2ce3d-021c-4a3d-b064-86e0b0e631bd service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:16.758245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a6b3-0452-4892-91d5-adc937a36c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:16.762658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a6b3-0452-4892-91d5-adc937a36c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:16.763348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a6b3-0452-4892-91d5-adc937a36c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:16.763729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a6b3-0452-4892-91d5-adc937a36c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:16.791456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0a6b3-0452-4892-91d5-adc937a36c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:16.793071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0a6b3-0452-4892-91d5-adc937a36c1f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:16.842065 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2968/5925] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:20.724661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:20.738247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e7bc-ba02-4587-9c5b-50ef8be217f8 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:20.749958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:20.750853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:20.757836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:20.758469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:20.760710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:20.780867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:20.783374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:20.799107 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2958/5926] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:21.438377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:21.439302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:21.439772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:21.475917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:21.488912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:21.575908 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2969/5927] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:22.002902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:22.004386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:22.032135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c4bd-3d55-45e4-9d1e-9c0cd19ed226 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:22.040184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:22.040836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:22.041151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:22.041421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] PATH_INFO: `/v3/users/728544ca5e164540b3c5395534542955` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:22.045273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=728544ca5e164540b3c5395534542955)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:22.050067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:22.137352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728544ca5e164540b3c5395534542955'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:22.145840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:22.153493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728544ca5e164540b3c5395534542955'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:22.154500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728544ca5e164540b3c5395534542955'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:22.169152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728544ca5e164540b3c5395534542955'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:22.170103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0f333e80-65a8-4d37-95a0-e8c87813f6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728544ca5e164540b3c5395534542955'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:22.200370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2959/5928] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:52:22 2022] DELETE /identity/v3/users/728544ca5e164540b3c5395534542955 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:22.716910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:22.739318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5df0f-40f0-42de-9b1c-d70287759a3c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:22.882581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:22.883587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:22.884045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:22.884502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] PATH_INFO: `/v3/projects/1ff63adf9571439d8f8bf9b0fa6c63f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:22.889653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff63adf9571439d8f8bf9b0fa6c63f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:22.893743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:23.011462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'request_id': 'req-66690bec-245a-4b84-a7d9-e381431a139b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:23.029028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'request_id': 'req-66690bec-245a-4b84-a7d9-e381431a139b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:23.049861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff63adf9571439d8f8bf9b0fa6c63f9', 'request_id': 'req-66690bec-245a-4b84-a7d9-e381431a139b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:23.072708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] The token cache is being invalidate because project 1ff63adf9571439d8f8bf9b0fa6c63f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:52:23.073294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:23.074146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-66690bec-245a-4b84-a7d9-e381431a139b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:23.076124 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2970/5929] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:52:22 2022] DELETE /identity/v3/projects/1ff63adf9571439d8f8bf9b0fa6c63f9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:23.081231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.081728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.081846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.117216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:23.118467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:23.235617 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2960/5930] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:23.244421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.247656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.247656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.278196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:23.280056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:23.292748 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2971/5931] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:23.297173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:23.315347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191ee30-5722-4699-a4cd-af7a76de8f73 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:23.322602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:23.329494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.330012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.341022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.342199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:52:23.344329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:23.348591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:23.380804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2961/5932] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:52:23.385645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:23.391120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:23.407822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc49c78-1033-416b-9980-7b620e10a88a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:23.418065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:23.420024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.421220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.429388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.430579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:23.432931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:23.504991 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2972/5933] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:52:23 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:52:23.507154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:23.531073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e20b-6c44-4f20-b52e-bf283bb610aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:23.717101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:23.717822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.719354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.719712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.721806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:23.727571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:23.783830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2962/5934] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:52:23 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:52:23.788678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:23.804267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851e3eb-6142-4bcf-87dd-6dbedc6096e4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:23.817212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:23.817941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.818295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.820094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.822723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:23.828565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:23.854248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:23.868048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2973/5935] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:52:23.871083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24ebd-df77-47d0-90a3-c7401d3f48a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:23.884792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6b612-8cd8-428d-adee-ca4cdd9b26f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:23.885743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b612-8cd8-428d-adee-ca4cdd9b26f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.886130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b612-8cd8-428d-adee-ca4cdd9b26f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.886509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6b612-8cd8-428d-adee-ca4cdd9b26f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:23.888118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6b612-8cd8-428d-adee-ca4cdd9b26f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:23.893616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6b612-8cd8-428d-adee-ca4cdd9b26f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:23.928309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2963/5936] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:52:23.932186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:23.948128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c4c57-1d65-4a04-ba08-bb06bc5928ed admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:23.963437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:23.964309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:23.964707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:23.965117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] PATH_INFO: `/v3/projects/4d7f0ec26e874f4291a8f93e864c9ca1/users/b3760004b7624b8fa6818650856ceaa5/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:24.004251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7f0ec26e874f4291a8f93e864c9ca1, user_id=b3760004b7624b8fa6818650856ceaa5, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:24.007403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:24.038162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2974/5937] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:52:23 2022] PUT /identity/v3/projects/4d7f0ec26e874f4291a8f93e864c9ca1/users/b3760004b7624b8fa6818650856ceaa5/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:52:24.043239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd6e3-9c3f-4244-a983-f015923acd9b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:24.043645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd6e3-9c3f-4244-a983-f015923acd9b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:24.044064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd6e3-9c3f-4244-a983-f015923acd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:24.075024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-47abd6e3-9c3f-4244-a983-f015923acd9b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:24.076925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-47abd6e3-9c3f-4244-a983-f015923acd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:24.161522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:24.223147 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2964/5938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:24.254190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:24.256175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:24.444116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5194-39d8-4342-921a-a16b7994fd0b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:24.453838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43198e4f-a9ad-43c1-af57-2ee7ba880a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:24.454730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43198e4f-a9ad-43c1-af57-2ee7ba880a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:24.455177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43198e4f-a9ad-43c1-af57-2ee7ba880a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:24.456022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43198e4f-a9ad-43c1-af57-2ee7ba880a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:24.479389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43198e4f-a9ad-43c1-af57-2ee7ba880a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:24.481242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43198e4f-a9ad-43c1-af57-2ee7ba880a8b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:24.534955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2975/5939] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:26.156828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85a464-56fa-44df-a8d7-47eb3fbd6544 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:26.157501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85a464-56fa-44df-a8d7-47eb3fbd6544 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:26.157501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85a464-56fa-44df-a8d7-47eb3fbd6544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:26.213375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ec85a464-56fa-44df-a8d7-47eb3fbd6544 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:26.218323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ec85a464-56fa-44df-a8d7-47eb3fbd6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:26.351741 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2965/5940] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:32.675868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb446-2eb4-4a23-b91c-49b9e934acf2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:32.677237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb446-2eb4-4a23-b91c-49b9e934acf2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:32.677707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb446-2eb4-4a23-b91c-49b9e934acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:32.729927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a4abb446-2eb4-4a23-b91c-49b9e934acf2 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:32.731182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a4abb446-2eb4-4a23-b91c-49b9e934acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:32.751230 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2976/5941] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:35.216889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:35.218099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:35.220011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:35.319037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:35.322504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:35.352760 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2966/5942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:35.546766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:35.547930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:35.548368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:35.595984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] MFA Rules not processed for user `b3760004b7624b8fa6818650856ceaa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:35.597478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:35.739905 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2977/5943] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:52:36.003207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:36.005880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:36.136987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0bcca-7d5a-44fd-948e-04c3d294a76a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:36.161624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357553ae-d716-40e8-bb1c-ce01ea6f2607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:36.165023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357553ae-d716-40e8-bb1c-ce01ea6f2607 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:36.165365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357553ae-d716-40e8-bb1c-ce01ea6f2607 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:36.165653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357553ae-d716-40e8-bb1c-ce01ea6f2607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:36.185137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357553ae-d716-40e8-bb1c-ce01ea6f2607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:36.186981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357553ae-d716-40e8-bb1c-ce01ea6f2607 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:36.234122 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2967/5944] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:37.786488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:37.801621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d419cf-cab6-4c33-952d-bf16ea829c26 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:37.817717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:37.818354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:37.819236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:37.819529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:37.821916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:37.889189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:37.896611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:37.899383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:37.899967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:37.960374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:37.962985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:37.964895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b876a7c-62d8-4f70-9bac-240bb40f5e1d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:37.965398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:37.987697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2968/5945] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:52:38.005275 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2978/5946] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:38.283692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:38.304186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c456-4794-47b0-aaff-6073b588fda1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:38.319496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:38.320127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:38.320609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:38.321091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:38.331126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:38.460622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:38.463581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:38.465254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24511f67-53fc-45c4-b92b-96a7d82f4729 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:38.482744 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2969/5947] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:40.198996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:40.199422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:40.199535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:40.254663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:40.260879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:40.279156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2979/5948] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:42.889794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171d4e-68d8-453f-a34e-d83cb06ffca5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:42.891283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171d4e-68d8-453f-a34e-d83cb06ffca5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:42.891733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171d4e-68d8-453f-a34e-d83cb06ffca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:42.937349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-de171d4e-68d8-453f-a34e-d83cb06ffca5 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:42.938926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de171d4e-68d8-453f-a34e-d83cb06ffca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:42.949831 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2970/5949] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:43.281902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:43.283975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:43.324086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63b93-1ce7-4367-acdc-dc5dab26ec86 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:43.338740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:43.339844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:43.342738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:43.343383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] PATH_INFO: `/v3/users/4a7a6f789e254ee18f45a9017a92c200` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:43.344965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7a6f789e254ee18f45a9017a92c200)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:43.351417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:43.480771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7a6f789e254ee18f45a9017a92c200'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:43.519382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7a6f789e254ee18f45a9017a92c200'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:43.525562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7a6f789e254ee18f45a9017a92c200'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:43.542928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7a6f789e254ee18f45a9017a92c200'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:43.545704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7a6f789e254ee18f45a9017a92c200'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:43.575838 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2980/5950] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:52:43 2022] DELETE /identity/v3/users/4a7a6f789e254ee18f45a9017a92c200 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:43.577578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267aa96-09c4-47b5-804c-48e58f383bdb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:43.577893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267aa96-09c4-47b5-804c-48e58f383bdb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:43.578174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267aa96-09c4-47b5-804c-48e58f383bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:43.638086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0267aa96-09c4-47b5-804c-48e58f383bdb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:43.639338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0267aa96-09c4-47b5-804c-48e58f383bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:43.821739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2971/5951] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:43.878267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:43.880454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:44.224077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25951ed6-c07d-419f-8ea1-80eba1577005 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:44.248674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:44.250198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:44.250993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:44.251636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:44.291037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:44.294095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:44.330918 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2981/5952] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:44.926035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fab3b-b3f3-4c31-b52c-8d9305f8efcb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:44.928564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fab3b-b3f3-4c31-b52c-8d9305f8efcb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:44.928564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fab3b-b3f3-4c31-b52c-8d9305f8efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:44.954766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b72fab3b-b3f3-4c31-b52c-8d9305f8efcb None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:44.957564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b72fab3b-b3f3-4c31-b52c-8d9305f8efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:45.132829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2972/5953] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:46.808648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:46.810753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:46.831609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03a89c-e2cc-4d1e-aeaf-00a72ec709aa service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:46.841055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:46.842553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:46.843170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:46.843694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] PATH_INFO: `/v3/projects/5160c21a40184c2eb544cdfe7d9c6e49` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:46.845474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5160c21a40184c2eb544cdfe7d9c6e49)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:46.847927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:46.897771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:46.928731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5160c21a40184c2eb544cdfe7d9c6e49', 'request_id': 'req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:46.935992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5160c21a40184c2eb544cdfe7d9c6e49', 'request_id': 'req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:46.971844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5160c21a40184c2eb544cdfe7d9c6e49', 'request_id': 'req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:47.006658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] The token cache is being invalidate because project 5160c21a40184c2eb544cdfe7d9c6e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:52:47.009158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:47.010932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc2fb94a-4b02-4a3f-aae1-6776be20bb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:47.023277 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2982/5954] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:52:46 2022] DELETE /identity/v3/projects/5160c21a40184c2eb544cdfe7d9c6e49 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:47.028365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b405a-62b5-4d0f-9ac3-9871244e5e16 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.029386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b405a-62b5-4d0f-9ac3-9871244e5e16 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.029919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b405a-62b5-4d0f-9ac3-9871244e5e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.068300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-814b405a-62b5-4d0f-9ac3-9871244e5e16 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:47.076588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-814b405a-62b5-4d0f-9ac3-9871244e5e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:47.214897 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2973/5955] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:47.222767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.223298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.224250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.248656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.249269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.250110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.295128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:47.299477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:47.321413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:47.327327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:47.339773 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2983/5956] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:47.341383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:47.375090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517d60-3140-4e32-a38f-0102bd551458 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:47.399105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:47.400684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.401285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.401730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.402559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:52:47.403034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:47.405628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:47.433042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:47.436718 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2984/5957] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:52:47.441345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:47.463944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e8aa-bb5f-40ef-a98c-f9da2b6eff07 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:47.475065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:47.475697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.475978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.476255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.476931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:47.483713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:47.532141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2974/5958] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:52:47.559202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2985/5959] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:52:47 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:52:47.565410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:47.580997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32328af8-ee31-4f86-81d8-adc27d449796 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:47.713337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:47.714328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.714843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.715317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.716174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:47.720121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:47.758547 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2975/5960] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:52:47 2022] POST /identity/v3/users => generated 282 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:52:47.762642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:47.781518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da994e-264a-416a-9776-ffd19862dcef admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:47.789447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:47.789582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.790704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.791051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.792663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:47.794982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:47.813374 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2986/5961] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:52:47.816893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:47.830332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e43e-70dc-4d50-be08-0af4149c0032 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:47.841781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6a56a-0360-40ec-96a6-9cfab3a48114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:47.847617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a56a-0360-40ec-96a6-9cfab3a48114 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.848166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a56a-0360-40ec-96a6-9cfab3a48114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.848377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a56a-0360-40ec-96a6-9cfab3a48114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.849182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6a56a-0360-40ec-96a6-9cfab3a48114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:47.852285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6a56a-0360-40ec-96a6-9cfab3a48114 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:47.866304 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2976/5962] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:52:47.870477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:47.888367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599029a-8acc-4caf-a2b3-20a7ab5124d7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:47.906623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:47.909131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.909489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.909838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] PATH_INFO: `/v3/projects/bd4b1d4fa7c640aeb0431a81e17c05a8/users/07e5604982304b39a471def3152668ec/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:47.934843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4b1d4fa7c640aeb0431a81e17c05a8, user_id=07e5604982304b39a471def3152668ec, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:47.937981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:47.961871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2987/5963] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:52:47 2022] PUT /identity/v3/projects/bd4b1d4fa7c640aeb0431a81e17c05a8/users/07e5604982304b39a471def3152668ec/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:47.971791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:47.972080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:47.972736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:48.020398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:48.023708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:48.042334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] MFA Rules not processed for user `07e5604982304b39a471def3152668ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:48.045513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:48.125713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147bd24-f223-4595-b73e-fdc4bcffafa8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:48.133512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:48.134482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:48.135023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:48.135469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] PATH_INFO: `/v3/users/b3760004b7624b8fa6818650856ceaa5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:48.137198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3760004b7624b8fa6818650856ceaa5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:48.139824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:48.165317 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2977/5964] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:48.175821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:48.177141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:48.212858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:48.233726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3760004b7624b8fa6818650856ceaa5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.258036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:48.260008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3760004b7624b8fa6818650856ceaa5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.261198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3760004b7624b8fa6818650856ceaa5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.274820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3760004b7624b8fa6818650856ceaa5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.275565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3760004b7624b8fa6818650856ceaa5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.288677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b3dc3-d028-4168-bd5e-ea182bc2bd0b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:48.293257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:48.294158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:48.294408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:48.294775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:48.296648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:48.300516 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2988/5965] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:52:48 2022] DELETE /identity/v3/users/b3760004b7624b8fa6818650856ceaa5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:48.313545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:48.315121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc1a41-5a68-4b3a-ae36-fabc5e9c506a service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:48.337725 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2978/5966] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:52:48.542230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:48.543912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:48.682273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7621-3b97-495e-8273-f412c765c8d6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:48.688749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:48.690400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:48.690400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:48.690990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] PATH_INFO: `/v3/projects/4d7f0ec26e874f4291a8f93e864c9ca1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:48.693710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7f0ec26e874f4291a8f93e864c9ca1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:48.697028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:48.797656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7f0ec26e874f4291a8f93e864c9ca1', 'request_id': 'req-6f840418-c724-473f-9fab-f5412cc62f66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.805283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7f0ec26e874f4291a8f93e864c9ca1', 'request_id': 'req-6f840418-c724-473f-9fab-f5412cc62f66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.815722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7f0ec26e874f4291a8f93e864c9ca1', 'request_id': 'req-6f840418-c724-473f-9fab-f5412cc62f66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.851454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] The token cache is being invalidate because project 4d7f0ec26e874f4291a8f93e864c9ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:52:48.851765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.859487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f840418-c724-473f-9fab-f5412cc62f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:52:48.869918 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2989/5967] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:52:48 2022] DELETE /identity/v3/projects/4d7f0ec26e874f4291a8f93e864c9ca1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:48.871671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:48.871991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:48.872265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:48.910037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:48.911609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:49.010048 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2979/5968] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:49.011317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.011609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.011885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.033654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:49.035080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:49.047503 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2990/5969] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:52:49.054533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.073567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc4c2-fb92-478f-bdfb-92402335ef1a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.093944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.094577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.094855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.095127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.096293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:52:49.096607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.098256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.130577 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2980/5970] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:52:49.136317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.146236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ec3f6-c21c-4250-b19d-d5323e06f261 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.162694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.163415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.163690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.166147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.166985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.173943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.239151 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2991/5971] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:52:49 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:52:49.244227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.259138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61273076-cba4-4cbf-abd9-96cc42a72c14 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.394007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.394703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.394990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.395527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.396404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.401042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.453295 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2981/5972] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:52:49 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:52:49.457797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.472718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89fab0-b22f-4b03-af02-bc54216e478a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.487762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61264-6995-4633-a077-74189db69210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.488680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61264-6995-4633-a077-74189db69210 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.489178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61264-6995-4633-a077-74189db69210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.489648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61264-6995-4633-a077-74189db69210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.491270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61264-6995-4633-a077-74189db69210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.493342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b61264-6995-4633-a077-74189db69210 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.516852 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2992/5973] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:52:49.521135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.533109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa8e17-b84f-4ffa-99f5-772fa740c4c9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.538940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32eca-81e7-4513-aa14-2f80f5c63ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.539842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32eca-81e7-4513-aa14-2f80f5c63ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.540290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32eca-81e7-4513-aa14-2f80f5c63ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.540741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32eca-81e7-4513-aa14-2f80f5c63ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.541577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32eca-81e7-4513-aa14-2f80f5c63ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.543815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32eca-81e7-4513-aa14-2f80f5c63ccc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.556923 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2982/5974] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:52:49.560972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61264-6995-4633-a077-74189db69210 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.573080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61264-6995-4633-a077-74189db69210 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.581612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.582581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.583026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.583514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] PATH_INFO: `/v3/projects/129b5343573f4f9fa648e984a68b6760/users/a031e94db13d4e7e8947f51abc36d629/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.595874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:49.626268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129b5343573f4f9fa648e984a68b6760, user_id=a031e94db13d4e7e8947f51abc36d629, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.629497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.670339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.670638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.670925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.674923 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2993/5975] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:52:49 2022] PUT /identity/v3/projects/129b5343573f4f9fa648e984a68b6760/users/a031e94db13d4e7e8947f51abc36d629/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:52:49.713729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.715964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:49.717973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:49.719754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:49.847463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:52:49.884549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d2702-73a1-431e-a721-9717f7d4d155 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:49.887033 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2983/5976] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:49.887919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.892864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:49.895708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:49.896459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:49.896744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:49.899063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:49.903963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:49.927473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:49.930607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:49.949874 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2994/5977] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:49.961744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:52:49.996695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc519ee9-2245-4b20-8ba4-733adec7c1ef service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:50.005608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7792cc1-e6a6-4052-967c-f84005f98202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:50.011346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792cc1-e6a6-4052-967c-f84005f98202 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:50.011648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792cc1-e6a6-4052-967c-f84005f98202 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:50.011927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7792cc1-e6a6-4052-967c-f84005f98202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:50.047409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7792cc1-e6a6-4052-967c-f84005f98202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:50.047409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7792cc1-e6a6-4052-967c-f84005f98202 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:50.093198 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2995/5978] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:50.149322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615294-ebe7-4817-9b8a-f72e0fd225bc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:52:50.161052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:52:50.161696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:50.162539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:50.162804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:50.174270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:50.187916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21cf43-ed99-4717-ba67-520ce3003d2f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:50.188266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21cf43-ed99-4717-ba67-520ce3003d2f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:50.188483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21cf43-ed99-4717-ba67-520ce3003d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:50.199242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:52:50.200125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fe271-adfe-4ca0-966f-620af2475fee service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:52:50.224326 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2984/5979] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:52:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:52:50.242079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bc21cf43-ed99-4717-ba67-520ce3003d2f None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:50.243322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc21cf43-ed99-4717-ba67-520ce3003d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:50.389526 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2996/5980] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:52:57.281780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:57.282404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:57.282404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:57.304493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:57.305745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:57.316418 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2985/5981] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:52:58.484593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37813c8f-7d39-4e74-a667-37abc3af4e75 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:52:58.485705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37813c8f-7d39-4e74-a667-37abc3af4e75 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:52:58.486225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37813c8f-7d39-4e74-a667-37abc3af4e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:52:58.508774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-37813c8f-7d39-4e74-a667-37abc3af4e75 None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:52:58.510666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-37813c8f-7d39-4e74-a667-37abc3af4e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:52:58.535996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2997/5982] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:52:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:00.907944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:00.909638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:01.147582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b5b3f-885d-4a9b-8ab4-580cd30bda68 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:01.156211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:01.165789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:01.166208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:01.166490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:01.168640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:01.201911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:01.204170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23f763-dbe1-43bf-8b57-2c91547f1cba service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:01.252028 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2986/5983] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:02.326696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:02.327241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:02.327457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:02.376716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] MFA Rules not processed for user `a031e94db13d4e7e8947f51abc36d629`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:02.378107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:02.470139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2998/5984] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:02.482567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:02.483659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:02.484174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:02.509230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] MFA Rules not processed for user `a031e94db13d4e7e8947f51abc36d629`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:02.510846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:02.525331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2987/5985] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:02.530894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:02.532364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:02.551919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:02.565679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd7c32-9d21-4ca2-93e4-e293d46ad27f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:02.579439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa04927-1863-4636-a611-292352537832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:02.580535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa04927-1863-4636-a611-292352537832 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:02.581326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa04927-1863-4636-a611-292352537832 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:02.581908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa04927-1863-4636-a611-292352537832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:02.602054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa04927-1863-4636-a611-292352537832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:02.605276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa04927-1863-4636-a611-292352537832 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:02.623762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 2999/5986] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:03.035251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:03.044148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:03.088825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86853304-e554-4613-ae51-901bdfe0e116 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:03.097029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:03.098178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:03.098178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:03.098432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] PATH_INFO: `/v3/users/5216a4ba597f4516b94edba99930c130` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:03.110440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5216a4ba597f4516b94edba99930c130)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:03.111901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:03.231601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:03.244225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5216a4ba597f4516b94edba99930c130'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:03.277565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5216a4ba597f4516b94edba99930c130'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:03.278354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5216a4ba597f4516b94edba99930c130'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:03.303171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5216a4ba597f4516b94edba99930c130'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:03.303836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5216a4ba597f4516b94edba99930c130'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:03.333061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2988/5987] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:03 2022] DELETE /identity/v3/users/5216a4ba597f4516b94edba99930c130 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:03.339431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:03.339978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:03.340073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:03.363948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:03.365776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:03.435605 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3000/5988] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:53:03.456525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:03.461030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:03.538111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3972c7-e064-4986-8daf-0e1bad5c0a3b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:03.541411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e42f-c532-4e9a-a77d-9172724f19e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:03.542555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e42f-c532-4e9a-a77d-9172724f19e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:03.543162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e42f-c532-4e9a-a77d-9172724f19e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:03.543601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e42f-c532-4e9a-a77d-9172724f19e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:03.560046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e42f-c532-4e9a-a77d-9172724f19e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:03.561829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e42f-c532-4e9a-a77d-9172724f19e5 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:03.590555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2989/5989] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:03.709990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:03.711445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:03.892014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef656af-c8b1-4868-9cc5-4e65000dcd25 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:03.909403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:03.910029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:03.910315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:03.910587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:03.915060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:03.948337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:03.950469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:03.995840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3001/5990] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:04.280887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:04.281183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:04.281552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:04.314290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:04.315920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:04.351452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] MFA Rules not processed for user `a031e94db13d4e7e8947f51abc36d629`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:04.356463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:04.376289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dab01-822c-43c8-9f72-d21c8b6a12c2 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:04.420772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:04.422771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:04.423265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:04.423558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] PATH_INFO: `/v3/projects/3b9aa0bd477e49fd9120cfb881b95c1e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:04.428712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9aa0bd477e49fd9120cfb881b95c1e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:04.430957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:04.491217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2990/5991] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:04.554223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9aa0bd477e49fd9120cfb881b95c1e', 'request_id': 'req-ca2c513a-9f99-4071-8cdf-b1c545864091'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:04.568351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9aa0bd477e49fd9120cfb881b95c1e', 'request_id': 'req-ca2c513a-9f99-4071-8cdf-b1c545864091'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:04.601074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9aa0bd477e49fd9120cfb881b95c1e', 'request_id': 'req-ca2c513a-9f99-4071-8cdf-b1c545864091'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:04.672713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] The token cache is being invalidate because project 3b9aa0bd477e49fd9120cfb881b95c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:04.673626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:04.675006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:04.682684 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3002/5992] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:04 2022] DELETE /identity/v3/projects/3b9aa0bd477e49fd9120cfb881b95c1e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:53:04.688270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:04.740182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38273f-ebf6-44df-b18f-eadf0be7de26 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:04.925083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:04.925083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:04.925083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:04.925083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] PATH_INFO: `/v3/users/b455d320a1d0495b89815328ef164460` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:04.925645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b455d320a1d0495b89815328ef164460)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:04.929653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:04.964487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:05.070999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b455d320a1d0495b89815328ef164460'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:05.124957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b455d320a1d0495b89815328ef164460'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:05.124957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b455d320a1d0495b89815328ef164460'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:05.145167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b455d320a1d0495b89815328ef164460'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:05.145919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b455d320a1d0495b89815328ef164460'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:05.183662 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2991/5993] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:04 2022] DELETE /identity/v3/users/b455d320a1d0495b89815328ef164460 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:06.327856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:06.331290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:06.351642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:06.362865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c513a-9f99-4071-8cdf-b1c545864091 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:06.574102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:06.575188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:06.575673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:06.576127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] PATH_INFO: `/v3/projects/74c652fc644e4ed09e1a401ffb353d27` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:06.578607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c652fc644e4ed09e1a401ffb353d27)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:06.580748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:06.755307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c652fc644e4ed09e1a401ffb353d27', 'request_id': 'req-fb16391d-23be-42b6-8fc8-65e16eb8bf76'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:06.767138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c652fc644e4ed09e1a401ffb353d27', 'request_id': 'req-fb16391d-23be-42b6-8fc8-65e16eb8bf76'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:06.781704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c652fc644e4ed09e1a401ffb353d27', 'request_id': 'req-fb16391d-23be-42b6-8fc8-65e16eb8bf76'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:06.813438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] The token cache is being invalidate because project 74c652fc644e4ed09e1a401ffb353d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:06.819480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:06.822764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:06.826098 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3003/5994] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:06 2022] DELETE /identity/v3/projects/74c652fc644e4ed09e1a401ffb353d27 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:06.831170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:06.833458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:06.861779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ff235-8daa-4701-b5b0-f52098e27a8d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:07.018052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:07.020989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:07.021783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:07.022068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] PATH_INFO: `/v3/users/1b8f76c352c34eea81589547a84a5e44` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:07.024760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8f76c352c34eea81589547a84a5e44)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:07.047430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:07.061832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:07.063522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:07.094121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16391d-23be-42b6-8fc8-65e16eb8bf76 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:07.121934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:07.122607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:07.122893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:07.123174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] PATH_INFO: `/v3/users/9e8f069e9e2a48549d02a1505b648a88` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:07.127462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8f069e9e2a48549d02a1505b648a88)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:07.132650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:07.194297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8f76c352c34eea81589547a84a5e44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.213303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8f76c352c34eea81589547a84a5e44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.214472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8f76c352c34eea81589547a84a5e44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.230096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8f76c352c34eea81589547a84a5e44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.230791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8f76c352c34eea81589547a84a5e44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.257088 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2992/5995] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:06 2022] DELETE /identity/v3/users/1b8f76c352c34eea81589547a84a5e44 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:07.284590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8f069e9e2a48549d02a1505b648a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.308626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8f069e9e2a48549d02a1505b648a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.315075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8f069e9e2a48549d02a1505b648a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.331710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8f069e9e2a48549d02a1505b648a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.334750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8f069e9e2a48549d02a1505b648a88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:07.377022 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3004/5996] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:07 2022] DELETE /identity/v3/users/9e8f069e9e2a48549d02a1505b648a88 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:08.119430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:08.122657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:08.135529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:08.161771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:08.166807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:08.182061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:08.284005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc401f8-d447-42a3-be2b-e9dbff3f7f82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:08.336844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8da5c-ff48-41ce-8016-7a492e17ad6b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:08.343227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:08.344453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:08.345029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:08.345579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] PATH_INFO: `/v3/projects/2a34cfbdc71c4729bd685b62ab38f05b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:08.347045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a34cfbdc71c4729bd685b62ab38f05b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:08.350812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:08.372054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:08.373596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:08.373888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:08.374357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] PATH_INFO: `/v3/projects/534df890fde640cc913ecd53e83540bc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:08.375972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=534df890fde640cc913ecd53e83540bc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:08.377975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:08.498978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a34cfbdc71c4729bd685b62ab38f05b', 'request_id': 'req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.500348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534df890fde640cc913ecd53e83540bc', 'request_id': 'req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.515506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a34cfbdc71c4729bd685b62ab38f05b', 'request_id': 'req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.517574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534df890fde640cc913ecd53e83540bc', 'request_id': 'req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.532574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534df890fde640cc913ecd53e83540bc', 'request_id': 'req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.536335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a34cfbdc71c4729bd685b62ab38f05b', 'request_id': 'req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.548455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] The token cache is being invalidate because project 534df890fde640cc913ecd53e83540bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:08.548845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.549627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.557177 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2993/5997] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:08 2022] DELETE /identity/v3/projects/534df890fde640cc913ecd53e83540bc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:08.561353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:08.565874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:08.572375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] The token cache is being invalidate because project 2a34cfbdc71c4729bd685b62ab38f05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:08.573722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.575213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-708d2fd7-81a8-481a-a79b-2e39dd7ce1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.578191 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3005/5998] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:08 2022] DELETE /identity/v3/projects/2a34cfbdc71c4729bd685b62ab38f05b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:08.584481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba05919-4c92-4758-a8d4-3308494a065c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:08.585073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba05919-4c92-4758-a8d4-3308494a065c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:08.585543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba05919-4c92-4758-a8d4-3308494a065c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:08.625438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0ba05919-4c92-4758-a8d4-3308494a065c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:08.627462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0ba05919-4c92-4758-a8d4-3308494a065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:08.740765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:08.782497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3006/5999] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:08.783698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf4b7-a7d6-46c5-99aa-270caca31bc8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:08.795510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:08.796507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:08.796792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:08.797134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] PATH_INFO: `/v3/users/92d3c125819b41039f16db48a58e8a3c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:08.798727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d3c125819b41039f16db48a58e8a3c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:08.808236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:08.888033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:08.888234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:08.888474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:08.920545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:08.922019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:08.940445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3007/6000] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:53:08.940445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:08.949765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb6522-97c7-4640-996f-2e4dded5af65 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:08.957571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d3c125819b41039f16db48a58e8a3c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.958036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:08.960325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:08.960626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:08.960935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:08.962299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:53:08.962620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:08.964446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:08.985242 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3008/6001] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:53:08.986094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:08.988409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d3c125819b41039f16db48a58e8a3c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:08.989564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d3c125819b41039f16db48a58e8a3c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.000822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1338d9d-e6ac-4fea-86f8-e1ce262603b1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.006147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d3c125819b41039f16db48a58e8a3c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.007160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d3c125819b41039f16db48a58e8a3c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.009425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.010601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.010897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.011790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.012926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.015448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.032102 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2994/6002] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:08 2022] DELETE /identity/v3/users/92d3c125819b41039f16db48a58e8a3c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:09.038979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:09.066388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3009/6003] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:53:08 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:53:09.071729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.073292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:09.183769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c6338-d2c9-4041-a3b9-5559aec4ce5c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.279252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.281599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:09.376327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.377009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.377346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.377890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.378549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.381868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.412714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2995/6004] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:53:09 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:53:09.417109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.419949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca222-d9e6-4707-8131-85c43849fa33 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.423604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:09.426307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.427404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.428588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.429153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] PATH_INFO: `/v3/projects/767e0b2cdbec480c99dd45925d537536` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.431293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767e0b2cdbec480c99dd45925d537536)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.432478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a140f-aad9-4c27-b058-6e5ab789419c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.433773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.443934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.445027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.445414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.445761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.446791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.449002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.462977 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2996/6005] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:09.466782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.491047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d6ec-4fa4-489d-926e-5354f1adf54d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.508269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.512464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.512762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.513071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.513746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.522284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.525864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767e0b2cdbec480c99dd45925d537536', 'request_id': 'req-87be37ca-de37-41ce-8201-e5554bdb71b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.546632 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2997/6006] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:53:09.547545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.553205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767e0b2cdbec480c99dd45925d537536', 'request_id': 'req-87be37ca-de37-41ce-8201-e5554bdb71b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.570309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a96b-9b96-47ea-af02-749cd681c0c9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.576484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767e0b2cdbec480c99dd45925d537536', 'request_id': 'req-87be37ca-de37-41ce-8201-e5554bdb71b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.626978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] The token cache is being invalidate because project 767e0b2cdbec480c99dd45925d537536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:09.627281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.628001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-87be37ca-de37-41ce-8201-e5554bdb71b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:09.629873 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3010/6007] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:09 2022] DELETE /identity/v3/projects/767e0b2cdbec480c99dd45925d537536 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:09.640102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac65b0-ef7a-4fa7-81d0-bdecb37eb2b1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.640102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac65b0-ef7a-4fa7-81d0-bdecb37eb2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.640102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac65b0-ef7a-4fa7-81d0-bdecb37eb2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.693669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e1ac65b0-ef7a-4fa7-81d0-bdecb37eb2b1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:09.697318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e1ac65b0-ef7a-4fa7-81d0-bdecb37eb2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:09.734423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695b0b0-d1c1-4c5c-9ffb-401b27e9d198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.735118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b0b0-d1c1-4c5c-9ffb-401b27e9d198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.735405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b0b0-d1c1-4c5c-9ffb-401b27e9d198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.735688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695b0b0-d1c1-4c5c-9ffb-401b27e9d198 admin admin] PATH_INFO: `/v3/projects/e09fcf0e259f49adbe50ba5674fa130e/users/60172a2c0d0749dba6eafe7e6455b315/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.757087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695b0b0-d1c1-4c5c-9ffb-401b27e9d198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09fcf0e259f49adbe50ba5674fa130e, user_id=60172a2c0d0749dba6eafe7e6455b315, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.760635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695b0b0-d1c1-4c5c-9ffb-401b27e9d198 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.780506 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2998/6008] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:53:09 2022] PUT /identity/v3/projects/e09fcf0e259f49adbe50ba5674fa130e/users/60172a2c0d0749dba6eafe7e6455b315/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:53:09.792767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.793149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.793552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.801016 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3011/6009] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:09.806631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.806925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.807515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.835807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:09.837091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:09.840271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] MFA Rules not processed for user `60172a2c0d0749dba6eafe7e6455b315`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:09.841753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:09.862964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:09.930156 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3012/6010] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:53:09.930852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.941254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf83ac-1e5c-4c6e-b300-f9904d77f561 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.950735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:09.951950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:09.952534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:09.953037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:09.954030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:53:09.955196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:09.956946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 2999/6011] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:09.958293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:09.970554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.972965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:09.977157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3013/6012] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:53:09.978141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:09.994061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef45f-c98b-4a76-8e12-3f20ada7feb1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:09.999685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.000770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.001089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.001513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.002561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.004806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.050523 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3014/6013] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:53:09 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:53:10.052555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:10.072335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f0b2-5ff2-4de8-a836-5e14736173c0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:10.078916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:10.135700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d8769-eef0-4418-8d54-3792e3de4777 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:10.141378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.142045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.142275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.142700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.143331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.145412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.171550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.172641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.172641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.172877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.195375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3015/6014] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:53:10 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:53:10.196388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:10.210315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eddfe-76b6-463b-b874-cfd0bc97d4d8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:10.215732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.216579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.217116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.217559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.218380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.220418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.241398 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3016/6015] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:53:10.243445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:10.256699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.257825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd2851-243e-4c70-9549-cbdeb4dfab43 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:10.258451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.264047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e1f4-d7b8-4826-885b-48b494c93d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.264887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e1f4-d7b8-4826-885b-48b494c93d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.265363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e1f4-d7b8-4826-885b-48b494c93d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.265804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e1f4-d7b8-4826-885b-48b494c93d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.266619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525e1f4-d7b8-4826-885b-48b494c93d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.269346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525e1f4-d7b8-4826-885b-48b494c93d6b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.270206 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3000/6016] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:53:10.285721 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3017/6017] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:10.287306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:10.304386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d178c77-76fe-4e7e-899a-67318049bd31 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:10.314023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.314967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.315982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.316477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] PATH_INFO: `/v3/projects/8a0c20bf9ac24a0184b2a83bdbe3b7e8/users/7ef58a16963444eba42e04b0de3747a2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.337709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0c20bf9ac24a0184b2a83bdbe3b7e8, user_id=7ef58a16963444eba42e04b0de3747a2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.341543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.397382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.398100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.399225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.406410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3001/6018] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:53:10 2022] PUT /identity/v3/projects/8a0c20bf9ac24a0184b2a83bdbe3b7e8/users/7ef58a16963444eba42e04b0de3747a2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:10.461635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:10.464678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:10.588233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:10.665386 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3018/6019] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:10.699398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:10.702291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:10.835972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178e899-87cc-46d5-acef-095e1e92f59c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:10.845828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e565c-cce5-4054-9b0a-8d79b6756aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:10.847270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e565c-cce5-4054-9b0a-8d79b6756aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:10.847568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e565c-cce5-4054-9b0a-8d79b6756aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:10.847820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e565c-cce5-4054-9b0a-8d79b6756aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:10.869373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e565c-cce5-4054-9b0a-8d79b6756aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:10.873158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e565c-cce5-4054-9b0a-8d79b6756aa6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:10.894521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3002/6020] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:15.965444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:15.965444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:16.256013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce87d-a8a6-4a94-bb5e-32f78fd9945f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:16.276424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:16.278531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:16.279546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:16.279925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:16.284480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:16.326707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:16.329469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6e88-4178-4ba4-8015-770f173858af service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:16.390901 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3019/6021] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:20.885904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:22.010619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:22.011257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:22.011257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:22.063317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] MFA Rules not processed for user `7ef58a16963444eba42e04b0de3747a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:22.063706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:22.181808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3003/6022] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:22.193427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5841d3-e3ba-4303-83d2-9d1d5fcecc37 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:22.194110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5841d3-e3ba-4303-83d2-9d1d5fcecc37 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:22.194110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5841d3-e3ba-4303-83d2-9d1d5fcecc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:22.231204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ea5841d3-e3ba-4303-83d2-9d1d5fcecc37 None None] MFA Rules not processed for user `7ef58a16963444eba42e04b0de3747a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:22.232652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea5841d3-e3ba-4303-83d2-9d1d5fcecc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:22.243220 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3020/6023] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:22.256802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:22.259397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:22.322997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9682b05-9cca-4559-8ecc-34966073e37f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:22.341736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:22.342493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:22.342869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:22.343653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:22.354571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:22.356720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:22.374366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3004/6024] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:22 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:23.241080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c9c5-c1a4-4f22-bc58-d57e1fa96e8f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:23.242570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c9c5-c1a4-4f22-bc58-d57e1fa96e8f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:23.243066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c9c5-c1a4-4f22-bc58-d57e1fa96e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:23.284158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0b63c9c5-c1a4-4f22-bc58-d57e1fa96e8f None None] MFA Rules not processed for user `fa65476b76e749cdab6ad9e7e77e79b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:23.285719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0b63c9c5-c1a4-4f22-bc58-d57e1fa96e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:23.418560 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3021/6025] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:23.504840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:23.507230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:23.534891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5884-30cb-4119-92e1-ae2af44d408d service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:23.548428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:23.549180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:23.549467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:23.549746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] PATH_INFO: `/v3/users/60172a2c0d0749dba6eafe7e6455b315` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:23.554100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60172a2c0d0749dba6eafe7e6455b315)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:23.557190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:23.687507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60172a2c0d0749dba6eafe7e6455b315'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:23.717049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60172a2c0d0749dba6eafe7e6455b315'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:23.717998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60172a2c0d0749dba6eafe7e6455b315'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:23.728056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60172a2c0d0749dba6eafe7e6455b315'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:23.728996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60172a2c0d0749dba6eafe7e6455b315'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:23.771039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3005/6026] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:23 2022] DELETE /identity/v3/users/60172a2c0d0749dba6eafe7e6455b315 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:23.775110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:23.775411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:23.775700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:23.811513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:23.812762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:23.913879 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3022/6027] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:23.923936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:23.925618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:24.029588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:24.046384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eca2f1-64ec-4f43-b0e4-ef44377c419b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:24.050582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd7c00-ce34-48d8-bbec-419546d510ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:24.051329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd7c00-ce34-48d8-bbec-419546d510ea service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:24.051481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd7c00-ce34-48d8-bbec-419546d510ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:24.051760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd7c00-ce34-48d8-bbec-419546d510ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:24.062929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd7c00-ce34-48d8-bbec-419546d510ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:24.064394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd7c00-ce34-48d8-bbec-419546d510ea service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:24.078160 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3006/6028] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:24.511659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:24.513251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:24.547556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee18467-93c6-413b-a0b4-456b3df6cdb6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:24.566856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:24.568583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:24.569191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:24.569288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] PATH_INFO: `/v3/projects/e09fcf0e259f49adbe50ba5674fa130e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:24.572323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09fcf0e259f49adbe50ba5674fa130e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:24.574290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:24.629455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:24.743017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09fcf0e259f49adbe50ba5674fa130e', 'request_id': 'req-363470db-3114-462d-ab6c-27792e4360b1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:24.754556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09fcf0e259f49adbe50ba5674fa130e', 'request_id': 'req-363470db-3114-462d-ab6c-27792e4360b1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:24.766790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09fcf0e259f49adbe50ba5674fa130e', 'request_id': 'req-363470db-3114-462d-ab6c-27792e4360b1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:24.795349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] The token cache is being invalidate because project e09fcf0e259f49adbe50ba5674fa130e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:24.796235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:24.797201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-363470db-3114-462d-ab6c-27792e4360b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:24.799705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3023/6029] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:24 2022] DELETE /identity/v3/projects/e09fcf0e259f49adbe50ba5674fa130e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:24.805469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:24.805967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:24.805967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:24.865571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:24.867425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:25.026682 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3007/6030] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:25.033388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.033821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.034114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.071881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:25.073299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:25.082025 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3024/6031] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:25.087542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.101053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4429-e12d-484f-a55d-af93639ffc13 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.117274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.118124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.123659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.124042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.124863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:53:25.125185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.127276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.155610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3008/6032] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:53:25.156358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.174879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3b325-7848-4280-91ad-c429f6b346d6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.180680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.181472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.181938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.182218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.182863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.184998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.220448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.229319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3025/6033] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:53:25 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:53:25.235579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b0048-b813-40ea-8bc5-d3b66d14deec admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.386664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.387280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.387571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.387851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.388507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.394727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.431908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3009/6034] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:53:25 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:53:25.436877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.452527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21ab57-f9f3-400c-abd4-f890f1db8cb2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.457862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.460119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.460455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.460723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.461618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.463253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.476951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3026/6035] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:25.479508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.496004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcf7f2-8eff-4175-9727-5f7efb2e5594 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.506974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9f387-e305-4c4a-a35f-e6e9fa1f96f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.507742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9f387-e305-4c4a-a35f-e6e9fa1f96f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.508125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9f387-e305-4c4a-a35f-e6e9fa1f96f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.508491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9f387-e305-4c4a-a35f-e6e9fa1f96f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.509278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9f387-e305-4c4a-a35f-e6e9fa1f96f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.511175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9f387-e305-4c4a-a35f-e6e9fa1f96f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.525041 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3010/6036] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:25.529608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.557116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5adf6-00b0-4747-aa58-698814a8f909 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.566349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.567537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.568822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.569599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] PATH_INFO: `/v3/projects/89aecdda7e0f4c5ca3f217f49783200b/users/9558cd41b4d445349f22c3b57a8a96bc/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.593300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89aecdda7e0f4c5ca3f217f49783200b, user_id=9558cd41b4d445349f22c3b57a8a96bc, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.596356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.613423 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3027/6037] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:53:25 2022] PUT /identity/v3/projects/89aecdda7e0f4c5ca3f217f49783200b/users/9558cd41b4d445349f22c3b57a8a96bc/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:25.626781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.627830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.628475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.667323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] MFA Rules not processed for user `9558cd41b4d445349f22c3b57a8a96bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:25.669309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:25.798035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:25.856692 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3011/6038] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:25.868285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:25.870549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:25.949922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a8b6e-2046-472d-b7a0-e8a691d9bec7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:25.955165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:25.956320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:25.956561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:25.956949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:25.970072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:25.971754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:25.992686 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3028/6039] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:35.853636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:35.982956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:46.738059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:46.740443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:46.867941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb060f55-2635-4bfc-9d96-16bac6478b9a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:46.911929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:46.914845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:46.915222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:46.915568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:46.919060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:46.939863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:46.944786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c48ac-c4f4-4afc-8677-441a4e6b4163 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:46.970129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3012/6040] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:48.238295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:48.240560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:48.411315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7f73-cb1f-4c13-819e-1ce1994c2938 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:48.417863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:48.419405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:48.419997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:48.420375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:48.422671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:48.453601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:48.456942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a1bf0-6596-4f28-a798-22e17943653f service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:48.487694 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3029/6041] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:49.601052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a5b9-2329-4ad7-b23b-e7717481c3d9 None None] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:49.601981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a5b9-2329-4ad7-b23b-e7717481c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:49.602503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206a5b9-2329-4ad7-b23b-e7717481c3d9 None None] PATH_INFO: `/` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:49.604407 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3013/6042] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:53:49.612765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:49.613470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:49.613470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:49.658214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:49.659535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:49.668256 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3030/6043] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:53:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:49.691056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206a5b9-2329-4ad7-b23b-e7717481c3d9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:49.694391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8206a5b9-2329-4ad7-b23b-e7717481c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:49.719262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206a5b9-2329-4ad7-b23b-e7717481c3d9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:49.729871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ed9a1-3c80-4454-9096-63ef74be0809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:49.730820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed9a1-3c80-4454-9096-63ef74be0809 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:49.731917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed9a1-3c80-4454-9096-63ef74be0809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:49.732215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ed9a1-3c80-4454-9096-63ef74be0809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:49.753201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed9a1-3c80-4454-9096-63ef74be0809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:49.759326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ed9a1-3c80-4454-9096-63ef74be0809 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:49.780356 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3014/6044] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:52.619720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:52.719397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b1705-d584-4246-8594-ea68abf9a98f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:52.725564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:52.726301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:52.726567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:52.727001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] PATH_INFO: `/v3/users/9558cd41b4d445349f22c3b57a8a96bc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:52.728177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9558cd41b4d445349f22c3b57a8a96bc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:52.730591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:52.790443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9558cd41b4d445349f22c3b57a8a96bc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:52.807802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9558cd41b4d445349f22c3b57a8a96bc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:52.807802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9558cd41b4d445349f22c3b57a8a96bc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:52.824673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9558cd41b4d445349f22c3b57a8a96bc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:52.826121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9558cd41b4d445349f22c3b57a8a96bc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:52.844549 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3031/6045] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:52 2022] DELETE /identity/v3/users/9558cd41b4d445349f22c3b57a8a96bc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:52.850027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:52.850530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:52.850769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:52.886106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:52.891429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:53.037956 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3015/6046] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:53.050675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:53.053316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:53.059450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:53.149894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36b81a-e96f-46de-8be8-bcbe621ee353 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:53.160130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d65db9-bcf5-4d65-851c-dabf0eb86622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:53.160863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d65db9-bcf5-4d65-851c-dabf0eb86622 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:53.161962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d65db9-bcf5-4d65-851c-dabf0eb86622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:53.162302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d65db9-bcf5-4d65-851c-dabf0eb86622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:53.173282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d65db9-bcf5-4d65-851c-dabf0eb86622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:53.174738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d65db9-bcf5-4d65-851c-dabf0eb86622 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:53.191808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3032/6047] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:53.541877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:53.544008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:53.569881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddcaaf-7441-4f80-865f-922a1b7f9b4c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:53.582492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:53.583991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:53.584381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:53.584768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] PATH_INFO: `/v3/projects/89aecdda7e0f4c5ca3f217f49783200b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:53.586121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] RBAC: Authorizing `identity:delete_project(project_id=89aecdda7e0f4c5ca3f217f49783200b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:53.588415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:53.687061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89aecdda7e0f4c5ca3f217f49783200b', 'request_id': 'req-0c8c6a1d-8703-4c89-8084-4a68414289af'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:53.698107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89aecdda7e0f4c5ca3f217f49783200b', 'request_id': 'req-0c8c6a1d-8703-4c89-8084-4a68414289af'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:53.706390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89aecdda7e0f4c5ca3f217f49783200b', 'request_id': 'req-0c8c6a1d-8703-4c89-8084-4a68414289af'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:53.709541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:53.722542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] The token cache is being invalidate because project 89aecdda7e0f4c5ca3f217f49783200b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:53.723407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:53.724651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c8c6a1d-8703-4c89-8084-4a68414289af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:53.727231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3016/6048] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:53 2022] DELETE /identity/v3/projects/89aecdda7e0f4c5ca3f217f49783200b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:53.731973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:53.732463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:53.732571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:53.754313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:53.756189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:53.834131 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3033/6049] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:53:53.841651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:53.841938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:53.842271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:53.863382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:53.864950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:53.873926 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3017/6050] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:53.878405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:53.889827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755ce7a-fe41-44aa-a229-2a9ba7c3505b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:53.897328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:53.897954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:53.898241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:53.898521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:53.899179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:53:53.899487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:53.901141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:53.913949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3034/6051] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:53:53.918548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:53.928237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6def9a7-44b4-4438-969a-08d9c22c10f7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:53.935316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:53.935942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:53.936423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:53.936895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:53.937668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:53.939619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:53.986542 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3018/6052] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:53:53 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:53:53.987393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:54.007829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f0eec-6a4f-433c-b9cc-50e19b937018 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:54.090068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:54.091190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:54.091779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:54.092274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:54.093234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:54.096073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:54.126708 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3035/6053] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:53:53 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:53:54.131646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:54.148107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1571-88b8-4c8e-9d41-fc4a55e9f5fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:54.154143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:54.155406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:54.156274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:54.156842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:54.157807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:54.159914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:54.177855 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3019/6054] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:54.178566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:54.190739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742759-2a8f-4d69-8421-64ae9b4a3aca admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:54.198692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406281f-2119-4677-94b9-ff3f3854af2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:54.199451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406281f-2119-4677-94b9-ff3f3854af2e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:54.199895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406281f-2119-4677-94b9-ff3f3854af2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:54.201145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406281f-2119-4677-94b9-ff3f3854af2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:54.201145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406281f-2119-4677-94b9-ff3f3854af2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:54.203322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406281f-2119-4677-94b9-ff3f3854af2e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:54.219951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3036/6055] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:54.222440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:54.238351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a6f0-c362-4703-ba68-760f4432a8f0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:54.244839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:54.245934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:54.246684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:54.247338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] PATH_INFO: `/v3/projects/9570eba92b0c411ba2a9ace44a90da33/users/fce945ea5d26423287ddd89f22019451/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:54.266048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9570eba92b0c411ba2a9ace44a90da33, user_id=fce945ea5d26423287ddd89f22019451, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:54.269344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:54.307464 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3020/6056] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:53:54 2022] PUT /identity/v3/projects/9570eba92b0c411ba2a9ace44a90da33/users/fce945ea5d26423287ddd89f22019451/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:54.308362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:54.308601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:54.309022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:54.336663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:54.354694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] MFA Rules not processed for user `fce945ea5d26423287ddd89f22019451`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:54.356665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:54.439127 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3037/6057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:53:54.450964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:54.452768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:54.522603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324aed6-ba97-409b-80b7-862a21ff59c5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:54.528441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:54.529475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:54.529986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:54.530426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:54.541409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:54.543271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:54.561906 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3021/6058] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:56.436059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:56.439541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:56.582929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784e65a-c3ef-42b7-bc5d-a18c8187c7ba None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:56.589009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:56.589814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:56.590175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:56.590528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] PATH_INFO: `/v3/users/7ef58a16963444eba42e04b0de3747a2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:56.591918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef58a16963444eba42e04b0de3747a2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:56.594213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:56.687970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef58a16963444eba42e04b0de3747a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:56.708379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef58a16963444eba42e04b0de3747a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:56.709584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef58a16963444eba42e04b0de3747a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:56.720414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef58a16963444eba42e04b0de3747a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:56.721237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f371ef63-d669-4d43-8d7d-7ebeb3842430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef58a16963444eba42e04b0de3747a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:56.740740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3038/6059] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:53:56 2022] DELETE /identity/v3/users/7ef58a16963444eba42e04b0de3747a2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:57.134744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.154694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241a741-61b5-4127-9eb6-e99c106826f1 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.234358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.235442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.235867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.236422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] PATH_INFO: `/v3/projects/8a0c20bf9ac24a0184b2a83bdbe3b7e8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.237876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0c20bf9ac24a0184b2a83bdbe3b7e8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.240799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.305128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:57.318549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'request_id': 'req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:57.328766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'request_id': 'req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:57.339450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0c20bf9ac24a0184b2a83bdbe3b7e8', 'request_id': 'req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:57.352697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] The token cache is being invalidate because project 8a0c20bf9ac24a0184b2a83bdbe3b7e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:53:57.353026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:57.354271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-07cbf9ed-21e4-4a32-a4cf-c760630fc82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:53:57.357984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3022/6060] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:53:57 2022] DELETE /identity/v3/projects/8a0c20bf9ac24a0184b2a83bdbe3b7e8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:57.362965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.363374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.363814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.388769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:57.390399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:57.406982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:57.517369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3039/6061] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:57.526684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.527760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.528402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.571052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:57.572557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:57.581953 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3023/6062] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:57.586244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.599062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512b8a5-a282-4202-8818-7735ab239377 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.606410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.607093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.607379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.607656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.608367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:53:57.608819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.611072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.644505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3040/6063] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:53:57.649668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.659923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620bd5f-943c-41e9-951e-2abb06396f8d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.666993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.667988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.668504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.668870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.669943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.672561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.711155 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3024/6064] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:53:57 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:53:57.715003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.726039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c909a-8e7e-4697-955e-c5a569b5eafc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.806716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.807422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.807766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.808501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.808992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.811268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.844165 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3041/6065] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:53:57 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:53:57.848155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.860374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7387f-affb-4be9-ba4e-a554fc0c1769 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.865963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.866698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.867083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.867484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.868288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.870110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.882974 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3025/6066] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:57.887141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.898008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f5b3-7583-4bc9-bb4f-071dae9e436e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.906365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4e5bf-00f8-4875-ad73-9142172aee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.907086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4e5bf-00f8-4875-ad73-9142172aee95 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.907443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4e5bf-00f8-4875-ad73-9142172aee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.907788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4e5bf-00f8-4875-ad73-9142172aee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.908498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4e5bf-00f8-4875-ad73-9142172aee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.910141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4e5bf-00f8-4875-ad73-9142172aee95 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.922193 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3042/6067] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:53:57.927050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:57.938856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f35b70-f36d-48ed-a76d-6141a60519a5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:57.945521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:57.946273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.946561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.946836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] PATH_INFO: `/v3/projects/dfa44fa2dc3c4df4bc34ff14deaf21ef/users/2825041f8aa2462f8719a0f124e0b8a0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:57.965651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa44fa2dc3c4df4bc34ff14deaf21ef, user_id=2825041f8aa2462f8719a0f124e0b8a0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:57.968667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:57.991476 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3026/6068] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:53:57 2022] PUT /identity/v3/projects/dfa44fa2dc3c4df4bc34ff14deaf21ef/users/2825041f8aa2462f8719a0f124e0b8a0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:53:57.993232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cc9e2-5124-4307-a36b-bd2ec6f1b8bc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:57.993618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cc9e2-5124-4307-a36b-bd2ec6f1b8bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:57.993957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cc9e2-5124-4307-a36b-bd2ec6f1b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:58.021799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f96cc9e2-5124-4307-a36b-bd2ec6f1b8bc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:58.023620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f96cc9e2-5124-4307-a36b-bd2ec6f1b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:58.100804 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3043/6069] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:58.111458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:58.113123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:58.192165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6195b07-1afc-4b46-8961-a4e680a2e5f3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:58.197634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52785c0-5e1a-4081-a85f-0990f4b46fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:58.198403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52785c0-5e1a-4081-a85f-0990f4b46fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:58.198611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52785c0-5e1a-4081-a85f-0990f4b46fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:58.199421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52785c0-5e1a-4081-a85f-0990f4b46fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:58.212715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52785c0-5e1a-4081-a85f-0990f4b46fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:58.214466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52785c0-5e1a-4081-a85f-0990f4b46fe1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:58.225761 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3027/6070] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:53:59.265891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d989-3ba7-4b84-949c-debb38386286 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:59.266767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d989-3ba7-4b84-949c-debb38386286 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:59.266974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d989-3ba7-4b84-949c-debb38386286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:59.324970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d000d989-3ba7-4b84-949c-debb38386286 None None] MFA Rules not processed for user `2825041f8aa2462f8719a0f124e0b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:59.327260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d000d989-3ba7-4b84-949c-debb38386286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:59.346061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:59.443841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3044/6071] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:59.453344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:59.453883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:59.454184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:59.480397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] MFA Rules not processed for user `2825041f8aa2462f8719a0f124e0b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:59.482133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:59.491824 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3028/6072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:53:59.502065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625d4c-9ce9-4076-886d-87c27920cf4b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:59.502642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625d4c-9ce9-4076-886d-87c27920cf4b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:59.503096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625d4c-9ce9-4076-886d-87c27920cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:59.557336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-67625d4c-9ce9-4076-886d-87c27920cf4b None None] MFA Rules not processed for user `2825041f8aa2462f8719a0f124e0b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:53:59.563563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-67625d4c-9ce9-4076-886d-87c27920cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:59.590758 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3045/6073] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:53:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:53:59.600931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:53:59.602555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:53:59.762367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:53:59.789834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5602335-5a8a-4c17-948a-86e17ec8a6b2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:53:59.806959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:53:59.808009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:53:59.808009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:53:59.808279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:53:59.818699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:53:59.821598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:53:59.832971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3029/6074] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:53:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:01.065047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c609a-da5c-4081-9227-c0aab21fc027 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:01.065902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c609a-da5c-4081-9227-c0aab21fc027 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:01.066369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c609a-da5c-4081-9227-c0aab21fc027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:01.138063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:01.139567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.140387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f80c609a-da5c-4081-9227-c0aab21fc027 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:01.141875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f80c609a-da5c-4081-9227-c0aab21fc027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.158791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1d3d3-ea97-461a-bf73-6b1e5d297be9 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:01.167342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:01.168600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:01.169087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:01.169433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] PATH_INFO: `/v3/users/fce945ea5d26423287ddd89f22019451` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:01.172135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce945ea5d26423287ddd89f22019451)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:01.176151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:01.224702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3046/6075] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:54:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:01.241694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce945ea5d26423287ddd89f22019451'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:01.260308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce945ea5d26423287ddd89f22019451'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:01.261277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce945ea5d26423287ddd89f22019451'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:01.271040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce945ea5d26423287ddd89f22019451'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:01.272220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce945ea5d26423287ddd89f22019451'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:01.289393 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3030/6076] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:01 2022] DELETE /identity/v3/users/fce945ea5d26423287ddd89f22019451 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:01.294428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:01.294724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:01.295008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:01.296156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:01.297576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.317666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:01.319245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.407836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3047/6077] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:01.429942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:01.433182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.448614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384726d-90e6-4c0f-be12-099903df472e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:01.461272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:01.461909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:01.463841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:01.464139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:01.472258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.603860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:01.607427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:01.611015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b434c-3e92-4691-b12d-43146e52c0cd service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:01.627391 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3031/6078] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:54:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:54:01.628940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b6bc-d684-448f-8f21-283f06213bb0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:01.629412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b6bc-d684-448f-8f21-283f06213bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:01.630499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b6bc-d684-448f-8f21-283f06213bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:01.673822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f0a8-bd4b-44f8-8353-774fa58a51f2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:01.696517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b3f0b6bc-d684-448f-8f21-283f06213bb0 None None] MFA Rules not processed for user `2825041f8aa2462f8719a0f124e0b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:01.697898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b3f0b6bc-d684-448f-8f21-283f06213bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:01.699641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:01.700473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:01.700805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:01.701112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:01.722181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:01.724217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:01.734098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:01.764107 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3048/6079] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:01.919626 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3032/6080] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:02.189730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:02.191217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:02.220315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb6dd7-f420-4fc8-a3b9-26a49b72ca10 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:02.230073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:02.231474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:02.231760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:02.232093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] PATH_INFO: `/v3/projects/9570eba92b0c411ba2a9ace44a90da33` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:02.233252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9570eba92b0c411ba2a9ace44a90da33)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:02.235168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:02.378161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9570eba92b0c411ba2a9ace44a90da33', 'request_id': 'req-a50e8549-de5f-45c7-a750-0523c8cf2f84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:02.401974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9570eba92b0c411ba2a9ace44a90da33', 'request_id': 'req-a50e8549-de5f-45c7-a750-0523c8cf2f84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:02.434908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9570eba92b0c411ba2a9ace44a90da33', 'request_id': 'req-a50e8549-de5f-45c7-a750-0523c8cf2f84'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:02.490831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] The token cache is being invalidate because project 9570eba92b0c411ba2a9ace44a90da33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:02.491156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:02.495287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a50e8549-de5f-45c7-a750-0523c8cf2f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:02.507083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:02.507679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:02.507679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:02.517075 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3049/6081] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:02 2022] DELETE /identity/v3/projects/9570eba92b0c411ba2a9ace44a90da33 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:02.559090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:02.560524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:02.691458 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3033/6082] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:02.694245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6946c-e659-4b14-967b-9743d294349d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:02.695098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6946c-e659-4b14-967b-9743d294349d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:02.695538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6946c-e659-4b14-967b-9743d294349d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:02.744133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aea6946c-e659-4b14-967b-9743d294349d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:02.746329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aea6946c-e659-4b14-967b-9743d294349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:02.773222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:02.785154 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3050/6083] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:02.787151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16302ac8-c5d5-4fcb-8b85-ac5f002fae65 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:02.792139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:02.793111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:02.793401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:02.793684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:02.794431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:02.795255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:02.797107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:02.815933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6946c-e659-4b14-967b-9743d294349d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:02.823054 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3034/6084] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:02.827074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6946c-e659-4b14-967b-9743d294349d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:02.832424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:02.833409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:02.833649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:02.833934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:02.834621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:02.837244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:02.896612 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3051/6085] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:02 2022] POST /identity/v3/projects => generated 401 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:02.901773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:02.919412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf8f79-3ade-4613-8023-2537425668b8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:03.037603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:03.042427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.043035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.043538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.044400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:03.046711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:03.101679 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3035/6086] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:02 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:03.119280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:03.125444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705d5f5-4e07-4c31-8024-f6a48bcecbbd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:03.147887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:03.148439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.148722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.149025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.149689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:03.151310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:03.206915 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3052/6087] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:03.208527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:03.237652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69061d75-8a7b-4a2c-9561-fec3b2991f9b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:03.273598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dba4-aa05-4b42-8f48-3d31f32295ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:03.274235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dba4-aa05-4b42-8f48-3d31f32295ed admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.274524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dba4-aa05-4b42-8f48-3d31f32295ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.274808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dba4-aa05-4b42-8f48-3d31f32295ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.275568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0dba4-aa05-4b42-8f48-3d31f32295ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:03.280788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0dba4-aa05-4b42-8f48-3d31f32295ed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:03.313540 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3036/6088] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:03.315465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:03.338431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27a39-f025-4423-aa8f-4e673958f0dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:03.350848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be913-82a5-41ed-9fea-20ca6068f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:03.352000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be913-82a5-41ed-9fea-20ca6068f219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.352488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be913-82a5-41ed-9fea-20ca6068f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.353094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be913-82a5-41ed-9fea-20ca6068f219 admin admin] PATH_INFO: `/v3/projects/a652f8521b434c6c807f1b6cc6437818/users/1ddb5e1818ba4b12a1026d58d059d43b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.373290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.373582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.373864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.374050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156be913-82a5-41ed-9fea-20ca6068f219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a652f8521b434c6c807f1b6cc6437818, user_id=1ddb5e1818ba4b12a1026d58d059d43b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:03.378190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156be913-82a5-41ed-9fea-20ca6068f219 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:03.394303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:03.409617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] MFA Rules not processed for user `2825041f8aa2462f8719a0f124e0b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:03.411490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:03.418843 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3053/6089] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:03 2022] PUT /identity/v3/projects/a652f8521b434c6c807f1b6cc6437818/users/1ddb5e1818ba4b12a1026d58d059d43b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:03.422806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b0e8-fe2e-41a6-a5b9-573ae75d903c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.423432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b0e8-fe2e-41a6-a5b9-573ae75d903c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.423979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500b0e8-fe2e-41a6-a5b9-573ae75d903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.492547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6500b0e8-fe2e-41a6-a5b9-573ae75d903c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:03.502752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6500b0e8-fe2e-41a6-a5b9-573ae75d903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:03.640625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3037/6090] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:03.699226 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3054/6091] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:03.707042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:03.708842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:03.875800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3d92-7b59-46ae-ab03-9a96aa7554e7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:03.907903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:03.908450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:03.908737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:03.909049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:03.930052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:03.931491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:03.954413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3038/6092] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:06.021483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:06.022442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:06.022933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:06.163315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] MFA Rules not processed for user `1ddb5e1818ba4b12a1026d58d059d43b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:06.181147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:06.210431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:06.380153 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3055/6093] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:06.382829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:06.398237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f871e-6921-4cce-b54b-0cc6a10e5d07 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:06.409997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:06.412264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:06.412794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:06.413599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:06.414524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:06.422714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:06.579990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3039/6094] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:06 2022] POST /identity/v3/projects => generated 405 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:06.583646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:06.598780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8418c9-af08-4190-8c8d-d6a5b49dad03 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:06.734521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:06.734521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:06.734521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:06.734521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:06.735039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:06.735039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:06.771248 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3056/6095] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:06 2022] POST /identity/v3/users => generated 309 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:06.775530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:06.790287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea5f38-5e9d-4723-a783-e501be132e5d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:06.795645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:06.796346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:06.796712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:06.797110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:06.797840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:06.799525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:06.819000 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3040/6096] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:06.823147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:06.836050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ef8e-3ff5-4c25-a0b0-c3f1efebb431 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:06.846750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:06.847897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:06.848854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:06.849168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] PATH_INFO: `/v3/projects/6afdd6e943e0454fb5caef266538b576/users/dfef990bb6e2447abeab0896f1ac0057/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:06.902962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afdd6e943e0454fb5caef266538b576, user_id=dfef990bb6e2447abeab0896f1ac0057, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:06.905708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:06.947328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3057/6097] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:06 2022] PUT /identity/v3/projects/6afdd6e943e0454fb5caef266538b576/users/dfef990bb6e2447abeab0896f1ac0057/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:06.951670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:06.971454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637634-b15c-49c8-8414-7663e5700eab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:07.112974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c677716-cbe8-4426-a4fc-e9bd318dca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:07.115604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c677716-cbe8-4426-a4fc-e9bd318dca20 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:07.116214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c677716-cbe8-4426-a4fc-e9bd318dca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:07.117557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c677716-cbe8-4426-a4fc-e9bd318dca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:07.119061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c677716-cbe8-4426-a4fc-e9bd318dca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:07.121647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c677716-cbe8-4426-a4fc-e9bd318dca20 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:07.136132 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3041/6098] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:07.140188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:07.156425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef16533-a9f3-4a3c-8bee-235ca5b78bff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:07.171841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:07.172781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:07.173314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:07.173941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] PATH_INFO: `/v3/projects/6afdd6e943e0454fb5caef266538b576/users/dfef990bb6e2447abeab0896f1ac0057/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:07.180452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afdd6e943e0454fb5caef266538b576, user_id=dfef990bb6e2447abeab0896f1ac0057, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:07.186982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:07.206878 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3058/6099] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:07 2022] PUT /identity/v3/projects/6afdd6e943e0454fb5caef266538b576/users/dfef990bb6e2447abeab0896f1ac0057/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:08.644204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:08.644768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:08.644768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:08.700092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] MFA Rules not processed for user `dfef990bb6e2447abeab0896f1ac0057`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:08.701468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:08.708967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:08.879117 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3042/6100] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:08 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:11.132714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:11.280202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf5ae-d3f6-48e3-ba97-9f5a3059287c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:11.288854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:11.289910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:11.290303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:11.290747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] PATH_INFO: `/v3/users/1ddb5e1818ba4b12a1026d58d059d43b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:11.292574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddb5e1818ba4b12a1026d58d059d43b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:11.306241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:11.308820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:11.441368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddb5e1818ba4b12a1026d58d059d43b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:11.460061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddb5e1818ba4b12a1026d58d059d43b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:11.460880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddb5e1818ba4b12a1026d58d059d43b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:11.471500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddb5e1818ba4b12a1026d58d059d43b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:11.472364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddb5e1818ba4b12a1026d58d059d43b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:11.494636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3059/6101] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:11 2022] DELETE /identity/v3/users/1ddb5e1818ba4b12a1026d58d059d43b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:11.917294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:11.947136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f867d3-a08e-4a3c-b6af-515cad8b63c6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:12.170732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:12.171423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:12.171882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:12.172171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] PATH_INFO: `/v3/projects/a652f8521b434c6c807f1b6cc6437818` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:12.183553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a652f8521b434c6c807f1b6cc6437818)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:12.191010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:12.369475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a652f8521b434c6c807f1b6cc6437818', 'request_id': 'req-6a467d72-ac29-42d6-8d8b-2d5e9388789f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.397902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a652f8521b434c6c807f1b6cc6437818', 'request_id': 'req-6a467d72-ac29-42d6-8d8b-2d5e9388789f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.434286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a652f8521b434c6c807f1b6cc6437818', 'request_id': 'req-6a467d72-ac29-42d6-8d8b-2d5e9388789f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.478270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] The token cache is being invalidate because project a652f8521b434c6c807f1b6cc6437818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:12.478789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.479641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.484683 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3043/6102] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:11 2022] DELETE /identity/v3/projects/a652f8521b434c6c807f1b6cc6437818 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:12.488451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:12.491105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:12.531121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5666ef-9e3b-4333-8c7d-31c5b5214ce3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:12.693039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:12.693796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:12.694085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:12.694371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] PATH_INFO: `/v3/users/dfef990bb6e2447abeab0896f1ac0057` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:12.695695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfef990bb6e2447abeab0896f1ac0057)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:12.698616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:12.919395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfef990bb6e2447abeab0896f1ac0057'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.968422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfef990bb6e2447abeab0896f1ac0057'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.969980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfef990bb6e2447abeab0896f1ac0057'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.998168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfef990bb6e2447abeab0896f1ac0057'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:12.998950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fec8db30-26ef-43e7-afc9-b847505a3fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfef990bb6e2447abeab0896f1ac0057'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:13.025823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:13.061491 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3060/6103] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:12 2022] DELETE /identity/v3/users/dfef990bb6e2447abeab0896f1ac0057 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:13.459623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:13.461492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:13.484074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a467d72-ac29-42d6-8d8b-2d5e9388789f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:13.552656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:13.612635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:13.614267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:13.614781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:13.615497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] PATH_INFO: `/v3/projects/6afdd6e943e0454fb5caef266538b576` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:13.616959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afdd6e943e0454fb5caef266538b576)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:13.619256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:13.722243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afdd6e943e0454fb5caef266538b576', 'request_id': 'req-cf597367-ceab-4503-9447-d141005b65b0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:13.757194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afdd6e943e0454fb5caef266538b576', 'request_id': 'req-cf597367-ceab-4503-9447-d141005b65b0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:13.766175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afdd6e943e0454fb5caef266538b576', 'request_id': 'req-cf597367-ceab-4503-9447-d141005b65b0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:13.804199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] The token cache is being invalidate because project 6afdd6e943e0454fb5caef266538b576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:13.804504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:13.809578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cf597367-ceab-4503-9447-d141005b65b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:13.811204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3044/6104] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:13 2022] DELETE /identity/v3/projects/6afdd6e943e0454fb5caef266538b576 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:13.816352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:13.817356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:13.817511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:13.855404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:13.858597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:13.971546 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3061/6105] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:13.979786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:13.980093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:13.980374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.011501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:14.012723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:14.021208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3045/6106] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:14.026432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:14.042224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9f10a-9819-447d-b294-8834d5ff8b17 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:14.065368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:14.065368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.065368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.065368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.065787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:14.065787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:14.065787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:14.081345 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3062/6107] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:14.090110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:14.104535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d823ca-3aae-4349-933c-dbf7b3738eef None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:14.122842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:14.123472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.123763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.124043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.124694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:14.128591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:14.178933 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3046/6108] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:14 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:14.184162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:14.200280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17657790-b14e-4766-b9a2-81c5fcce8f0c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:14.356739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:14.358340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.358738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.359032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.360981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:14.371301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:14.444353 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3063/6109] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:14 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:14.445778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:14.482786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4119f-a6a9-4874-91bd-6dee297f2a0e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:14.513355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:14.515597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.517929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.519530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.524238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:14.531303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:14.579778 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3047/6110] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:14.581004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:14.597410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2f39e-a571-457f-a9b6-f3ee291d4233 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:14.606178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846e24-797f-4c68-a20f-91a22d4deb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:14.606887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846e24-797f-4c68-a20f-91a22d4deb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.607178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846e24-797f-4c68-a20f-91a22d4deb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.607553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846e24-797f-4c68-a20f-91a22d4deb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.608219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e846e24-797f-4c68-a20f-91a22d4deb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:14.610164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e846e24-797f-4c68-a20f-91a22d4deb3e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:14.634404 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3064/6111] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:14.635579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:14.651694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26019737-ae61-424c-a6df-40671847e5bf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:14.661229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:14.661967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.662216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.662432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] PATH_INFO: `/v3/projects/c0bde453cb3344c4a6732982e6fe0056/users/4ba74423e92840889b9c39c8791923e9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.706067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bde453cb3344c4a6732982e6fe0056, user_id=4ba74423e92840889b9c39c8791923e9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:14.715703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:14.748265 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3048/6112] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:14 2022] PUT /identity/v3/projects/c0bde453cb3344c4a6732982e6fe0056/users/4ba74423e92840889b9c39c8791923e9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:14.760698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:14.761487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:14.762278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:14.824566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] MFA Rules not processed for user `4ba74423e92840889b9c39c8791923e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:14.826470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:14.945980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:14.963080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3065/6113] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:14.964238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.122709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789a321-e650-41d1-ab62-8077c49b9938 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:15.128121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:15.128877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.129327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.129611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.130298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:15.132536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:15.138024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:15.203420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3049/6114] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:14 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:15.208412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.229896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1cf6b-4ad3-422b-adf1-8b87f86f1123 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:15.311306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:15.311550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.311981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.312224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.313211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:15.315288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:15.345759 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3066/6115] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:15 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:15.346487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.360948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b1ea9-49f3-4f82-a72d-d4c798a59ac6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:15.367513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:15.369173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.369770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.370585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.372489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:15.375327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:15.393862 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3050/6116] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:15.395444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.409512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e1ff-a7ac-4fa4-88b8-4c3a304bf514 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:15.417789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:15.418753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.419270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.419744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] PATH_INFO: `/v3/projects/3c313f716ea64445bafcf65d27e6cd98/users/ec46758e6b644d82ad34a5ed5bf3cf8b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.455860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c313f716ea64445bafcf65d27e6cd98, user_id=ec46758e6b644d82ad34a5ed5bf3cf8b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:15.459366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:15.489998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.495751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3067/6117] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:15 2022] PUT /identity/v3/projects/3c313f716ea64445bafcf65d27e6cd98/users/ec46758e6b644d82ad34a5ed5bf3cf8b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:15.502090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a84be-c7c9-45b3-ad8f-83516d6ff6f4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:15.612488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5fb47-2964-40f0-afec-4b33db381229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:15.613053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5fb47-2964-40f0-afec-4b33db381229 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.613539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5fb47-2964-40f0-afec-4b33db381229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.614772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5fb47-2964-40f0-afec-4b33db381229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.616999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5fb47-2964-40f0-afec-4b33db381229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:15.618998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5fb47-2964-40f0-afec-4b33db381229 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:15.643231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3051/6118] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:15.647370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.659757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78e039-4edb-491f-82d8-11219f936834 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:15.678514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:15.679207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.679666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.679795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] PATH_INFO: `/v3/projects/3c313f716ea64445bafcf65d27e6cd98/users/ec46758e6b644d82ad34a5ed5bf3cf8b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.681965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c313f716ea64445bafcf65d27e6cd98, user_id=ec46758e6b644d82ad34a5ed5bf3cf8b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:15.684697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:15.726834 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3068/6119] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:15 2022] PUT /identity/v3/projects/3c313f716ea64445bafcf65d27e6cd98/users/ec46758e6b644d82ad34a5ed5bf3cf8b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:15.728364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:15.728661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:15.728979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:15.782750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] MFA Rules not processed for user `ec46758e6b644d82ad34a5ed5bf3cf8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:15.784069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:15.846260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.848100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:15.909790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3052/6120] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:54:15.941596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:15.951997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:16.001167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad937c-dfc1-49aa-b317-c198519eba9c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:16.014942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:16.015604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:16.015887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:16.016162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] PATH_INFO: `/v3/users/07e5604982304b39a471def3152668ec` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:16.017369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e5604982304b39a471def3152668ec)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:16.019394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:16.076521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f629a1-f495-44ef-b0c7-c0892c84536f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:16.088854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff4618-8492-4cbb-84bb-f56618959efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:16.089873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4618-8492-4cbb-84bb-f56618959efe service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:16.090357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4618-8492-4cbb-84bb-f56618959efe service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:16.090893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff4618-8492-4cbb-84bb-f56618959efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:16.104245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e5604982304b39a471def3152668ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:16.105472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:16.109774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff4618-8492-4cbb-84bb-f56618959efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:16.111342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff4618-8492-4cbb-84bb-f56618959efe service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:16.120670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e5604982304b39a471def3152668ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:16.121521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:16.121639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e5604982304b39a471def3152668ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:16.142204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3053/6121] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:16.143867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e5604982304b39a471def3152668ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:16.144611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e5604982304b39a471def3152668ec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:16.161322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3069/6122] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:15 2022] DELETE /identity/v3/users/07e5604982304b39a471def3152668ec => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:16.166815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:16.167114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:16.167753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:16.216036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:16.217594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:16.307876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:16.309425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:16.345175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3054/6123] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:16.355836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:16.357326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:16.445293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395679b-e78c-4215-946d-2fcc98dec5ae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:16.450990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:16.452132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:16.452920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:16.453185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:16.456306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:16.493004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a69878-9dfc-4a26-9061-335187a96228 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:16.501354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:16.503597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:16.504161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:16.505486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:16.522323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:16.526522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:16.551639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3055/6124] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:54:16.561825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:16.563992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c85daf-2ee3-4d7c-81cc-e26c3659321e service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:16.593399 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3070/6125] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:54:17.241558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:17.243062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:17.268285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ae311-b999-489d-8986-e035b9479ea7 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:17.292074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:17.293135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:17.293471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:17.293878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] PATH_INFO: `/v3/projects/bd4b1d4fa7c640aeb0431a81e17c05a8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:17.305459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4b1d4fa7c640aeb0431a81e17c05a8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:17.307695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:17.384780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4b1d4fa7c640aeb0431a81e17c05a8', 'request_id': 'req-8a651668-a925-4287-af79-7f7ada6cd509'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:17.411597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4b1d4fa7c640aeb0431a81e17c05a8', 'request_id': 'req-8a651668-a925-4287-af79-7f7ada6cd509'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:17.423521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4b1d4fa7c640aeb0431a81e17c05a8', 'request_id': 'req-8a651668-a925-4287-af79-7f7ada6cd509'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:17.460085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] The token cache is being invalidate because project bd4b1d4fa7c640aeb0431a81e17c05a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:17.461447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:17.462495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8a651668-a925-4287-af79-7f7ada6cd509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:17.464931 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3056/6126] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:17 2022] DELETE /identity/v3/projects/bd4b1d4fa7c640aeb0431a81e17c05a8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:17.470252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:17.470752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:17.470854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:17.512171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:17.513353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:17.604996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3071/6127] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:54:17.606450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:17.606895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:17.607285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:17.633362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:17.635050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:17.645052 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3057/6128] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:17.652212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:17.671431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47efbbf-2ab1-4136-b63a-e39eb18d6ab4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:17.688424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:17.689341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:17.691284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:17.692600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:17.694092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:17.694552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:17.696818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:17.726974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:17.727586 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3072/6129] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:17.738280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f991e-963b-4872-8238-8107833ccba8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:17.745668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:17.746292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:17.746575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:17.746851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:17.747517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:17.749471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:17.775930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:17.802769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3058/6130] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:17 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:54:17.806352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:17.820725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5796f-6885-4537-b39d-88013be00996 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:17.828871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:17.977865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:17.978631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:17.978921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:17.979201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:17.979912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:17.982275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:18.037139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3073/6131] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:17 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:54:18.041687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:18.060480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab3b-a60f-432b-ad9a-6aa08f5dc33a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:18.067081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:18.068090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:18.075878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:18.094317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:18.098314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:18.098314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:18.118234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3059/6132] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:18.119666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:18.133257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7d831-217f-40d0-ab2b-a05e214a5d75 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:18.141357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ad7f0-88f5-402e-a0d1-6436d3bf6abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:18.142802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ad7f0-88f5-402e-a0d1-6436d3bf6abd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:18.143190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ad7f0-88f5-402e-a0d1-6436d3bf6abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:18.144156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ad7f0-88f5-402e-a0d1-6436d3bf6abd admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:18.144328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ad7f0-88f5-402e-a0d1-6436d3bf6abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:18.146910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ad7f0-88f5-402e-a0d1-6436d3bf6abd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:18.182727 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3074/6133] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:18.189805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:18.210427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80af10-16d9-47bd-b857-28786de80b9e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:18.223679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:18.224727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:18.225235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:18.225706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] PATH_INFO: `/v3/projects/e2d341dc672c4b15a97cf92d2167a26e/users/4a2155d0c4a345119204669abadb4bfc/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:18.260957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d341dc672c4b15a97cf92d2167a26e, user_id=4a2155d0c4a345119204669abadb4bfc, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:18.264449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:18.322227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3060/6134] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:18 2022] PUT /identity/v3/projects/e2d341dc672c4b15a97cf92d2167a26e/users/4a2155d0c4a345119204669abadb4bfc/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:18.332008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:18.333152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:18.333732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:18.377995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] MFA Rules not processed for user `4a2155d0c4a345119204669abadb4bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:18.380791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:18.554704 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3075/6135] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:18.571424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:18.573422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:18.712248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902c62d-7001-4451-88af-ed13ad47a8cb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:18.745496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:18.745871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:18.746358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:18.746727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:18.767628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:18.776493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:18.799454 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3061/6136] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:28.546303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:28.787023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:29.283349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:29.287638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:29.375519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6ccaa-7512-4768-bf5a-7b1d222a7691 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:29.380515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:29.381518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:29.382023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:29.382671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:29.385370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:29.485139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:29.486820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:29.502788 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3076/6137] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:29.618587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:29.620396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:29.735769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebb20-48b6-465e-a300-b72996c7fdb4 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:29.740731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:29.741409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:29.741868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:29.742100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:29.743987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:29.759495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:29.761322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:29.773639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3062/6138] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:29.905844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:29.924695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8f664-e913-4c6f-8d83-ee5d82bc53fc service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:29.930265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:29.930869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:29.931330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:29.931664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:29.933609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:29.961324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:29.963204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6407c8-5dea-4eea-bbf1-3e4ded2baf15 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:29.989138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3077/6139] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:31.166607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:31.168873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:31.288329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4e014-60fd-45c0-b7a0-9ed7deb5ea8b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:31.294933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:31.295874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:31.296310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:31.296784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] PATH_INFO: `/v3/users/4ba74423e92840889b9c39c8791923e9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:31.298197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba74423e92840889b9c39c8791923e9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:31.300348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:31.386380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba74423e92840889b9c39c8791923e9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:31.403194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba74423e92840889b9c39c8791923e9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:31.404287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba74423e92840889b9c39c8791923e9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:31.415247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba74423e92840889b9c39c8791923e9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:31.417632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba74423e92840889b9c39c8791923e9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:31.455710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3063/6140] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:31 2022] DELETE /identity/v3/users/4ba74423e92840889b9c39c8791923e9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:31.458344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:31.458884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:31.458958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:31.484042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:31.485283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:31.575688 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3078/6141] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:31.587502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:31.589086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:31.648360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:31.720431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633182bc-9514-4ba1-afa4-19f00da101ce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:31.725397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:31.726616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:31.727480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:31.727480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:31.742248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:31.744008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:31.765896 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3064/6142] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:54:32.128782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:32.130324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:32.151746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6856a4-3021-49b3-9368-612272511fbd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:32.164689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:32.165380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:32.165669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:32.165992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] PATH_INFO: `/v3/projects/c0bde453cb3344c4a6732982e6fe0056` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:32.168840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bde453cb3344c4a6732982e6fe0056)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:32.170822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:32.226400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:32.256833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bde453cb3344c4a6732982e6fe0056', 'request_id': 'req-965becb3-c4ed-4e31-8e9f-78bb564b037a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.281223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bde453cb3344c4a6732982e6fe0056', 'request_id': 'req-965becb3-c4ed-4e31-8e9f-78bb564b037a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.294076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bde453cb3344c4a6732982e6fe0056', 'request_id': 'req-965becb3-c4ed-4e31-8e9f-78bb564b037a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.322256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] The token cache is being invalidate because project c0bde453cb3344c4a6732982e6fe0056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:32.322864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.323917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.329115 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3079/6143] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:32 2022] DELETE /identity/v3/projects/c0bde453cb3344c4a6732982e6fe0056 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:32.329938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:32.340347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c85ef-7573-449b-b1c1-2809a15ab6c0 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:32.420775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:32.422636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:32.423497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:32.423985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] PATH_INFO: `/v3/users/ec46758e6b644d82ad34a5ed5bf3cf8b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:32.426136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec46758e6b644d82ad34a5ed5bf3cf8b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:32.429479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:32.498014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec46758e6b644d82ad34a5ed5bf3cf8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.517276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec46758e6b644d82ad34a5ed5bf3cf8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.518093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec46758e6b644d82ad34a5ed5bf3cf8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.534608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec46758e6b644d82ad34a5ed5bf3cf8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.536215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-188e15d7-433f-4191-9f12-f65cf705a004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec46758e6b644d82ad34a5ed5bf3cf8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:32.558974 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3065/6144] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:32 2022] DELETE /identity/v3/users/ec46758e6b644d82ad34a5ed5bf3cf8b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:33.013747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.015492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:33.042920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965becb3-c4ed-4e31-8e9f-78bb564b037a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.125093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.125842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.126348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.127064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] PATH_INFO: `/v3/projects/3c313f716ea64445bafcf65d27e6cd98` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.129573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c313f716ea64445bafcf65d27e6cd98)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.131863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.205266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c313f716ea64445bafcf65d27e6cd98', 'request_id': 'req-eff452d4-2d33-4f21-ad6b-9d87e0d00473'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:33.212909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c313f716ea64445bafcf65d27e6cd98', 'request_id': 'req-eff452d4-2d33-4f21-ad6b-9d87e0d00473'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:33.220941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c313f716ea64445bafcf65d27e6cd98', 'request_id': 'req-eff452d4-2d33-4f21-ad6b-9d87e0d00473'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:33.238816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] The token cache is being invalidate because project 3c313f716ea64445bafcf65d27e6cd98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:33.239357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:33.240262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eff452d4-2d33-4f21-ad6b-9d87e0d00473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:33.245688 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3080/6145] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:33 2022] DELETE /identity/v3/projects/3c313f716ea64445bafcf65d27e6cd98 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:33.247579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.248098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.248652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.272542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:33.274010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:33.336329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:33.366658 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3066/6146] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:33.368896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.369236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.369971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.392773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:33.394022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:33.406925 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3081/6147] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:33.408375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.420842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df5111-2bf2-4342-89c7-8916e008257c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.425926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.426708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.427058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.427402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.428158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:33.428583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.430446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.451078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.456997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3067/6148] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:54:33.461249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c1e36-bca9-4f87-8589-6a21471dff67 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.466519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.467433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.467609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.468001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.468748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.470968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.507901 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3082/6149] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:33 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:33.509308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.520498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47188e88-0451-40d9-b72a-e82c345563ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.601198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.601198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.601198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.601198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.601566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.608936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.632424 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3068/6150] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:33 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:54:33.637026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.653151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4695957-42fb-4701-b621-eebcbebc4a01 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.665080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.665932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.667285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.667768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.668784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.670645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.687983 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3083/6151] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:33.692882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.706204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d6db3-b788-4f5c-9b18-197a3b5595d1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.714969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f9f8c-e5c3-441a-8525-fd6ba5141f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.715839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f9f8c-e5c3-441a-8525-fd6ba5141f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.716316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f9f8c-e5c3-441a-8525-fd6ba5141f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.717070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f9f8c-e5c3-441a-8525-fd6ba5141f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.718313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f9f8c-e5c3-441a-8525-fd6ba5141f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.720255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f9f8c-e5c3-441a-8525-fd6ba5141f04 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.738161 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3069/6152] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:33.738888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:33.744182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:33.750479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ed31-bdcc-460b-8bdb-aa16035a682f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:33.758446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:33.759159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.760265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.760562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] PATH_INFO: `/v3/projects/65c628ea03bd49d8ba1413281b85484d/users/313c27aa6b034bf6a3e217331059b62a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.794638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c628ea03bd49d8ba1413281b85484d, user_id=313c27aa6b034bf6a3e217331059b62a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:33.802777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:33.831371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3084/6153] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:33 2022] PUT /identity/v3/projects/65c628ea03bd49d8ba1413281b85484d/users/313c27aa6b034bf6a3e217331059b62a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:33.841973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:33.841973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:33.842253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:33.880153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] MFA Rules not processed for user `313c27aa6b034bf6a3e217331059b62a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:33.881877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:34.049103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3070/6154] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:34.052353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:34.147767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead305f-663b-44b9-ba5d-1bef6cda9e16 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:34.153168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:34.154398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.154398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.154610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.155224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:34.157416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:34.207178 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3085/6155] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:34 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:34.208479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:34.222155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e3d4c-2165-4f2b-8c03-d1b2b391e6fa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:34.307794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:34.353347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:34.355489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.356007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.356545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.357634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:34.360013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:34.399097 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3071/6156] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:34 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:34.403350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:34.415517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c95f45-129a-4046-af8a-cf7212c2ee4f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:34.432950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:34.433803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.433803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.434095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.434743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:34.436445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:34.471359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3086/6157] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:34.474271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:34.487100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c03c-4fa2-4bed-9d9c-6e0850a71a9a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:34.494240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:34.495025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.495431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.495645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] PATH_INFO: `/v3/projects/b952132a387c4436bbbec0a2d5ca648c/users/7adebc367c9f4d3d9a66ba60d1140da1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.530964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b952132a387c4436bbbec0a2d5ca648c, user_id=7adebc367c9f4d3d9a66ba60d1140da1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:34.534473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:34.559300 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3072/6158] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:34 2022] PUT /identity/v3/projects/b952132a387c4436bbbec0a2d5ca648c/users/7adebc367c9f4d3d9a66ba60d1140da1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:34.560541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:34.576215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf2e2-1395-48d5-a7aa-1e4cba1096f4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:34.745678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc0151-37fd-4e2d-8569-892eabac0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:34.746309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc0151-37fd-4e2d-8569-892eabac0225 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.746591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc0151-37fd-4e2d-8569-892eabac0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.746865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc0151-37fd-4e2d-8569-892eabac0225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.747520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc0151-37fd-4e2d-8569-892eabac0225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:34.749615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc0151-37fd-4e2d-8569-892eabac0225 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:34.777659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:34.778217 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3087/6159] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:34.793327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d518-6111-4d6e-9d88-8d0f1c0414e9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:34.803140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:34.805841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.806248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.807016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] PATH_INFO: `/v3/projects/b952132a387c4436bbbec0a2d5ca648c/users/7adebc367c9f4d3d9a66ba60d1140da1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.810166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b952132a387c4436bbbec0a2d5ca648c, user_id=7adebc367c9f4d3d9a66ba60d1140da1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:34.812834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:34.845808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:34.846095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:34.846375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:34.851420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3073/6160] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:34 2022] PUT /identity/v3/projects/b952132a387c4436bbbec0a2d5ca648c/users/7adebc367c9f4d3d9a66ba60d1140da1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:34.884705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] MFA Rules not processed for user `7adebc367c9f4d3d9a66ba60d1140da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:34.886215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:34.934975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:34.998325 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3088/6161] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:35.017994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:35.021069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:35.112468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8ed2-2801-4ccc-b719-dcc18697c756 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:35.117732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa8e4-0824-4b9d-9340-d6ada469d8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:35.118589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa8e4-0824-4b9d-9340-d6ada469d8fa service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:35.118930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa8e4-0824-4b9d-9340-d6ada469d8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:35.119516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa8e4-0824-4b9d-9340-d6ada469d8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:35.132404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa8e4-0824-4b9d-9340-d6ada469d8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:35.134806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa8e4-0824-4b9d-9340-d6ada469d8fa service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:35.160177 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3074/6162] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:35.906290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:36.053467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8214c0d-2984-4953-aca4-51f7687d6868 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:36.064010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:36.065149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:36.066571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:36.067146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] PATH_INFO: `/v3/users/313c27aa6b034bf6a3e217331059b62a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:36.069738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313c27aa6b034bf6a3e217331059b62a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:36.071935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:36.190824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313c27aa6b034bf6a3e217331059b62a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:36.213729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313c27aa6b034bf6a3e217331059b62a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:36.214960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313c27aa6b034bf6a3e217331059b62a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:36.239908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313c27aa6b034bf6a3e217331059b62a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:36.240968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313c27aa6b034bf6a3e217331059b62a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:36.277998 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3089/6163] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:35 2022] DELETE /identity/v3/users/313c27aa6b034bf6a3e217331059b62a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:36.279657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:36.280103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:36.280246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:36.324770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:36.328207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:36.492387 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3075/6164] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:36.555646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:36.557393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:36.632892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243af4b7-0a4a-459a-8fff-e46ae0de9f55 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:36.636928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:36.637628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:36.637915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:36.638191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:36.648143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:36.657753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:36.669264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:36.682469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3090/6165] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:54:37.205923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:37.207764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:37.222334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85785b7a-0e01-4ccf-9273-9a360ccb297e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:37.230306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:37.231241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:37.231858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:37.232458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] PATH_INFO: `/v3/projects/65c628ea03bd49d8ba1413281b85484d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:37.233823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c628ea03bd49d8ba1413281b85484d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:37.244495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:37.284439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:37.305647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c628ea03bd49d8ba1413281b85484d', 'request_id': 'req-af4ba14e-f65a-4778-abd6-8425a1ecfe43'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.319046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c628ea03bd49d8ba1413281b85484d', 'request_id': 'req-af4ba14e-f65a-4778-abd6-8425a1ecfe43'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.326073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c628ea03bd49d8ba1413281b85484d', 'request_id': 'req-af4ba14e-f65a-4778-abd6-8425a1ecfe43'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.338849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] The token cache is being invalidate because project 65c628ea03bd49d8ba1413281b85484d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:37.339152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.339836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.341384 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3076/6166] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:37 2022] DELETE /identity/v3/projects/65c628ea03bd49d8ba1413281b85484d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:37.346069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:37.358150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e1101-d696-4dcc-bc48-cebc08021aa0 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:37.424272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:37.424932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:37.425230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:37.425638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] PATH_INFO: `/v3/users/7adebc367c9f4d3d9a66ba60d1140da1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:37.427423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7adebc367c9f4d3d9a66ba60d1140da1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:37.429424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:37.482043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7adebc367c9f4d3d9a66ba60d1140da1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.504331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7adebc367c9f4d3d9a66ba60d1140da1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.505270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7adebc367c9f4d3d9a66ba60d1140da1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.514661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7adebc367c9f4d3d9a66ba60d1140da1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.515422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-58fbbbc5-9a1c-41e4-8b07-1bf42582a11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7adebc367c9f4d3d9a66ba60d1140da1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:37.531181 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3091/6167] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:37 2022] DELETE /identity/v3/users/7adebc367c9f4d3d9a66ba60d1140da1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:37.856320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:37.857799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:37.874491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ba14e-f65a-4778-abd6-8425a1ecfe43 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:37.947328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:37.948045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:37.948523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:37.948932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] PATH_INFO: `/v3/projects/b952132a387c4436bbbec0a2d5ca648c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:37.950157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b952132a387c4436bbbec0a2d5ca648c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:37.953395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.043460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b952132a387c4436bbbec0a2d5ca648c', 'request_id': 'req-03bdf836-5a5e-4f37-8674-b22fc4166e2b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:38.070410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b952132a387c4436bbbec0a2d5ca648c', 'request_id': 'req-03bdf836-5a5e-4f37-8674-b22fc4166e2b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:38.078219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b952132a387c4436bbbec0a2d5ca648c', 'request_id': 'req-03bdf836-5a5e-4f37-8674-b22fc4166e2b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:38.107335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] The token cache is being invalidate because project b952132a387c4436bbbec0a2d5ca648c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:38.108716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:38.110716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-03bdf836-5a5e-4f37-8674-b22fc4166e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:38.114952 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3077/6168] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:37 2022] DELETE /identity/v3/projects/b952132a387c4436bbbec0a2d5ca648c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:38.120315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.120551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.120810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.155323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:38.161186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:38.235245 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3092/6169] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:38.236573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.236980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.237212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.260583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:38.262015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:38.282013 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3078/6170] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:38.286388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.299305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b3ae5-0009-461f-9e5f-03d42268a153 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.306135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.306922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.307218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.307497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.308170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:38.308474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.310170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.327930 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3093/6171] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:38.329166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.339952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d45b1-7299-400f-b183-dbfb4ba1d83d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.345081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.345816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.346107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.346386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.347036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.350443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.388264 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3079/6172] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:38.392914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.399748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:38.409365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2651f-3cbd-4212-a8da-287496153550 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.512605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.513265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.513551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.513824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.514480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.516441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.540235 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3094/6173] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:38.544490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.556310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc2df-d766-4c83-a3fc-32cc1d4f61e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.561714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.562559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.562939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.563312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.564065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.565818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.580945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3080/6174] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:38.584065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.597945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d61b5-04db-4b94-aed3-55754598476c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.602802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0cdc7-1e43-4f72-b049-9c89d47be2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.603430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0cdc7-1e43-4f72-b049-9c89d47be2ef admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.603713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0cdc7-1e43-4f72-b049-9c89d47be2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.603993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0cdc7-1e43-4f72-b049-9c89d47be2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.604648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0cdc7-1e43-4f72-b049-9c89d47be2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.606784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0cdc7-1e43-4f72-b049-9c89d47be2ef admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.620232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3095/6175] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:38.624317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.636069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228227f2-caea-4641-973a-4bad9f7a52bb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.641094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.641703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.641986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.642264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] PATH_INFO: `/v3/projects/208851d8d05c43db9a4d80b257ac67c1/users/cd4593e56cea44d6afe5c620708caec7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.658297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:38.677750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208851d8d05c43db9a4d80b257ac67c1, user_id=cd4593e56cea44d6afe5c620708caec7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.681330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.731589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.731589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.731589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.731950 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3081/6176] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:38 2022] PUT /identity/v3/projects/208851d8d05c43db9a4d80b257ac67c1/users/cd4593e56cea44d6afe5c620708caec7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:38.763288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] MFA Rules not processed for user `cd4593e56cea44d6afe5c620708caec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:38.764679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:38.870060 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3096/6177] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:38.874236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:38.951469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde2e88-e603-4021-9bcb-7cc548560812 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:38.956351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc406c-88f0-4b0c-b974-375f98b3e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:38.957650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc406c-88f0-4b0c-b974-375f98b3e168 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:38.957936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc406c-88f0-4b0c-b974-375f98b3e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:38.958309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc406c-88f0-4b0c-b974-375f98b3e168 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:38.958970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc406c-88f0-4b0c-b974-375f98b3e168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:38.960970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc406c-88f0-4b0c-b974-375f98b3e168 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:38.990425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3082/6178] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:38.994131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.014339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bdc32-ec5e-4877-92da-1fddab6df705 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.071012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.071012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.071261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.093976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.096030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.096522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.097056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.098235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.098350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:39.099633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:39.102027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.130533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:39.141526 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3097/6179] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:38 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:39.142949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.154858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e27a-cfec-4335-b617-918a6d08b520 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.161838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.162465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.162752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.163033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.164137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.166217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.189580 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3098/6180] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:39.196141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.211370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3083/6181] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:54:39.214120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a31d1-ef8e-4e5b-9ded-eb6c507d93df admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.220756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.221591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.221940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.222279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] PATH_INFO: `/v3/projects/fe3c6db20de14ed7a4030c6255a4e670/users/050db9bc36d3433a9ea22602f9022d8e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.229133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.230691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:39.263780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3c6db20de14ed7a4030c6255a4e670, user_id=050db9bc36d3433a9ea22602f9022d8e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.267381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.295024 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3099/6182] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:39 2022] PUT /identity/v3/projects/fe3c6db20de14ed7a4030c6255a4e670/users/050db9bc36d3433a9ea22602f9022d8e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:39.298915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.378524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69967cd1-94e8-430c-a168-b628a8c40df1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.396723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:39.410224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac991-3af5-4020-a10e-8035b758465c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.416629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.417493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.417919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.418346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.419153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.421028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.433808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3100/6183] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:39.437464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.451091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7df5f-a4fc-459d-8515-0fddc390e9d5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.456395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e878e3-b4ea-4130-86f5-4a91b5fc1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.457731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e878e3-b4ea-4130-86f5-4a91b5fc1fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.458005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e878e3-b4ea-4130-86f5-4a91b5fc1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.458289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e878e3-b4ea-4130-86f5-4a91b5fc1fa4 admin admin] PATH_INFO: `/v3/projects/fe3c6db20de14ed7a4030c6255a4e670/users/050db9bc36d3433a9ea22602f9022d8e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.462428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e878e3-b4ea-4130-86f5-4a91b5fc1fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3c6db20de14ed7a4030c6255a4e670, user_id=050db9bc36d3433a9ea22602f9022d8e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.465447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e878e3-b4ea-4130-86f5-4a91b5fc1fa4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.479382 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3101/6184] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:39 2022] PUT /identity/v3/projects/fe3c6db20de14ed7a4030c6255a4e670/users/050db9bc36d3433a9ea22602f9022d8e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:39.481865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.482808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.483227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.483602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.491988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.492561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.493093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.531535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] MFA Rules not processed for user `050db9bc36d3433a9ea22602f9022d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:39.533078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:39.570930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.572885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.588246 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3084/6185] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:54:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:54:39.637957 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3102/6186] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:54:39.651493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:39.653124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:39.741056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b38a9c-e747-425f-81a9-6f9a126e7dd4 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:39.892533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:39.893269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:39.895486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:39.896839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:39.921362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:39.922764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:39.962462 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3085/6187] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:40.082261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:40.095862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e5b0-b3ca-4c07-b0d4-c7dd8214093a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:40.108233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f5e5a-e7f1-4f3c-9890-b296c9938635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:40.109383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5e5a-e7f1-4f3c-9890-b296c9938635 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:40.109950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5e5a-e7f1-4f3c-9890-b296c9938635 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:40.110373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f5e5a-e7f1-4f3c-9890-b296c9938635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:40.170332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:40.211217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f5e5a-e7f1-4f3c-9890-b296c9938635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:40.213611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f5e5a-e7f1-4f3c-9890-b296c9938635 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:40.249770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3103/6188] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:40.862747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:40.865227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:40.952990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:41.064455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b7f48-2eaf-4c22-897d-09596b16436c service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:41.088804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:41.089571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:41.089854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:41.090133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] PATH_INFO: `/v3/users/4a2155d0c4a345119204669abadb4bfc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:41.091312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2155d0c4a345119204669abadb4bfc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:41.093258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:41.199597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2155d0c4a345119204669abadb4bfc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:41.226080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2155d0c4a345119204669abadb4bfc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:41.226920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2155d0c4a345119204669abadb4bfc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:41.246526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2155d0c4a345119204669abadb4bfc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:41.247312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2155d0c4a345119204669abadb4bfc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:41.286976 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3086/6189] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:40 2022] DELETE /identity/v3/users/4a2155d0c4a345119204669abadb4bfc => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:41.292392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:41.293412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:41.293903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:41.337322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:41.338956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:41.490836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3104/6190] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:41.502929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:41.505116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:41.711979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea5d9-b9e2-4da5-938d-19022c9a1a44 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:41.718743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d1c06-da71-4476-bce3-2687dadfd27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:41.720975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1c06-da71-4476-bce3-2687dadfd27a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:41.721422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1c06-da71-4476-bce3-2687dadfd27a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:41.721983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1c06-da71-4476-bce3-2687dadfd27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:41.737544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d1c06-da71-4476-bce3-2687dadfd27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:41.740305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d1c06-da71-4476-bce3-2687dadfd27a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:41.755333 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3087/6191] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:42.459043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:42.464779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:42.484435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ccef1-1381-4813-9635-5e7bf1e04d6d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:42.504511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:42.505395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:42.505811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:42.506193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] PATH_INFO: `/v3/projects/e2d341dc672c4b15a97cf92d2167a26e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:42.508197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d341dc672c4b15a97cf92d2167a26e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:42.512171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:42.654095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d341dc672c4b15a97cf92d2167a26e', 'request_id': 'req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:42.666088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d341dc672c4b15a97cf92d2167a26e', 'request_id': 'req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:42.692260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d341dc672c4b15a97cf92d2167a26e', 'request_id': 'req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:42.715911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] The token cache is being invalidate because project e2d341dc672c4b15a97cf92d2167a26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:42.716965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:42.728328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ac1a3be-d2c4-4e9c-bebd-44333dc77d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:42.732922 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3105/6192] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:42 2022] DELETE /identity/v3/projects/e2d341dc672c4b15a97cf92d2167a26e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:42.738536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:42.739101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:42.739176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:42.795235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:42.798473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:42.855863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:42.902193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:42.902480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:42.902766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:42.911786 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3088/6193] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:42.928190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:42.929575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:42.943164 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3106/6194] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:42.944608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:42.956143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3ea56-7ef3-434f-84b4-f88f6ef25846 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:42.969311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:42.969954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:42.974251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:42.974251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:42.974251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:42.974251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:42.974697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:43.043476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:43.057037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24debdf3-7b1a-428a-afa8-a6f25f10cda7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:43.058958 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3089/6195] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:43.079477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:43.080218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:43.082415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:43.082764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:43.084661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:43.088196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:43.226062 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3107/6196] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:43 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:43.230727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:43.261629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3459-d199-4f17-a01f-afdd3e65745c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:43.527264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:43.528621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:43.529055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:43.529403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:43.530113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:43.532305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:43.576619 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3090/6197] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:43 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:43.578220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:43.591647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e976-3f93-4df4-8d39-8a6f291a7979 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:43.598328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:43.598965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:43.599250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:43.599525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:43.600916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:43.610058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:43.631009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:43.642613 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3108/6198] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:43.645314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1282a87-99ed-4891-ba24-48f27711269e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:43.651543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5f28-39d6-48f1-b634-9eef5b9fd2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:43.652447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5f28-39d6-48f1-b634-9eef5b9fd2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:43.653851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5f28-39d6-48f1-b634-9eef5b9fd2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:43.654148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5f28-39d6-48f1-b634-9eef5b9fd2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:43.655353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e5f28-39d6-48f1-b634-9eef5b9fd2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:43.660461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e5f28-39d6-48f1-b634-9eef5b9fd2f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:43.684873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:43.685714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3091/6199] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:43.698990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32f60-914a-41b0-9b19-9a74b399501a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:43.716233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:43.716942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:43.717238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:43.717639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] PATH_INFO: `/v3/projects/6345a777ff224f558120171bee710f6a/users/de963cdc932941c7bac32406ee190634/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:43.763580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:43.772844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6345a777ff224f558120171bee710f6a, user_id=de963cdc932941c7bac32406ee190634, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:43.776120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:43.852347 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3109/6200] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:43 2022] PUT /identity/v3/projects/6345a777ff224f558120171bee710f6a/users/de963cdc932941c7bac32406ee190634/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:43.858557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:43.859111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:43.859209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:43.929392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:43.930391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:43.932805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:43.950356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:44.162163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adda3-a318-4849-96a7-980276e792c4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:44.178956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:44.180192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:44.180488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:44.180770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] PATH_INFO: `/v3/users/cd4593e56cea44d6afe5c620708caec7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:44.197578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3092/6201] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:44.201328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4593e56cea44d6afe5c620708caec7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:44.209053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:44.213636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:44.217220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:44.317971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4593e56cea44d6afe5c620708caec7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:44.374265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4593e56cea44d6afe5c620708caec7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:44.375390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4593e56cea44d6afe5c620708caec7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:44.381815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:44.393120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4593e56cea44d6afe5c620708caec7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:44.396698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2b09738a-808e-4d39-9970-1a701e601f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4593e56cea44d6afe5c620708caec7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:44.417304 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3110/6202] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:43 2022] DELETE /identity/v3/users/cd4593e56cea44d6afe5c620708caec7 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:44.421670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:44.421957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:44.422277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:44.425624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffba1a-b024-4079-915f-e3d5bf21a679 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:44.448639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:44.451304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:44.583219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:44.585672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:44.586153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:44.587996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:44.596349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:44.607545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3111/6203] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:54:44.617546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:44.619300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:44.630188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:44.632441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:44.639453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6596-b49e-421f-99c4-25e3b94d8675 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:44.643148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:44.643776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:44.644125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:44.645493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:44.648147 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3093/6204] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:54:44.662735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:44.663427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:44.670733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:44.694805 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3112/6205] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:45.208620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:45.210504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:45.262424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3a094-0a80-4ff4-9380-9641ad5bf160 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:45.276885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:45.279484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:45.279992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:45.280757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] PATH_INFO: `/v3/projects/208851d8d05c43db9a4d80b257ac67c1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:45.282774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208851d8d05c43db9a4d80b257ac67c1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:45.285652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:45.385998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208851d8d05c43db9a4d80b257ac67c1', 'request_id': 'req-c7a2aad0-f3e4-432f-945b-678afb26a024'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.397519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208851d8d05c43db9a4d80b257ac67c1', 'request_id': 'req-c7a2aad0-f3e4-432f-945b-678afb26a024'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.412302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208851d8d05c43db9a4d80b257ac67c1', 'request_id': 'req-c7a2aad0-f3e4-432f-945b-678afb26a024'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.433471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] The token cache is being invalidate because project 208851d8d05c43db9a4d80b257ac67c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:45.433733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.434452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.440483 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3094/6206] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:45 2022] DELETE /identity/v3/projects/208851d8d05c43db9a4d80b257ac67c1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:45.443543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:45.473109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5991e-fc42-46ac-bea0-c593ea45b4eb service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:45.568660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:45.569294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:45.569703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:45.569840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] PATH_INFO: `/v3/users/050db9bc36d3433a9ea22602f9022d8e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:45.571932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050db9bc36d3433a9ea22602f9022d8e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:45.575647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:45.684832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050db9bc36d3433a9ea22602f9022d8e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.726890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050db9bc36d3433a9ea22602f9022d8e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.731694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050db9bc36d3433a9ea22602f9022d8e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.755502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050db9bc36d3433a9ea22602f9022d8e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.757486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-02f47d05-6690-4fa6-a62d-5998c90c0de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050db9bc36d3433a9ea22602f9022d8e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:45.795777 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3113/6207] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:45 2022] DELETE /identity/v3/users/050db9bc36d3433a9ea22602f9022d8e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:47.222127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:47.224418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:47.244756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2aad0-f3e4-432f-945b-678afb26a024 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:47.387008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:47.388275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:47.388566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:47.393239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] PATH_INFO: `/v3/projects/fe3c6db20de14ed7a4030c6255a4e670` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:47.395457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3c6db20de14ed7a4030c6255a4e670)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:47.397756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:47.464710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:47.494261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3c6db20de14ed7a4030c6255a4e670', 'request_id': 'req-d835018e-6eb6-473d-b04b-8754e7613753'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:47.508701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3c6db20de14ed7a4030c6255a4e670', 'request_id': 'req-d835018e-6eb6-473d-b04b-8754e7613753'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:47.525853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3c6db20de14ed7a4030c6255a4e670', 'request_id': 'req-d835018e-6eb6-473d-b04b-8754e7613753'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:47.541076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] The token cache is being invalidate because project fe3c6db20de14ed7a4030c6255a4e670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:47.542281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:47.543234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d835018e-6eb6-473d-b04b-8754e7613753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:47.550844 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3095/6208] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:47 2022] DELETE /identity/v3/projects/fe3c6db20de14ed7a4030c6255a4e670 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:47.551846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91a76-dbc6-4aa7-8787-90fd600f4627 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:47.553521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91a76-dbc6-4aa7-8787-90fd600f4627 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:47.553521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b91a76-dbc6-4aa7-8787-90fd600f4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:47.590309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-27b91a76-dbc6-4aa7-8787-90fd600f4627 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:47.592055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-27b91a76-dbc6-4aa7-8787-90fd600f4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:47.651738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:47.652284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:47.652724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:47.723986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] MFA Rules not processed for user `de963cdc932941c7bac32406ee190634`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:47.725190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:47.771514 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3114/6209] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:47.785579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:47.785961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:47.786561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:47.821883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:47.823119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:47.850900 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3115/6210] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:47.852571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:47.883412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06cbc1-0e29-4bea-bda8-f77a5d2bd8d9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:47.892651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:47.893551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:47.893977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:47.894518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:47.895334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:47.896435 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3096/6211] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:47.896997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:47.898923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:47.921609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:47.923681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:47.935159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:47.952169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3116/6212] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:54:47.963422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:47.986228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992232-c568-4d6c-a621-ebb9707627fd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:47.998489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa05908-9eea-443a-8447-1fab1b6dd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:47.999130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05908-9eea-443a-8447-1fab1b6dd9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:47.999397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05908-9eea-443a-8447-1fab1b6dd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:47.999671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa05908-9eea-443a-8447-1fab1b6dd9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.000311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa05908-9eea-443a-8447-1fab1b6dd9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.003929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa05908-9eea-443a-8447-1fab1b6dd9a4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:48.058974 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3117/6213] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:47 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:48.060345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.060876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.061287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.085445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] MFA Rules not processed for user `a031e94db13d4e7e8947f51abc36d629`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:48.086758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:48.098301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016df195-0e45-422a-bfa6-94c0b225f216 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:48.186383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3118/6214] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:48.189306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:48.202433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:48.205539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.206052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.207203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.214684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:48.338900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13ca07-34ba-45a7-af92-27729eabbcb7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:48.351457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:48.352094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.352376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.352651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.353958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.356390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:48.363649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.365451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:48.389165 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3097/6215] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:48.403263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3119/6216] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:48 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:48.407463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:48.427251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510160f-a1ec-42fb-b50b-4d99a5c00317 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:48.438296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:48.439080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.439475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.439861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.440631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.442440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:48.473913 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3098/6217] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:48.475143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:48.489530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbef53-5092-45af-a197-ad3cb786660d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:48.501571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cba1b-7b5e-45da-bd5b-0bd017bc5a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:48.502494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cba1b-7b5e-45da-bd5b-0bd017bc5a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.502630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cba1b-7b5e-45da-bd5b-0bd017bc5a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.502903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cba1b-7b5e-45da-bd5b-0bd017bc5a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.503598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cba1b-7b5e-45da-bd5b-0bd017bc5a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.505264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cba1b-7b5e-45da-bd5b-0bd017bc5a70 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:48.537241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3120/6218] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:48.541555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:48.552610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d8c9-24cf-41bb-a63b-25c4969f222c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:48.569990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:48.570672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.570953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.571225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] PATH_INFO: `/v3/projects/8329d7c9206e4a44a74aab7a4fdf86d7/users/8987dcf9a88544eb94973a8635250585/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.589189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8329d7c9206e4a44a74aab7a4fdf86d7, user_id=8987dcf9a88544eb94973a8635250585, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.592201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:48.618665 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3099/6219] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:48 2022] PUT /identity/v3/projects/8329d7c9206e4a44a74aab7a4fdf86d7/users/8987dcf9a88544eb94973a8635250585/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:48.629760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.630294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.630294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.710024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] MFA Rules not processed for user `8987dcf9a88544eb94973a8635250585`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:48.711399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:48.827506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:48.860327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3121/6220] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:48.878666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:48.984230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73425ff4-997e-47b8-a5a4-0687049c4294 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:48.990070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:48.990750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:48.991039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:48.991314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:48.991954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:48.994386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:49.039399 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3100/6221] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:48 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:49.041606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:49.058425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7d9c-0378-4eb4-b593-96577a884606 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:49.166958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:49.167586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.167913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.168207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:49.168893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:49.170892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:49.215431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3122/6222] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:49 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:49.217195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:49.240566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee1c6-e8da-44ee-8b16-1158add62f71 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:49.257245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:49.259601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.261637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.262093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:49.262927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:49.266952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:49.295488 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3101/6223] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:49.299998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:49.324864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba7a21-5096-4373-9c96-0d1dc123ee29 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:49.335138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:49.335968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.336535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.336998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] PATH_INFO: `/v3/projects/0421f18f6bda4c96951e86689b268a3f/users/4f6eb44230324d0ab9cddc79e5c8a2e2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:49.387443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0421f18f6bda4c96951e86689b268a3f, user_id=4f6eb44230324d0ab9cddc79e5c8a2e2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:49.390616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:49.413190 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3123/6224] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:49 2022] PUT /identity/v3/projects/0421f18f6bda4c96951e86689b268a3f/users/4f6eb44230324d0ab9cddc79e5c8a2e2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:49.417290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:49.429272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab6d6d-aed2-4ccf-a9ac-d79a2ea7075d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:49.525372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:49.542808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc2bf-0325-400b-b0e6-cc9a9784c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:49.543418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc2bf-0325-400b-b0e6-cc9a9784c0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.543823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc2bf-0325-400b-b0e6-cc9a9784c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.544164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc2bf-0325-400b-b0e6-cc9a9784c0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:49.545200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc2bf-0325-400b-b0e6-cc9a9784c0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:49.547123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc2bf-0325-400b-b0e6-cc9a9784c0b8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:49.565467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3102/6225] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:49.569955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:49.582537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280d26e-1f61-44ac-b1bc-eb04096a2831 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:49.601583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:49.603046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.603340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.603780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] PATH_INFO: `/v3/projects/0421f18f6bda4c96951e86689b268a3f/users/4f6eb44230324d0ab9cddc79e5c8a2e2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:49.611077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0421f18f6bda4c96951e86689b268a3f, user_id=4f6eb44230324d0ab9cddc79e5c8a2e2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:49.619632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:49.643323 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3124/6226] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:49 2022] PUT /identity/v3/projects/0421f18f6bda4c96951e86689b268a3f/users/4f6eb44230324d0ab9cddc79e5c8a2e2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:49.657499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.657849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.658069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:49.753357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] MFA Rules not processed for user `4f6eb44230324d0ab9cddc79e5c8a2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:49.755352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:49.872929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3103/6227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:49.884828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:49.970907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cd215-1086-4fed-9352-dea80e387225 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:49.987013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:49.988736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:49.989547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:49.989972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:50.009205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:50.011153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:50.023802 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3125/6228] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:50.447915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:50.458402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21e981-049e-40d4-b3b7-fb71fef9a548 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:50.463485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6eb44230324d0ab9cddc79e5c8a2e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0421f18f6bda4c96951e86689b268a3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:50.464202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:50.464408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:50.465070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:50.465753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:50.466088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:50.468074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:50.486691 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3104/6229] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:50.487593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:50.499287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47b7f5-38f9-4307-ad70-85140e384cf3 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:50.506149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6eb44230324d0ab9cddc79e5c8a2e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0421f18f6bda4c96951e86689b268a3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:50.506840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:50.507240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:50.507591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:50.508309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:50.510365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:50.542756 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3126/6230] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:50 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:50.547569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:50.560050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb91d6-35b1-49cc-87aa-0f453466b98b tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:50.624742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6eb44230324d0ab9cddc79e5c8a2e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0421f18f6bda4c96951e86689b268a3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:50.625457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:50.625747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:50.626030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:50.626682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:50.626995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:50.630085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:50.643253 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3105/6231] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:54:50.683616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:50.696431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58f7b-5e55-4489-beeb-b5ae416b90ab tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:50.701196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6eb44230324d0ab9cddc79e5c8a2e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0421f18f6bda4c96951e86689b268a3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:50.701833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:50.702124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:50.702438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] PATH_INFO: `/v3/projects/abd11fc2fb0e4ffda0c4abe242a0ba7f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:50.703677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abd11fc2fb0e4ffda0c4abe242a0ba7f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:50.705653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:50.724660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:50.758387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd11fc2fb0e4ffda0c4abe242a0ba7f', 'request_id': 'req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:50.764289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd11fc2fb0e4ffda0c4abe242a0ba7f', 'request_id': 'req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:50.771546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd11fc2fb0e4ffda0c4abe242a0ba7f', 'request_id': 'req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:50.784001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] The token cache is being invalidate because project abd11fc2fb0e4ffda0c4abe242a0ba7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:50.784315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:50.785860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ed7a61b2-cf76-4f6a-a89f-2747e46ef89e tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:50.787354 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3127/6232] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:50 2022] DELETE /identity/v3/projects/abd11fc2fb0e4ffda0c4abe242a0ba7f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:50.995889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:50.997636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:51.050088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:51.070852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced4ca5-b259-45a6-afa3-1df2df49957c tempest-VolumeQuotaClassesTest-1582249731 tempest-VolumeQuotaClassesTest-1582249731-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:51.131020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:51.131672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:51.131955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:51.132257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] PATH_INFO: `/v3/users/8987dcf9a88544eb94973a8635250585` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:51.133435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8987dcf9a88544eb94973a8635250585)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:51.135396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:51.200620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8987dcf9a88544eb94973a8635250585'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:51.215767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8987dcf9a88544eb94973a8635250585'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:51.216644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8987dcf9a88544eb94973a8635250585'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:51.230744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8987dcf9a88544eb94973a8635250585'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:51.231497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8987dcf9a88544eb94973a8635250585'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:51.250062 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3106/6233] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:50 2022] DELETE /identity/v3/users/8987dcf9a88544eb94973a8635250585 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:51.251812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:51.252595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:51.253048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:51.282879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:51.284232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:51.366159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3128/6234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:51.376828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:51.379189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:51.461099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4703241-99c4-4eca-a4d6-572e349e975e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:51.465351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:51.466025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:51.466402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:51.466744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:51.477949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:51.479531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:51.496389 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3107/6235] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:52.068720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:52.070261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:52.082964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3969d3-4b5c-4fa1-8b26-e37920e8a3d9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:52.088559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:52.089323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:52.089691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:52.090034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] PATH_INFO: `/v3/projects/8329d7c9206e4a44a74aab7a4fdf86d7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:52.091278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8329d7c9206e4a44a74aab7a4fdf86d7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:52.093444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:52.149372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8329d7c9206e4a44a74aab7a4fdf86d7', 'request_id': 'req-a305bb61-f96f-4ffb-97d5-12621643ab01'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.158101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8329d7c9206e4a44a74aab7a4fdf86d7', 'request_id': 'req-a305bb61-f96f-4ffb-97d5-12621643ab01'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.166062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8329d7c9206e4a44a74aab7a4fdf86d7', 'request_id': 'req-a305bb61-f96f-4ffb-97d5-12621643ab01'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.185022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] The token cache is being invalidate because project 8329d7c9206e4a44a74aab7a4fdf86d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:52.185379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.186219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.188512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3129/6236] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:52 2022] DELETE /identity/v3/projects/8329d7c9206e4a44a74aab7a4fdf86d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:52.193147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:52.203392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a0306-4977-482d-a06a-4bd9994e8349 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:52.219616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:52.296993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:52.297857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:52.298206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:52.298553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] PATH_INFO: `/v3/users/4f6eb44230324d0ab9cddc79e5c8a2e2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:52.299856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6eb44230324d0ab9cddc79e5c8a2e2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:52.302312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:52.364086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6eb44230324d0ab9cddc79e5c8a2e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.379246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6eb44230324d0ab9cddc79e5c8a2e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.380245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6eb44230324d0ab9cddc79e5c8a2e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.393763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6eb44230324d0ab9cddc79e5c8a2e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.394981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-20c7032a-efe6-48d1-9a99-6e2d2fae3c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6eb44230324d0ab9cddc79e5c8a2e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:52.414804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3108/6237] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:54:52 2022] DELETE /identity/v3/users/4f6eb44230324d0ab9cddc79e5c8a2e2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:52.759068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:52.760532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:52.775408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305bb61-f96f-4ffb-97d5-12621643ab01 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:52.824130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:52.886891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:52.887886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:52.888469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:52.888957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] PATH_INFO: `/v3/projects/0421f18f6bda4c96951e86689b268a3f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:52.890889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0421f18f6bda4c96951e86689b268a3f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:52.894174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.085687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0421f18f6bda4c96951e86689b268a3f', 'request_id': 'req-3b85c603-297e-4f59-8f95-f46bb379e8e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:53.102527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0421f18f6bda4c96951e86689b268a3f', 'request_id': 'req-3b85c603-297e-4f59-8f95-f46bb379e8e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:53.110224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0421f18f6bda4c96951e86689b268a3f', 'request_id': 'req-3b85c603-297e-4f59-8f95-f46bb379e8e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:53.134911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] The token cache is being invalidate because project 0421f18f6bda4c96951e86689b268a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:54:53.135399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:53.136344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3b85c603-297e-4f59-8f95-f46bb379e8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:54:53.138781 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3130/6238] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:54:52 2022] DELETE /identity/v3/projects/0421f18f6bda4c96951e86689b268a3f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:53.143385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.144446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.144778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.186666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:53.187926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:53.268527 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3109/6239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:53.277887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.278394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.278908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.301658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:53.302929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:53.311336 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3131/6240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:53.315409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.325983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de1ffb-20e3-4999-9863-40fc053ad498 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.330760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.331368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.332255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.332533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.333381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:54:53.333685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.335303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.352531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3110/6241] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:54:53.353568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.364158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0123e2-df27-4b83-bf04-a7d85b650f5b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.369149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.369865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.370255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.370788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.371507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.373468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.418975 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3132/6242] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:53 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:54:53.423005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.433654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950184-0096-45d3-a57c-baf235eb39e1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.454363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:53.496963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.497579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.497863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.498139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.498802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.500783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.525037 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3111/6243] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:53 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:53.529576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.541695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a0b9e-fb2b-44f1-bd19-4ec20bcb8119 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.556921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.557616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.557943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.558780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.559481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.562975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.583809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.597028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3133/6244] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:53.609845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251d7f9-fd93-4c5e-bc6c-836d96638cdd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.615907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79899f-4597-4913-bdbd-f119874d70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.616708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79899f-4597-4913-bdbd-f119874d70d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.617138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79899f-4597-4913-bdbd-f119874d70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.617670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79899f-4597-4913-bdbd-f119874d70d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.618423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79899f-4597-4913-bdbd-f119874d70d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.620170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79899f-4597-4913-bdbd-f119874d70d1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.636175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3112/6245] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:53.637413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.648309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fd270-4273-41d6-b107-f2513917568d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.662037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.663024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.663780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.664248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] PATH_INFO: `/v3/projects/bc05f890d9134765abd8593a4ee9079e/users/aadd61c898494a7eb7c16a688c4497da/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.685546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc05f890d9134765abd8593a4ee9079e, user_id=aadd61c898494a7eb7c16a688c4497da, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.688867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.707246 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3134/6246] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:53 2022] PUT /identity/v3/projects/bc05f890d9134765abd8593a4ee9079e/users/aadd61c898494a7eb7c16a688c4497da/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:53.717641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.717955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.718267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.750347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] MFA Rules not processed for user `aadd61c898494a7eb7c16a688c4497da`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:53.751653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:53.850473 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3113/6247] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:53.854585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:53.930510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:53.945253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598befcf-c1a9-4e62-9c95-91dda7cd1c7f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:53.955925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:53.957852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:53.958398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:53.958889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:53.959723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:53.962016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:53.997664 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3135/6248] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:54:53 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:54.001791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.014204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4022-9768-40e8-b478-5c859e0b6744 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.082930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.083563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.083851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.084134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.084796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.087473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.117250 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3114/6249] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:54:54 2022] POST /identity/v3/users => generated 307 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:54:54.121447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.134002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbc884-ae72-400d-a781-f8a4b302f9c8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.139341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.140231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.140702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.141026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.141715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.143395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.156184 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3136/6250] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:54:54.160650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.172422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbad0-ce6d-4f18-a92f-6f15a817ae3a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.178274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.178954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.179240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.179568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] PATH_INFO: `/v3/projects/bc93ac55c6e84940b0e35fd03eda77c9/users/857f120b2d674879a58caac207be2258/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.196145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc93ac55c6e84940b0e35fd03eda77c9, user_id=857f120b2d674879a58caac207be2258, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.198873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.207637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:54.217454 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3115/6251] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:54 2022] PUT /identity/v3/projects/bc93ac55c6e84940b0e35fd03eda77c9/users/857f120b2d674879a58caac207be2258/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:54:54.218724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.229881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ebcd-0fd1-4965-adb1-1bc2302538de admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.290214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384c5e0-0e4d-4558-b159-4cb3af1d022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.290749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c5e0-0e4d-4558-b159-4cb3af1d022e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.291041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c5e0-0e4d-4558-b159-4cb3af1d022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.291321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384c5e0-0e4d-4558-b159-4cb3af1d022e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.291971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c5e0-0e4d-4558-b159-4cb3af1d022e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.293609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384c5e0-0e4d-4558-b159-4cb3af1d022e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.303857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3137/6252] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:54:54.308001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.318949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06292ee-b108-48ee-b879-963a22754630 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.323871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.324566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.324848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.325149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] PATH_INFO: `/v3/projects/bc93ac55c6e84940b0e35fd03eda77c9/users/857f120b2d674879a58caac207be2258/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.327101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc93ac55c6e84940b0e35fd03eda77c9, user_id=857f120b2d674879a58caac207be2258, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.329876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.341259 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3116/6253] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:54:54 2022] PUT /identity/v3/projects/bc93ac55c6e84940b0e35fd03eda77c9/users/857f120b2d674879a58caac207be2258/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:54:54.353521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.353814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.354090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.382686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] MFA Rules not processed for user `857f120b2d674879a58caac207be2258`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:54:54.383899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:54.480570 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3138/6254] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:54:54.481223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.483216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:54:54.552441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de97d5-80c6-41d1-b19f-b3c378dcf310 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.556696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.557123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.557502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.557854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.568737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.570056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.581116 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3117/6255] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:54 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:54:54.695609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:54:54.711556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0ce2-9f51-4063-a0f2-81d94e7b1265 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:54:54.721523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e38e0d-8e2a-4670-9f73-48d948544724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:54:54.723129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e38e0d-8e2a-4670-9f73-48d948544724 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:54:54.723587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e38e0d-8e2a-4670-9f73-48d948544724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:54:54.723918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e38e0d-8e2a-4670-9f73-48d948544724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:54:54.779969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:54:54.791289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e38e0d-8e2a-4670-9f73-48d948544724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:54:54.792739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e38e0d-8e2a-4670-9f73-48d948544724 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:54:54.804594 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3139/6256] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:54:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:01.540323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:01.713455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac8cf-65c6-431e-9da7-1cefd6c004e7 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:01.719644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:01.720343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:01.720681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:01.721013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] PATH_INFO: `/v3/users/aadd61c898494a7eb7c16a688c4497da` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:01.722948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadd61c898494a7eb7c16a688c4497da)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:01.725108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:01.811353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadd61c898494a7eb7c16a688c4497da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:01.850445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadd61c898494a7eb7c16a688c4497da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:01.851204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadd61c898494a7eb7c16a688c4497da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:01.853411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:01.872535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadd61c898494a7eb7c16a688c4497da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:01.873576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadd61c898494a7eb7c16a688c4497da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:01.890633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3118/6257] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:01 2022] DELETE /identity/v3/users/aadd61c898494a7eb7c16a688c4497da => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:01.895884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:01.896358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:01.896673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:01.985859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:01.987268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:02.082774 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3140/6258] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:02.095467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:02.097396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:02.293085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d1abe-eb3e-4363-b2d0-6a7c96c3c0b2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:02.297086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405092a6-5a37-4111-93d4-d4568c03c228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:02.297694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405092a6-5a37-4111-93d4-d4568c03c228 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:02.298022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405092a6-5a37-4111-93d4-d4568c03c228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:02.298286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405092a6-5a37-4111-93d4-d4568c03c228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:02.309535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405092a6-5a37-4111-93d4-d4568c03c228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:02.310978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405092a6-5a37-4111-93d4-d4568c03c228 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:02.326287 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3119/6259] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:02.717842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:02.719453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:02.747028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92d262-40b0-490a-a4b2-adde4aa7ed81 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:02.756443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:02.759344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:02.759344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:02.759344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] PATH_INFO: `/v3/projects/bc05f890d9134765abd8593a4ee9079e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:02.761198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc05f890d9134765abd8593a4ee9079e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:02.772896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:02.821198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:02.821723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:02.821801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:02.851991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:02.854714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:02.855024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc05f890d9134765abd8593a4ee9079e', 'request_id': 'req-eb88852c-9ac4-4a47-a38a-1b782bbad245'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:02.862706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc05f890d9134765abd8593a4ee9079e', 'request_id': 'req-eb88852c-9ac4-4a47-a38a-1b782bbad245'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:02.870834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc05f890d9134765abd8593a4ee9079e', 'request_id': 'req-eb88852c-9ac4-4a47-a38a-1b782bbad245'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:02.898099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] The token cache is being invalidate because project bc05f890d9134765abd8593a4ee9079e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:02.898580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:02.899355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:02.901965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3141/6260] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:02 2022] DELETE /identity/v3/projects/bc05f890d9134765abd8593a4ee9079e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:02.905107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:02.906788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:02.940544 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3120/6261] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:55:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:02.980566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:02.983172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:03.023326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88852c-9ac4-4a47-a38a-1b782bbad245 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:03.032723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:03.033757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:03.033757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:03.034275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] PATH_INFO: `/v3/users/857f120b2d674879a58caac207be2258` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:03.036000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] RBAC: Authorizing `identity:delete_user(user_id=857f120b2d674879a58caac207be2258)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:03.038862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:03.046650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:03.130586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723bc56-dc14-4b0d-a16c-c734f1512ef6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:03.131511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857f120b2d674879a58caac207be2258'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.140206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:03.141075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:03.141463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:03.142541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:03.146832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857f120b2d674879a58caac207be2258'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.147579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857f120b2d674879a58caac207be2258'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.158263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:03.159239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857f120b2d674879a58caac207be2258'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.160754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-612d002a-7b20-48e7-9755-0c2c6562103b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857f120b2d674879a58caac207be2258'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.161419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:03.175224 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3121/6262] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:55:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 02:55:03.196330 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3142/6263] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:02 2022] DELETE /identity/v3/users/857f120b2d674879a58caac207be2258 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:03.578253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:03.589734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:03.594937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a18b4-5def-4c10-8460-fd222f0c157e service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:03.692729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:03.693595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:03.694011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:03.694394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] PATH_INFO: `/v3/projects/bc93ac55c6e84940b0e35fd03eda77c9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:03.695725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc93ac55c6e84940b0e35fd03eda77c9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:03.698938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:03.761325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc93ac55c6e84940b0e35fd03eda77c9', 'request_id': 'req-4074c7ca-2f7d-4cd8-a804-27e055e69db7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.774404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc93ac55c6e84940b0e35fd03eda77c9', 'request_id': 'req-4074c7ca-2f7d-4cd8-a804-27e055e69db7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.781689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc93ac55c6e84940b0e35fd03eda77c9', 'request_id': 'req-4074c7ca-2f7d-4cd8-a804-27e055e69db7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.794107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] The token cache is being invalidate because project bc93ac55c6e84940b0e35fd03eda77c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:03.794526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.795207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4074c7ca-2f7d-4cd8-a804-27e055e69db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:03.796892 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3122/6264] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:03 2022] DELETE /identity/v3/projects/bc93ac55c6e84940b0e35fd03eda77c9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:03.806066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:03.806534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:03.806947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:03.837480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:03.839196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:03.912643 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3143/6265] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:03.920578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:03.921075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:03.921075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:03.947696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:03.952282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:03.965381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3123/6266] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:03.966256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:03.981240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b5e2f-b4ba-4acf-97fc-b43f4b508609 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:03.987060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:03.988205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:03.988666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:03.988987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:03.989656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:03.989947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:03.991650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.006739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3144/6267] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:04.010986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.022503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d7ead-b73b-4d55-a931-95778201487e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.028059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.028795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.029210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.029582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.030527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.033078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.069280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3124/6268] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:04 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:04.073215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.094472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275355bc-6baf-44a0-a650-e9d7aa577aa3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.160671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.161309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.161588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.161860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.162489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.164396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.181478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:04.190350 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3145/6269] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:04 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:04.192075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.203694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92917b8e-def6-4abe-813b-770d3f736623 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.209844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.210534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.210884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.211229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.211948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.213660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.224842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3125/6270] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:04.228706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.240348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7e55-2b6d-48f1-82f8-6c543ce3660a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.255546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea7a1-69dd-40a1-b732-0aece7aa5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.256429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea7a1-69dd-40a1-b732-0aece7aa5a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.256806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea7a1-69dd-40a1-b732-0aece7aa5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.257209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea7a1-69dd-40a1-b732-0aece7aa5a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.258061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea7a1-69dd-40a1-b732-0aece7aa5a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.260647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea7a1-69dd-40a1-b732-0aece7aa5a96 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.276449 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3146/6271] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:04.277766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.288831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fb3b47-fbd4-4664-8477-24326c2a4289 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.293676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.294401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.294752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.295099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] PATH_INFO: `/v3/projects/2ecbbae498d6442a9d99750f409b3f31/users/ed326abb9b7e4271812a3c0d89b7f546/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.314192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecbbae498d6442a9d99750f409b3f31, user_id=ed326abb9b7e4271812a3c0d89b7f546, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.319561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.334420 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3126/6272] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:04 2022] PUT /identity/v3/projects/2ecbbae498d6442a9d99750f409b3f31/users/ed326abb9b7e4271812a3c0d89b7f546/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:04.345891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.346186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.346465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.380425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] MFA Rules not processed for user `ed326abb9b7e4271812a3c0d89b7f546`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:04.382156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:04.451477 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3147/6273] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:04.455899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.503635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:04.544070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2c47e-1ceb-458f-92c4-8531f4f53b5d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.549993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.550252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.550644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.551112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.551814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.553938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.598600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3127/6274] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:04 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:04.603087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.616485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e45906-dca8-4493-a4a6-c17c4b6a1fca None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.726686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.727238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.727524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.727805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.728463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.730603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.766990 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3148/6275] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:04 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:04.772500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.783000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88437ce1-a5e6-44e0-ad0d-264e5d3f689a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.806144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.806784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.807248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.807535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.823435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.830047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.857202 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3128/6276] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:04.860417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.871418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a8ee6-c88f-45ac-b259-78fa388e08e7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:04.880946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:04.881623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:04.881906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:04.882182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] PATH_INFO: `/v3/projects/66aafcbf339b4a1a823fbda52b95285a/users/71a16d1ca54042339b79ce861f57adae/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:04.921045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66aafcbf339b4a1a823fbda52b95285a, user_id=71a16d1ca54042339b79ce861f57adae, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:04.921045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:04.939770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3149/6277] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:04 2022] PUT /identity/v3/projects/66aafcbf339b4a1a823fbda52b95285a/users/71a16d1ca54042339b79ce861f57adae/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:04.944484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:04.964568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270560a5-dd1b-4e39-8b98-a3c10535fa05 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:05.033712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc7cf-cba5-40b7-87f5-19611d79a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:05.034466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc7cf-cba5-40b7-87f5-19611d79a4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:05.035299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc7cf-cba5-40b7-87f5-19611d79a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:05.035299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc7cf-cba5-40b7-87f5-19611d79a4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:05.036250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cc7cf-cba5-40b7-87f5-19611d79a4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:05.037546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cc7cf-cba5-40b7-87f5-19611d79a4a6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:05.048947 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3129/6278] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:05.053776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:05.065223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e43c-348b-406c-99a1-2143bc338b0d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:05.071104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:05.071883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:05.072234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:05.072508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] PATH_INFO: `/v3/projects/66aafcbf339b4a1a823fbda52b95285a/users/71a16d1ca54042339b79ce861f57adae/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:05.074604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66aafcbf339b4a1a823fbda52b95285a, user_id=71a16d1ca54042339b79ce861f57adae, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:05.077263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:05.089778 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3150/6279] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:05 2022] PUT /identity/v3/projects/66aafcbf339b4a1a823fbda52b95285a/users/71a16d1ca54042339b79ce861f57adae/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:05.101309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:05.102070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:05.102521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:05.147873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] MFA Rules not processed for user `71a16d1ca54042339b79ce861f57adae`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:05.149282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:05.304960 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3130/6280] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:05.315446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:05.318039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:05.357792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:05.400254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a359865-d5f6-46f2-a47e-73fb0b646966 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:05.419177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:05.419809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:05.420092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:05.420370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:05.433967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:05.436168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:05.450901 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3151/6281] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:05.573826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:05.587293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0c30-6e9f-4ac7-8eca-d42c824ea109 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:05.591122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:05.591735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:05.592018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:05.592598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:05.621462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:05.678664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:05.680415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:05.703227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3131/6282] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:09.513784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:09.514760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:09.698464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41669491-c160-4dfe-a23f-2b3ffecd7961 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:09.716544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:09.717234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:09.717522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:09.717782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:09.723701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:09.757991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:09.759618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:09.789448 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3152/6283] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:13.182482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:13.186511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:13.276758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4dc63-c24d-4363-95cd-c9a1b83f0a13 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:13.282190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:13.282876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:13.283229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:13.283677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:13.286173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:13.350586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:13.352466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7b155-f4ab-40b8-8d39-973dd8ba8b5b service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:13.365232 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3132/6284] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:55:13.878716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:13.997670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bddb0-2ac6-4a11-ae71-a0ada031bf0c service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:14.012224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:14.013138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:14.013560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:14.014000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] PATH_INFO: `/v3/users/ed326abb9b7e4271812a3c0d89b7f546` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:14.015368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed326abb9b7e4271812a3c0d89b7f546)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:14.017515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:14.133927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed326abb9b7e4271812a3c0d89b7f546'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:14.143187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:14.161814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed326abb9b7e4271812a3c0d89b7f546'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:14.162500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed326abb9b7e4271812a3c0d89b7f546'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:14.189239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed326abb9b7e4271812a3c0d89b7f546'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:14.190155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed326abb9b7e4271812a3c0d89b7f546'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:14.215772 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3153/6285] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:13 2022] DELETE /identity/v3/users/ed326abb9b7e4271812a3c0d89b7f546 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:14.220729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:14.221535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:14.222954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:14.270050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:14.271598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:14.343904 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3133/6286] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:14.350917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:14.352353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:14.438649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f000-c435-46e8-b05e-99cfa83d8a5c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:14.450276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:14.450525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:14.450808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:14.451087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:14.470414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:14.474425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:14.487085 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3154/6287] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:14.942796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:14.945208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:14.960578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceee59-0b41-4b49-87a4-da45140e351b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:14.981544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:14.982463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:14.984199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:14.985088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] PATH_INFO: `/v3/projects/2ecbbae498d6442a9d99750f409b3f31` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:14.989719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecbbae498d6442a9d99750f409b3f31)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:14.992985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:14.995346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:15.076715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecbbae498d6442a9d99750f409b3f31', 'request_id': 'req-2a3613e8-1815-40f2-ae9e-353a571b6789'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.086770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecbbae498d6442a9d99750f409b3f31', 'request_id': 'req-2a3613e8-1815-40f2-ae9e-353a571b6789'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.093752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecbbae498d6442a9d99750f409b3f31', 'request_id': 'req-2a3613e8-1815-40f2-ae9e-353a571b6789'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.105658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] The token cache is being invalidate because project 2ecbbae498d6442a9d99750f409b3f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:15.105957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.106674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.108500 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3134/6288] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:14 2022] DELETE /identity/v3/projects/2ecbbae498d6442a9d99750f409b3f31 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:15.112990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:15.124304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52648c-20bf-47f3-9547-6b068653c4fc service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:15.197139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:15.197797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:15.198084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:15.198365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] PATH_INFO: `/v3/users/71a16d1ca54042339b79ce861f57adae` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:15.199520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a16d1ca54042339b79ce861f57adae)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:15.201498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:15.278955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a16d1ca54042339b79ce861f57adae'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.302518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a16d1ca54042339b79ce861f57adae'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.302518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a16d1ca54042339b79ce861f57adae'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.310111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a16d1ca54042339b79ce861f57adae'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.310936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-938a6224-42a7-4399-a470-991841ba3250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a16d1ca54042339b79ce861f57adae'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.322627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:15.335057 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3155/6289] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:15 2022] DELETE /identity/v3/users/71a16d1ca54042339b79ce861f57adae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:15.803568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:15.805429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:15.821126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3613e8-1815-40f2-ae9e-353a571b6789 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:15.920882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:15.921973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:15.922439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:15.922870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] PATH_INFO: `/v3/projects/66aafcbf339b4a1a823fbda52b95285a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:15.924199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66aafcbf339b4a1a823fbda52b95285a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:15.926956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:15.988069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66aafcbf339b4a1a823fbda52b95285a', 'request_id': 'req-011876df-c0fc-4c2f-8127-a90e55592f1d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:15.999853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66aafcbf339b4a1a823fbda52b95285a', 'request_id': 'req-011876df-c0fc-4c2f-8127-a90e55592f1d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:16.010418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66aafcbf339b4a1a823fbda52b95285a', 'request_id': 'req-011876df-c0fc-4c2f-8127-a90e55592f1d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:16.029495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] The token cache is being invalidate because project 66aafcbf339b4a1a823fbda52b95285a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:16.030045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:16.030925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-011876df-c0fc-4c2f-8127-a90e55592f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:16.039531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3135/6290] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:15 2022] DELETE /identity/v3/projects/66aafcbf339b4a1a823fbda52b95285a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:16.041243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.041579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.041844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.074045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:16.076055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:16.153492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3156/6291] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:16.161910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.162195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.162479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.197839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:16.199014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:16.208973 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3136/6292] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:16.213208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.223847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6200ef-87f2-41e6-8161-ebbc092cf27f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.228478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.229127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.229416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.229696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.230356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:16.230664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.232349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:16.250008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.255363 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3157/6293] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:16.262922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7a722-751d-4532-adb2-cb4d8457f2db None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.268021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.269485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.269872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.270279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.281515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.283585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:16.313667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:16.337187 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3137/6294] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:16 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:16.341716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.359596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e5e39-587b-4367-b0a8-c76719e4b740 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.434875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.435709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.436160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.436385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.437429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.439120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:16.468717 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3158/6295] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:16 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:16.470453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.484403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49273765-e276-4fe7-becf-8e50880ebd33 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.491989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.493338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.493806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.494164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.494931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.496665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:16.529961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3138/6296] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:16.533818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.549661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24397d5-de1c-4021-b230-b48884e8590a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.554568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db3517-fabe-48bb-8c64-e9600bdaa47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.555178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db3517-fabe-48bb-8c64-e9600bdaa47e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.555459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db3517-fabe-48bb-8c64-e9600bdaa47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.555736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db3517-fabe-48bb-8c64-e9600bdaa47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.556379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db3517-fabe-48bb-8c64-e9600bdaa47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.558008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db3517-fabe-48bb-8c64-e9600bdaa47e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:16.569290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3159/6297] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:16.574704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.586273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b053f4-3d20-444c-b954-f0a8619b5163 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.591269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.591922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.592276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.592556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] PATH_INFO: `/v3/projects/b865d6f47acc4d4985523a9627dd3fe6/users/4383122efc2d40d0985da876f8417710/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.611705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b865d6f47acc4d4985523a9627dd3fe6, user_id=4383122efc2d40d0985da876f8417710, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.615257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:16.639589 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3139/6298] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:16 2022] PUT /identity/v3/projects/b865d6f47acc4d4985523a9627dd3fe6/users/4383122efc2d40d0985da876f8417710/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:16.753687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.754073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.754366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.810992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] MFA Rules not processed for user `4383122efc2d40d0985da876f8417710`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:16.812239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:16.868121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:16.892566 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3160/6299] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:16.897087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:16.962363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b90eb-4ece-4b27-9fbb-bd999cba3edc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:16.966881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:16.967489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:16.967769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:16.968043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:16.968684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:16.970732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.009068 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3140/6300] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:16 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:17.012459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:17.026186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c23151-6a71-432d-ad55-5443680ccb5c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:17.122240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:17.123041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.123496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.124076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.124884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:17.127247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.171535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3161/6301] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:17 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:17.173017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:17.187657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37747b84-f743-42ce-afc4-4ce08d251dac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:17.193035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:17.196935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.197300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.197644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.198368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:17.200096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.224870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3141/6302] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:17.229239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:17.241269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaa5db-5617-4a72-b4a0-186cf0e86df2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:17.246557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:17.247344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.247691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.248038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] PATH_INFO: `/v3/projects/1208bf18b3a44f189a6e5d80efb71df4/users/d2a0bcadb04f47c08758924bb8157247/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.265432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1208bf18b3a44f189a6e5d80efb71df4, user_id=d2a0bcadb04f47c08758924bb8157247, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:17.268254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.286739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3162/6303] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:17 2022] PUT /identity/v3/projects/1208bf18b3a44f189a6e5d80efb71df4/users/d2a0bcadb04f47c08758924bb8157247/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:17.290684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:17.304650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e183-20f0-4a6a-a297-7f18815ae82b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:17.402892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66ad8-b3db-4cae-872d-c97f667a103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:17.403745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66ad8-b3db-4cae-872d-c97f667a103b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.404145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66ad8-b3db-4cae-872d-c97f667a103b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.404513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66ad8-b3db-4cae-872d-c97f667a103b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.405702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66ad8-b3db-4cae-872d-c97f667a103b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:17.409029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66ad8-b3db-4cae-872d-c97f667a103b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.424940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3142/6304] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:17.429456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:17.440562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cd708-fb48-4497-8d62-536cf8844bd1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:17.445574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:17.446332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.446701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.447081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] PATH_INFO: `/v3/projects/1208bf18b3a44f189a6e5d80efb71df4/users/d2a0bcadb04f47c08758924bb8157247/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.449302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1208bf18b3a44f189a6e5d80efb71df4, user_id=d2a0bcadb04f47c08758924bb8157247, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:17.452047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.464764 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3163/6305] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:17 2022] PUT /identity/v3/projects/1208bf18b3a44f189a6e5d80efb71df4/users/d2a0bcadb04f47c08758924bb8157247/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:17.476365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.476760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.477175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.511974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] MFA Rules not processed for user `d2a0bcadb04f47c08758924bb8157247`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:17.513355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:17.530611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:17.625625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3143/6306] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:17.646439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:17.649633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:17.798873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cd91a-779e-4758-ab0d-fc44b6434019 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:17.806040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53539b-83e9-44a9-b647-a500cbff137c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:17.806681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53539b-83e9-44a9-b647-a500cbff137c service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:17.806964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53539b-83e9-44a9-b647-a500cbff137c service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:17.807240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53539b-83e9-44a9-b647-a500cbff137c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:17.841075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53539b-83e9-44a9-b647-a500cbff137c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:17.843102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53539b-83e9-44a9-b647-a500cbff137c service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:17.864721 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3164/6307] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:18.792541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:18.896279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d1158-5ab3-44e7-8c7f-18276e77e8fd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:18.902503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:18.903260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:18.903491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:18.903783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] PATH_INFO: `/v3/users/4383122efc2d40d0985da876f8417710` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:18.905871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4383122efc2d40d0985da876f8417710)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:18.908250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:18.983883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4383122efc2d40d0985da876f8417710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:19.006342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4383122efc2d40d0985da876f8417710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:19.007491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4383122efc2d40d0985da876f8417710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:19.019545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4383122efc2d40d0985da876f8417710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:19.022152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4383122efc2d40d0985da876f8417710'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:19.039558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3144/6308] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:18 2022] DELETE /identity/v3/users/4383122efc2d40d0985da876f8417710 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:19.044589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:19.045183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:19.045989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:19.070905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:19.072116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:19.122256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:19.148956 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3165/6309] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:19.162847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:19.164625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:19.211493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:19.246108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148ff5-c471-4329-8ed4-a5cbef2dd57b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:19.250125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:19.250753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:19.251040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:19.251318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:19.262377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:19.264138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:19.294485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3145/6310] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:19.838659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:19.844123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:19.875471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b0199-fd1d-4b1a-a4d4-f694315217ca None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:19.888587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:19.889437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:19.889967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:19.890626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] PATH_INFO: `/v3/projects/b865d6f47acc4d4985523a9627dd3fe6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:19.893559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b865d6f47acc4d4985523a9627dd3fe6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:19.899563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:20.016616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b865d6f47acc4d4985523a9627dd3fe6', 'request_id': 'req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.024362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b865d6f47acc4d4985523a9627dd3fe6', 'request_id': 'req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.034849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b865d6f47acc4d4985523a9627dd3fe6', 'request_id': 'req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.058101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] The token cache is being invalidate because project b865d6f47acc4d4985523a9627dd3fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:20.059454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.060327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.062809 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3166/6311] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:19 2022] DELETE /identity/v3/projects/b865d6f47acc4d4985523a9627dd3fe6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:20.067055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:20.082055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a614e0-cf03-42be-9575-4a27332f4fad service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:20.206981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:20.208234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:20.208778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:20.209436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] PATH_INFO: `/v3/users/d2a0bcadb04f47c08758924bb8157247` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:20.211029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a0bcadb04f47c08758924bb8157247)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:20.214354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:20.236655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:20.239142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:20.276007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebefc9-7c8a-4e93-8cf3-e78cd4cfdb28 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:20.289010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a0bcadb04f47c08758924bb8157247'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.291996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:20.293129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:20.293583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:20.294022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] PATH_INFO: `/v3/users/2825041f8aa2462f8719a0f124e0b8a0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:20.295368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2825041f8aa2462f8719a0f124e0b8a0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:20.297713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:20.303966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a0bcadb04f47c08758924bb8157247'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.304984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a0bcadb04f47c08758924bb8157247'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.314172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a0bcadb04f47c08758924bb8157247'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.315205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a0bcadb04f47c08758924bb8157247'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.334541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3146/6312] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:20 2022] DELETE /identity/v3/users/d2a0bcadb04f47c08758924bb8157247 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:20.421614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2825041f8aa2462f8719a0f124e0b8a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.443121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2825041f8aa2462f8719a0f124e0b8a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.444065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2825041f8aa2462f8719a0f124e0b8a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.457740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2825041f8aa2462f8719a0f124e0b8a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.458714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2825041f8aa2462f8719a0f124e0b8a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:20.482425 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3167/6313] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:20 2022] DELETE /identity/v3/users/2825041f8aa2462f8719a0f124e0b8a0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:20.793843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:20.795723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:20.858998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:20.862061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:20.954437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:20.986113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ae8d-91fd-4750-a9fe-86ddb4fab456 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.042545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:21.092284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a83b8-156f-4a57-b4fa-62eae0c522c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.098034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.099034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.099383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.099667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] PATH_INFO: `/v3/projects/1208bf18b3a44f189a6e5d80efb71df4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.101329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1208bf18b3a44f189a6e5d80efb71df4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.103243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.115186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.115596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.115842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.116520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] PATH_INFO: `/v3/projects/dfa44fa2dc3c4df4bc34ff14deaf21ef` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.117487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa44fa2dc3c4df4bc34ff14deaf21ef)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.119713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.173778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1208bf18b3a44f189a6e5d80efb71df4', 'request_id': 'req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.183280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1208bf18b3a44f189a6e5d80efb71df4', 'request_id': 'req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.196763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1208bf18b3a44f189a6e5d80efb71df4', 'request_id': 'req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.221361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'request_id': 'req-664930ea-8865-4620-a843-c65fb88ae87a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.229816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] The token cache is being invalidate because project 1208bf18b3a44f189a6e5d80efb71df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:21.230322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.231590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6c2fb44-e460-4b43-b88e-9cc5ffac976f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.232106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'request_id': 'req-664930ea-8865-4620-a843-c65fb88ae87a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.234032 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3168/6314] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:20 2022] DELETE /identity/v3/projects/1208bf18b3a44f189a6e5d80efb71df4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:21.240385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c93de-52e2-4dcb-8a1f-dc09288c1a79 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.240945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c93de-52e2-4dcb-8a1f-dc09288c1a79 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.241369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa44fa2dc3c4df4bc34ff14deaf21ef', 'request_id': 'req-664930ea-8865-4620-a843-c65fb88ae87a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.242055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c93de-52e2-4dcb-8a1f-dc09288c1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.257446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] The token cache is being invalidate because project dfa44fa2dc3c4df4bc34ff14deaf21ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:21.257875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.258775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-664930ea-8865-4620-a843-c65fb88ae87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:21.262314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3147/6315] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:20 2022] DELETE /identity/v3/projects/dfa44fa2dc3c4df4bc34ff14deaf21ef => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:21.268207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fffb4-db5c-40d5-8e8c-bdfc6e0a4b68 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.269482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fffb4-db5c-40d5-8e8c-bdfc6e0a4b68 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.270079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fffb4-db5c-40d5-8e8c-bdfc6e0a4b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.272625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0b0c93de-52e2-4dcb-8a1f-dc09288c1a79 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:21.274054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0b0c93de-52e2-4dcb-8a1f-dc09288c1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:21.303065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d19fffb4-db5c-40d5-8e8c-bdfc6e0a4b68 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:21.305582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d19fffb4-db5c-40d5-8e8c-bdfc6e0a4b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:21.358063 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3169/6316] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:21.359357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.359947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.359947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.385067 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3148/6317] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:21.392452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.392876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.394461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.395452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:21.396886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:21.407987 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3170/6318] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:21.413276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.423766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:21.425786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:21.426657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc118a-88d6-4839-8a68-1435bb21dd45 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.431853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.432561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.432938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.433305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.434085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:21.434455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.436766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.438411 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3149/6319] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:21.447056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.453960 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3171/6320] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:21.462174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.490640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae592b6-e6ee-4f43-9118-e7559f336193 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.491754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c253-93af-460e-b344-3074948bc4cc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.497809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.498851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.499047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.499337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.499681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.500319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.500534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:21.500988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.501268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.501343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.501830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.502494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.504490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.542937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3150/6321] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:21.543842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.566312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971191b-af18-4501-b878-ea411083f842 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.578849 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3172/6322] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:21.582879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.583448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.584884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.585307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.585693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.586403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.588723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.602249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:21.635839 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3151/6323] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:21.640508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.715636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:21.743987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fac81-d42e-451a-be84-877dc763e914 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.750733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.751687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.752319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.754078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.755465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.774830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.793252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b90b43-f9ba-454c-84ef-95e6c2dffa5f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.801004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.801724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.802088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.802584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.803305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.805885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.821752 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3152/6324] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:21.822991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.851625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d497be7-689c-4899-86c0-fb5e5468846e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.861076 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3173/6325] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:21 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:21.861925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.863777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.864397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.864658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.865006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.867016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.868954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.880552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c8b83-778c-487f-b214-265ec2a04b3e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.900775 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3153/6326] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:21.901577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.911008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.912033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.912572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.912854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.913598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.915475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.930612 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3174/6327] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:21.935314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.945125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c8b70-a32c-46a7-a77a-389629665937 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.949384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d0b64-a0e1-4857-8f79-f3eeed79d1b4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.954770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.955710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.956633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.957176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.957948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.959736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.973126 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3175/6328] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:21.975403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:21.976052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:21.976330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:21.976606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:21.977278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:21.977493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:21.978883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:21.990512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5a92-d937-4d61-89c6-abc5c44b54d6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:21.999783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f78a5-eea3-49fe-90ae-b4c1e2293338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.000478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f78a5-eea3-49fe-90ae-b4c1e2293338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.000825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f78a5-eea3-49fe-90ae-b4c1e2293338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.001918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f78a5-eea3-49fe-90ae-b4c1e2293338 admin admin] PATH_INFO: `/v3/projects/e334055109ab422e925b711ebe640b04/users/ef200b0a184646aa9bd068dea8b43814/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.003075 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3154/6329] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:22.006991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.026820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fa49b-c6a1-4333-a5b7-fc8184b95c46 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.030450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f78a5-eea3-49fe-90ae-b4c1e2293338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e334055109ab422e925b711ebe640b04, user_id=ef200b0a184646aa9bd068dea8b43814, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.032295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e065cd-35dc-4b69-bc41-3148e1e6b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.032995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e065cd-35dc-4b69-bc41-3148e1e6b0b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.033284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e065cd-35dc-4b69-bc41-3148e1e6b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.033566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e065cd-35dc-4b69-bc41-3148e1e6b0b1 admin admin] PATH_INFO: `/v3/projects/d238a08e954c42e7a646cbe300e831a0/users/a21786dcd412436facda618c37ff02b7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.035174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f78a5-eea3-49fe-90ae-b4c1e2293338 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.052577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e065cd-35dc-4b69-bc41-3148e1e6b0b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d238a08e954c42e7a646cbe300e831a0, user_id=a21786dcd412436facda618c37ff02b7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.063165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e065cd-35dc-4b69-bc41-3148e1e6b0b1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.065013 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3176/6330] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:21 2022] PUT /identity/v3/projects/e334055109ab422e925b711ebe640b04/users/ef200b0a184646aa9bd068dea8b43814/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:22.067034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.067365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.067761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.082252 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3155/6331] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:22 2022] PUT /identity/v3/projects/d238a08e954c42e7a646cbe300e831a0/users/a21786dcd412436facda618c37ff02b7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:22.097323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455746e-87a5-4abf-bba2-27ffbb1fc01c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.097717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455746e-87a5-4abf-bba2-27ffbb1fc01c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.097962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455746e-87a5-4abf-bba2-27ffbb1fc01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.116275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] MFA Rules not processed for user `ef200b0a184646aa9bd068dea8b43814`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:22.118186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:22.130291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0455746e-87a5-4abf-bba2-27ffbb1fc01c None None] MFA Rules not processed for user `a21786dcd412436facda618c37ff02b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:22.131640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0455746e-87a5-4abf-bba2-27ffbb1fc01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:22.202422 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3177/6332] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:22.206906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.270554 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3156/6333] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:22.288740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.288740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.288740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.311766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] MFA Rules not processed for user `a21786dcd412436facda618c37ff02b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:22.313513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:22.319608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26903d-d665-4d40-9a80-523eec1a0c3c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.326086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.326086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.326086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.326437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.326874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3157/6334] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:22.327071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.329138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.336055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:22.336296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.338652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:22.365074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:22.367987 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3178/6335] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:22 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:22.370994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.453011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777f437-80c9-460c-b2b9-d10644dcc7a9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.459166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.459992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.460358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.460791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.461033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486313f-efab-4666-97ee-06b52ed3226a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.461968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.464579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.500263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3179/6336] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:22 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:22.501559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.517557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e59e0-84e7-4099-9149-6913370d5ada admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.525047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.526260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.526416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.526805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.527534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.529174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.546928 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3180/6337] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:22.552051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.552555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.552689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.552980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.553248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.564473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483031-be61-432e-a34b-b44639e55133 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.571950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.573104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.573386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.573665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] PATH_INFO: `/v3/projects/eec1df40862747d4bbd2c080edff26e6/users/553708bd73354660a71da3dee4320db3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.595192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec1df40862747d4bbd2c080edff26e6, user_id=553708bd73354660a71da3dee4320db3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.598091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.627545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3181/6338] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:22 2022] PUT /identity/v3/projects/eec1df40862747d4bbd2c080edff26e6/users/553708bd73354660a71da3dee4320db3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:22.629742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.652214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.654690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.681433 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3158/6339] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:55:22.713084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de769ca1-38f0-429d-8db5-84adb3141078 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.718070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158413c9-de3e-4a1b-acb1-e55b7223b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.719111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158413c9-de3e-4a1b-acb1-e55b7223b41f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.719391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158413c9-de3e-4a1b-acb1-e55b7223b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.719665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158413c9-de3e-4a1b-acb1-e55b7223b41f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.720310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158413c9-de3e-4a1b-acb1-e55b7223b41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.722189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158413c9-de3e-4a1b-acb1-e55b7223b41f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.732464 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3182/6340] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:22.736720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:22.761575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069f28-0342-4bd7-ad2c-8a938e69862e service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:22.774880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:22.777348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.778312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.778657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] PATH_INFO: `/v3/projects/eec1df40862747d4bbd2c080edff26e6/users/553708bd73354660a71da3dee4320db3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.781461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec1df40862747d4bbd2c080edff26e6, user_id=553708bd73354660a71da3dee4320db3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:22.785368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:22.802203 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3159/6341] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:22 2022] PUT /identity/v3/projects/eec1df40862747d4bbd2c080edff26e6/users/553708bd73354660a71da3dee4320db3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:22.812985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:22.813363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:22.813731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:22.854566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] MFA Rules not processed for user `553708bd73354660a71da3dee4320db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:22.856216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:22.926070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:23.013862 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3183/6342] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:23.024066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:23.029508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:23.130125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:23.178573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9e6e-496e-42ed-a18a-4b702320576b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:23.182467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc34120-7bad-4e6d-b9d8-258550ea4ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:23.183152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc34120-7bad-4e6d-b9d8-258550ea4ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:23.183501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc34120-7bad-4e6d-b9d8-258550ea4ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:23.183843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc34120-7bad-4e6d-b9d8-258550ea4ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:23.198030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc34120-7bad-4e6d-b9d8-258550ea4ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:23.199723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc34120-7bad-4e6d-b9d8-258550ea4ae6 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:23.214247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3160/6343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:23.874778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:23.968684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f03e-5277-4fa2-84ec-ae00f340e09e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:23.974281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:23.975180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:23.975466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:23.975749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] PATH_INFO: `/v3/users/ef200b0a184646aa9bd068dea8b43814` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:23.976951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef200b0a184646aa9bd068dea8b43814)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:23.979467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:24.045275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef200b0a184646aa9bd068dea8b43814'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.059250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef200b0a184646aa9bd068dea8b43814'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.060228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef200b0a184646aa9bd068dea8b43814'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.070536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef200b0a184646aa9bd068dea8b43814'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.071396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef200b0a184646aa9bd068dea8b43814'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.088485 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3184/6344] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:23 2022] DELETE /identity/v3/users/ef200b0a184646aa9bd068dea8b43814 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:24.093173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:24.093545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:24.093944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:24.130548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:24.132971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:24.231479 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3161/6345] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:24.258334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:24.259937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:24.326468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:24.342962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135aac7-4034-4d70-94c8-5f19de9e6ed3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:24.347414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:24.348202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:24.348673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:24.348892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:24.358727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:24.360286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:24.370991 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3185/6346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:24.670859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:24.672398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:24.687701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ae65-05cc-48dc-871f-fbc06872b122 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:24.695596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:24.696542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:24.696998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:24.697534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] PATH_INFO: `/v3/projects/e334055109ab422e925b711ebe640b04` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:24.698914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e334055109ab422e925b711ebe640b04)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:24.701094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:24.756976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e334055109ab422e925b711ebe640b04', 'request_id': 'req-806bbaa9-126e-4728-a367-29ddd948bb78'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.772977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e334055109ab422e925b711ebe640b04', 'request_id': 'req-806bbaa9-126e-4728-a367-29ddd948bb78'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.781553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e334055109ab422e925b711ebe640b04', 'request_id': 'req-806bbaa9-126e-4728-a367-29ddd948bb78'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.795702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] The token cache is being invalidate because project e334055109ab422e925b711ebe640b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:24.796098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.796847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.798830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3162/6347] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:24 2022] DELETE /identity/v3/projects/e334055109ab422e925b711ebe640b04 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:24.804142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:24.814815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a185fd-c2c6-4ae2-a061-4b3ef6fd99e6 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:24.901159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:24.902450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:24.902902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:24.903325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] PATH_INFO: `/v3/users/553708bd73354660a71da3dee4320db3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:24.905317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553708bd73354660a71da3dee4320db3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:24.907376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:24.958643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553708bd73354660a71da3dee4320db3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.976761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553708bd73354660a71da3dee4320db3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.977548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553708bd73354660a71da3dee4320db3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.988335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553708bd73354660a71da3dee4320db3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:24.989092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-608af1ce-d169-4008-8838-531b1a8a53a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553708bd73354660a71da3dee4320db3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:25.003980 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3186/6348] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:24 2022] DELETE /identity/v3/users/553708bd73354660a71da3dee4320db3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:25.447779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:25.449687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:25.463069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bbaa9-126e-4728-a367-29ddd948bb78 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:25.523351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:25.530620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:25.531596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.532473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.532953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] PATH_INFO: `/v3/projects/eec1df40862747d4bbd2c080edff26e6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.534572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec1df40862747d4bbd2c080edff26e6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:25.536981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:25.585617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec1df40862747d4bbd2c080edff26e6', 'request_id': 'req-8361f5f2-a6b7-43da-8292-4b2f8b05138c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:25.593033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec1df40862747d4bbd2c080edff26e6', 'request_id': 'req-8361f5f2-a6b7-43da-8292-4b2f8b05138c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:25.602425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec1df40862747d4bbd2c080edff26e6', 'request_id': 'req-8361f5f2-a6b7-43da-8292-4b2f8b05138c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:25.615085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] The token cache is being invalidate because project eec1df40862747d4bbd2c080edff26e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:25.615456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:25.616384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8361f5f2-a6b7-43da-8292-4b2f8b05138c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:25.618096 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3163/6349] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:25 2022] DELETE /identity/v3/projects/eec1df40862747d4bbd2c080edff26e6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:25.623607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.623822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.624042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.644879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:25.646137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:25.716732 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3187/6350] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:25.724423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.724717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.725030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.745391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:25.746602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:25.754939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3164/6351] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:25.759216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:25.765855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:25.770919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9d979-f35a-40a3-8576-8d90eab8fc54 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:25.776633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:25.777390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.778243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.778243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.779078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:25.779816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:25.781572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:25.797174 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3188/6352] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:25.798245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:25.808784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb93f8c-67a1-481b-9a69-26e68009763a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:25.813751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:25.814355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.814641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.814921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.815786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:25.817741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:25.846362 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3165/6353] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:25 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:25.851573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:25.861773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f573-e9c4-4fac-81f4-947479e7459d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:25.925249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:25.925905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.926125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.926400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.927029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:25.928977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:25.958627 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3189/6354] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:25 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:25.962919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:25.976125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6a6b-e3a1-43bf-8c31-a987fdf29e8c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:25.981138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:25.981761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:25.982042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:25.982319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:25.983450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:25.985862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:25.998994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3166/6355] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:26.003542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.013839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1e5e3-4a43-4086-bc14-dad0c338fca3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.018965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e5b49-27ec-402a-b23e-7b76985bc952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.019572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5b49-27ec-402a-b23e-7b76985bc952 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.019854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5b49-27ec-402a-b23e-7b76985bc952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.020128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e5b49-27ec-402a-b23e-7b76985bc952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.020780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e5b49-27ec-402a-b23e-7b76985bc952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.022424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e5b49-27ec-402a-b23e-7b76985bc952 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.033957 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3190/6356] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:26.038165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.048462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caddab5-96e0-482c-8432-876301e25f75 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.053424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.054198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.054559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.054913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] PATH_INFO: `/v3/projects/f36ab46f0f204802822169a8b97537d4/users/c9fdf7a354144936a0678e5a4b594666/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.071461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36ab46f0f204802822169a8b97537d4, user_id=c9fdf7a354144936a0678e5a4b594666, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.074411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.089010 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3167/6357] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:26 2022] PUT /identity/v3/projects/f36ab46f0f204802822169a8b97537d4/users/c9fdf7a354144936a0678e5a4b594666/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:26.099480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.099869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.100212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.128822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] MFA Rules not processed for user `c9fdf7a354144936a0678e5a4b594666`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:26.130067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:26.210237 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3191/6358] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:26.214287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.319993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95061d7-6146-4947-885d-2f267228f2cf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.326088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.326331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.326677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.327019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.327730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.330075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.360830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3168/6359] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:26 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:26.364596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.375772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd5159-7b85-45f3-8e3b-a1381dc556c5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.453044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.454002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.454336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.454606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.455323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.458225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.468265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:26.490417 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3192/6360] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:26 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:26.494399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.515796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306b4ab-1408-472e-8e39-353a208b62f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.525515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.525515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.525515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.525515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.525943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.525943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.528222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:26.541103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3169/6361] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:26.543986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.558606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50169-7e76-4021-9d0e-d8339a2528bc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.563615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.564616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.564722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.569092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] PATH_INFO: `/v3/projects/c7d261ab741a4cb1b397bfe1fb4024df/users/225da82eb04444f69995d929391b0e9a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.599491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d261ab741a4cb1b397bfe1fb4024df, user_id=225da82eb04444f69995d929391b0e9a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.602444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.616689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3193/6362] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:26 2022] PUT /identity/v3/projects/c7d261ab741a4cb1b397bfe1fb4024df/users/225da82eb04444f69995d929391b0e9a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:26.620513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.632079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe56b3-4ce8-4224-a4e2-e805009a4166 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.706873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39465-bf5a-490b-b53f-031082899040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.707695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39465-bf5a-490b-b53f-031082899040 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.707984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39465-bf5a-490b-b53f-031082899040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.708263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39465-bf5a-490b-b53f-031082899040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.708938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39465-bf5a-490b-b53f-031082899040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.710817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39465-bf5a-490b-b53f-031082899040 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.730646 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3170/6363] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:26.732843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.747873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ab08-b74e-4054-a0db-bc3c7e371f57 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:26.754380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:26.755064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.755340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.755614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] PATH_INFO: `/v3/projects/c7d261ab741a4cb1b397bfe1fb4024df/users/225da82eb04444f69995d929391b0e9a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.757642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d261ab741a4cb1b397bfe1fb4024df, user_id=225da82eb04444f69995d929391b0e9a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:26.760516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:26.777262 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3194/6364] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:26 2022] PUT /identity/v3/projects/c7d261ab741a4cb1b397bfe1fb4024df/users/225da82eb04444f69995d929391b0e9a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:26.789115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:26.789378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:26.789934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:26.835557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] MFA Rules not processed for user `225da82eb04444f69995d929391b0e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:26.846274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:26.942823 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3171/6365] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:26.950338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:26.952220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:27.031907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03524-fd92-4aab-baaa-0b63db39655c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:27.036596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:27.037418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:27.037700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:27.037987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:27.047824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:27.049366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:27.063502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3195/6366] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:27.150298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:27.163251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742b6e-bdc7-420c-9345-322b997dc667 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:27.167674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e70da-8bb6-4c71-9665-09ff77c4ff9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:27.168757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e70da-8bb6-4c71-9665-09ff77c4ff9a service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:27.169076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e70da-8bb6-4c71-9665-09ff77c4ff9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:27.169355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e70da-8bb6-4c71-9665-09ff77c4ff9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:27.228080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e70da-8bb6-4c71-9665-09ff77c4ff9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:27.229853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e70da-8bb6-4c71-9665-09ff77c4ff9a service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:27.245082 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3172/6367] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:27.560094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:27.672779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311aa8-2cd1-412f-ab4e-af45e142a70a service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:27.678476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:27.679572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:27.679942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:27.680223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] PATH_INFO: `/v3/users/c9fdf7a354144936a0678e5a4b594666` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:27.681628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fdf7a354144936a0678e5a4b594666)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:27.683728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:27.771047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fdf7a354144936a0678e5a4b594666'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:27.791146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:27.799297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fdf7a354144936a0678e5a4b594666'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:27.802626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fdf7a354144936a0678e5a4b594666'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:27.818902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fdf7a354144936a0678e5a4b594666'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:27.821045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fdf7a354144936a0678e5a4b594666'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:27.847267 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3196/6368] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:27 2022] DELETE /identity/v3/users/c9fdf7a354144936a0678e5a4b594666 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:27.851665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:27.852208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:27.852293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:27.873954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:27.875100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:27.891585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:27.947502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3173/6369] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:27.958530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:27.959883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:28.035685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea93bf-4051-4714-91dd-0441aa81cd41 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:28.046779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:28.047472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:28.047770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:28.048048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:28.061101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:28.062367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:28.074449 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3197/6370] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:28.466770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:28.469062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:28.498697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eacfe3-396f-41ec-a5cc-906f8ff0f8ae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:28.503650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:28.504552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:28.504918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:28.505229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] PATH_INFO: `/v3/projects/f36ab46f0f204802822169a8b97537d4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:28.506408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36ab46f0f204802822169a8b97537d4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:28.508328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:28.562551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36ab46f0f204802822169a8b97537d4', 'request_id': 'req-de4c4fba-316f-4af5-b8b2-db4c618b0ede'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.573147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36ab46f0f204802822169a8b97537d4', 'request_id': 'req-de4c4fba-316f-4af5-b8b2-db4c618b0ede'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.581503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36ab46f0f204802822169a8b97537d4', 'request_id': 'req-de4c4fba-316f-4af5-b8b2-db4c618b0ede'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.600214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] The token cache is being invalidate because project f36ab46f0f204802822169a8b97537d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:28.600543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.601434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.603270 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3174/6371] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:28 2022] DELETE /identity/v3/projects/f36ab46f0f204802822169a8b97537d4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:28.607055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:28.617951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b3fd-d410-4717-92d9-418be1f1cf1a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:28.691554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:28.692574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:28.693296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:28.694275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] PATH_INFO: `/v3/users/225da82eb04444f69995d929391b0e9a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:28.695796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=225da82eb04444f69995d929391b0e9a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:28.700053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:28.755886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225da82eb04444f69995d929391b0e9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.773895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225da82eb04444f69995d929391b0e9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.774818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225da82eb04444f69995d929391b0e9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.789917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225da82eb04444f69995d929391b0e9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.790703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f02a5d1b-df13-47a4-a00c-1b18a5d9ed3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225da82eb04444f69995d929391b0e9a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:28.804111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:28.821781 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3198/6372] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:28 2022] DELETE /identity/v3/users/225da82eb04444f69995d929391b0e9a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:29.513604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:29.515936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:29.545390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c4fba-316f-4af5-b8b2-db4c618b0ede admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:29.663751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:29.665622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:29.666128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:29.666651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] PATH_INFO: `/v3/projects/c7d261ab741a4cb1b397bfe1fb4024df` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:29.668526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d261ab741a4cb1b397bfe1fb4024df)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:29.671004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:29.727372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:29.732757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d261ab741a4cb1b397bfe1fb4024df', 'request_id': 'req-0728839f-db06-4561-bf67-2cab4696dca5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:29.741879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d261ab741a4cb1b397bfe1fb4024df', 'request_id': 'req-0728839f-db06-4561-bf67-2cab4696dca5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:29.748426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d261ab741a4cb1b397bfe1fb4024df', 'request_id': 'req-0728839f-db06-4561-bf67-2cab4696dca5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:29.761487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] The token cache is being invalidate because project c7d261ab741a4cb1b397bfe1fb4024df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:29.761944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:29.762768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0728839f-db06-4561-bf67-2cab4696dca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:29.764782 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3175/6373] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:29 2022] DELETE /identity/v3/projects/c7d261ab741a4cb1b397bfe1fb4024df => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:29.769626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:29.770086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:29.770196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:29.791366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:29.792607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:29.859302 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3199/6374] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:29.867381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:29.867886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:29.868167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:29.899539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:29.901038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:29.915962 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3176/6375] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:29.917134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:29.930669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc722-c8de-433b-b385-cfe52f787302 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:29.938223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:29.939105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:29.939593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:29.940823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:29.941737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:29.942535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:29.944520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:29.962816 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3200/6376] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:29.964546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:29.978126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6c04c-74f3-4b26-a045-c2a221c32f3a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:29.986424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:29.987130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:29.987909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:29.988197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:29.989002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:29.991002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:30.048747 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3177/6377] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:29 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:30.053687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:30.069010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152adf1-f739-4457-8d32-591bf002c6b7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:30.191877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:30.194249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:30.195373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:30.195833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:30.199113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:30.203082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:30.261628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3201/6378] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:30 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:30.263102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:30.288338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69d45-e72e-4a9c-8f0e-7c4761010850 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:30.293582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:30.294380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:30.294727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:30.295075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:30.296118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:30.298114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:30.318555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:30.318721 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3178/6379] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:30.334034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da11af-fe2d-4b83-9e71-4703b66dedec admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:30.349526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b9b0-fadc-4784-bac6-791740f73fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:30.350328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b9b0-fadc-4784-bac6-791740f73fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:30.350756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b9b0-fadc-4784-bac6-791740f73fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:30.351177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b9b0-fadc-4784-bac6-791740f73fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:30.366511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6b9b0-fadc-4784-bac6-791740f73fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:30.370203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6b9b0-fadc-4784-bac6-791740f73fe9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:30.414700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3202/6380] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:30.420214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:30.442020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7e58-6f3c-4bbb-89ef-531ac9280132 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:30.466559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:30.466795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:30.466994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:30.467280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] PATH_INFO: `/v3/projects/10aa8602b45c45a2b5d30052aaa01e42/users/ba34319166e041129b4a05926efa2af3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:30.502517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10aa8602b45c45a2b5d30052aaa01e42, user_id=ba34319166e041129b4a05926efa2af3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:30.507963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:30.536975 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3179/6381] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:30 2022] PUT /identity/v3/projects/10aa8602b45c45a2b5d30052aaa01e42/users/ba34319166e041129b4a05926efa2af3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:30.542008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0ed8-7a1f-4e30-b897-7a7071a3df00 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:30.542646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0ed8-7a1f-4e30-b897-7a7071a3df00 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:30.543082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0ed8-7a1f-4e30-b897-7a7071a3df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:30.576378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a0db0ed8-7a1f-4e30-b897-7a7071a3df00 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:30.590425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a0db0ed8-7a1f-4e30-b897-7a7071a3df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:30.730595 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3203/6382] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:30.782297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:30.785044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:30.902179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4997638-02ca-4f28-90a5-e7dbe64307a3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:30.906434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:30.907068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:30.907511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:30.907609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:30.918486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:30.920023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:30.933007 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3180/6383] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:32.265357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:32.265856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:32.265935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:32.277748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:32.320773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] MFA Rules not processed for user `ba34319166e041129b4a05926efa2af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:32.322139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:32.468460 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3204/6384] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:32.473642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:32.485094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e811862-521f-404a-b7aa-26f485cad43a service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:32.491160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:32.491876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:32.492252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:32.493409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:32.494321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:32.497486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:32.546707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:32.547866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:32.572601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3181/6385] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:32 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:32.576954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:32.582051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8adaf-d068-4f39-9407-88c97cbb1052 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:32.633448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:32.667417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbd91a-5c97-49c0-854c-9ab5979ee860 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:32.673407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:32.674132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:32.674562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:32.674967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:32.675689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:32.675813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:32.676439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:32.676725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:32.677047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] PATH_INFO: `/v3/users/fa65476b76e749cdab6ad9e7e77e79b7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:32.678196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa65476b76e749cdab6ad9e7e77e79b7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:32.678355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:32.680238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:32.709180 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3182/6386] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:32 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:32.711175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:32.727183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008077c8-0110-4ad2-9bc3-eb4c57f79e99 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:32.734659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:32.735677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:32.735843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:32.736116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:32.736772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:32.738742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:32.747445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa65476b76e749cdab6ad9e7e77e79b7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:32.756961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3183/6387] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:32.758062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:32.763974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa65476b76e749cdab6ad9e7e77e79b7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:32.764697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa65476b76e749cdab6ad9e7e77e79b7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:32.771669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa322-8003-43cb-bcc9-414241bfac89 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:32.774389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa65476b76e749cdab6ad9e7e77e79b7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:32.775306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa65476b76e749cdab6ad9e7e77e79b7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:32.777829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:32.778723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:32.778975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:32.779338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] PATH_INFO: `/v3/projects/005332b5ab964891bfb178def6e1a63b/users/fb657d3496834b91aa36cd01289d21bc/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:32.789526 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3205/6388] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:32 2022] DELETE /identity/v3/users/fa65476b76e749cdab6ad9e7e77e79b7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:32.797525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005332b5ab964891bfb178def6e1a63b, user_id=fb657d3496834b91aa36cd01289d21bc, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:32.801621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:32.816495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3184/6389] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:32 2022] PUT /identity/v3/projects/005332b5ab964891bfb178def6e1a63b/users/fb657d3496834b91aa36cd01289d21bc/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:32.820698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:32.822777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:32.828621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:32.913228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefa885-f709-461a-997a-a8814fbb6be5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.044010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.044632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.044960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.045750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.046284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.046419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.048076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.050775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:33.061301 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3206/6390] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:33.067008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.078379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ef4a7-6b48-42b4-adf4-ae54ae3bcc3b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.082406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97661-5640-4950-af97-e1b03bc28c70 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.083698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b595678-4b50-49bb-9e3d-a25c95fa4fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.084632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b595678-4b50-49bb-9e3d-a25c95fa4fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.084736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b595678-4b50-49bb-9e3d-a25c95fa4fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.085000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b595678-4b50-49bb-9e3d-a25c95fa4fdd admin admin] PATH_INFO: `/v3/projects/005332b5ab964891bfb178def6e1a63b/users/fb657d3496834b91aa36cd01289d21bc/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.087072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b595678-4b50-49bb-9e3d-a25c95fa4fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=005332b5ab964891bfb178def6e1a63b, user_id=fb657d3496834b91aa36cd01289d21bc, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.087844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.088676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.089097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.089476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] PATH_INFO: `/v3/projects/c76521b0c2f8465b866756ccc9c299e4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.090459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b595678-4b50-49bb-9e3d-a25c95fa4fdd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.091068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76521b0c2f8465b866756ccc9c299e4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.093149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.103554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3207/6391] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:33 2022] PUT /identity/v3/projects/005332b5ab964891bfb178def6e1a63b/users/fb657d3496834b91aa36cd01289d21bc/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:33.151043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76521b0c2f8465b866756ccc9c299e4', 'request_id': 'req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:33.160512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76521b0c2f8465b866756ccc9c299e4', 'request_id': 'req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:33.168240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76521b0c2f8465b866756ccc9c299e4', 'request_id': 'req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:33.183382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] The token cache is being invalidate because project c76521b0c2f8465b866756ccc9c299e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:33.183382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:33.189995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad3364a6-bb53-4652-822e-fcd9ffaaa7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:33.193112 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3185/6392] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:33 2022] DELETE /identity/v3/projects/c76521b0c2f8465b866756ccc9c299e4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:33.199769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.200845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.201422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.254761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:33.256022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:33.349016 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3208/6393] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:33.354574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.355064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.355346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.416349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:33.417611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:33.426105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3186/6394] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:33.430420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.441225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc0824-baaa-4bc0-9ff1-18c70c41baec None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.445928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.446538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.446952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.447243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.447882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:33.448215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.449850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.462957 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3209/6395] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:33.467847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.479392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370ffe-1c36-4104-b3a5-11684a2b1423 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.487963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.489030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.489557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.489984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.491126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.494294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.554540 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3187/6396] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:33 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:33.558680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.582340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27c658-2ea7-4de0-a061-6484221a1506 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.599598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:33.701658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.702194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.702625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.702877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.703935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.706144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.734591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3210/6397] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:33 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:33.739744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.750444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c03983-8041-448c-9fec-6a2ee2d127ab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.756364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.757304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.757681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.758055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.758804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.760939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.773056 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3188/6398] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:33.776791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.789309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002d3c9-06cd-4d99-87aa-648b5ab54c3e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.804925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9540643-687b-45ca-a237-1e8ecb116dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.805716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540643-687b-45ca-a237-1e8ecb116dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.806007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540643-687b-45ca-a237-1e8ecb116dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.806283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540643-687b-45ca-a237-1e8ecb116dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.806943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9540643-687b-45ca-a237-1e8ecb116dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.808603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9540643-687b-45ca-a237-1e8ecb116dbf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.824541 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3211/6399] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:33.826035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:33.837676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df1e17-8c9b-44bd-aa9b-efda2dfab285 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:33.843114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c08f8-9d16-424f-8c9c-c83d637dde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:33.843789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c08f8-9d16-424f-8c9c-c83d637dde70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.844203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c08f8-9d16-424f-8c9c-c83d637dde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.844489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c08f8-9d16-424f-8c9c-c83d637dde70 admin admin] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55/users/507a2bdedc4441e48f7de00c4ef3b1e0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.860000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c08f8-9d16-424f-8c9c-c83d637dde70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b62f05af6545b4981c135da7197b55, user_id=507a2bdedc4441e48f7de00c4ef3b1e0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:33.863595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c08f8-9d16-424f-8c9c-c83d637dde70 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:33.883926 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3189/6400] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:33 2022] PUT /identity/v3/projects/a2b62f05af6545b4981c135da7197b55/users/507a2bdedc4441e48f7de00c4ef3b1e0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:33.894804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.895046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.895331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.931245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68812090-3f73-456d-8535-6ab523402e53 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:33.931536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68812090-3f73-456d-8535-6ab523402e53 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:33.931811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68812090-3f73-456d-8535-6ab523402e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:33.942210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] MFA Rules not processed for user `507a2bdedc4441e48f7de00c4ef3b1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:33.943463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:33.959935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:33.976596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-68812090-3f73-456d-8535-6ab523402e53 None None] MFA Rules not processed for user `fb657d3496834b91aa36cd01289d21bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:33.979596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-68812090-3f73-456d-8535-6ab523402e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:34.041383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3212/6401] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:34.065296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.070802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:34.108325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3190/6402] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:34.109790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.110090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.111710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.138058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] MFA Rules not processed for user `ba34319166e041129b4a05926efa2af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:34.139989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:34.179960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37dfdc-867a-411e-9bee-ed6479459c40 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.191102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240ec9-b478-41b9-acb1-8d7bce538470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.191912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240ec9-b478-41b9-acb1-8d7bce538470 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.192286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240ec9-b478-41b9-acb1-8d7bce538470 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.192649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240ec9-b478-41b9-acb1-8d7bce538470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.201335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240ec9-b478-41b9-acb1-8d7bce538470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.203171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240ec9-b478-41b9-acb1-8d7bce538470 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.211337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3191/6403] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:34.213209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3213/6404] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:55:34.223348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.224734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:34.229032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3831-d764-4169-b3ef-bba0840e7c79 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.229352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3831-d764-4169-b3ef-bba0840e7c79 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.229631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3831-d764-4169-b3ef-bba0840e7c79 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.231148 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3214/6405] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:55:34.235594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3831-d764-4169-b3ef-bba0840e7c79 None None] Authenticating service token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:55:34.243886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669b2c-eb75-40b0-b0ec-04cea418addc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.250088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.250739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.251602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.251902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.256215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3831-d764-4169-b3ef-bba0840e7c79 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.257402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:34.261584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:34.269997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3831-d764-4169-b3ef-bba0840e7c79 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.273931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.275727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.276323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5d64-cf54-4dd0-bcf7-ded314bd8075 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507a2bdedc4441e48f7de00c4ef3b1e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2b62f05af6545b4981c135da7197b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.277291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5d64-cf54-4dd0-bcf7-ded314bd8075 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.277645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5d64-cf54-4dd0-bcf7-ded314bd8075 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.278111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5d64-cf54-4dd0-bcf7-ded314bd8075 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.279405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5d64-cf54-4dd0-bcf7-ded314bd8075 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorizing `identity:get_project(project_id=a2b62f05af6545b4981c135da7197b55)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.281343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5d64-cf54-4dd0-bcf7-ded314bd8075 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.283615 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3215/6406] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/projects/a2b62f05af6545b4981c135da7197b55 => generated 363 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:34.287267 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3192/6407] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:34.317082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702a5d-d3a7-4208-854f-feb41962ef37 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.317371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702a5d-d3a7-4208-854f-feb41962ef37 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.317765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702a5d-d3a7-4208-854f-feb41962ef37 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.319296 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3216/6408] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:55:34.324992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:55:34.343336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.353867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f78add-4d55-404a-9f59-d315d132866b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.358603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507a2bdedc4441e48f7de00c4ef3b1e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2b62f05af6545b4981c135da7197b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.359352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.359709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.360057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.361300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorizing `identity:get_project(project_id=a2b62f05af6545b4981c135da7197b55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.363428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.365365 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3193/6409] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/projects/a2b62f05af6545b4981c135da7197b55 => generated 363 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:34.519128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac33ea-21e9-4560-8411-b7dea4881f0b None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.520477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac33ea-21e9-4560-8411-b7dea4881f0b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.521156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac33ea-21e9-4560-8411-b7dea4881f0b None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.523050 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3217/6410] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:55:34.528279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:55:34.544405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.556669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdcf12-e0d0-42ce-bf23-8f3b86a50684 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.561318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507a2bdedc4441e48f7de00c4ef3b1e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2b62f05af6545b4981c135da7197b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.562069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.562618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.563052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.564449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorizing `identity:get_project(project_id=a2b62f05af6545b4981c135da7197b55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.572637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.572637 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3194/6411] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/projects/a2b62f05af6545b4981c135da7197b55 => generated 363 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:34.603934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26202-977e-4b5a-86ad-481e4098c383 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.604388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26202-977e-4b5a-86ad-481e4098c383 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.604747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26202-977e-4b5a-86ad-481e4098c383 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.606185 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3218/6412] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:55:34.614322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:55:34.630329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.639943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10343-9709-4154-8660-6c35af5ef7cf tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.645033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507a2bdedc4441e48f7de00c4ef3b1e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2b62f05af6545b4981c135da7197b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.645744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.646183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.646535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.647758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorizing `identity:get_project(project_id=a2b62f05af6545b4981c135da7197b55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.649719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.651625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3195/6413] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/projects/a2b62f05af6545b4981c135da7197b55 => generated 363 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:34.693481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaa4ca-8c53-46a5-83c1-0ee4c2837cf2 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.693773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaa4ca-8c53-46a5-83c1-0ee4c2837cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.694101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaa4ca-8c53-46a5-83c1-0ee4c2837cf2 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.698283 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3219/6414] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 02:55:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 02:55:34.704303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 02:55:34.720737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.731122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd70070-1caf-46b8-8975-e6076e2467b1 tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.735441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d811696-5df2-4297-b31a-4c8b3fc442ee tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '507a2bdedc4441e48f7de00c4ef3b1e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2b62f05af6545b4981c135da7197b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.736172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811696-5df2-4297-b31a-4c8b3fc442ee tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.736420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811696-5df2-4297-b31a-4c8b3fc442ee tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.736671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d811696-5df2-4297-b31a-4c8b3fc442ee tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.738006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d811696-5df2-4297-b31a-4c8b3fc442ee tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorizing `identity:get_project(project_id=a2b62f05af6545b4981c135da7197b55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.739843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d811696-5df2-4297-b31a-4c8b3fc442ee tempest-QuotasTestJSON-435657257 tempest-QuotasTestJSON-435657257-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.741667 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3196/6415] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 02:55:34 2022] GET /identity/v3/projects/a2b62f05af6545b4981c135da7197b55 => generated 363 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:34.776350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaa4ca-8c53-46a5-83c1-0ee4c2837cf2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:34.851484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaa4ca-8c53-46a5-83c1-0ee4c2837cf2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:34.856199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:34.856840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.857165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.857452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] PATH_INFO: `/v3/users/507a2bdedc4441e48f7de00c4ef3b1e0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:34.858636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507a2bdedc4441e48f7de00c4ef3b1e0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:34.860878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:34.918111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507a2bdedc4441e48f7de00c4ef3b1e0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:34.932603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507a2bdedc4441e48f7de00c4ef3b1e0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:34.933510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507a2bdedc4441e48f7de00c4ef3b1e0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:34.945005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507a2bdedc4441e48f7de00c4ef3b1e0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:34.947003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507a2bdedc4441e48f7de00c4ef3b1e0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:34.960951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3220/6416] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:34 2022] DELETE /identity/v3/users/507a2bdedc4441e48f7de00c4ef3b1e0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:34.965620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:34.965906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:34.966183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:35.013083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:35.014384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:35.082400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:35.097830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3197/6417] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:35.108585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:35.110052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:35.194546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbf01c-a6db-4ba0-ad3f-f7c4491b5122 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:35.198473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4302086-fac4-4ce7-bb0e-08fe490bcf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:35.199105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302086-fac4-4ce7-bb0e-08fe490bcf8a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:35.199391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302086-fac4-4ce7-bb0e-08fe490bcf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:35.199666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302086-fac4-4ce7-bb0e-08fe490bcf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:35.209476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4302086-fac4-4ce7-bb0e-08fe490bcf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:35.210928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4302086-fac4-4ce7-bb0e-08fe490bcf8a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:35.230729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3221/6418] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:35.694095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:35.695734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:35.739258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4f636-01cf-41f9-9fac-2d287d6d8061 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:35.758084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:35.758084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:35.758084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:35.758084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] PATH_INFO: `/v3/projects/a2b62f05af6545b4981c135da7197b55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:35.760371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b62f05af6545b4981c135da7197b55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:35.763121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:35.820167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b62f05af6545b4981c135da7197b55', 'request_id': 'req-d9584e53-9477-43cd-aee0-6c7d80ce373e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:35.828397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b62f05af6545b4981c135da7197b55', 'request_id': 'req-d9584e53-9477-43cd-aee0-6c7d80ce373e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:35.835342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b62f05af6545b4981c135da7197b55', 'request_id': 'req-d9584e53-9477-43cd-aee0-6c7d80ce373e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:35.848477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] The token cache is being invalidate because project a2b62f05af6545b4981c135da7197b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:35.848773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:35.849493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9584e53-9477-43cd-aee0-6c7d80ce373e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:35.851033 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3198/6419] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:35 2022] DELETE /identity/v3/projects/a2b62f05af6545b4981c135da7197b55 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:35.856693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:35.857240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:35.857328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:35.882764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:35.883986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:35.891817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:35.976020 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3222/6420] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:35.978924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:35.979502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:35.979794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.001283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:36.002599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:36.012370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3199/6421] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:36.017673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.028624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab2f75-3e30-4387-afec-3c584b980b2a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.033728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.034912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.035195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.035472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.036154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:36.036460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.042227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.054705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3223/6422] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:36.059015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.069185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdd28-a9c0-4f51-8773-897910eaa533 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.075511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.076324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.076668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.077101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.077913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.079971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.114946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3200/6423] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:36 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:36.115595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.127649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbe0be-42a0-4cd8-86bf-d15c78542715 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.210451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.211071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.211355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.211632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.212273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.214278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.242515 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3224/6424] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:36 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:36.247161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.260564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16606cf5-71dc-4ece-bf54-29ed178705ed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.265721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.266407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.266692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.266968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.267943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.270202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.284369 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3201/6425] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:36.285652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.300642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b84b7d-1e2a-420c-8586-eb487901e1bf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.305511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad454f06-8951-4f12-837a-7fc56f765c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.306197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454f06-8951-4f12-837a-7fc56f765c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.306551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454f06-8951-4f12-837a-7fc56f765c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.306933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454f06-8951-4f12-837a-7fc56f765c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.307624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454f06-8951-4f12-837a-7fc56f765c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.309597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454f06-8951-4f12-837a-7fc56f765c44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.324945 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3225/6426] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:36.327675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.351054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c754918-b12f-4f8f-8535-13df52b565c8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.356079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.357014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.357464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.357893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] PATH_INFO: `/v3/projects/a79d988f81714f6a90e17a0f2fe6866e/users/1ac4348747d948be935ace59b19d62a0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.374351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79d988f81714f6a90e17a0f2fe6866e, user_id=1ac4348747d948be935ace59b19d62a0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.377217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.391235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3202/6427] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:36 2022] PUT /identity/v3/projects/a79d988f81714f6a90e17a0f2fe6866e/users/1ac4348747d948be935ace59b19d62a0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:36.403737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.404030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.404308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.434221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] MFA Rules not processed for user `1ac4348747d948be935ace59b19d62a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:36.435431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:36.504815 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3226/6428] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:36.516482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.592239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b2a16-c6f9-4ee0-97c2-978572e63fa6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.598318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.599096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.599378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.600715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.601399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.604569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.630300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:36.654999 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3203/6429] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:36 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:36.656972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.665265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:36.670926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f80cf-f34d-4cb9-8134-df087043aa74 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.750556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.751517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.753252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.753712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.754511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.756678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.814755 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3227/6430] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:36 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:36.821144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.846050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d069fd-b3e9-4bc9-904d-13f792228496 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.853438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.854081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.854370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.854654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.855317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.857199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.870998 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3204/6431] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:36.874572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.885538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab633b6-e401-460a-883e-0024737b6a65 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:36.895850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:36.896961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:36.897603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:36.898056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] PATH_INFO: `/v3/projects/a33f3c680f7f4d48ae56b69acf52de80/users/12b02263331b4ba5850335d99ee105f1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:36.933659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33f3c680f7f4d48ae56b69acf52de80, user_id=12b02263331b4ba5850335d99ee105f1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:36.936628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:36.958205 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3228/6432] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:36 2022] PUT /identity/v3/projects/a33f3c680f7f4d48ae56b69acf52de80/users/12b02263331b4ba5850335d99ee105f1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:36.959737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:36.972041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3464c-d1d9-4de0-9c5e-e08399d8bd2f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.055954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1e021-2780-4b88-ae46-4f32910cc2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.056843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e021-2780-4b88-ae46-4f32910cc2ef admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.057148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e021-2780-4b88-ae46-4f32910cc2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.057583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e021-2780-4b88-ae46-4f32910cc2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.058388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e021-2780-4b88-ae46-4f32910cc2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.060290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e021-2780-4b88-ae46-4f32910cc2ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.077555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3205/6433] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:37.079136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:37.093400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ea70-92ff-4266-a4b5-f11b9e0cd484 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.099375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.100167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.100467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.100752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] PATH_INFO: `/v3/projects/a33f3c680f7f4d48ae56b69acf52de80/users/12b02263331b4ba5850335d99ee105f1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.107336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33f3c680f7f4d48ae56b69acf52de80, user_id=12b02263331b4ba5850335d99ee105f1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.131695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.160755 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3229/6434] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:37 2022] PUT /identity/v3/projects/a33f3c680f7f4d48ae56b69acf52de80/users/12b02263331b4ba5850335d99ee105f1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:37.163102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.163383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.163692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.203812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] MFA Rules not processed for user `12b02263331b4ba5850335d99ee105f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:37.203812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:37.301857 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3206/6435] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:37.309084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:37.322902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600100ad-bd34-4417-a043-99b03c48b81d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.329163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.329802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.330093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.330368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.331914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.333444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.371727 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3230/6436] 10.222.0.16 () {60 vars in 1150 bytes} [Wed Oct 5 02:55:37 2022] POST /identity/v3/domains => generated 277 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:37.374521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:37.386278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774022-9fe5-4c6f-a2b8-e4e7d72e0f04 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.454826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.455483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.456390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.456672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.457401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.459043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.476862 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3207/6437] 10.222.0.16 () {60 vars in 1150 bytes} [Wed Oct 5 02:55:37 2022] POST /identity/v3/domains => generated 276 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:37.480804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:37.491710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d01c3a-3bfd-4263-9ff7-bddf1ae0fc60 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.574755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.583399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.583697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.583980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.584702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.586820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.607239 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3231/6438] 10.222.0.16 () {60 vars in 1150 bytes} [Wed Oct 5 02:55:37 2022] POST /identity/v3/domains => generated 276 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:37.611350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:37.617572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:37.625481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170330f-35ed-4879-9873-648290d3a169 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.725238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.725798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.726059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.726351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.727077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.729071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.757199 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3208/6439] 10.222.0.16 () {60 vars in 1150 bytes} [Wed Oct 5 02:55:37 2022] POST /identity/v3/domains => generated 278 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:37.761419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:37.772634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2469-6686-49ae-95a4-4a13da203d91 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:37.811586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:37.841315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:37.841964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:37.842248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:37.842529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/692aad66db624cadaa8a9dd976c2eda3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:37.854861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=692aad66db624cadaa8a9dd976c2eda3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:37.858033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:37.884476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:37.888088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:37.957980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3', 'request_id': 'req-b3e973f3-a71e-49bd-940f-3677f0a82eed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:37.965369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3', 'request_id': 'req-b3e973f3-a71e-49bd-940f-3677f0a82eed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:37.975138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3', 'request_id': 'req-b3e973f3-a71e-49bd-940f-3677f0a82eed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.015207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project 692aad66db624cadaa8a9dd976c2eda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:38.015451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.026223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.037099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3', 'request_id': 'req-b3e973f3-a71e-49bd-940f-3677f0a82eed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.037925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3', 'request_id': 'req-b3e973f3-a71e-49bd-940f-3677f0a82eed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.041824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '692aad66db624cadaa8a9dd976c2eda3', 'request_id': 'req-b3e973f3-a71e-49bd-940f-3677f0a82eed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.054007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3232/6440] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:37 2022] DELETE /identity/v3/domains/692aad66db624cadaa8a9dd976c2eda3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:38.055093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:38.057213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:38.081935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd55d04-bafa-46b0-844f-edfec7abf1e3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:38.158419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:38.159315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:38.159608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:38.159884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:38.160773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:38.162506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:38.183268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3209/6441] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:55:38 2022] POST /identity/v3/domains => generated 249 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:38.184576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:38.196877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e973f3-a71e-49bd-940f-3677f0a82eed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:38.267588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:38.268889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:38.269200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:38.269511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/638725b14b5045278091a2cdf408660e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:38.281940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=638725b14b5045278091a2cdf408660e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:38.283618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:38.295437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:38.317532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '638725b14b5045278091a2cdf408660e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.326449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '638725b14b5045278091a2cdf408660e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.368280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '638725b14b5045278091a2cdf408660e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.369304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '638725b14b5045278091a2cdf408660e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.377581 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3233/6442] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:38 2022] PATCH /identity/v3/domains/638725b14b5045278091a2cdf408660e => generated 250 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:38.383426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:38.385530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:38.401012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2682b3-5a61-4f12-8579-1a28949d91b3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:38.524848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:38.527575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:38.527988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:38.528380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/638725b14b5045278091a2cdf408660e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:38.547090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=638725b14b5045278091a2cdf408660e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:38.549885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:38.584588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '638725b14b5045278091a2cdf408660e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.587438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:38.591918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '638725b14b5045278091a2cdf408660e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.694237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638725b14b5045278091a2cdf408660e', 'request_id': 'req-fa9a26b6-9af0-4782-873a-c53cc1013372'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.708102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638725b14b5045278091a2cdf408660e', 'request_id': 'req-fa9a26b6-9af0-4782-873a-c53cc1013372'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.715760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638725b14b5045278091a2cdf408660e', 'request_id': 'req-fa9a26b6-9af0-4782-873a-c53cc1013372'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.735153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project 638725b14b5045278091a2cdf408660e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:38.735406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.736223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.751169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '638725b14b5045278091a2cdf408660e', 'request_id': 'req-fa9a26b6-9af0-4782-873a-c53cc1013372'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.752193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '638725b14b5045278091a2cdf408660e', 'request_id': 'req-fa9a26b6-9af0-4782-873a-c53cc1013372'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.757430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '638725b14b5045278091a2cdf408660e', 'request_id': 'req-fa9a26b6-9af0-4782-873a-c53cc1013372'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:38.769760 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3210/6443] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:38 2022] DELETE /identity/v3/domains/638725b14b5045278091a2cdf408660e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:38.771346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:38.784812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5091-1d64-460a-8b71-787968dbe5f2 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:38.864428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:38.866413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:38.866698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:38.867072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:38.867756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:38.869409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:38.894770 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3234/6444] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:55:38 2022] POST /identity/v3/domains => generated 277 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:38.895876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:38.897730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:38.911015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a26b6-9af0-4782-873a-c53cc1013372 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.012398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.013077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.013431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.013774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/61d8539a2e9c49ed947057078536351d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.029340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=61d8539a2e9c49ed947057078536351d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.031235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.059282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '61d8539a2e9c49ed947057078536351d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.060563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '61d8539a2e9c49ed947057078536351d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.105405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '61d8539a2e9c49ed947057078536351d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.109190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '61d8539a2e9c49ed947057078536351d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.115972 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3211/6445] 10.222.0.16 () {60 vars in 1250 bytes} [Wed Oct 5 02:55:38 2022] PATCH /identity/v3/domains/61d8539a2e9c49ed947057078536351d => generated 278 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:39.119963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.122077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:39.137665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c1f77-8770-4238-8877-f9e85d2c8904 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.204433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.211132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.211132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.211132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/61d8539a2e9c49ed947057078536351d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.229050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=61d8539a2e9c49ed947057078536351d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.231788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.233868 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3235/6446] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:55:39 2022] GET /identity/v3/domains/61d8539a2e9c49ed947057078536351d => generated 278 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:39.238418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.252434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbe307-ef41-4c10-8518-de7912cc0cea tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.257672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.258411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.258791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.259166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/61d8539a2e9c49ed947057078536351d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.260678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=61d8539a2e9c49ed947057078536351d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.262661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.284893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:39.289334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '61d8539a2e9c49ed947057078536351d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.293418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '61d8539a2e9c49ed947057078536351d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.343233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d8539a2e9c49ed947057078536351d', 'request_id': 'req-4ab29925-1c9b-4f2f-982c-a9046601ebcf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.352002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d8539a2e9c49ed947057078536351d', 'request_id': 'req-4ab29925-1c9b-4f2f-982c-a9046601ebcf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.357976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d8539a2e9c49ed947057078536351d', 'request_id': 'req-4ab29925-1c9b-4f2f-982c-a9046601ebcf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.369948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project 61d8539a2e9c49ed947057078536351d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:39.370245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.370920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.379472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '61d8539a2e9c49ed947057078536351d', 'request_id': 'req-4ab29925-1c9b-4f2f-982c-a9046601ebcf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.380175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '61d8539a2e9c49ed947057078536351d', 'request_id': 'req-4ab29925-1c9b-4f2f-982c-a9046601ebcf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.383487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '61d8539a2e9c49ed947057078536351d', 'request_id': 'req-4ab29925-1c9b-4f2f-982c-a9046601ebcf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.389053 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3212/6447] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:39 2022] DELETE /identity/v3/domains/61d8539a2e9c49ed947057078536351d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:39.393910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.395692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:39.408319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5ac90-ecd6-4254-ae8a-6511ea54f4f4 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.475716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.476350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.476638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.476944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.477591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.479210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.480749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:39.497757 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3236/6448] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:55:39 2022] GET /identity/v3/domains => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:39.502551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.514751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab29925-1c9b-4f2f-982c-a9046601ebcf tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.520367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.521075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.521346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.521626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/61d8539a2e9c49ed947057078536351d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.529083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find domain: 61d8539a2e9c49ed947057078536351d.: keystone.exception.DomainNotFound: Could not find domain: 61d8539a2e9c49ed947057078536351d. Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 61d8539a2e9c49ed947057078536351d. Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:39.534731 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:39.535722 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 61d8539a2e9c49ed947057078536351d. Oct 05 02:55:39.536796 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:39.538049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3213/6449] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:39 2022] PATCH /identity/v3/domains/61d8539a2e9c49ed947057078536351d => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:39.541434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.552334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d94f0-f319-45f2-b0c0-31e90863ab5a tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.557015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.557617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.557902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.558180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.558842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.560433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.577373 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3237/6450] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:55:39 2022] POST /identity/v3/domains => generated 276 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:39.581859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.592750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ea9f8-a989-4fb0-9a25-67657235a5c0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.661251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.661973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.662323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.662662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.663551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.665902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.703984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3214/6451] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:39 2022] POST /identity/v3/users => generated 348 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:39.709138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.721986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709311-621c-4c5b-8113-3473139f5bed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.727040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.727697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.728061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.728500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.729187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.731280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.767163 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3238/6452] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:55:39 2022] POST /identity/v3/groups => generated 325 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:39.770536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.782340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e466a4-c22e-421b-b1f2-f2e1d63351fe tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.788669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.789309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.789702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.789990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/00347352c19a4adea00d4482f56628a5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.791477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=00347352c19a4adea00d4482f56628a5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.793425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.818932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '00347352c19a4adea00d4482f56628a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.819707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '00347352c19a4adea00d4482f56628a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.842284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:39.855235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '00347352c19a4adea00d4482f56628a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.855947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '00347352c19a4adea00d4482f56628a5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.862693 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3215/6453] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:39 2022] PATCH /identity/v3/domains/00347352c19a4adea00d4482f56628a5 => generated 277 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:39.863548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:39.865401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:39.878535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef84a-d63f-4c8b-b140-b0af930f9c3c tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:39.939764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:39.940580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:39.940867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:39.941176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/00347352c19a4adea00d4482f56628a5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:39.953119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=00347352c19a4adea00d4482f56628a5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:39.954750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:39.981201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '00347352c19a4adea00d4482f56628a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:39.985761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '00347352c19a4adea00d4482f56628a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.140415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:40.167071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ec9e54fd0e4be6ac1ec16effddcb2f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.183785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ec9e54fd0e4be6ac1ec16effddcb2f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.184569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ec9e54fd0e4be6ac1ec16effddcb2f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.193053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ec9e54fd0e4be6ac1ec16effddcb2f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.193773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ec9e54fd0e4be6ac1ec16effddcb2f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.243925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00347352c19a4adea00d4482f56628a5', 'request_id': 'req-bb683453-1b5a-4cf4-a541-3b957f8b1cca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.250560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00347352c19a4adea00d4482f56628a5', 'request_id': 'req-bb683453-1b5a-4cf4-a541-3b957f8b1cca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.258041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00347352c19a4adea00d4482f56628a5', 'request_id': 'req-bb683453-1b5a-4cf4-a541-3b957f8b1cca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.271733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project 00347352c19a4adea00d4482f56628a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:40.271968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.272621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.280933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '00347352c19a4adea00d4482f56628a5', 'request_id': 'req-bb683453-1b5a-4cf4-a541-3b957f8b1cca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.281941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '00347352c19a4adea00d4482f56628a5', 'request_id': 'req-bb683453-1b5a-4cf4-a541-3b957f8b1cca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.286033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '00347352c19a4adea00d4482f56628a5', 'request_id': 'req-bb683453-1b5a-4cf4-a541-3b957f8b1cca'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.294252 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3239/6454] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:39 2022] DELETE /identity/v3/domains/00347352c19a4adea00d4482f56628a5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:40.298029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.309572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fecabf-cc9c-4221-bea1-2004ed8a069f tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.388161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.388799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.389239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.389613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/00347352c19a4adea00d4482f56628a5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.397987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=00347352c19a4adea00d4482f56628a5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.399930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find domain: 00347352c19a4adea00d4482f56628a5.: keystone.exception.DomainNotFound: Could not find domain: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.412249 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.413529 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.414725 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:40.416711 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3216/6455] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:55:40 2022] GET /identity/v3/domains/00347352c19a4adea00d4482f56628a5 => generated 112 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.417994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.419519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:40.433887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb683453-1b5a-4cf4-a541-3b957f8b1cca tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.438644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.439277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.439566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.440579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/users/95ec9e54fd0e4be6ac1ec16effddcb2f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.449333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:get_user(user_id=95ec9e54fd0e4be6ac1ec16effddcb2f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.451394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find user: 95ec9e54fd0e4be6ac1ec16effddcb2f.: keystone.exception.UserNotFound: Could not find user: 95ec9e54fd0e4be6ac1ec16effddcb2f. Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 05 02:55:40.475352 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.476508 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 95ec9e54fd0e4be6ac1ec16effddcb2f. Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.477531 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3240/6456] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:55:40 2022] GET /identity/v3/users/95ec9e54fd0e4be6ac1ec16effddcb2f => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.480926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.491943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad2700-fd13-4441-b807-6b93530183be tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.496706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.497474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.497760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.498039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/groups/fab7c1f998aa487b9b2a1d7faf6eb033` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.504276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:get_group(group_id=fab7c1f998aa487b9b2a1d7faf6eb033)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.505351 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:55:40.505351 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 02:55:40.505351 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 02:55:40.506500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find group: fab7c1f998aa487b9b2a1d7faf6eb033.: keystone.exception.GroupNotFound: Could not find group: fab7c1f998aa487b9b2a1d7faf6eb033. Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 05 02:55:40.520109 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.521319 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fab7c1f998aa487b9b2a1d7faf6eb033. Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:40.522528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3217/6457] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:40 2022] GET /identity/v3/groups/fab7c1f998aa487b9b2a1d7faf6eb033 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.526121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.538083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b93c1c-46bb-430c-aca9-a935e6702974 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.542941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.543628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.543911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.544186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/groups/fab7c1f998aa487b9b2a1d7faf6eb033` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.551575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find group: fab7c1f998aa487b9b2a1d7faf6eb033.: keystone.exception.GroupNotFound: Could not find group: fab7c1f998aa487b9b2a1d7faf6eb033. Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 05 02:55:40.557247 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.558190 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fab7c1f998aa487b9b2a1d7faf6eb033. Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.559233 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3241/6458] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:55:40 2022] DELETE /identity/v3/groups/fab7c1f998aa487b9b2a1d7faf6eb033 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.562708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.574101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9f56d-3146-4c51-af13-0d0b0c85c4ad tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.578815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.579437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.579753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.580031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/users/95ec9e54fd0e4be6ac1ec16effddcb2f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.587888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_user(user_id=95ec9e54fd0e4be6ac1ec16effddcb2f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.589765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find user: 95ec9e54fd0e4be6ac1ec16effddcb2f.: keystone.exception.UserNotFound: Could not find user: 95ec9e54fd0e4be6ac1ec16effddcb2f. Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 05 02:55:40.601266 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.602290 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 95ec9e54fd0e4be6ac1ec16effddcb2f. Oct 05 02:55:40.603257 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:40.604268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3218/6459] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:40 2022] DELETE /identity/v3/users/95ec9e54fd0e4be6ac1ec16effddcb2f => generated 110 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.606827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.617483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925793a-d578-4162-adbc-37b5594cfb9d tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.622243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.622901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.623186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.623490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/00347352c19a4adea00d4482f56628a5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.634515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find domain: 00347352c19a4adea00d4482f56628a5.: keystone.exception.DomainNotFound: Could not find domain: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.638866 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.640218 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.641487 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.642471 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3242/6460] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:40 2022] PATCH /identity/v3/domains/00347352c19a4adea00d4482f56628a5 => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.647483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.666580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e60b-fbd6-4f8d-9bd7-5bf8473ddc33 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.672160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.672774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.673107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.673395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.674052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.676505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.691405 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3219/6461] 10.222.0.16 () {58 vars in 1128 bytes} [Wed Oct 5 02:55:40 2022] GET /identity/v3/domains => generated 1347 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:40.698166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.709114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1239aa1-7b6b-4775-be0e-e46c3acf4ae9 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.714103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.714710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.714999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.715285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.715939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:40.716251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.717881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.738930 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3243/6462] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:40 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:40.744106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.755345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3000f-268d-4b81-b2ff-f393ef8883ce tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.759986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.760587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.761012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.761292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.761937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-2137328940) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:40.762239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.764106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.781881 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3220/6463] 10.222.0.16 () {58 vars in 1199 bytes} [Wed Oct 5 02:55:40 2022] GET /identity/v3/domains?name=tempest-test_domain-2137328940 => generated 409 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:40.783594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.795576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eaa44-be77-41c4-b1a6-53f3ec1b8e96 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.800876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.801565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.801846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.802121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/00347352c19a4adea00d4482f56628a5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.809374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Could not find domain: 00347352c19a4adea00d4482f56628a5.: keystone.exception.DomainNotFound: Could not find domain: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:40.814309 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:40.816398 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application with Lock( Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._enter() Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.creator() Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application created_value = creator( Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 00347352c19a4adea00d4482f56628a5. Oct 05 02:55:40.817298 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:40.818254 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3244/6464] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:40 2022] PATCH /identity/v3/domains/00347352c19a4adea00d4482f56628a5 => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 02:55:40.820264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.831707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162f63d-bbc3-48b4-91d4-a17d95176740 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.837009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.837635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.837971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.838305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/ae05e703789347d2acb862217dc298c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.854345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ae05e703789347d2acb862217dc298c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.856001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.903015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3221/6465] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:40 2022] PATCH /identity/v3/domains/ae05e703789347d2acb862217dc298c7 => generated 276 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:40.907485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:40.920023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6373fa-e7b6-426a-8e81-07dea6f8b5f3 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:40.925575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:40.926322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:40.926631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:40.926920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/ae05e703789347d2acb862217dc298c7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:40.938410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ae05e703789347d2acb862217dc298c7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:40.940134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:40.961908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:40.967405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ae05e703789347d2acb862217dc298c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:40.972356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ae05e703789347d2acb862217dc298c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.032937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae05e703789347d2acb862217dc298c7', 'request_id': 'req-d3b597b1-3dfd-4014-9ace-1093094c12ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.043080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae05e703789347d2acb862217dc298c7', 'request_id': 'req-d3b597b1-3dfd-4014-9ace-1093094c12ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.052374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae05e703789347d2acb862217dc298c7', 'request_id': 'req-d3b597b1-3dfd-4014-9ace-1093094c12ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.070054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project ae05e703789347d2acb862217dc298c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:41.070479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.071274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.080841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ae05e703789347d2acb862217dc298c7', 'request_id': 'req-d3b597b1-3dfd-4014-9ace-1093094c12ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.081654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ae05e703789347d2acb862217dc298c7', 'request_id': 'req-d3b597b1-3dfd-4014-9ace-1093094c12ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.085682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ae05e703789347d2acb862217dc298c7', 'request_id': 'req-d3b597b1-3dfd-4014-9ace-1093094c12ed'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.093219 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3245/6466] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:40 2022] DELETE /identity/v3/domains/ae05e703789347d2acb862217dc298c7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:41.097758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:41.099850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:41.116828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae9bf8-8d5b-4317-9b98-6313c7dc63a0 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:41.187580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:41.221606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:41.222541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:41.223064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:41.223473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/7fcca7b0a39a4ed9ab31bde951c1987c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:41.238881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7fcca7b0a39a4ed9ab31bde951c1987c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:41.240556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:41.268812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.269699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.297423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.298332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.305003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3222/6467] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:41 2022] PATCH /identity/v3/domains/7fcca7b0a39a4ed9ab31bde951c1987c => generated 277 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:41.307032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:41.318838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b597b1-3dfd-4014-9ace-1093094c12ed tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:41.392116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:41.392771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:41.393219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:41.393545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/7fcca7b0a39a4ed9ab31bde951c1987c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:41.406787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7fcca7b0a39a4ed9ab31bde951c1987c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:41.408641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:41.457899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.468281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.517955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:41.541141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c', 'request_id': 'req-37015d53-cfff-41f2-8c78-1871e021086e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.565567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c', 'request_id': 'req-37015d53-cfff-41f2-8c78-1871e021086e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.572935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c', 'request_id': 'req-37015d53-cfff-41f2-8c78-1871e021086e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.590639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project 7fcca7b0a39a4ed9ab31bde951c1987c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:41.590940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.591560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.600391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c', 'request_id': 'req-37015d53-cfff-41f2-8c78-1871e021086e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.601214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c', 'request_id': 'req-37015d53-cfff-41f2-8c78-1871e021086e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.605242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7fcca7b0a39a4ed9ab31bde951c1987c', 'request_id': 'req-37015d53-cfff-41f2-8c78-1871e021086e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.612595 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3246/6468] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:41 2022] DELETE /identity/v3/domains/7fcca7b0a39a4ed9ab31bde951c1987c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:41.616958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:41.618327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:41.634034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2301b-37c2-4e24-8e02-b6280a9ca190 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:41.740942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:41.741936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:41.742369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:41.742793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/3e0f63df4a414e83b2d199d3e8deb82b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:41.756083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3e0f63df4a414e83b2d199d3e8deb82b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:41.757801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:41.784279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.785788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.820042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.822197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.826161 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3223/6469] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:41 2022] PATCH /identity/v3/domains/3e0f63df4a414e83b2d199d3e8deb82b => generated 278 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:41.829928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:41.831466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:41.857702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37015d53-cfff-41f2-8c78-1871e021086e tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:41.928715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12b02263331b4ba5850335d99ee105f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a33f3c680f7f4d48ae56b69acf52de80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:41.929627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:41.929920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:41.930197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] PATH_INFO: `/v3/domains/3e0f63df4a414e83b2d199d3e8deb82b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:41.944078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3e0f63df4a414e83b2d199d3e8deb82b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:41.945813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:41.975735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:41.979760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.035302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b', 'request_id': 'req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.043469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b', 'request_id': 'req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.051675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b', 'request_id': 'req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.055840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:42.071644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] The token cache is being invalidate because project 3e0f63df4a414e83b2d199d3e8deb82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:42.071946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.072535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.082951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b', 'request_id': 'req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.083937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b', 'request_id': 'req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.087823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3e0f63df4a414e83b2d199d3e8deb82b', 'request_id': 'req-a1ea7a1e-d642-4c30-95c8-2e96c5df77f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.094611 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3247/6470] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:41 2022] DELETE /identity/v3/domains/3e0f63df4a414e83b2d199d3e8deb82b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:42.099391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:42.100814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:42.189051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eff19-52b0-42a4-9516-4c2853cd8601 tempest-DomainsTestJSON-2044207112 tempest-DomainsTestJSON-2044207112-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:42.194029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:42.254928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:42.255568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:42.255851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:42.256129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] PATH_INFO: `/v3/users/1ac4348747d948be935ace59b19d62a0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:42.257330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac4348747d948be935ace59b19d62a0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:42.259564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:42.317790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac4348747d948be935ace59b19d62a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.333535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac4348747d948be935ace59b19d62a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.334457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac4348747d948be935ace59b19d62a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.345553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac4348747d948be935ace59b19d62a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.346926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac4348747d948be935ace59b19d62a0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:42.364166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3224/6471] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:42 2022] DELETE /identity/v3/users/1ac4348747d948be935ace59b19d62a0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:42.369030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:42.369329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:42.369694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:42.395167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:42.396599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:42.477078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3248/6472] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:42.487862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:42.489375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:42.553375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893d0b1-9914-41d2-b531-b822f962e44a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:42.557042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:42.557644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:42.557924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:42.558198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:42.568139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:42.569598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:42.579015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3225/6473] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:42.933142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:42.934630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:42.949608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f9735-87d3-4a60-9b8d-d3366d72952c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:42.954725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:42.955557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:42.956366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:42.956582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] PATH_INFO: `/v3/projects/a79d988f81714f6a90e17a0f2fe6866e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:42.957799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79d988f81714f6a90e17a0f2fe6866e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:42.959772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:43.030761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79d988f81714f6a90e17a0f2fe6866e', 'request_id': 'req-97ce4d66-4180-48d7-b06a-43f50d2072c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.043775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79d988f81714f6a90e17a0f2fe6866e', 'request_id': 'req-97ce4d66-4180-48d7-b06a-43f50d2072c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.055626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79d988f81714f6a90e17a0f2fe6866e', 'request_id': 'req-97ce4d66-4180-48d7-b06a-43f50d2072c4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.084805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] The token cache is being invalidate because project a79d988f81714f6a90e17a0f2fe6866e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:43.085166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.086058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.088405 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3249/6474] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:42 2022] DELETE /identity/v3/projects/a79d988f81714f6a90e17a0f2fe6866e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:43.092287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:43.103786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787caaea-95d0-48a8-8f27-c20cca91ecec service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:43.131459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:43.165304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:43.165940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:43.166224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:43.166503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] PATH_INFO: `/v3/users/12b02263331b4ba5850335d99ee105f1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:43.167760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b02263331b4ba5850335d99ee105f1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:43.169726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:43.219178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b02263331b4ba5850335d99ee105f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.231374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b02263331b4ba5850335d99ee105f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.232061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b02263331b4ba5850335d99ee105f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.239691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b02263331b4ba5850335d99ee105f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.240337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-992c29a8-ca58-41e6-b05d-b67071760178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b02263331b4ba5850335d99ee105f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.254432 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3226/6475] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:43 2022] DELETE /identity/v3/users/12b02263331b4ba5850335d99ee105f1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:43.585259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:43.587625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:43.631089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4d66-4180-48d7-b06a-43f50d2072c4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:43.743004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:43.743654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:43.744075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:43.744356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] PATH_INFO: `/v3/projects/a33f3c680f7f4d48ae56b69acf52de80` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:43.745516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33f3c680f7f4d48ae56b69acf52de80)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:43.748023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:43.750439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:43.815429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33f3c680f7f4d48ae56b69acf52de80', 'request_id': 'req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.821338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33f3c680f7f4d48ae56b69acf52de80', 'request_id': 'req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.827987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33f3c680f7f4d48ae56b69acf52de80', 'request_id': 'req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.842794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] The token cache is being invalidate because project a33f3c680f7f4d48ae56b69acf52de80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:43.843095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.843839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-51cc0d5b-7a89-4995-86f5-64fb76a3edaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:43.845384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3250/6476] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:43 2022] DELETE /identity/v3/projects/a33f3c680f7f4d48ae56b69acf52de80 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:43.851362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:43.851854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:43.851964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:43.934060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:43.935639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:44.024998 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3227/6477] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:44.034582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.035199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.035199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.055522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:44.056742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:44.064727 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3251/6478] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:44.069494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.079320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ffae-5575-4268-bc94-da9e516c3104 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.084843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.085488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.085805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.086070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.086744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:44.087461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.089095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.101964 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3228/6479] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:44.105786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.115426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e1e49-1d25-4ee9-83e8-b288ca6b3c8e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.120379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.121092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.121447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.121792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.122497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.124468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.153929 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3252/6480] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:44 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:44.158161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.168440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32897a31-f35b-4e08-a8af-35fa5075f11f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.177386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:44.236973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.237595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.237874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.238145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.238790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.240706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.264001 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3229/6481] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:44 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:44.268088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.283684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58176e1c-1131-4593-aaa2-9c3a55ee4fd5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.290490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.291128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.291418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.291699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.293975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.294232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.308946 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3253/6482] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:44.312381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.324169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81487211-3f16-4dfd-84a5-f630d6fe3557 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.329069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea46d4a-76d3-492d-a2e6-35331ac58e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.329677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea46d4a-76d3-492d-a2e6-35331ac58e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.329957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea46d4a-76d3-492d-a2e6-35331ac58e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.330229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea46d4a-76d3-492d-a2e6-35331ac58e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.331132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea46d4a-76d3-492d-a2e6-35331ac58e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.332718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea46d4a-76d3-492d-a2e6-35331ac58e25 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.343746 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3230/6483] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:44.348547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.359186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9da8d-ee92-48cc-9f73-e1b8346eb71a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.364753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.365494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.365778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.366056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] PATH_INFO: `/v3/projects/44d1beeeb12c48f9bcf3fa52a63dbff1/users/4eea050f71df409dbd873f0f8a34b83b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.384155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d1beeeb12c48f9bcf3fa52a63dbff1, user_id=4eea050f71df409dbd873f0f8a34b83b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.388565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.407420 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3254/6484] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:44 2022] PUT /identity/v3/projects/44d1beeeb12c48f9bcf3fa52a63dbff1/users/4eea050f71df409dbd873f0f8a34b83b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:44.420291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.420583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.420868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.455711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] MFA Rules not processed for user `4eea050f71df409dbd873f0f8a34b83b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:44.456450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:44.533701 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3231/6485] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:44.538440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.621109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5149a-39ae-48a4-bb80-4dbbfbc610fb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.630454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.631089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.631355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.631631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.632626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.634641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.674894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3255/6486] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:44 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:44.679433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.694696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6ef9-eaba-46ef-b524-21bfe0ae0b68 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.760570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.761818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.762182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.762532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.763245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.765455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.796116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.802647 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3232/6487] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:44 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:44.809876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa067d-1cf3-4a7c-bfdf-a0ba6c2c1be4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.817293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.817994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.818283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.818602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.819415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.821209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.829380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:44.838652 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3256/6488] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:44.842126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.856511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedb0e6-7e42-46e8-a21b-265d72b3458e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:44.867479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:44.868371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:44.868729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:44.869250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] PATH_INFO: `/v3/projects/9c481fb5eeff45e483b64b932da1e569/users/f17414b899964ae8ab928ed33ed363f9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:44.874001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:44.889830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c481fb5eeff45e483b64b932da1e569, user_id=f17414b899964ae8ab928ed33ed363f9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:44.893701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:44.919738 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3233/6489] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:44 2022] PUT /identity/v3/projects/9c481fb5eeff45e483b64b932da1e569/users/f17414b899964ae8ab928ed33ed363f9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:44.928997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:44.946817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef528556-f960-4a68-ab3d-644b70749713 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.038672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94658ef-26bf-45c1-83d0-d1f68c09a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.040093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94658ef-26bf-45c1-83d0-d1f68c09a785 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.040384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94658ef-26bf-45c1-83d0-d1f68c09a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.040667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94658ef-26bf-45c1-83d0-d1f68c09a785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.041751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94658ef-26bf-45c1-83d0-d1f68c09a785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.044643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94658ef-26bf-45c1-83d0-d1f68c09a785 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.081993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.090763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3257/6490] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:45.098959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19872e-2531-432d-9fea-17e121e5d5f1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.107728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.108551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.108999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.109385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] PATH_INFO: `/v3/projects/9c481fb5eeff45e483b64b932da1e569/users/f17414b899964ae8ab928ed33ed363f9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.111980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c481fb5eeff45e483b64b932da1e569, user_id=f17414b899964ae8ab928ed33ed363f9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.114924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.133462 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3234/6491] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:45 2022] PUT /identity/v3/projects/9c481fb5eeff45e483b64b932da1e569/users/f17414b899964ae8ab928ed33ed363f9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:45.142708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.145614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.145614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.197829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] MFA Rules not processed for user `f17414b899964ae8ab928ed33ed363f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:45.199769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:45.307398 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3258/6492] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:45.403379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.414277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf8b7-12a7-44c3-8a4a-d713c348caea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.419509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.420111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.420398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.420675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.421394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.423087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.444888 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3235/6493] 10.222.0.16 () {60 vars in 1149 bytes} [Wed Oct 5 02:55:45 2022] POST /identity/v3/domains => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:45.445429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.457372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cebe3-b3bf-453b-bf5e-a212006390a9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.522524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.523142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.523433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.523717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.524370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.526380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.561815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:45.581792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3259/6494] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:45 2022] POST /identity/v3/projects => generated 402 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:45.582484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.593774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590415e-3132-4e1a-8628-e32b20445cd7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.654475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.655098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.655384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.655667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.656313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.662575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.679404 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3236/6495] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Oct 5 02:55:45 2022] POST /identity/v3/groups => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:45.683617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.695589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67cfde-4df0-4835-bd6d-55996389bf0e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.700505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.701196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.701489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.701761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.702412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.704322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.732370 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3260/6496] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:45 2022] POST /identity/v3/users => generated 442 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:45.733798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.744489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3b4e7-055a-4c97-8ac2-d8d32b5184f6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.749483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.750222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.750504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.750779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.751456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.754201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.775771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3237/6497] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:55:45 2022] POST /identity/v3/roles => generated 240 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:45.778668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.789236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dba92-5fa6-46b3-b74f-1c5f5fe39fbb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.793957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.794624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.794906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.795183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/groups/d4d4214a53514c9a877088c534e815c2/roles/e4620f8724da4af19ac11a4b46940047/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.802850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1f2062be89064447aba54755a0d33e0a, group_id=d4d4214a53514c9a877088c534e815c2, role_id=e4620f8724da4af19ac11a4b46940047)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.805588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.818459 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3261/6498] 10.222.0.16 () {60 vars in 1585 bytes} [Wed Oct 5 02:55:45 2022] PUT /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/groups/d4d4214a53514c9a877088c534e815c2/roles/e4620f8724da4af19ac11a4b46940047/inherited_to_projects => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:45.822595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.833830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18b64e-e44a-43cc-9ac0-61b2fac0c218 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.900682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.901413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.901657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.901934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/groups/d4d4214a53514c9a877088c534e815c2/roles/e4620f8724da4af19ac11a4b46940047/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.904370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1f2062be89064447aba54755a0d33e0a, group_id=d4d4214a53514c9a877088c534e815c2, role_id=e4620f8724da4af19ac11a4b46940047)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.907077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.914528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3238/6499] 10.222.0.16 () {58 vars in 1567 bytes} [Wed Oct 5 02:55:45 2022] HEAD /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/groups/d4d4214a53514c9a877088c534e815c2/roles/e4620f8724da4af19ac11a4b46940047/inherited_to_projects => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:45.918706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.929582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968caed-c831-41af-a5be-cf5500bcf8b7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:45.934588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:45.935322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:45.935661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:45.935946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/groups/d4d4214a53514c9a877088c534e815c2/roles/e4620f8724da4af19ac11a4b46940047/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:45.938152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1f2062be89064447aba54755a0d33e0a, group_id=d4d4214a53514c9a877088c534e815c2, role_id=e4620f8724da4af19ac11a4b46940047)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:45.942136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:45.949066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role e4620f8724da4af19ac11a4b46940047 was removed from group d4d4214a53514c9a877088c534e815c2 on project 1f2062be89064447aba54755a0d33e0a. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:45.949300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:45.949986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:45.964703 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3262/6500] 10.222.0.16 () {58 vars in 1569 bytes} [Wed Oct 5 02:55:45 2022] DELETE /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/groups/d4d4214a53514c9a877088c534e815c2/roles/e4620f8724da4af19ac11a4b46940047/inherited_to_projects => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:45.968616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:45.970412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:45.983986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8a5a8-7df3-4677-bca3-927ecd3461c3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.023153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:46.049686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.050562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.050945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.051231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles/e4620f8724da4af19ac11a4b46940047` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.052814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e4620f8724da4af19ac11a4b46940047)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.054831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.094025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role e4620f8724da4af19ac11a4b46940047 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:46.094321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.094991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.097285 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3239/6501] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:45 2022] DELETE /identity/v3/roles/e4620f8724da4af19ac11a4b46940047 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:46.102727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.119898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78fdc-c117-404c-8a18-fd9b04cf3e63 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.184625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.185340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.185698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.186044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.187996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.189719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.209026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3263/6502] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:55:46 2022] POST /identity/v3/roles => generated 239 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:46.211920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.213478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:46.229500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483538f5-86a1-4663-92a8-473fe60ccbee tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.235431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.236114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.236403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.236802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/26a9e198ed6e42aa9a6c40e58d9fd58c/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.254645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1f2062be89064447aba54755a0d33e0a, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=26a9e198ed6e42aa9a6c40e58d9fd58c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.257383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.281526 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3240/6503] 10.222.0.16 () {60 vars in 1582 bytes} [Wed Oct 5 02:55:46 2022] PUT /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/26a9e198ed6e42aa9a6c40e58d9fd58c/inherited_to_projects => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:46.286151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.296680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa56222-86a8-4740-98f2-ec65f776a084 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.374989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.375670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.375956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.376240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/26a9e198ed6e42aa9a6c40e58d9fd58c/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.379130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1f2062be89064447aba54755a0d33e0a, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=26a9e198ed6e42aa9a6c40e58d9fd58c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.383429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.389969 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3264/6504] 10.222.0.16 () {58 vars in 1564 bytes} [Wed Oct 5 02:55:46 2022] HEAD /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/26a9e198ed6e42aa9a6c40e58d9fd58c/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:46.395983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.408113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b723-0e6f-4498-a526-37217ca9b8ce tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.414514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.414832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.415118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.415396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/26a9e198ed6e42aa9a6c40e58d9fd58c/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.417585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1f2062be89064447aba54755a0d33e0a, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=26a9e198ed6e42aa9a6c40e58d9fd58c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.420307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.426771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role 26a9e198ed6e42aa9a6c40e58d9fd58c was removed from user 853dfcb00aae4da6b2f9faf1c7cde248 on project 1f2062be89064447aba54755a0d33e0a. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:46.427064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.427758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.441902 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3241/6505] 10.222.0.16 () {58 vars in 1566 bytes} [Wed Oct 5 02:55:46 2022] DELETE /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/26a9e198ed6e42aa9a6c40e58d9fd58c/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:46.446424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.448228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:46.461339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7650aeb-b20c-44c7-bd1f-828aa8d3c8d0 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.496435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:46.522737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.523365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.523648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.523930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles/26a9e198ed6e42aa9a6c40e58d9fd58c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.525336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_role(role_id=26a9e198ed6e42aa9a6c40e58d9fd58c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.526940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.563407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role 26a9e198ed6e42aa9a6c40e58d9fd58c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:46.563792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.564534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.567463 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3265/6506] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:46 2022] DELETE /identity/v3/roles/26a9e198ed6e42aa9a6c40e58d9fd58c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:46.572750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.584543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968e3b-fcb0-45da-833d-f354c5b07c16 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.662724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.663726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.664091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.664520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.665591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.667829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.689145 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3242/6507] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:55:46 2022] POST /identity/v3/roles => generated 239 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:46.690464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.692255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:46.706715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c46e7-7e27-4a7a-a316-fb17d38ed22c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.715166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.715869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.716229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.716586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/b49535e93b954f0a8a367e492f22f473/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.720254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e602219d935c4502861130a51275ae26, group_id=d4d4214a53514c9a877088c534e815c2, role_id=b49535e93b954f0a8a367e492f22f473)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.723735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.738250 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3266/6508] 10.222.0.16 () {60 vars in 1582 bytes} [Wed Oct 5 02:55:46 2022] PUT /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/b49535e93b954f0a8a367e492f22f473/inherited_to_projects => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:46.742695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.754645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845caa0b-7c0e-467e-900a-62476385339d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.811647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:46.819990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.821113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.821399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.822517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.824299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e602219d935c4502861130a51275ae26, group_id=d4d4214a53514c9a877088c534e815c2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.826947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.843668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3243/6509] 10.222.0.16 () {58 vars in 1464 bytes} [Wed Oct 5 02:55:46 2022] GET /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/inherited_to_projects => generated 447 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:46.844894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.857153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86cbed-940d-4468-b253-9a1ff2b32f8b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.862173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.862872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.863159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.863444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/b49535e93b954f0a8a367e492f22f473/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.865752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e602219d935c4502861130a51275ae26, group_id=d4d4214a53514c9a877088c534e815c2, role_id=b49535e93b954f0a8a367e492f22f473)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.868502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.876035 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3267/6510] 10.222.0.16 () {58 vars in 1564 bytes} [Wed Oct 5 02:55:46 2022] HEAD /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/b49535e93b954f0a8a367e492f22f473/inherited_to_projects => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:46.881350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.892311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85f04a-a0ff-4c6b-91f3-7418067c9901 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:46.898037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:46.898869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:46.899254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:46.899640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/b49535e93b954f0a8a367e492f22f473/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:46.902220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e602219d935c4502861130a51275ae26, group_id=d4d4214a53514c9a877088c534e815c2, role_id=b49535e93b954f0a8a367e492f22f473)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:46.904988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:46.911126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role b49535e93b954f0a8a367e492f22f473 was removed from group d4d4214a53514c9a877088c534e815c2 on domain e602219d935c4502861130a51275ae26. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:46.911421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.912179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:46.926016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3244/6511] 10.222.0.16 () {58 vars in 1566 bytes} [Wed Oct 5 02:55:46 2022] DELETE /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/groups/d4d4214a53514c9a877088c534e815c2/roles/b49535e93b954f0a8a367e492f22f473/inherited_to_projects => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:46.930076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:46.931844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:46.945964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b858fb3-0593-4d1e-840d-6f2d1c11c4a1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.008697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.010304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.010703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.010991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles/b49535e93b954f0a8a367e492f22f473` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.012488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b49535e93b954f0a8a367e492f22f473)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.014295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.052936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role b49535e93b954f0a8a367e492f22f473 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:47.053236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:47.053995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:47.056280 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3268/6512] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:46 2022] DELETE /identity/v3/roles/b49535e93b954f0a8a367e492f22f473 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:47.061495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.073173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dabb60-361f-4e19-aefc-407675c9498e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.132327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.132965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.133252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.133529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.134197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.135788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.154995 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3245/6513] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:55:47 2022] POST /identity/v3/roles => generated 239 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:47.156224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.157703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:47.170420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216861f-e004-4992-979d-8ea7d471d9dd tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.175410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.176161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.176509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.176851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/a634b3dc6e6343ae96d45510a9d46729/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.179217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e602219d935c4502861130a51275ae26, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=a634b3dc6e6343ae96d45510a9d46729)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.182060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.195869 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3269/6514] 10.222.0.16 () {60 vars in 1579 bytes} [Wed Oct 5 02:55:47 2022] PUT /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/a634b3dc6e6343ae96d45510a9d46729/inherited_to_projects => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:47.200269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.210775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac31e65-5bf1-4f46-ab6e-ffe027a3ef00 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.275561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.276140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.276424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.276703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.278412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=e602219d935c4502861130a51275ae26, user_id=853dfcb00aae4da6b2f9faf1c7cde248)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.281171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.294235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3246/6515] 10.222.0.16 () {58 vars in 1461 bytes} [Wed Oct 5 02:55:47 2022] GET /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/inherited_to_projects => generated 446 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:47.298436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.309583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c95f7-273d-46c7-ae0e-bb37b46d9ab6 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.314268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.315178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.315529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.315924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/a634b3dc6e6343ae96d45510a9d46729/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.318281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=e602219d935c4502861130a51275ae26, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=a634b3dc6e6343ae96d45510a9d46729)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.321088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.327511 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3270/6516] 10.222.0.16 () {58 vars in 1561 bytes} [Wed Oct 5 02:55:47 2022] HEAD /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/a634b3dc6e6343ae96d45510a9d46729/inherited_to_projects => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:47.332252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.343582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28d071-8946-4106-a72e-5464c602bc29 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.349138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.349809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.350095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.350724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/a634b3dc6e6343ae96d45510a9d46729/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.352945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e602219d935c4502861130a51275ae26, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=a634b3dc6e6343ae96d45510a9d46729)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.355536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.361144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role a634b3dc6e6343ae96d45510a9d46729 was removed from user 853dfcb00aae4da6b2f9faf1c7cde248 on domain e602219d935c4502861130a51275ae26. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:47.361442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:47.362153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:47.379373 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3247/6517] 10.222.0.16 () {58 vars in 1563 bytes} [Wed Oct 5 02:55:47 2022] DELETE /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/a634b3dc6e6343ae96d45510a9d46729/inherited_to_projects => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:47.387987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.396255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:47.430808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade3a0-402e-4276-8afb-2471df4491c9 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.461640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:47.508642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.509520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.509813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.510095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles/a634b3dc6e6343ae96d45510a9d46729` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.511564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a634b3dc6e6343ae96d45510a9d46729)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.513238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.591785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role a634b3dc6e6343ae96d45510a9d46729 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:47.592295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:47.593116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:47.595222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3271/6518] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:47 2022] DELETE /identity/v3/roles/a634b3dc6e6343ae96d45510a9d46729 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:47.601863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.613662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f7b8d-6330-4277-b5ef-0b3f6f4eb79b tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.668305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:47.706208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.706973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.707262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.707540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.708270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.710575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.732940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3248/6519] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:55:47 2022] POST /identity/v3/roles => generated 240 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:47.735006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.737587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:47.752288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56910b7-7637-418a-9aab-5a5b84914e98 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.759213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.759966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.760111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.760372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.761102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.763234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.806578 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3272/6520] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:47 2022] POST /identity/v3/projects => generated 410 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:47.807885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.819009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c116bf7-7301-4106-bb9e-1eb77992daa8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:47.934233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:47.934935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:47.935209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:47.935486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/bf134bb822764c708f5bc85211ab618c/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:47.938205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e602219d935c4502861130a51275ae26, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=bf134bb822764c708f5bc85211ab618c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:47.941822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:47.973739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3249/6521] 10.222.0.16 () {60 vars in 1579 bytes} [Wed Oct 5 02:55:47 2022] PUT /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/bf134bb822764c708f5bc85211ab618c/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:47.978437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:47.991169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a481f-a2fa-42e7-b401-d1f47c32b9e8 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.057992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.058448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.058732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.059011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.059738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Adding query filter params (scope.project.id=1f2062be89064447aba54755a0d33e0a, user.id=853dfcb00aae4da6b2f9faf1c7cde248) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:48.060047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.061922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.119812 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3273/6522] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:55:47 2022] GET /identity/v3/role_assignments?scope.project.id=1f2062be89064447aba54755a0d33e0a&user.id=853dfcb00aae4da6b2f9faf1c7cde248&effective => generated 648 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:48.124050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.135743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514678-30b1-4541-9ce3-94a4daf986df tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.140617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.141325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.141622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.141896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.142625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Adding query filter params (scope.project.id=23b639b91adb4d42be9d512b3845a425, user.id=853dfcb00aae4da6b2f9faf1c7cde248) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:48.143530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.145833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.208121 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3250/6523] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:55:48 2022] GET /identity/v3/role_assignments?scope.project.id=23b639b91adb4d42be9d512b3845a425&user.id=853dfcb00aae4da6b2f9faf1c7cde248&effective => generated 648 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:48.209649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.220167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f612a-4011-4287-8afe-7a6d102b8339 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.225087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.225838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.226475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.226875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/bf134bb822764c708f5bc85211ab618c/inherited_to_projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.229174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e602219d935c4502861130a51275ae26, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=bf134bb822764c708f5bc85211ab618c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.232812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.239471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role bf134bb822764c708f5bc85211ab618c was removed from user 853dfcb00aae4da6b2f9faf1c7cde248 on domain e602219d935c4502861130a51275ae26. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:48.240678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.240678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.261490 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3274/6524] 10.222.0.16 () {58 vars in 1563 bytes} [Wed Oct 5 02:55:48 2022] DELETE /identity/v3/OS-INHERIT/domains/e602219d935c4502861130a51275ae26/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/bf134bb822764c708f5bc85211ab618c/inherited_to_projects => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:48.262785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.264646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:48.278415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8b0bf-683d-46c8-8371-a12cba37cb40 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.342831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.343466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.343822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.344172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.344989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Adding query filter params (scope.project.id=1f2062be89064447aba54755a0d33e0a, user.id=853dfcb00aae4da6b2f9faf1c7cde248) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:48.345434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.347361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.359757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:48.403282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3251/6525] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:55:48 2022] GET /identity/v3/role_assignments?scope.project.id=1f2062be89064447aba54755a0d33e0a&user.id=853dfcb00aae4da6b2f9faf1c7cde248&effective => generated 228 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:48.404558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.410504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:48.415905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a7600-b86b-4158-9ed1-5a84e3d92d68 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.422077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.423053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.423872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.424769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.425716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Adding query filter params (scope.project.id=23b639b91adb4d42be9d512b3845a425, user.id=853dfcb00aae4da6b2f9faf1c7cde248) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:48.426099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.428476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.488785 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3275/6526] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:55:48 2022] GET /identity/v3/role_assignments?scope.project.id=23b639b91adb4d42be9d512b3845a425&user.id=853dfcb00aae4da6b2f9faf1c7cde248&effective => generated 228 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:48.490068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.500416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986d846-4493-4142-8c50-1a733977b6aa tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.506185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.506893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.507245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.507609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/projects/23b639b91adb4d42be9d512b3845a425` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.508822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23b639b91adb4d42be9d512b3845a425)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.511607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.563932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b639b91adb4d42be9d512b3845a425', 'request_id': 'req-e27d472f-064c-4403-a3c9-ca0b2cfa4476'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.573832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b639b91adb4d42be9d512b3845a425', 'request_id': 'req-e27d472f-064c-4403-a3c9-ca0b2cfa4476'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.581098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b639b91adb4d42be9d512b3845a425', 'request_id': 'req-e27d472f-064c-4403-a3c9-ca0b2cfa4476'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.594592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] The token cache is being invalidate because project 23b639b91adb4d42be9d512b3845a425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:48.594592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.596624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.598723 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3252/6527] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:48 2022] DELETE /identity/v3/projects/23b639b91adb4d42be9d512b3845a425 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:48.605936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.607842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:48.623344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b682711-9737-4b2a-98eb-eae2f267f79c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.716656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.717638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.718111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.718544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles/bf134bb822764c708f5bc85211ab618c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.720254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bf134bb822764c708f5bc85211ab618c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.724052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.772391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role bf134bb822764c708f5bc85211ab618c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:48.772774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.773552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:48.775806 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3276/6528] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:48 2022] DELETE /identity/v3/roles/bf134bb822764c708f5bc85211ab618c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:48.781090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.794799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d472f-064c-4403-a3c9-ca0b2cfa4476 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.875445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.876095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.876386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.876665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.877502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.879485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:48.900788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3253/6529] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:55:48 2022] POST /identity/v3/roles => generated 240 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:48.905252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:48.907118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:48.922887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7d4d6-5918-4dcd-b9b8-ffc9d402f5b3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:48.929189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:48.930282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:48.930806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:48.931316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:48.932198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:48.934268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.001210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3277/6530] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:48 2022] POST /identity/v3/projects => generated 409 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:49.001318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.007653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649409e8-a618-4afa-ba55-936210e6291d tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.055085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:49.071552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.072367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.072814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.073232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/d93a5947cd7c4a9696236699ca771923/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.075550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1f2062be89064447aba54755a0d33e0a, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=d93a5947cd7c4a9696236699ca771923)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.078846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.099331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3254/6531] 10.222.0.16 () {60 vars in 1582 bytes} [Wed Oct 5 02:55:48 2022] PUT /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/d93a5947cd7c4a9696236699ca771923/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:49.103569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.122535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b893a4-f3db-44d4-8444-b63e64b9adf7 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.175920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:49.197666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.198298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.198587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.199218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.199970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Adding query filter params (scope.project.id=0677bd0b542f4c818c85606195113781, user.id=853dfcb00aae4da6b2f9faf1c7cde248) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:49.200284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.202183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.280870 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3278/6532] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:55:49 2022] GET /identity/v3/role_assignments?scope.project.id=0677bd0b542f4c818c85606195113781&user.id=853dfcb00aae4da6b2f9faf1c7cde248&effective => generated 649 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:49.282052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.295819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9920b-60fc-485f-9526-0ca15b7edc60 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.301542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.303031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.303473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.303846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/d93a5947cd7c4a9696236699ca771923/inherited_to_projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.306394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1f2062be89064447aba54755a0d33e0a, user_id=853dfcb00aae4da6b2f9faf1c7cde248, role_id=d93a5947cd7c4a9696236699ca771923)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.309249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.316193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role d93a5947cd7c4a9696236699ca771923 was removed from user 853dfcb00aae4da6b2f9faf1c7cde248 on project 1f2062be89064447aba54755a0d33e0a. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:49.316820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.317565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.338280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3255/6533] 10.222.0.16 () {58 vars in 1566 bytes} [Wed Oct 5 02:55:49 2022] DELETE /identity/v3/OS-INHERIT/projects/1f2062be89064447aba54755a0d33e0a/users/853dfcb00aae4da6b2f9faf1c7cde248/roles/d93a5947cd7c4a9696236699ca771923/inherited_to_projects => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:49.342233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.344159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:49.345499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.347657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:49.360863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2b445-ec95-40bf-ade3-8e979a5ee28a tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.419522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aec0d-92b4-4392-b02f-f48c24200df3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.424130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.426361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.426361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.426361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.428263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:49.429864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.430479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.430763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.431037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.431899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Adding query filter params (scope.project.id=0677bd0b542f4c818c85606195113781, user.id=853dfcb00aae4da6b2f9faf1c7cde248) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:49.432209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.434088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.494518 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3279/6534] 10.222.0.16 () {58 vars in 1356 bytes} [Wed Oct 5 02:55:49 2022] GET /identity/v3/role_assignments?scope.project.id=0677bd0b542f4c818c85606195113781&user.id=853dfcb00aae4da6b2f9faf1c7cde248&effective => generated 228 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:49.498540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.503593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.505270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.514755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853d4af-6e1f-4246-bb1a-6bc269a4b6d3 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.516515 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3256/6535] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:55:49.520757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.521499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.521894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.522226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/projects/0677bd0b542f4c818c85606195113781` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.523619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0677bd0b542f4c818c85606195113781)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.525641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.585894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0677bd0b542f4c818c85606195113781', 'request_id': 'req-7faf9758-449e-43c5-9a57-b81d6a6c67fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.588164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:49.593352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0677bd0b542f4c818c85606195113781', 'request_id': 'req-7faf9758-449e-43c5-9a57-b81d6a6c67fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.601362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0677bd0b542f4c818c85606195113781', 'request_id': 'req-7faf9758-449e-43c5-9a57-b81d6a6c67fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.618140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] The token cache is being invalidate because project 0677bd0b542f4c818c85606195113781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:49.618649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.619311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.623987 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3280/6536] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:49 2022] DELETE /identity/v3/projects/0677bd0b542f4c818c85606195113781 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:49.625444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.637521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e547b0-b1d5-4580-83c1-2735e88c6655 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.710929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.710929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.710929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.711319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/roles/d93a5947cd7c4a9696236699ca771923` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.712499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d93a5947cd7c4a9696236699ca771923)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.714252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.729689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:49.774764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invalidating the token cache because role d93a5947cd7c4a9696236699ca771923 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:49.775934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.776796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.780003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3257/6537] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:49 2022] DELETE /identity/v3/roles/d93a5947cd7c4a9696236699ca771923 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:49.785781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:49.788057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:49.804016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf9758-449e-43c5-9a57-b81d6a6c67fb tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:49.893031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:49.893711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:49.894177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:49.894525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/users/853dfcb00aae4da6b2f9faf1c7cde248` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:49.895878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_user(user_id=853dfcb00aae4da6b2f9faf1c7cde248)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:49.897888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:49.957189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853dfcb00aae4da6b2f9faf1c7cde248'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.972813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853dfcb00aae4da6b2f9faf1c7cde248'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.973622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853dfcb00aae4da6b2f9faf1c7cde248'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.982487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853dfcb00aae4da6b2f9faf1c7cde248'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:49.983216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853dfcb00aae4da6b2f9faf1c7cde248'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.012896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:50.013437 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3281/6538] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:49 2022] DELETE /identity/v3/users/853dfcb00aae4da6b2f9faf1c7cde248 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:50.014382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:50.028050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee91ece-154c-491e-a7b8-6189590d8c91 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:50.095589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:50.096496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:50.097041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:50.097444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/groups/d4d4214a53514c9a877088c534e815c2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:50.098733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d4d4214a53514c9a877088c534e815c2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:50.100737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:50.167804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3258/6539] 10.222.0.16 () {58 vars in 1227 bytes} [Wed Oct 5 02:55:50 2022] DELETE /identity/v3/groups/d4d4214a53514c9a877088c534e815c2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:50.171694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:50.175080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:50.188536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d0c59-fec4-4fd3-879e-899f97b98bb1 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:50.251866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:50.253502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:50.253800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:50.254077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/projects/1f2062be89064447aba54755a0d33e0a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:50.255425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f2062be89064447aba54755a0d33e0a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:50.257567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:50.259658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:50.321963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2062be89064447aba54755a0d33e0a', 'request_id': 'req-38a079cb-4cee-43a0-be4b-88ccffa99d12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.328425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2062be89064447aba54755a0d33e0a', 'request_id': 'req-38a079cb-4cee-43a0-be4b-88ccffa99d12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.335294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2062be89064447aba54755a0d33e0a', 'request_id': 'req-38a079cb-4cee-43a0-be4b-88ccffa99d12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.349563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] The token cache is being invalidate because project 1f2062be89064447aba54755a0d33e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:50.349865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.350595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.355483 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3282/6540] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:50 2022] DELETE /identity/v3/projects/1f2062be89064447aba54755a0d33e0a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:50.356664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:50.358963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:50.373391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2786278-6334-4a8f-a6a2-2813a6d1b787 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:50.443282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:50.443850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:50.444139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:50.444421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/domains/e602219d935c4502861130a51275ae26` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:50.445735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e602219d935c4502861130a51275ae26)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:50.447613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:50.476165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e602219d935c4502861130a51275ae26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.476930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e602219d935c4502861130a51275ae26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.501463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e602219d935c4502861130a51275ae26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.502090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e602219d935c4502861130a51275ae26'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.504877 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3259/6541] 10.222.0.16 () {60 vars in 1249 bytes} [Wed Oct 5 02:55:50 2022] PATCH /identity/v3/domains/e602219d935c4502861130a51275ae26 => generated 276 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:50.508840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:50.519561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a079cb-4cee-43a0-be4b-88ccffa99d12 tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:50.577779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f17414b899964ae8ab928ed33ed363f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c481fb5eeff45e483b64b932da1e569', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:50.578538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:50.578829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:50.579115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] PATH_INFO: `/v3/domains/e602219d935c4502861130a51275ae26` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:50.591133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e602219d935c4502861130a51275ae26)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:50.592778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:50.616917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e602219d935c4502861130a51275ae26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.620252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e602219d935c4502861130a51275ae26'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.670602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e602219d935c4502861130a51275ae26', 'request_id': 'req-ad492f7f-1246-41e9-893e-477dec31099c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.677355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e602219d935c4502861130a51275ae26', 'request_id': 'req-ad492f7f-1246-41e9-893e-477dec31099c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.678511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:50.686550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e602219d935c4502861130a51275ae26', 'request_id': 'req-ad492f7f-1246-41e9-893e-477dec31099c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.709430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] The token cache is being invalidate because project e602219d935c4502861130a51275ae26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:50.709633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.710314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.718734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e602219d935c4502861130a51275ae26', 'request_id': 'req-ad492f7f-1246-41e9-893e-477dec31099c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.719475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e602219d935c4502861130a51275ae26', 'request_id': 'req-ad492f7f-1246-41e9-893e-477dec31099c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.723494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ad492f7f-1246-41e9-893e-477dec31099c tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e602219d935c4502861130a51275ae26', 'request_id': 'req-ad492f7f-1246-41e9-893e-477dec31099c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.729453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3283/6542] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:55:50 2022] DELETE /identity/v3/domains/e602219d935c4502861130a51275ae26 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:50.733573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:50.735083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:50.745368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:50.807267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b0713-2913-4f41-b789-f8dad646ba8e tempest-InheritsV3TestJSON-1678036632 tempest-InheritsV3TestJSON-1678036632-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:50.865060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:50.865867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:50.866252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:50.866625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] PATH_INFO: `/v3/users/4eea050f71df409dbd873f0f8a34b83b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:50.867886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eea050f71df409dbd873f0f8a34b83b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:50.870537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:50.933608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eea050f71df409dbd873f0f8a34b83b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.954822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eea050f71df409dbd873f0f8a34b83b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.956195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eea050f71df409dbd873f0f8a34b83b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.966325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eea050f71df409dbd873f0f8a34b83b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.967262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eea050f71df409dbd873f0f8a34b83b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:50.981687 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3260/6543] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:50 2022] DELETE /identity/v3/users/4eea050f71df409dbd873f0f8a34b83b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:50.986040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:50.986332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:50.986642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:51.006662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:51.007791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:51.068494 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3284/6544] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:51.082733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:51.084257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:51.124737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:51.154029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7b392-0842-4e95-9e92-ea595a993fef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:51.157769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:51.158380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:51.158675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:51.159066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:51.168981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:51.170547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:51.182115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3261/6545] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:51.841202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:51.842829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:51.858338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675fe79-7301-42e2-b1a6-e22dba09686d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:51.866803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:51.867449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:51.867732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:51.868004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] PATH_INFO: `/v3/projects/44d1beeeb12c48f9bcf3fa52a63dbff1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:51.869266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d1beeeb12c48f9bcf3fa52a63dbff1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:51.871334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:51.921851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d1beeeb12c48f9bcf3fa52a63dbff1', 'request_id': 'req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:51.928748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d1beeeb12c48f9bcf3fa52a63dbff1', 'request_id': 'req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:51.935755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d1beeeb12c48f9bcf3fa52a63dbff1', 'request_id': 'req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:51.952995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] The token cache is being invalidate because project 44d1beeeb12c48f9bcf3fa52a63dbff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:51.953327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:51.954016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:51.956388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3285/6546] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:51 2022] DELETE /identity/v3/projects/44d1beeeb12c48f9bcf3fa52a63dbff1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:51.961092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:51.972717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af223e73-d583-4d04-b0df-0878e983f1e1 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:52.048838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:52.050078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.050357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.050627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] PATH_INFO: `/v3/users/f17414b899964ae8ab928ed33ed363f9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.053888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17414b899964ae8ab928ed33ed363f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:52.055987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:52.117871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17414b899964ae8ab928ed33ed363f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.134548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17414b899964ae8ab928ed33ed363f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.139229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17414b899964ae8ab928ed33ed363f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.150873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17414b899964ae8ab928ed33ed363f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.152201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17414b899964ae8ab928ed33ed363f9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.169041 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3262/6547] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:51 2022] DELETE /identity/v3/users/f17414b899964ae8ab928ed33ed363f9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:52.492315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:52.493987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:52.536828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f9831-ab22-4a56-8660-ad2d1e0c65ce admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:52.599032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:52.610317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:52.610983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.612120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.613151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] PATH_INFO: `/v3/projects/9c481fb5eeff45e483b64b932da1e569` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.615173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c481fb5eeff45e483b64b932da1e569)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:52.617348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:52.665659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:52.667429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:52.701505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c481fb5eeff45e483b64b932da1e569', 'request_id': 'req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.710525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c481fb5eeff45e483b64b932da1e569', 'request_id': 'req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.718234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c481fb5eeff45e483b64b932da1e569', 'request_id': 'req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.733532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] The token cache is being invalidate because project 9c481fb5eeff45e483b64b932da1e569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:52.733831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.734492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e002ce86-72fb-44f8-873b-e2a6adaf2c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:52.736192 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3286/6548] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:52 2022] DELETE /identity/v3/projects/9c481fb5eeff45e483b64b932da1e569 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:52.738288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:52.740782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940a33-af65-47e6-90a3-c9ef9c5707f4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.741151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940a33-af65-47e6-90a3-c9ef9c5707f4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.741432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940a33-af65-47e6-90a3-c9ef9c5707f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.759590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33518a-6bdc-4685-a60c-9dc40e7f26c1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:52.763102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-56940a33-af65-47e6-90a3-c9ef9c5707f4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:52.764308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56940a33-af65-47e6-90a3-c9ef9c5707f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:52.828020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:52.828732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.829101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.829452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.833160 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3287/6549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:52.836638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.837603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:52.839838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.840126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.854841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:52.856768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:52.866215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:52.867568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:52.873581 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3263/6550] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:52.878839 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3288/6551] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:52.882826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:52.893562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d196f-3914-44aa-8062-5d8371c98906 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:52.898709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:52.899320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.899604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.899881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.900543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:52.900845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:52.903159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:52.919612 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3264/6552] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:52.924024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:52.939573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4375cb-7a89-4127-ba2d-4c904c65cf71 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:52.946147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:52.946725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:52.947016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:52.947291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:52.948275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:52.950550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:52.986048 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3289/6553] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:52 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:52.991531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.009081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af528582-5ead-4b99-bb2b-068c55f90f37 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:53.081768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:53.082398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.082678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.082962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.083755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:53.085702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:53.115227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3265/6554] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:52 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:53.116337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.129612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d6b4-de2b-4ca5-afa1-734b93386345 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:53.134683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:53.135325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.135626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.136503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.137226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:53.138898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:53.151208 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3290/6555] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:53.155201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.169613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a83033-f88a-4937-bfee-a9053b2643ce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:53.178044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16b6ac-add9-4d6a-927a-141f7cf50495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:53.178755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b6ac-add9-4d6a-927a-141f7cf50495 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.179160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b6ac-add9-4d6a-927a-141f7cf50495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.179538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16b6ac-add9-4d6a-927a-141f7cf50495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.180491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b6ac-add9-4d6a-927a-141f7cf50495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:53.182458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16b6ac-add9-4d6a-927a-141f7cf50495 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:53.196680 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3266/6556] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:53.201192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.219284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114878b-78f2-423c-81c8-613bd3c1c1f0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:53.244060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:53.246757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.247387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.247827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] PATH_INFO: `/v3/projects/d69112dc87b74bc4846b1e02995ea336/users/ea3a17cee2ab40c0bc278fb336a0d582/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.307030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69112dc87b74bc4846b1e02995ea336, user_id=ea3a17cee2ab40c0bc278fb336a0d582, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:53.311137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:53.327478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3291/6557] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:53 2022] PUT /identity/v3/projects/d69112dc87b74bc4846b1e02995ea336/users/ea3a17cee2ab40c0bc278fb336a0d582/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:53.337899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.338193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.338469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.368591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] MFA Rules not processed for user `ea3a17cee2ab40c0bc278fb336a0d582`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:53.369865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:53.434619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:53.479661 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3267/6558] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:53.484663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.496883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4600cc-b078-4ffa-a5d3-6df12bd729c8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:53.502219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98450848-6731-4b23-a19a-bfb992c62b1e tempest-IdentityCatalogTest-768433602 tempest-IdentityCatalogTest-768433602-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea3a17cee2ab40c0bc278fb336a0d582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd69112dc87b74bc4846b1e02995ea336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:53.502219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98450848-6731-4b23-a19a-bfb992c62b1e tempest-IdentityCatalogTest-768433602 tempest-IdentityCatalogTest-768433602-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.503120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98450848-6731-4b23-a19a-bfb992c62b1e tempest-IdentityCatalogTest-768433602 tempest-IdentityCatalogTest-768433602-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.503671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98450848-6731-4b23-a19a-bfb992c62b1e tempest-IdentityCatalogTest-768433602 tempest-IdentityCatalogTest-768433602-project] PATH_INFO: `/v3/auth/catalog` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.504366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98450848-6731-4b23-a19a-bfb992c62b1e tempest-IdentityCatalogTest-768433602 tempest-IdentityCatalogTest-768433602-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:53.505747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98450848-6731-4b23-a19a-bfb992c62b1e tempest-IdentityCatalogTest-768433602 tempest-IdentityCatalogTest-768433602-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:53.507924 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3292/6559] 10.222.0.16 () {58 vars in 1143 bytes} [Wed Oct 5 02:55:53 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:53.520174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.636833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ca02-c9e9-4d90-b8ae-da2ab223fc7f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:53.653472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:53.654236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.654429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.654708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] PATH_INFO: `/v3/users/ea3a17cee2ab40c0bc278fb336a0d582` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.664296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3a17cee2ab40c0bc278fb336a0d582)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:53.667202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:53.757117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3a17cee2ab40c0bc278fb336a0d582'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:53.776651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3a17cee2ab40c0bc278fb336a0d582'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:53.777629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3a17cee2ab40c0bc278fb336a0d582'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:53.787578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3a17cee2ab40c0bc278fb336a0d582'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:53.788372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3a17cee2ab40c0bc278fb336a0d582'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:53.807854 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3268/6560] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:53 2022] DELETE /identity/v3/users/ea3a17cee2ab40c0bc278fb336a0d582 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:53.808929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:53.809237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:53.809510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:53.834667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:53.835797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:53.845365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:53.909363 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3293/6561] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:53.919001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:53.920415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:54.006152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b354-329f-4aa3-9c4c-619a5bd554d3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:54.010782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86be2f-119b-4b96-b472-6c4f303248f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:54.011407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86be2f-119b-4b96-b472-6c4f303248f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:54.011671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86be2f-119b-4b96-b472-6c4f303248f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:54.012031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86be2f-119b-4b96-b472-6c4f303248f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:54.023683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86be2f-119b-4b96-b472-6c4f303248f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:54.026204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86be2f-119b-4b96-b472-6c4f303248f1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:54.039421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3269/6562] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:54.429709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:54.431375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:54.464536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a8c0f-4929-4ba2-91ee-b407272ecc48 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:54.472231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:54.482856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:54.483168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:54.483534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] PATH_INFO: `/v3/projects/d69112dc87b74bc4846b1e02995ea336` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:54.486045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69112dc87b74bc4846b1e02995ea336)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:54.491820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:54.597988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69112dc87b74bc4846b1e02995ea336', 'request_id': 'req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:54.605955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69112dc87b74bc4846b1e02995ea336', 'request_id': 'req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:54.614462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69112dc87b74bc4846b1e02995ea336', 'request_id': 'req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:54.634641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] The token cache is being invalidate because project d69112dc87b74bc4846b1e02995ea336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:54.635114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:54.636635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfcb5433-8fd6-4afe-a448-e5e1b4f04052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:54.639517 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3294/6563] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:54 2022] DELETE /identity/v3/projects/d69112dc87b74bc4846b1e02995ea336 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:54.668086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:54.669252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:54.669683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:54.692981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:54.709727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:54.711626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:54.800874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3270/6564] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:54.809901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:54.810240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:54.810713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:54.863394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:54.865822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:54.883893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3295/6565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:54.885463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:54.905552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebde6c-69f9-4cb2-a017-a5062cdb07a1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:54.912052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:54.912763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:54.913462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:54.913782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:54.915685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:54.916072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:54.917984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:54.932641 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3271/6566] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:55:54.937191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:54.949067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c442d-6b73-4604-a325-b615c0ac13cf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:54.954540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:54.955404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:54.956286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:54.956929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:54.957770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:54.960030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.003746 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3296/6567] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:54 2022] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:55.008503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.021758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc900-a972-44de-b676-bf3590a50144 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.116798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.117476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.117772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.118210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.118849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.120860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.149403 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3272/6568] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:55 2022] POST /identity/v3/users => generated 279 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:55:55.153650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.168238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b35fb8-9657-49b4-8356-4b68e8592f92 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.176044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.177151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.177528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.177899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.178658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.180633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.194367 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3297/6569] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:55.198275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.213547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c41e-a58d-4c69-bcb0-51c6a051ee0b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.218610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b48350-e83c-45e7-8cc9-a4c93b783c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.219374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48350-e83c-45e7-8cc9-a4c93b783c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.219706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48350-e83c-45e7-8cc9-a4c93b783c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.220050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b48350-e83c-45e7-8cc9-a4c93b783c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.220773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b48350-e83c-45e7-8cc9-a4c93b783c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.223555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b48350-e83c-45e7-8cc9-a4c93b783c57 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.248136 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3273/6570] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:55.249686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.266786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c266-3bbf-45c2-90fd-03cb1450892b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.275728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cdc35-f8b3-494f-b0c9-a0c7d7950b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.276800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cdc35-f8b3-494f-b0c9-a0c7d7950b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.277381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cdc35-f8b3-494f-b0c9-a0c7d7950b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.277806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cdc35-f8b3-494f-b0c9-a0c7d7950b07 admin admin] PATH_INFO: `/v3/projects/bf96d718d070479f8ec7978e21ca992a/users/8a8ac9ab1d944ba8aa82a49e17654cfe/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.298841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cdc35-f8b3-494f-b0c9-a0c7d7950b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf96d718d070479f8ec7978e21ca992a, user_id=8a8ac9ab1d944ba8aa82a49e17654cfe, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.302669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68cdc35-f8b3-494f-b0c9-a0c7d7950b07 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.325910 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3298/6571] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:55 2022] PUT /identity/v3/projects/bf96d718d070479f8ec7978e21ca992a/users/8a8ac9ab1d944ba8aa82a49e17654cfe/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:55.336728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353255-19cb-4cc2-9433-7b937edac342 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.337066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353255-19cb-4cc2-9433-7b937edac342 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.337576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353255-19cb-4cc2-9433-7b937edac342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.387874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dd353255-19cb-4cc2-9433-7b937edac342 None None] MFA Rules not processed for user `8a8ac9ab1d944ba8aa82a49e17654cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:55.390302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd353255-19cb-4cc2-9433-7b937edac342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:55.532703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:55.540558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3274/6572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:55.546800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.547948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.548474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.593118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] MFA Rules not processed for user `8a8ac9ab1d944ba8aa82a49e17654cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:55.594970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:55.600683 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3299/6573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:55 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:55:55.606209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.606497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.606770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.645257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] MFA Rules not processed for user `8a8ac9ab1d944ba8aa82a49e17654cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:55.647990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:55.677447 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3275/6574] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:55 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:55:55.681851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.704571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77df18-20a4-4b25-9eff-08b583178f3d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.710846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.711551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `HEAD` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.711889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.712286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.719464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorizing `identity:check_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.721729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.727844 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3300/6575] 10.222.0.16 () {56 vars in 1264 bytes} [Wed Oct 5 02:55:55 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 05 02:55:55.732158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.743698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb250a6-7be0-4823-8702-c224dc8a40b4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.748415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.749139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.749489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.749829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.757828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.759782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.768578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3276/6576] 10.222.0.16 () {56 vars in 1263 bytes} [Wed Oct 5 02:55:55 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:55.773790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.784521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356da6-c1ab-4590-b2c5-46265cd862f7 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.790304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3425552-1ab0-4769-9dcf-bf30a8274118 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.790834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3425552-1ab0-4769-9dcf-bf30a8274118 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.791115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3425552-1ab0-4769-9dcf-bf30a8274118 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.791385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3425552-1ab0-4769-9dcf-bf30a8274118 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.798626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3425552-1ab0-4769-9dcf-bf30a8274118 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.800422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3425552-1ab0-4769-9dcf-bf30a8274118 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.807726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:55.823955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3301/6577] 10.222.0.16 () {56 vars in 1266 bytes} [Wed Oct 5 02:55:55 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:55.828033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.840209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f344743-10a6-4d08-a654-b26c97e93f2e tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.845269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.845930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.846246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.846480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.848239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 05 02:55:55.892121 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 05 02:55:55.893567 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:55.894702 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3277/6578] 10.222.0.16 () {56 vars in 1264 bytes} [Wed Oct 5 02:55:55 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:55:55.899174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.899468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.899748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.920325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] MFA Rules not processed for user `8a8ac9ab1d944ba8aa82a49e17654cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:55.921579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:55.925475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3302/6579] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:55 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:55:55.929470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.939624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058399d-11ec-4345-a343-dd25c078167b tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.943928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.944508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.944723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.945038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.951797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.953582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:55.960673 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3278/6580] 10.222.0.16 () {56 vars in 1263 bytes} [Wed Oct 5 02:55:55 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 05 02:55:55.964258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:55.981774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bd8dc-2388-41f9-a978-0ea24bd27e16 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:55.987643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:55.988265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:55.988551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:55.988845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:55.995741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:55.997376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:56.012442 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3303/6581] 10.222.0.16 () {56 vars in 1266 bytes} [Wed Oct 5 02:55:55 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:56.016827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:56.026827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e524455-2f92-4012-ba8c-469d406493a0 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:56.031061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918161e-4c9c-43c4-b53e-bec26df23b91 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a8ac9ab1d944ba8aa82a49e17654cfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf96d718d070479f8ec7978e21ca992a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:56.031661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918161e-4c9c-43c4-b53e-bec26df23b91 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:56.031929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918161e-4c9c-43c4-b53e-bec26df23b91 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:56.032204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918161e-4c9c-43c4-b53e-bec26df23b91 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:56.034674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c918161e-4c9c-43c4-b53e-bec26df23b91 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-c918161e-4c9c-43c4-b53e-bec26df23b91 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 05 02:55:56.046526 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 05 02:55:56.047493 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:56.050425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3279/6582] 10.222.0.16 () {56 vars in 1263 bytes} [Wed Oct 5 02:55:56 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:55:56.053121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:56.125927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49597a7-3428-4218-8735-87abeccc0a77 tempest-TokensV3Test-83262011 tempest-TokensV3Test-83262011-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:56.131153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:56.131792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:56.132071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:56.132347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] PATH_INFO: `/v3/users/8a8ac9ab1d944ba8aa82a49e17654cfe` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:56.133526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8ac9ab1d944ba8aa82a49e17654cfe)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:56.135471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:56.189639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8ac9ab1d944ba8aa82a49e17654cfe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.202765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8ac9ab1d944ba8aa82a49e17654cfe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.203521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8ac9ab1d944ba8aa82a49e17654cfe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.212993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8ac9ab1d944ba8aa82a49e17654cfe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.213628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8ac9ab1d944ba8aa82a49e17654cfe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.227896 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3304/6583] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:55:56 2022] DELETE /identity/v3/users/8a8ac9ab1d944ba8aa82a49e17654cfe => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:56.232447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:56.232737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:56.233045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:56.254739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:56.256203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:56.323597 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3280/6584] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:56.334240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:56.335708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:56.398932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:56.409112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd994e9-a806-4a6a-9b96-fe9d2f3fdc61 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:56.413902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e262c5-e0e9-4ca4-b1c0-62aa4d936936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:56.414516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e262c5-e0e9-4ca4-b1c0-62aa4d936936 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:56.414805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e262c5-e0e9-4ca4-b1c0-62aa4d936936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:56.415110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e262c5-e0e9-4ca4-b1c0-62aa4d936936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:56.427443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e262c5-e0e9-4ca4-b1c0-62aa4d936936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:56.428996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e262c5-e0e9-4ca4-b1c0-62aa4d936936 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:56.440499 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3305/6585] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:55:56.820721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:56.823178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:56.839225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654c5a-141f-4d33-b104-327f00650e6f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:56.844553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:56.845231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:56.845514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:56.846365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] PATH_INFO: `/v3/projects/bf96d718d070479f8ec7978e21ca992a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:56.848750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf96d718d070479f8ec7978e21ca992a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:56.850730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:56.913260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf96d718d070479f8ec7978e21ca992a', 'request_id': 'req-c3392f22-50c9-41af-ad36-2b19abc93b87'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.926082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf96d718d070479f8ec7978e21ca992a', 'request_id': 'req-c3392f22-50c9-41af-ad36-2b19abc93b87'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.933140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf96d718d070479f8ec7978e21ca992a', 'request_id': 'req-c3392f22-50c9-41af-ad36-2b19abc93b87'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.953794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] The token cache is being invalidate because project bf96d718d070479f8ec7978e21ca992a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:55:56.954083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.954751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c3392f22-50c9-41af-ad36-2b19abc93b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:56.956632 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3281/6586] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:55:56 2022] DELETE /identity/v3/projects/bf96d718d070479f8ec7978e21ca992a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:56.962382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:56.962670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:56.963091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:56.996828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:56.998633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:57.074749 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3306/6587] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:57.085408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.092607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.092607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.118095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:57.119839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:57.137181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3282/6588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:55:57.141970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.153495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127bb18-9f09-4baa-b481-f8c525c8ab09 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.159284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.159907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.160252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.160534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.161818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:55:57.162275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:57.164181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:57.178821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3307/6589] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:55:57.183146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.194468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c325-96a8-4ae1-93da-e8d83a9f2f47 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.199337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.200013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.200249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.200526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.201372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:57.203558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:57.243582 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3283/6590] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:55:57 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:57.244688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.255836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fcf62-f74e-4344-9720-d1fb42391c5f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.315436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.316047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.316335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.316629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.317303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:57.319222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:57.341390 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3308/6591] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:55:57 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:55:57.345346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.352960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:57.357179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc48a14-b394-44b7-b97f-a13c997ba42a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.364275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.365185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.365657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.365996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.366936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:57.368609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:57.383421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3284/6592] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:55:57.384719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.395353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbaf85-0a57-4e0c-b658-a691aa6d6e54 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.399987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27e3e6-bf45-4382-81c9-91241e722f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.400587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27e3e6-bf45-4382-81c9-91241e722f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.400871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27e3e6-bf45-4382-81c9-91241e722f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.401183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27e3e6-bf45-4382-81c9-91241e722f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.401829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27e3e6-bf45-4382-81c9-91241e722f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:57.403419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27e3e6-bf45-4382-81c9-91241e722f38 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:57.414641 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3309/6593] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:55:57.418793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.429087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f0034-8c3a-438a-8935-53a38f1cea21 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.433677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.434358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.434641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.434916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] PATH_INFO: `/v3/projects/577f1bc5494e4591bb6cecce6e81a4f5/users/db3b971c106d44039856b66b76c8905d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.450528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577f1bc5494e4591bb6cecce6e81a4f5, user_id=db3b971c106d44039856b66b76c8905d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:55:57.453443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:55:57.469004 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3285/6594] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:55:57 2022] PUT /identity/v3/projects/577f1bc5494e4591bb6cecce6e81a4f5/users/db3b971c106d44039856b66b76c8905d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:55:57.481653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bced16e-ae58-493f-af44-8c69d0f15ffb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.482029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bced16e-ae58-493f-af44-8c69d0f15ffb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.482387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bced16e-ae58-493f-af44-8c69d0f15ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.512842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4bced16e-ae58-493f-af44-8c69d0f15ffb None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:57.514200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4bced16e-ae58-493f-af44-8c69d0f15ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:57.558158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:55:57.579915 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3310/6595] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:57.585525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:57.596040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b36211-009f-4122-9b8f-90b53533bf50 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:57.600296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fff36c-9be1-4675-8213-33962111fe31 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:57.600988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff36c-9be1-4675-8213-33962111fe31 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.601274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff36c-9be1-4675-8213-33962111fe31 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.601556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fff36c-9be1-4675-8213-33962111fe31 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.661431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1395182-7b9c-4ca4-9074-6c0b218c6c39 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:57.662115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1395182-7b9c-4ca4-9074-6c0b218c6c39 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:57.662618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1395182-7b9c-4ca4-9074-6c0b218c6c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:57.663668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f1fff36c-9be1-4675-8213-33962111fe31 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:57.678498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3286/6596] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:55:57 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:57.687002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c1395182-7b9c-4ca4-9074-6c0b218c6c39 None None] MFA Rules not processed for user `de963cdc932941c7bac32406ee190634`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:57.688332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1395182-7b9c-4ca4-9074-6c0b218c6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:57.754687 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3311/6597] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:58.683892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:58.684429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:58.684697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:58.707337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:58.708541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:58.711726 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3287/6598] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:58 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:55:58.716764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e3f13-fb80-43da-a236-00523b094fae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:58.717259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e3f13-fb80-43da-a236-00523b094fae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:58.717928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e3f13-fb80-43da-a236-00523b094fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:58.749066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-808e3f13-fb80-43da-a236-00523b094fae None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:55:58.750327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-808e3f13-fb80-43da-a236-00523b094fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:55:58.758267 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3312/6599] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:55:58.762848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:58.778135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dc98-b0ab-4f5e-bda6-514260097353 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:58.783283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:58.784525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:58.784767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:58.785378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:58.830016 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 05 02:55:58.832070 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:55:58.833091 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3288/6600] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:55:58 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 188 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:55:58.836804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e3f13-fb80-43da-a236-00523b094fae None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:58.846490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e3f13-fb80-43da-a236-00523b094fae None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:58.850807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779bf3-9cca-4d92-93d4-61353e35a6ee tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:58.851473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779bf3-9cca-4d92-93d4-61353e35a6ee tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:58.851926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779bf3-9cca-4d92-93d4-61353e35a6ee tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:58.852379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779bf3-9cca-4d92-93d4-61353e35a6ee tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-6c779bf3-9cca-4d92-93d4-61353e35a6ee tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:55:58.895020 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 05 02:55:58.895973 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:55:58.896836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3313/6601] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:55:58 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 188 bytes in 60 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 05 02:55:58.901544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:55:58.912987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305db6b-8761-4dba-928a-e11674084cbb tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:55:58.919739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae543c7-71f4-4fb1-a904-de084a2cfdf5 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:55:58.920417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae543c7-71f4-4fb1-a904-de084a2cfdf5 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:58.920773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae543c7-71f4-4fb1-a904-de084a2cfdf5 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:58.921005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae543c7-71f4-4fb1-a904-de084a2cfdf5 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:55:58.968392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-aae543c7-71f4-4fb1-a904-de084a2cfdf5 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:55:58.977819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3289/6602] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:55:58 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:55:59.982837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:55:59.983393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:55:59.983393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:00.006670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:00.008276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:00.012928 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3314/6603] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:55:59 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:56:00.018372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a4a9-eb82-4386-b544-19fbe78f7e77 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:00.019350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a4a9-eb82-4386-b544-19fbe78f7e77 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:00.019977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a4a9-eb82-4386-b544-19fbe78f7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:00.044048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2692a4a9-eb82-4386-b544-19fbe78f7e77 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:00.045723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2692a4a9-eb82-4386-b544-19fbe78f7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:00.055732 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3290/6604] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:00.060404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:00.078178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee823ff-c494-40e0-834e-eaa37670f665 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:00.085218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed07337-4568-4b30-bf50-1867732d3025 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:00.085910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed07337-4568-4b30-bf50-1867732d3025 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:00.086384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed07337-4568-4b30-bf50-1867732d3025 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:00.086809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed07337-4568-4b30-bf50-1867732d3025 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:00.201154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1ed07337-4568-4b30-bf50-1867732d3025 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:00.217955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3315/6605] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:00 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:01.221108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:01.221583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:01.221693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:01.251645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:01.254009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:01.258581 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3291/6606] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:01 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:56:01.263448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c628-230a-4231-a323-f3313229dee0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:01.264422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c628-230a-4231-a323-f3313229dee0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:01.264932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8c628-230a-4231-a323-f3313229dee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:01.293895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3ed8c628-230a-4231-a323-f3313229dee0 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:01.296837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ed8c628-230a-4231-a323-f3313229dee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:01.309545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3316/6607] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:01.310504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:01.325049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ecadb-e319-40c7-a501-6bb0d421960b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:01.331656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f890c3-29ff-4cd3-a5b7-a7dd0b588c42 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:01.332366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f890c3-29ff-4cd3-a5b7-a7dd0b588c42 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:01.332659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f890c3-29ff-4cd3-a5b7-a7dd0b588c42 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:01.332942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f890c3-29ff-4cd3-a5b7-a7dd0b588c42 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:01.386003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-47f890c3-29ff-4cd3-a5b7-a7dd0b588c42 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:01.395141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3292/6608] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:01 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:02.400687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:02.401338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:02.401338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:02.422051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:02.423260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:02.427286 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3317/6609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:02 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:56:02.432138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce5a8d-43d0-44fd-919b-05b7d3824b20 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:02.432645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce5a8d-43d0-44fd-919b-05b7d3824b20 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:02.432758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce5a8d-43d0-44fd-919b-05b7d3824b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:02.454524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3ce5a8d-43d0-44fd-919b-05b7d3824b20 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:02.455727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3ce5a8d-43d0-44fd-919b-05b7d3824b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:02.464816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3293/6610] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:02.469713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:02.480981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eb46a-3f60-46f9-ab4b-7f886bc1b4ba None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:02.485221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da33932-619c-4f43-b0c7-80f76b73d53c tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:02.485867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33932-619c-4f43-b0c7-80f76b73d53c tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:02.486156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33932-619c-4f43-b0c7-80f76b73d53c tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:02.487001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33932-619c-4f43-b0c7-80f76b73d53c tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:02.537430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1da33932-619c-4f43-b0c7-80f76b73d53c tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:02.547047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3318/6611] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:02 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:03.552682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac016-2c94-478c-9d57-fe325ca6eb2a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:03.553279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac016-2c94-478c-9d57-fe325ca6eb2a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:03.553279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cac016-2c94-478c-9d57-fe325ca6eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:03.572265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-45cac016-2c94-478c-9d57-fe325ca6eb2a None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:03.573505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-45cac016-2c94-478c-9d57-fe325ca6eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:03.576585 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3294/6612] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:03 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:56:04.582570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab234-ee4f-45f2-b13f-86ec2ed3632c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:04.583148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab234-ee4f-45f2-b13f-86ec2ed3632c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:04.583148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ab234-ee4f-45f2-b13f-86ec2ed3632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:04.605881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-177ab234-ee4f-45f2-b13f-86ec2ed3632c None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:04.607560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-177ab234-ee4f-45f2-b13f-86ec2ed3632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:04.615891 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3319/6613] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:04.622100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650783-c756-41a5-93a1-4de520be7291 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:04.622610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650783-c756-41a5-93a1-4de520be7291 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:04.622713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650783-c756-41a5-93a1-4de520be7291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:04.643078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-69650783-c756-41a5-93a1-4de520be7291 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:04.644257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-69650783-c756-41a5-93a1-4de520be7291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:04.647630 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3295/6614] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:04 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:56:04.652415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103512-fff1-4b41-b05a-9b8209a86160 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:04.653077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103512-fff1-4b41-b05a-9b8209a86160 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:04.653518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4103512-fff1-4b41-b05a-9b8209a86160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:04.724257 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.server.flask.application [None req-f4103512-fff1-4b41-b05a-9b8209a86160 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 05 02:56:04.728622 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3320/6615] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 75 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 05 02:56:04.730458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:04.730822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:04.731190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:04.789738 n-d-858272-3 devstack@keystone.service[81827]: WARNING keystone.server.flask.application [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 05 02:56:04.794095 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3296/6616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 62 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 05 02:56:04.796376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee457d-2dfc-4243-8521-349e696bcc78 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:04.796766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee457d-2dfc-4243-8521-349e696bcc78 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:04.797194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee457d-2dfc-4243-8521-349e696bcc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:04.809837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:04.837487 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.server.flask.application [None req-4fee457d-2dfc-4243-8521-349e696bcc78 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 05 02:56:04.840816 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3321/6617] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:04 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 46 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 05 02:56:06.277968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:06.279897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:06.290585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:INSERT=7,keystone:UPDATE=4,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:06.351673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c124198-0456-4727-b754-c73aa06f7910 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:06.356242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:06.356889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:06.357198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:06.357499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] PATH_INFO: `/v3/users/a21786dcd412436facda618c37ff02b7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:06.358655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21786dcd412436facda618c37ff02b7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:06.360596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:06.411806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21786dcd412436facda618c37ff02b7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:06.425241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21786dcd412436facda618c37ff02b7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:06.425714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21786dcd412436facda618c37ff02b7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:06.433723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21786dcd412436facda618c37ff02b7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:06.434489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21786dcd412436facda618c37ff02b7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:06.447331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3297/6618] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:06 2022] DELETE /identity/v3/users/a21786dcd412436facda618c37ff02b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:06.451866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:06.452332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:06.452444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:06.474880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:06.476095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:06.544134 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3322/6619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:06.554200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:06.555692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:06.618584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5fc8-38cd-4e4e-bc06-df21bfa8cec3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:06.623124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2a954-a48c-4281-9a34-9c02a0f87a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:06.623939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2a954-a48c-4281-9a34-9c02a0f87a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:06.624220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2a954-a48c-4281-9a34-9c02a0f87a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:06.624496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2a954-a48c-4281-9a34-9c02a0f87a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:06.635134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2a954-a48c-4281-9a34-9c02a0f87a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:06.636777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2a954-a48c-4281-9a34-9c02a0f87a4a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:06.647292 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3298/6620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:07.062259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.063711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:07.078660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82f822-c62a-4a72-b533-0e1b923d70a0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.085503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.086177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.086463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.086742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] PATH_INFO: `/v3/projects/d238a08e954c42e7a646cbe300e831a0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.088152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d238a08e954c42e7a646cbe300e831a0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.091020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.171130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd238a08e954c42e7a646cbe300e831a0', 'request_id': 'req-1722a71b-1155-4bad-b31f-df8bd785bf7b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:07.178498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd238a08e954c42e7a646cbe300e831a0', 'request_id': 'req-1722a71b-1155-4bad-b31f-df8bd785bf7b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:07.186250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd238a08e954c42e7a646cbe300e831a0', 'request_id': 'req-1722a71b-1155-4bad-b31f-df8bd785bf7b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:07.200829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] The token cache is being invalidate because project d238a08e954c42e7a646cbe300e831a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:07.201443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:07.202302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1722a71b-1155-4bad-b31f-df8bd785bf7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:07.210066 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3323/6621] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:07 2022] DELETE /identity/v3/projects/d238a08e954c42e7a646cbe300e831a0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:07.211398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.211699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.212073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.253850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:07.255498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:07.289608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:07.326798 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3299/6622] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:07.335156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.335873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.336257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.360060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:07.361482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:07.376674 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3324/6623] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:07.377619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.388240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc45ec-13a7-487c-828b-37fe82c128ea None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.395133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.395960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.396465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.397527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.398482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:07.399007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.401133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.417166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3300/6624] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:07.421578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.432111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7921-0e6c-43d6-9323-c8ae477eefac None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.436888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.437588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.437944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.438302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.439000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.441803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.474588 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3325/6625] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:07 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:07.478958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.491386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2767aad-c82d-4334-b0c0-2bae2700ab90 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.558180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.558903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.559257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.559603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.560314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.562431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.589402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3301/6626] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:07 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:07.593741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.605740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8df133-7da5-4a55-9a42-413289b6c505 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.611109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.612458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.612841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.613250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.614039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.615752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.628838 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3326/6627] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:56:07.631559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.644323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3749744-de16-4a65-80d3-8ad0721318e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.653913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563228b-f8ad-4162-be86-dc773b63707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.653913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563228b-f8ad-4162-be86-dc773b63707d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.653913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563228b-f8ad-4162-be86-dc773b63707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.653913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563228b-f8ad-4162-be86-dc773b63707d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.654274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563228b-f8ad-4162-be86-dc773b63707d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.654274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563228b-f8ad-4162-be86-dc773b63707d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.668869 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3302/6628] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:07.672831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.684175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868e048-bc8a-4cc7-bd8a-9c9d46e83516 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:07.689070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d1dd6-91a2-4747-b52e-963b1ef4d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:07.690671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1dd6-91a2-4747-b52e-963b1ef4d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.691022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1dd6-91a2-4747-b52e-963b1ef4d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.691296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d1dd6-91a2-4747-b52e-963b1ef4d96c admin admin] PATH_INFO: `/v3/projects/9789e2e26a5e4679b6f83e0feff71c2c/users/2879c269c66546329d7b2417e99a7d9c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.712485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d1dd6-91a2-4747-b52e-963b1ef4d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9789e2e26a5e4679b6f83e0feff71c2c, user_id=2879c269c66546329d7b2417e99a7d9c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:07.715282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d1dd6-91a2-4747-b52e-963b1ef4d96c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:07.731199 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3327/6629] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:07 2022] PUT /identity/v3/projects/9789e2e26a5e4679b6f83e0feff71c2c/users/2879c269c66546329d7b2417e99a7d9c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:07.751028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.751692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.752562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.796618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] MFA Rules not processed for user `2879c269c66546329d7b2417e99a7d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:07.798002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:07.873463 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3303/6630] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:07.884784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbb32-7787-4bc4-ba1f-d37d2c33abbd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:07.885182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbb32-7787-4bc4-ba1f-d37d2c33abbd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:07.885414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbb32-7787-4bc4-ba1f-d37d2c33abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:07.905887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3c6bbb32-7787-4bc4-ba1f-d37d2c33abbd None None] MFA Rules not processed for user `2879c269c66546329d7b2417e99a7d9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:07.907067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3c6bbb32-7787-4bc4-ba1f-d37d2c33abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:07.915229 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3328/6631] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:07.927718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:07.929186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:07.957381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:08.028873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4665964-00b0-41af-b794-67dc6322c8be None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:08.037266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:08.037896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:08.038181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:08.038674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:08.048006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:08.050657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:08.060946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3304/6632] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:15.852489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091b97-fe56-47ed-afe8-f630db933844 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:15.853075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091b97-fe56-47ed-afe8-f630db933844 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:15.853075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32091b97-fe56-47ed-afe8-f630db933844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:15.867855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:15.900843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-32091b97-fe56-47ed-afe8-f630db933844 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:15.902181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-32091b97-fe56-47ed-afe8-f630db933844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:15.905631 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3329/6633] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:15 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:56:15.911158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:15.912586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:15.989637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dd387-a09f-4c30-b820-915c23ef0fed service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:15.993742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3a2b4-cd13-4873-a2f9-42c40fe22d6f tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:15.994378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a2b4-cd13-4873-a2f9-42c40fe22d6f tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:15.994664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a2b4-cd13-4873-a2f9-42c40fe22d6f tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:15.994999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a2b4-cd13-4873-a2f9-42c40fe22d6f tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:16.047387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27b3a2b4-cd13-4873-a2f9-42c40fe22d6f tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:16.060207 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3305/6634] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:15 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:17.065150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87e853-3f5e-4988-b4c5-5c070c4d7bfa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:17.065679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87e853-3f5e-4988-b4c5-5c070c4d7bfa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:17.066728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87e853-3f5e-4988-b4c5-5c070c4d7bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:17.096191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dd87e853-3f5e-4988-b4c5-5c070c4d7bfa None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:17.098820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dd87e853-3f5e-4988-b4c5-5c070c4d7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:17.105511 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3330/6635] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:17 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:56:17.109953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340241-5cc8-491b-945c-8f78992f7c7b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:17.110434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340241-5cc8-491b-945c-8f78992f7c7b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:17.110531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6340241-5cc8-491b-945c-8f78992f7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-b6340241-5cc8-491b-945c-8f78992f7c7b None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 05 02:56:17.134263 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:56:17.135366 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 02:56:17.136807 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3306/6636] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:17 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:56:17.140401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee3e1-506b-49e7-8d9d-394b257dd9db None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:17.141065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee3e1-506b-49e7-8d9d-394b257dd9db None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:17.141306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ee3e1-506b-49e7-8d9d-394b257dd9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:17.200003 n-d-858272-3 devstack@keystone.service[81826]: WARNING keystone.server.flask.application [None req-b61ee3e1-506b-49e7-8d9d-394b257dd9db None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 05 02:56:17.202238 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3331/6637] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:17 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 63 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 05 02:56:17.206740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b31ba-370e-4b32-974e-bde296437074 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:17.207033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b31ba-370e-4b32-974e-bde296437074 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:17.207318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b31ba-370e-4b32-974e-bde296437074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:17.259625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-203b31ba-370e-4b32-974e-bde296437074 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:17.261660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-203b31ba-370e-4b32-974e-bde296437074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:17.273366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3307/6638] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:17.277675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ee3e1-506b-49e7-8d9d-394b257dd9db None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:17.294596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ee3e1-506b-49e7-8d9d-394b257dd9db None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:17.301081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:17.301736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:17.302022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:17.302299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:17.391606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:17.419167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3332/6639] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:17 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:18.009103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b31ba-370e-4b32-974e-bde296437074 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:18.010685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-203b31ba-370e-4b32-974e-bde296437074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:18.087092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:18.096244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b31ba-370e-4b32-974e-bde296437074 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:18.103872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:18.104670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:18.105017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:18.105639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] PATH_INFO: `/v3/users/ba34319166e041129b4a05926efa2af3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:18.107431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba34319166e041129b4a05926efa2af3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:18.109901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:18.164475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba34319166e041129b4a05926efa2af3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.178781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba34319166e041129b4a05926efa2af3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.179522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba34319166e041129b4a05926efa2af3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.187102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba34319166e041129b4a05926efa2af3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.187797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98608fd-d46d-4011-bc1a-f657ff768bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba34319166e041129b4a05926efa2af3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.203074 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3308/6640] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:18 2022] DELETE /identity/v3/users/ba34319166e041129b4a05926efa2af3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:18.412605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:18.414652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:18.422678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4f18-4e12-4897-9eee-e9437d8d7d07 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:18.422973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4f18-4e12-4897-9eee-e9437d8d7d07 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:18.423257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4f18-4e12-4897-9eee-e9437d8d7d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:18.474211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb6a4f18-4e12-4897-9eee-e9437d8d7d07 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:18.474530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c37d-aa46-4062-bde7-3944fc386264 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:18.475447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb6a4f18-4e12-4897-9eee-e9437d8d7d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:18.479178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3309/6641] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:18 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:56:18.483926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:18.484285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:18.486759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:18.511445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:18.512660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:18.570149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:18.570802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:18.571094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:18.571378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] PATH_INFO: `/v3/projects/10aa8602b45c45a2b5d30052aaa01e42` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:18.573647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10aa8602b45c45a2b5d30052aaa01e42)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:18.575835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:18.588945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3310/6642] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:18.591158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:18.600573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803d35-e9bf-4944-84fb-36e5d05f305d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:18.605042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:18.605955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:18.606707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:18.606836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:18.644166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10aa8602b45c45a2b5d30052aaa01e42', 'request_id': 'req-d8194a82-8c91-4a77-9cab-72d370d3f3c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.657544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10aa8602b45c45a2b5d30052aaa01e42', 'request_id': 'req-d8194a82-8c91-4a77-9cab-72d370d3f3c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.663714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.668860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10aa8602b45c45a2b5d30052aaa01e42', 'request_id': 'req-d8194a82-8c91-4a77-9cab-72d370d3f3c5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.677931 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3311/6643] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:18 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:18.693753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] The token cache is being invalidate because project 10aa8602b45c45a2b5d30052aaa01e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:18.694281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.695317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.697768 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3333/6644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:18 2022] DELETE /identity/v3/projects/10aa8602b45c45a2b5d30052aaa01e42 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:18.703120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:18.706313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:18.726482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1b87a-9418-4714-b652-2b07c48d7606 tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:18.765315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:18.793741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:18.794385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:18.794669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:18.794945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] PATH_INFO: `/v3/users/fb657d3496834b91aa36cd01289d21bc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:18.796123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb657d3496834b91aa36cd01289d21bc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:18.798203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:18.851197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb657d3496834b91aa36cd01289d21bc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.864515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb657d3496834b91aa36cd01289d21bc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.865310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb657d3496834b91aa36cd01289d21bc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.873198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb657d3496834b91aa36cd01289d21bc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.873976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26f1e24c-aad7-4822-be4b-48d0d70e813d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb657d3496834b91aa36cd01289d21bc'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:18.890740 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3312/6645] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:18 2022] DELETE /identity/v3/users/fb657d3496834b91aa36cd01289d21bc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:19.089751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.104353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8194a82-8c91-4a77-9cab-72d370d3f3c5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.116235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:UPDATE=3,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:19.174691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.175439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.175806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.176153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] PATH_INFO: `/v3/projects/005332b5ab964891bfb178def6e1a63b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.177402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005332b5ab964891bfb178def6e1a63b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.179403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.230193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005332b5ab964891bfb178def6e1a63b', 'request_id': 'req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:19.235613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005332b5ab964891bfb178def6e1a63b', 'request_id': 'req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:19.242893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005332b5ab964891bfb178def6e1a63b', 'request_id': 'req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:19.256498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] The token cache is being invalidate because project 005332b5ab964891bfb178def6e1a63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:19.256800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:19.257458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-32ea4c9f-3da7-469a-9626-cbe5a6d0f0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:19.258940 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3334/6646] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:19 2022] DELETE /identity/v3/projects/005332b5ab964891bfb178def6e1a63b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:19.263903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.264407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.264736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.285164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:19.286371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:19.353652 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3313/6647] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:19.361391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.362085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.362085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.389648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:19.390876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:19.422523 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3335/6648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:19.426376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.448238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93005-b596-4199-9b8b-da4014d0236a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.458646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.459302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.459588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.459873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.460545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:19.460854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.462552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.494993 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3314/6649] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:19.499343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.509959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cce1a-7722-4c7a-80cb-5b9ed7b4e80b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.514689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.515293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.515683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.515967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.520222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.523071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.561843 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3336/6650] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:56:19.563038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.575327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221308f-ebc1-4a35-bc3d-9ef8b93d7a75 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.620225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:19.640127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0081ec-d592-4380-bab6-924768a18885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.640764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0081ec-d592-4380-bab6-924768a18885 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.641076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0081ec-d592-4380-bab6-924768a18885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.641354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0081ec-d592-4380-bab6-924768a18885 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.641989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0081ec-d592-4380-bab6-924768a18885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.644171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0081ec-d592-4380-bab6-924768a18885 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.670694 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3315/6651] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:56:19.675191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.683707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463a1e-7ed6-46cc-b674-cd267ce5759d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.683977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463a1e-7ed6-46cc-b674-cd267ce5759d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.684259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51463a1e-7ed6-46cc-b674-cd267ce5759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.686366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1462c0a-bba5-4db2-839a-3fd3df4be29e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.693560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.694749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.695060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.695436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.696325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.698560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.708015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-51463a1e-7ed6-46cc-b674-cd267ce5759d None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:19.709752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-51463a1e-7ed6-46cc-b674-cd267ce5759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:19.711762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3337/6652] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:56:19.715841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.716943 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3316/6653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:56:19.722209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.722705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.723092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.727890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d249e45-91e8-4193-a614-bc281a7f4142 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.733397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.734004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.734290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.734564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.735208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.736932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.747822 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3338/6654] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:56:19.748228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:19.749560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:19.751667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.762216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb985f7-d34b-4ea6-aac9-8ac09d7c7607 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.767069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf7fc-ac96-4eaf-8781-45896e6b3c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.768254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf7fc-ac96-4eaf-8781-45896e6b3c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.768562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf7fc-ac96-4eaf-8781-45896e6b3c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.768975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf7fc-ac96-4eaf-8781-45896e6b3c46 admin admin] PATH_INFO: `/v3/projects/ce350e6cc8ca4f608a2d9d831156b994/users/28eafebe94ec4eb6997e8bdd4ec6b7d0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.788301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbf7fc-ac96-4eaf-8781-45896e6b3c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce350e6cc8ca4f608a2d9d831156b994, user_id=28eafebe94ec4eb6997e8bdd4ec6b7d0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:19.791611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbf7fc-ac96-4eaf-8781-45896e6b3c46 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:19.809002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3339/6655] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:19 2022] PUT /identity/v3/projects/ce350e6cc8ca4f608a2d9d831156b994/users/28eafebe94ec4eb6997e8bdd4ec6b7d0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:19.819140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.819447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.819718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.820061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3317/6656] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:19.823707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.834285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af40fa-1c8d-4175-8bbd-557df37bc0ff None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:19.852612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] MFA Rules not processed for user `28eafebe94ec4eb6997e8bdd4ec6b7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:19.855994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:19.874067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:19.900338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b971c106d44039856b66b76c8905d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '577f1bc5494e4591bb6cecce6e81a4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:19.901116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:19.901402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:19.901686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d/password` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:19.943446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3340/6657] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:19.948958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:19.952543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:19.965740 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3318/6658] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/users/db3b971c106d44039856b66b76c8905d/password => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:20.018446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8878f65-1a8d-4e70-a378-b78f7be813f0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.023482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.024093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.025753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.025753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.025753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.027634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.063094 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3341/6659] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:19 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:20.067762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:20.081082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552f317-d37d-47f6-95d4-cc48029592dc tempest-IdentityV3UsersTest-516329343 tempest-IdentityV3UsersTest-516329343-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.140065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:20.158249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.158867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.159144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.159415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.160050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.162122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.184106 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3319/6660] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:20 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:20.188136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:20.200061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0e086-37d1-4fbc-be17-ced6a3b502b6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.205536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.205885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.206169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.206450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.207105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.208703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.223698 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3342/6661] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:20.224946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:20.237963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86b19-5894-42db-bb7c-10ec41d36951 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.243008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.243686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.243976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.244257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] PATH_INFO: `/v3/projects/9ffec9f1d2144e1688be6736849849bd/users/3f80987900c142d1a2b6bf56c4fcf4cb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.262686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffec9f1d2144e1688be6736849849bd, user_id=3f80987900c142d1a2b6bf56c4fcf4cb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.266307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.281863 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3320/6662] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:20 2022] PUT /identity/v3/projects/9ffec9f1d2144e1688be6736849849bd/users/3f80987900c142d1a2b6bf56c4fcf4cb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:20.286991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:20.300886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31a72a-8399-4a85-8304-a7470d89145e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.360728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a4c9-5d97-4090-a8e8-f23c0a89ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.361863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a4c9-5d97-4090-a8e8-f23c0a89ebcc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.362141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a4c9-5d97-4090-a8e8-f23c0a89ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.362415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a4c9-5d97-4090-a8e8-f23c0a89ebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.363055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a4c9-5d97-4090-a8e8-f23c0a89ebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.364679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a4c9-5d97-4090-a8e8-f23c0a89ebcc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.379397 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3343/6663] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:20.380644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:20.391808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b06755-76ad-40b5-8e15-475af4b8ae2d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.397163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.397877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.398186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.398468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] PATH_INFO: `/v3/projects/9ffec9f1d2144e1688be6736849849bd/users/3f80987900c142d1a2b6bf56c4fcf4cb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.400509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffec9f1d2144e1688be6736849849bd, user_id=3f80987900c142d1a2b6bf56c4fcf4cb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.403240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.414358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3321/6664] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:20 2022] PUT /identity/v3/projects/9ffec9f1d2144e1688be6736849849bd/users/3f80987900c142d1a2b6bf56c4fcf4cb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:20.427241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217e585-15e2-4907-a21c-2e8baf895750 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.427809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217e585-15e2-4907-a21c-2e8baf895750 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.427909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217e585-15e2-4907-a21c-2e8baf895750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.461518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d217e585-15e2-4907-a21c-2e8baf895750 None None] MFA Rules not processed for user `3f80987900c142d1a2b6bf56c4fcf4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:20.462757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d217e585-15e2-4907-a21c-2e8baf895750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:20.480579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:20.536116 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3344/6665] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:20.546947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:20.549361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:20.613910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1677a1-57e1-46b8-9101-dcea4b944258 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:20.617604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff732fe7-7964-4864-9572-e99b449b9d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:20.618216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff732fe7-7964-4864-9572-e99b449b9d63 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.618494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff732fe7-7964-4864-9572-e99b449b9d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.618799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff732fe7-7964-4864-9572-e99b449b9d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.686625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff732fe7-7964-4864-9572-e99b449b9d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:20.688240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff732fe7-7964-4864-9572-e99b449b9d63 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:20.699266 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3322/6666] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:20.971854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21989d00-872a-4549-a23d-50a157abc48f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:20.972273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21989d00-872a-4549-a23d-50a157abc48f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:20.973076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21989d00-872a-4549-a23d-50a157abc48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:20.998548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-21989d00-872a-4549-a23d-50a157abc48f None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:20.999823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21989d00-872a-4549-a23d-50a157abc48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:21.006001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3345/6667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:20 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 05 02:56:22.009940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8508-1bc0-450d-9e30-09ce1da31729 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:22.010445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8508-1bc0-450d-9e30-09ce1da31729 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:22.010561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8508-1bc0-450d-9e30-09ce1da31729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:22.031410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-619b8508-1bc0-450d-9e30-09ce1da31729 None None] MFA Rules not processed for user `db3b971c106d44039856b66b76c8905d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:22.032609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-619b8508-1bc0-450d-9e30-09ce1da31729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:22.083923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:22.097584 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3323/6668] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:22.098754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21989d00-872a-4549-a23d-50a157abc48f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:22.100149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21989d00-872a-4549-a23d-50a157abc48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:22.180685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21989d00-872a-4549-a23d-50a157abc48f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:22.186848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:22.187421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:22.187703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:22.187975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] PATH_INFO: `/v3/users/db3b971c106d44039856b66b76c8905d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:22.189223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3b971c106d44039856b66b76c8905d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:22.191406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:22.251244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:22.266301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:22.267199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:22.279320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:22.280016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3b971c106d44039856b66b76c8905d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:22.300954 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3346/6669] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:22 2022] DELETE /identity/v3/users/db3b971c106d44039856b66b76c8905d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:22.305861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:22.306985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:22.307270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:22.336300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:22.336563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:22.421235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3324/6670] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:22.431401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:22.432824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:22.475568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:22.523052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f841f-3b87-4f0a-8339-982119d1fd7f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:22.527202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a6317-04bc-4d0a-a11d-4e0845b38679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:22.527909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a6317-04bc-4d0a-a11d-4e0845b38679 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:22.528263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a6317-04bc-4d0a-a11d-4e0845b38679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:22.528607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a6317-04bc-4d0a-a11d-4e0845b38679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:22.540015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a6317-04bc-4d0a-a11d-4e0845b38679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:22.542790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a6317-04bc-4d0a-a11d-4e0845b38679 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:22.555372 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3347/6671] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:22.905805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:22.907380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:22.928942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff5dc3-15b6-4980-b822-8201fdc1ef12 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:22.933949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:22.934700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:22.935127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:22.935417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] PATH_INFO: `/v3/projects/577f1bc5494e4591bb6cecce6e81a4f5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:22.937100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=577f1bc5494e4591bb6cecce6e81a4f5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:22.940092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.026332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577f1bc5494e4591bb6cecce6e81a4f5', 'request_id': 'req-333f032f-2646-4e50-9b52-a9871a5cdf4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:23.037883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577f1bc5494e4591bb6cecce6e81a4f5', 'request_id': 'req-333f032f-2646-4e50-9b52-a9871a5cdf4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:23.046377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577f1bc5494e4591bb6cecce6e81a4f5', 'request_id': 'req-333f032f-2646-4e50-9b52-a9871a5cdf4f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:23.060532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] The token cache is being invalidate because project 577f1bc5494e4591bb6cecce6e81a4f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:23.060834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:23.061554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-333f032f-2646-4e50-9b52-a9871a5cdf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:23.064949 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3325/6672] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:22 2022] DELETE /identity/v3/projects/577f1bc5494e4591bb6cecce6e81a4f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:23.069681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.070205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.070480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.103809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:23.105173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:23.184634 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3348/6673] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:23.193138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.193565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.194382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.226764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:23.228154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:23.241125 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3326/6674] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:23.243988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.257235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364762d5-077b-45dc-8a10-d17cb1573e0b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:23.264068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:23.264476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.264760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.266108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.266701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:23.267014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:23.269639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.290830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3349/6675] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:23.296282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.330242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e95c-8628-4736-9d53-c321164658a0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:23.346269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:23.347452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.347961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.348400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.349247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:23.351366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.400245 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3327/6676] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:23 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:23.406044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.450730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc816b89-0c84-4aad-a624-edcfc6d029ab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:23.554746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:23.555549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.566486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.570300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.570300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:23.577139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.619818 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3350/6677] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:23 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:23.623650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.636824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0d150-14f5-493a-b34d-67ec291897ca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:23.654984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:23.655951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.656563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.657017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.657866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:23.659807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.685869 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3328/6678] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:23.687265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.703275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b72c25-5a81-41a0-89eb-6061da76c66a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:23.711267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3e2c3-2d15-4191-b680-550a4774a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:23.712475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e2c3-2d15-4191-b680-550a4774a228 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.712763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e2c3-2d15-4191-b680-550a4774a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.713085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e2c3-2d15-4191-b680-550a4774a228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.713733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3e2c3-2d15-4191-b680-550a4774a228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:23.715335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3e2c3-2d15-4191-b680-550a4774a228 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.729292 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3351/6679] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:23.734255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.746888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8284b70-b243-4d26-8d95-dfc6d27b80e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:23.754026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:23.755015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.755367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.755709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] PATH_INFO: `/v3/projects/c51901c7ce79404abf67cbbe75e060dd/users/b6901748192a48e19625662ca8e278e8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.773554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51901c7ce79404abf67cbbe75e060dd, user_id=b6901748192a48e19625662ca8e278e8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:23.776489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:23.792939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3329/6680] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:23 2022] PUT /identity/v3/projects/c51901c7ce79404abf67cbbe75e060dd/users/b6901748192a48e19625662ca8e278e8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:23.803586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:23.804142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:23.804519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:23.844514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] MFA Rules not processed for user `b6901748192a48e19625662ca8e278e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:23.846313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:23.883382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:23.934461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3352/6681] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:23.939564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:23.964452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:24.021331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e56f17-7fbc-4e32-b0c0-22d4cba3f4bc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.027284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.027894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.028684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.029318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.030113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.032188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.072180 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3330/6682] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:23 2022] POST /identity/v3/projects => generated 399 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:24.075961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:24.087459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d232e36-8a4d-463c-a2a6-8828cffb84f0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.152612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.153758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.154202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.154571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.155305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.157366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.184117 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3353/6683] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:24 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:24.185426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:24.196675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550c61-8204-48fe-a9ab-524deb96de95 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.201490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.202191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.202668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.203037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.203806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.205723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.217607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3331/6684] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:24.221578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:24.232033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4764a-6d77-4995-8e21-139a5ec01e37 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.237403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.238072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.238353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.238630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] PATH_INFO: `/v3/projects/5f994e11e8014e7b897046e67b8e3924/users/d3a4c106877e486f90ceb4908db39032/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.258812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f994e11e8014e7b897046e67b8e3924, user_id=d3a4c106877e486f90ceb4908db39032, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.261854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.280098 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3354/6685] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:24 2022] PUT /identity/v3/projects/5f994e11e8014e7b897046e67b8e3924/users/d3a4c106877e486f90ceb4908db39032/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:24.284753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:24.294867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f05e-64a7-4fd5-9ad7-c224ccce14a7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.369304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a062345-3017-41a4-9851-dc87fc44a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.370369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a062345-3017-41a4-9851-dc87fc44a2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.370759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a062345-3017-41a4-9851-dc87fc44a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.371136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a062345-3017-41a4-9851-dc87fc44a2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.371905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a062345-3017-41a4-9851-dc87fc44a2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.373742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a062345-3017-41a4-9851-dc87fc44a2c1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.389697 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3332/6686] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:24.395272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:24.407287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbf9bd-1590-4f58-8fe8-dd9402942f0a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.413801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.414561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.414910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.415252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] PATH_INFO: `/v3/projects/5f994e11e8014e7b897046e67b8e3924/users/d3a4c106877e486f90ceb4908db39032/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.417348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f994e11e8014e7b897046e67b8e3924, user_id=d3a4c106877e486f90ceb4908db39032, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.420141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.445105 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3355/6687] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:24 2022] PUT /identity/v3/projects/5f994e11e8014e7b897046e67b8e3924/users/d3a4c106877e486f90ceb4908db39032/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:24.446649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.447045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.447430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.478960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] MFA Rules not processed for user `d3a4c106877e486f90ceb4908db39032`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:24.480095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:24.563403 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3333/6688] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:24.574770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:24.576312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:24.652281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1f011-02ec-4e2b-b8c5-e537391e9c6f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:24.656711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:24.657027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:24.657413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:24.658314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:24.709647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:24.794687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:24.796314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:24.806437 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3356/6689] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:56:25.265715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:25.267484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:25.292242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:25.425587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a790a5-e47b-4d9d-9d33-893c1c86dace None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:25.432530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:25.433497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:25.433993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:25.434491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:25.445840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:25.448216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:25.460276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3334/6690] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:26.591928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:26.594413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:26.704091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71f0f1-543a-432d-9175-28bb146ec056 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:26.710616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:26.711314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:26.711857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:26.712178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:26.714615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:26.852393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:26.854379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca3e5b-19f8-4c40-98a6-d4d3fbfb4703 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:26.870719 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3357/6691] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:33.048121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:33.172880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1bb05-818a-4e63-bcda-c24af25d3501 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:33.182094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:33.183143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:33.183617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:33.184076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] PATH_INFO: `/v3/users/b6901748192a48e19625662ca8e278e8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:33.185955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6901748192a48e19625662ca8e278e8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:33.188052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:33.252928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6901748192a48e19625662ca8e278e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.266554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6901748192a48e19625662ca8e278e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.267965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6901748192a48e19625662ca8e278e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.276129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6901748192a48e19625662ca8e278e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.276779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6901748192a48e19625662ca8e278e8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.293058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3335/6692] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:33 2022] DELETE /identity/v3/users/b6901748192a48e19625662ca8e278e8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:33.297237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:33.297723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:33.297808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:33.318653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:33.321259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:33.396554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3358/6693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:33.407467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:33.422354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:33.474968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:33.554399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023eb95-4883-4973-90e2-eb80931e2977 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:33.565954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:33.566684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:33.567033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:33.567593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:33.588416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:33.590172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:33.627542 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3336/6694] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:33.850811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:33.852287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:33.875198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec640d04-db72-46dc-8828-9e1264e76aa4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:33.887238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:33.887893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:33.888176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:33.888451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] PATH_INFO: `/v3/projects/c51901c7ce79404abf67cbbe75e060dd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:33.889643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51901c7ce79404abf67cbbe75e060dd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:33.891556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:33.923664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:33.964297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51901c7ce79404abf67cbbe75e060dd', 'request_id': 'req-f8de6fb7-055a-4c9c-a551-7e5fece5003f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.978732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51901c7ce79404abf67cbbe75e060dd', 'request_id': 'req-f8de6fb7-055a-4c9c-a551-7e5fece5003f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:33.987520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51901c7ce79404abf67cbbe75e060dd', 'request_id': 'req-f8de6fb7-055a-4c9c-a551-7e5fece5003f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.009115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] The token cache is being invalidate because project c51901c7ce79404abf67cbbe75e060dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:34.009444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.010173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.012695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3359/6695] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:33 2022] DELETE /identity/v3/projects/c51901c7ce79404abf67cbbe75e060dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:34.016628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:34.036252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f84cb-3e3b-4323-a79f-56657a9f098d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:34.159463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:34.160088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:34.160383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:34.160741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] PATH_INFO: `/v3/users/d3a4c106877e486f90ceb4908db39032` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:34.162037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a4c106877e486f90ceb4908db39032)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:34.165071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:34.247822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a4c106877e486f90ceb4908db39032'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.284027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a4c106877e486f90ceb4908db39032'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.284850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a4c106877e486f90ceb4908db39032'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.312365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a4c106877e486f90ceb4908db39032'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.313057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fec6c03d-cf5e-4b46-8fc8-0af274196a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a4c106877e486f90ceb4908db39032'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.337395 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3337/6696] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:34 2022] DELETE /identity/v3/users/d3a4c106877e486f90ceb4908db39032 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:34.582250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:34.584663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:34.609916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de6fb7-055a-4c9c-a551-7e5fece5003f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:34.707475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:34.708230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:34.708513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:34.708973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] PATH_INFO: `/v3/projects/5f994e11e8014e7b897046e67b8e3924` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:34.710201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f994e11e8014e7b897046e67b8e3924)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:34.712126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:34.765116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f994e11e8014e7b897046e67b8e3924', 'request_id': 'req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.772481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f994e11e8014e7b897046e67b8e3924', 'request_id': 'req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.779057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f994e11e8014e7b897046e67b8e3924', 'request_id': 'req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.792941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] The token cache is being invalidate because project 5f994e11e8014e7b897046e67b8e3924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:34.793263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.793901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c592a16c-9c64-4715-85fe-1df2a1d7cbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:34.795699 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3360/6697] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:34 2022] DELETE /identity/v3/projects/5f994e11e8014e7b897046e67b8e3924 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:34.800832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:34.801162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:34.801447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:34.822094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:34.823312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:34.866016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:34.889714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3338/6698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:34.897620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:34.897963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:34.898251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:34.928228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:34.930818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:34.942188 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3361/6699] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:34.946501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:34.957797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8208-f08c-48a0-b1c2-a73d7460ea08 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:34.962599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:34.963307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:34.963658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:34.964002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:34.964729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:34.965126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:34.966902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:34.983531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3339/6700] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:34.985358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:34.997103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab61f00-7a40-4b43-844d-c66d7253b88e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.007185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.007954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.008239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.008510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.009190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.011098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.040982 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3362/6701] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:34 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:35.045072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.056060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d3e6-0c24-4f0d-90a2-109110d6a1a5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.116801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.117482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.117770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.118052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.118764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.120750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.146797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3340/6702] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:35 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:35.150976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.162659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9e52f-cf8f-47af-a547-31634fb915e3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.167671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.168274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.168556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.168829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.169536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.171126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.172832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:35.192535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3363/6703] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:35.192746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.204810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d0348-218c-42d4-ad27-4a89e39a0c98 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.209959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b44a-8d1b-4276-a82a-f89ca69e921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.210593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b44a-8d1b-4276-a82a-f89ca69e921c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.210881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b44a-8d1b-4276-a82a-f89ca69e921c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.211312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b44a-8d1b-4276-a82a-f89ca69e921c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.211986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9b44a-8d1b-4276-a82a-f89ca69e921c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.213670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9b44a-8d1b-4276-a82a-f89ca69e921c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.226411 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3341/6704] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:35.230449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.242918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93b598-5f43-406b-bce7-90bc5ca11d79 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.249519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.250479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.250842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.251228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] PATH_INFO: `/v3/projects/02a3e30e2f4b43d68fb9a64497e2548f/users/3a1109d8ce5742beb240a5fb78fb88a5/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.270014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a3e30e2f4b43d68fb9a64497e2548f, user_id=3a1109d8ce5742beb240a5fb78fb88a5, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.272787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.298505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3364/6705] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:35 2022] PUT /identity/v3/projects/02a3e30e2f4b43d68fb9a64497e2548f/users/3a1109d8ce5742beb240a5fb78fb88a5/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:35.300748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.301427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.301779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.335634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] MFA Rules not processed for user `3a1109d8ce5742beb240a5fb78fb88a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:35.337002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:35.425341 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3342/6706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:35.427865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.515770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffead4b-c42b-4664-9014-6b54371fda4f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.534483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.535001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.535222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.535517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.536137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.538276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.611737 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3365/6707] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:35 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:56:35.625071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.638218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5f7f-f91f-4a4a-8edc-e1ae47248a4e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.682423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:35.711840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.713641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.713922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.714345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.715027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.717015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.745005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3343/6708] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:35 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:35.746853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.758818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8123-2013-461b-8e0c-de5ad26f6546 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.763649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.764249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.764529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.764825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.765504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.767706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.778301 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3366/6709] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:35.782357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.792567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717ab44-bf38-40be-8cac-9c11b851597d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.797243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.797955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.798306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.798597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] PATH_INFO: `/v3/projects/270b5e657b03432ab66a3f0cbcfc178e/users/1a45188117fe468b889b1f72cfe9861b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.816516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270b5e657b03432ab66a3f0cbcfc178e, user_id=1a45188117fe468b889b1f72cfe9861b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.819239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.833169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3344/6710] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:35 2022] PUT /identity/v3/projects/270b5e657b03432ab66a3f0cbcfc178e/users/1a45188117fe468b889b1f72cfe9861b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:35.837263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.849901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993557a-cfc2-4130-a3ef-59ec81bcda8b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.914208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2b841-2b47-4523-88d8-312328d1f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.914884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b841-2b47-4523-88d8-312328d1f06f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.915176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b841-2b47-4523-88d8-312328d1f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.915460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b841-2b47-4523-88d8-312328d1f06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.916132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2b841-2b47-4523-88d8-312328d1f06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.917994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2b841-2b47-4523-88d8-312328d1f06f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.930578 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3367/6711] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:35.934272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:35.945185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513c32-4efb-4d5c-8edc-d3bb963bf701 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:35.949925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:35.950601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.950884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.951167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] PATH_INFO: `/v3/projects/270b5e657b03432ab66a3f0cbcfc178e/users/1a45188117fe468b889b1f72cfe9861b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:35.953374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270b5e657b03432ab66a3f0cbcfc178e, user_id=1a45188117fe468b889b1f72cfe9861b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:35.956016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:35.967238 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3345/6712] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:35 2022] PUT /identity/v3/projects/270b5e657b03432ab66a3f0cbcfc178e/users/1a45188117fe468b889b1f72cfe9861b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:35.978658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:35.978955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:35.979240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:36.008235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] MFA Rules not processed for user `1a45188117fe468b889b1f72cfe9861b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:36.009521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:36.047994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:36.094261 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3368/6713] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:36.105486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:36.107334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:36.169737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416df8e6-3ece-4456-9355-f77a8c184ae1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:36.173991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:36.174605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:36.174888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:36.175163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:36.184496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:36.185974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:36.197535 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3346/6714] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:37.415363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:37.418560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:37.569931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1247d4-e688-4d0c-8d9d-2df7bdeae042 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:37.577048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:37.577614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:37.577903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:37.578262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:37.581116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:37.652970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:37.652970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ae15b-ca1f-41ce-abd0-c7cd681d0de0 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:37.675613 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3369/6715] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:39.077954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:39.079512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:39.162469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2728b-80c0-4d55-9d9b-301cf26ff5c9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:39.167256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:39.167958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:39.168947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:39.169302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] PATH_INFO: `/v3/users/28eafebe94ec4eb6997e8bdd4ec6b7d0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:39.170513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eafebe94ec4eb6997e8bdd4ec6b7d0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:39.172491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:39.211244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:39.224489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eafebe94ec4eb6997e8bdd4ec6b7d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.238865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eafebe94ec4eb6997e8bdd4ec6b7d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.239599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eafebe94ec4eb6997e8bdd4ec6b7d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.249920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eafebe94ec4eb6997e8bdd4ec6b7d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.250928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eafebe94ec4eb6997e8bdd4ec6b7d0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.268773 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3347/6716] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:39 2022] DELETE /identity/v3/users/28eafebe94ec4eb6997e8bdd4ec6b7d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:39.272467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:39.273052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:39.273052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:39.296066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:39.297513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:39.371030 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3370/6717] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:39.379824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:39.381517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:39.463820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7df00-84bc-40de-b984-3a0140ccf96a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:39.468658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:39.469563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:39.469941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:39.470849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:39.482074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:39.483643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:39.495262 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3348/6718] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:39.827932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:39.831742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:39.844419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:39.857239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a1953-b0d2-4fed-84a5-d0eb7aa09489 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:39.868696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:39.869455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:39.869838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:39.870177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] PATH_INFO: `/v3/projects/ce350e6cc8ca4f608a2d9d831156b994` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:39.871398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce350e6cc8ca4f608a2d9d831156b994)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:39.873467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:39.941918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce350e6cc8ca4f608a2d9d831156b994', 'request_id': 'req-2864efc8-c002-4cad-95d7-32439d217661'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.953324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce350e6cc8ca4f608a2d9d831156b994', 'request_id': 'req-2864efc8-c002-4cad-95d7-32439d217661'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.964213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce350e6cc8ca4f608a2d9d831156b994', 'request_id': 'req-2864efc8-c002-4cad-95d7-32439d217661'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.993570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] The token cache is being invalidate because project ce350e6cc8ca4f608a2d9d831156b994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:39.994054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.994986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:39.999884 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3371/6719] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:39 2022] DELETE /identity/v3/projects/ce350e6cc8ca4f608a2d9d831156b994 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:40.001142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:40.012391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f075b-2abe-414c-8bea-584c41124b0f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:40.077508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:40.078151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:40.078695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:40.078695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] PATH_INFO: `/v3/users/3f80987900c142d1a2b6bf56c4fcf4cb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:40.080596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f80987900c142d1a2b6bf56c4fcf4cb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:40.082835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:40.147471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f80987900c142d1a2b6bf56c4fcf4cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.157059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:40.165745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f80987900c142d1a2b6bf56c4fcf4cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.166750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f80987900c142d1a2b6bf56c4fcf4cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.181568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f80987900c142d1a2b6bf56c4fcf4cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.182825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af4bfaaf-de58-4359-85dc-6f1da275b1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f80987900c142d1a2b6bf56c4fcf4cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.211713 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3349/6720] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:39 2022] DELETE /identity/v3/users/3f80987900c142d1a2b6bf56c4fcf4cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:40.601600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:40.603244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:40.628492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864efc8-c002-4cad-95d7-32439d217661 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:40.743387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:40.744040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:40.744323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:40.744595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] PATH_INFO: `/v3/projects/9ffec9f1d2144e1688be6736849849bd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:40.749845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ffec9f1d2144e1688be6736849849bd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:40.751835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:40.830121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ffec9f1d2144e1688be6736849849bd', 'request_id': 'req-95757690-cce8-41d5-bf75-190d6694c413'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.838456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ffec9f1d2144e1688be6736849849bd', 'request_id': 'req-95757690-cce8-41d5-bf75-190d6694c413'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.847708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ffec9f1d2144e1688be6736849849bd', 'request_id': 'req-95757690-cce8-41d5-bf75-190d6694c413'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.865236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] The token cache is being invalidate because project 9ffec9f1d2144e1688be6736849849bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:40.865758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.866595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-95757690-cce8-41d5-bf75-190d6694c413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:40.868666 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3372/6721] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:40 2022] DELETE /identity/v3/projects/9ffec9f1d2144e1688be6736849849bd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:40.874699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:40.875332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:40.875796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:40.907320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:40.909738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:41.094212 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3350/6722] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:41.104024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.104537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.105032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.136473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:41.138408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:41.148747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3373/6723] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:41.152715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.165705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c8191-608e-4301-8ece-a53a715ae8ab None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.173072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.175589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.176068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.176517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.177362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:41.177853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.180791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.202491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3351/6724] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:41.207783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.219237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0a758-1538-4ab9-8d6e-94d00160bed8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.228619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.229550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.230160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.234643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.235507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.239216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.253966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:41.296093 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3374/6725] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:41 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:41.300586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.315663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a4495-fa48-4ab9-89d7-6eda03189099 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.422338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155115-036c-4553-af60-615e1043579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.424302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155115-036c-4553-af60-615e1043579f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.424748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155115-036c-4553-af60-615e1043579f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.425363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8155115-036c-4553-af60-615e1043579f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.426162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155115-036c-4553-af60-615e1043579f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.428490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8155115-036c-4553-af60-615e1043579f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.461955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3352/6726] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:41 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:41.465737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.506423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170dc9-0ced-41fc-84a9-0822c5f62727 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.519269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.520420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.520997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.521635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.524080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.526493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.549983 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3375/6727] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:41.550794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155115-036c-4553-af60-615e1043579f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.568078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8155115-036c-4553-af60-615e1043579f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.573464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92971753-b8fe-4765-9f63-3e0fa3aadfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.574107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971753-b8fe-4765-9f63-3e0fa3aadfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.574392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971753-b8fe-4765-9f63-3e0fa3aadfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.574666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971753-b8fe-4765-9f63-3e0fa3aadfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.575362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92971753-b8fe-4765-9f63-3e0fa3aadfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.577000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92971753-b8fe-4765-9f63-3e0fa3aadfc6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.592058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3353/6728] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:56:41.593424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.604732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9032af9-9fca-47d8-893c-3c62e1c4bd71 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.611338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.612180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.612640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.613021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] PATH_INFO: `/v3/projects/02baca83fe9e4234b0d09a5e7f6d1581/users/2c718657bb1146cf9fd001d38193714f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.637568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02baca83fe9e4234b0d09a5e7f6d1581, user_id=2c718657bb1146cf9fd001d38193714f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.640795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.665387 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3376/6729] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:41 2022] PUT /identity/v3/projects/02baca83fe9e4234b0d09a5e7f6d1581/users/2c718657bb1146cf9fd001d38193714f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:41.677259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.677473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.677758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.712527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] MFA Rules not processed for user `2c718657bb1146cf9fd001d38193714f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:41.713830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:41.748074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:41.797496 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3354/6730] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:41.811668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:41.813572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:41.878733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6519d-15d7-4071-b8b7-504e2309bf93 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:41.882797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:41.883499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:41.883852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:41.884200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:41.896842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:41.898395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:41.909021 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3377/6731] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:42.584826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:42.586349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:42.766330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201989a-54ce-4495-84aa-e3d379d3eb3b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:42.771894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a45188117fe468b889b1f72cfe9861b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '270b5e657b03432ab66a3f0cbcfc178e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:42.772527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:42.772818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:42.773140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:42.773802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:42.774111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:42.775747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:42.806467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3355/6732] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:42.807128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:42.824382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b3fe-c6b5-4a0d-8426-1d635e50f552 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:42.830643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a45188117fe468b889b1f72cfe9861b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '270b5e657b03432ab66a3f0cbcfc178e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:42.831803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:42.832278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:42.833846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:42.834697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:42.838044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:42.895948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:42.903461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3378/6733] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:42 2022] POST /identity/v3/projects => generated 349 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:42.907777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208db65-d85c-40da-acf7-e349fef664ed tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:42.992637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a45188117fe468b889b1f72cfe9861b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '270b5e657b03432ab66a3f0cbcfc178e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:42.993594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:42.993977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:42.994358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:42.995127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:42.995612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:42.997730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:43.037342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3356/6734] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:44.009994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:44.026917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4600b09-6785-4408-aaca-95ecce1400c9 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:44.037602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a45188117fe468b889b1f72cfe9861b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '270b5e657b03432ab66a3f0cbcfc178e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:44.038637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:44.039132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:44.039557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] PATH_INFO: `/v3/projects/60134abac21643c3a63a63fe566f03f2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:44.041081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60134abac21643c3a63a63fe566f03f2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:44.043495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:44.162982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60134abac21643c3a63a63fe566f03f2', 'request_id': 'req-1bdacc37-27f0-45c4-8c6b-e11391555194'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:44.174005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60134abac21643c3a63a63fe566f03f2', 'request_id': 'req-1bdacc37-27f0-45c4-8c6b-e11391555194'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:44.184001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60134abac21643c3a63a63fe566f03f2', 'request_id': 'req-1bdacc37-27f0-45c4-8c6b-e11391555194'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:44.217708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] The token cache is being invalidate because project 60134abac21643c3a63a63fe566f03f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:44.219541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:44.222822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:44.227659 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3379/6735] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:44 2022] DELETE /identity/v3/projects/60134abac21643c3a63a63fe566f03f2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:44.238665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:44.241153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:44.394193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c7a1b-5de9-46c6-bf77-e7df9228fb0d tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:44.434564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:44.507369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:44.508068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:44.508622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:44.509229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:44.511725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:44.636926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:44.636926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:44.689537 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3357/6736] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:50.390159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:50.393191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:50.443950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdacc37-27f0-45c4-8c6b-e11391555194 tempest-RoutersAdminTest-1503520507 tempest-RoutersAdminTest-1503520507-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:50.460402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:50.463455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:50.469090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:50.469510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:50.476797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:50.565596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:50.751708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:50.752216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:50.753429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:50.773732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54fbf2-cf65-4255-9b34-997d5aedcc52 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:50.780209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:50.781023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:50.781444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:50.782852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:50.799462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:50.800616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3380/6737] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:50.836561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:50.840139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f656a-6fa3-4cd8-8646-05912ab42ad1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:50.860345 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3358/6738] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:51.115282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:51.116712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:51.239999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36edca9-1056-4315-93de-db313eeca6ee service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:51.245052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:51.245862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:51.246238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:51.246868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] PATH_INFO: `/v3/users/2879c269c66546329d7b2417e99a7d9c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:51.248207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2879c269c66546329d7b2417e99a7d9c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:51.250288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:51.313274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2879c269c66546329d7b2417e99a7d9c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:51.328802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2879c269c66546329d7b2417e99a7d9c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:51.330739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2879c269c66546329d7b2417e99a7d9c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:51.341832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2879c269c66546329d7b2417e99a7d9c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:51.342842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2879c269c66546329d7b2417e99a7d9c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:51.360752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3381/6739] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:51 2022] DELETE /identity/v3/users/2879c269c66546329d7b2417e99a7d9c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:51.365060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:51.365356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:51.365640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:51.387831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:51.389632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:51.463200 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3359/6740] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:51.475284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:51.476840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:51.510664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:51.563273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e084210-6def-444d-86d1-314050096ed5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:51.570106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ca6c0-2822-40de-9099-7869f5c78c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:51.570732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca6c0-2822-40de-9099-7869f5c78c74 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:51.571015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca6c0-2822-40de-9099-7869f5c78c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:51.571295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca6c0-2822-40de-9099-7869f5c78c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:51.584424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ca6c0-2822-40de-9099-7869f5c78c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:51.585933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ca6c0-2822-40de-9099-7869f5c78c74 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:51.598830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3382/6741] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:52.335492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:52.337091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:52.363127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71bab8-5d57-4c23-8582-bcd01fc2f55a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:52.384928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:52.387288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:52.389271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:52.389858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] PATH_INFO: `/v3/projects/9789e2e26a5e4679b6f83e0feff71c2c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:52.393502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9789e2e26a5e4679b6f83e0feff71c2c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:52.397995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:52.518005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9789e2e26a5e4679b6f83e0feff71c2c', 'request_id': 'req-36a697cd-bdc0-40c3-9549-178f54f77fef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:52.520103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:52.537342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9789e2e26a5e4679b6f83e0feff71c2c', 'request_id': 'req-36a697cd-bdc0-40c3-9549-178f54f77fef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:52.544434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9789e2e26a5e4679b6f83e0feff71c2c', 'request_id': 'req-36a697cd-bdc0-40c3-9549-178f54f77fef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:52.570739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] The token cache is being invalidate because project 9789e2e26a5e4679b6f83e0feff71c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:52.571047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:52.579188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36a697cd-bdc0-40c3-9549-178f54f77fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:52.581265 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3360/6742] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:52 2022] DELETE /identity/v3/projects/9789e2e26a5e4679b6f83e0feff71c2c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:56:52.589710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:52.590227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:52.590350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:52.635235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:52.638911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:52.794716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:52.794957 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3383/6743] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:52.795411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:52.795768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:52.833592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:52.834869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:52.877551 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3361/6744] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:52.878482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:52.895182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79d637-109c-4050-a968-9a3a58a64652 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:52.905481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:52.906111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:52.906576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:52.906849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:52.913270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:52.913766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:52.915579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:52.941354 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3384/6745] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:56:52.945795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:52.959890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e865-c751-405c-9204-8689eb4bfa47 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:52.968025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:52.969513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:52.970494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:52.970819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:52.971635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:52.981559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:53.065240 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3362/6746] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:52 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:53.070071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:53.093124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad63b8b-9371-42cc-83cc-993cc5ba6c9d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:53.258502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:53.259137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:53.259417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:53.259689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:53.260338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:53.262307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:53.316342 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3385/6747] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:53 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:56:53.321077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:53.358170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf88344-3cfd-4991-8f5f-a9769225d93d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:53.372251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:53.373203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:53.373658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:53.374177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:53.375170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:53.377752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:53.411639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3363/6748] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:53.416413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:53.440387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412821a-4583-4330-813b-656287b9e102 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:53.455142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf476db-945c-4e82-9736-44ca14b9b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:53.455786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf476db-945c-4e82-9736-44ca14b9b345 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:53.456069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf476db-945c-4e82-9736-44ca14b9b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:53.456349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf476db-945c-4e82-9736-44ca14b9b345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:53.457035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf476db-945c-4e82-9736-44ca14b9b345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:53.458650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf476db-945c-4e82-9736-44ca14b9b345 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:53.491490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:53.497411 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3386/6749] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:53.510929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f7dbf-2163-491e-aa87-64c887b69a4b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:53.528693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:53.529459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:53.529744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:53.530019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] PATH_INFO: `/v3/projects/9a61af1551654944b943320e816b9d62/users/323decb12a0d4bcca95089416bd6dbb8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:53.555492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a61af1551654944b943320e816b9d62, user_id=323decb12a0d4bcca95089416bd6dbb8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:53.558594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:53.598838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3364/6750] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:53 2022] PUT /identity/v3/projects/9a61af1551654944b943320e816b9d62/users/323decb12a0d4bcca95089416bd6dbb8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:53.599680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:53.600139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:53.600230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:53.671806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] MFA Rules not processed for user `323decb12a0d4bcca95089416bd6dbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:53.675100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:53.702168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:53.775732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:53.778548 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3387/6751] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:53.866733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f02554-3a9c-41c1-920b-078083ca124b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:53.873306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:53.874590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:53.875315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:53.877049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:53.878181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:53.881968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:53.960203 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3365/6752] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:56:53 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:56:53.964251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:53.989570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930159c0-1127-49b1-aba0-66b59c2a0fce None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:54.138566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:54.139205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:54.139486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:54.139876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:54.140525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:54.143494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:54.199308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3388/6753] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:56:53 2022] POST /identity/v3/users => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:56:54.202861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:54.224095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40656-7b88-462c-94ec-fa2828ad4d52 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:54.241661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:54.242379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:54.246649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:54.247074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:54.247963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:54.250690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:54.336854 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3366/6754] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:54.340983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:54.355457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69158336-dcb5-45e5-90bd-1ff494bc6852 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:54.385429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:54.386273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:54.390632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:54.390632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] PATH_INFO: `/v3/projects/1bbb6a98908c496889067d09fc2bef44/users/d4692ce20ff74371a6c0c53b0fb90c7a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:54.493508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbb6a98908c496889067d09fc2bef44, user_id=d4692ce20ff74371a6c0c53b0fb90c7a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:54.503050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:54.544939 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3389/6755] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:54 2022] PUT /identity/v3/projects/1bbb6a98908c496889067d09fc2bef44/users/d4692ce20ff74371a6c0c53b0fb90c7a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:54.547174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:54.566531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c2bf-5345-46c1-8f28-b55e533bd2aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:54.694836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:54.746684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c137a-9735-4211-a802-5aeda40cbc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:54.747739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c137a-9735-4211-a802-5aeda40cbc63 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:54.748841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c137a-9735-4211-a802-5aeda40cbc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:54.751818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c137a-9735-4211-a802-5aeda40cbc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:54.752751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c137a-9735-4211-a802-5aeda40cbc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:54.754885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c137a-9735-4211-a802-5aeda40cbc63 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:54.784857 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3367/6756] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:54.788485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:54.803045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c3dce-d001-415a-8705-264a6b390a44 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:54.820524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:54.821479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:54.821752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:54.822067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] PATH_INFO: `/v3/projects/1bbb6a98908c496889067d09fc2bef44/users/d4692ce20ff74371a6c0c53b0fb90c7a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:54.826750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbb6a98908c496889067d09fc2bef44, user_id=d4692ce20ff74371a6c0c53b0fb90c7a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:54.836968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:54.884875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3390/6757] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:56:54 2022] PUT /identity/v3/projects/1bbb6a98908c496889067d09fc2bef44/users/d4692ce20ff74371a6c0c53b0fb90c7a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:54.886626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:54.886999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:54.887397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.053923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] MFA Rules not processed for user `d4692ce20ff74371a6c0c53b0fb90c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:55.055196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:55.289982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.298017 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3368/6758] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:56:55.306173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0408-7133-4575-a86d-72bcbf6b5b6b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.318462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.319344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.319636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.319914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects/9a61af1551654944b943320e816b9d62` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.322754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:get_project(project_id=9a61af1551654944b943320e816b9d62)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.328602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:55.338415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.338633 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3391/6759] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:56:55 2022] GET /identity/v3/projects/9a61af1551654944b943320e816b9d62 => generated 389 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:55.354218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d97db-7f0a-4e75-aada-08f74552c4af None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.363673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.364308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.370045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.370197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.370855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.373746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:55.433902 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3369/6760] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 02:56:55 2022] POST /identity/v3/projects => generated 338 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:56:55.435016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.456283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d255cc3-6a3a-4fdf-a056-2f2e90806ed4 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.575743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.576803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.577320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.579198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.580231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.582792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:55.627287 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3392/6761] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 02:56:55 2022] GET /identity/v3/projects => generated 6912 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:55.633474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.650063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750d3f9-35d8-4515-82bf-43c55b89b1f5 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.665512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.666570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.667141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.667927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects/9a61af1551654944b943320e816b9d62` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.672667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:get_project(project_id=9a61af1551654944b943320e816b9d62)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.682019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:55.692389 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3370/6762] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:56:55 2022] GET /identity/v3/projects/9a61af1551654944b943320e816b9d62 => generated 389 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:55.694397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.700407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:55.717897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a061a9-a80a-4964-8358-8e28c98e6505 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.735108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.737492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.738053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.738588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects/74e8eabdda484ff6b044fc9d4483af2b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.745002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:get_project(project_id=74e8eabdda484ff6b044fc9d4483af2b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.748253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:55.758194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.759700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3393/6763] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:56:55 2022] GET /identity/v3/projects/74e8eabdda484ff6b044fc9d4483af2b => generated 338 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:55.775125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df4783-2bc1-4627-a59e-3b3d1d017aae tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.810649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.810919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.813196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.814086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.814801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.824968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:55.900065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3371/6764] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 02:56:55 2022] GET /identity/v3/projects => generated 6912 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:55.904734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:55.927511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf6fb-5d32-44ec-8827-bab12956804a tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:55.946660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:55.947293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:55.947582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:55.947865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:55.948558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:55.948871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:55.950967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:56.054524 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3394/6765] 10.222.0.16 () {58 vars in 1166 bytes} [Wed Oct 5 02:56:55 2022] GET /identity/v3/projects?domain_id=default => generated 6581 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:56.056286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:56.081818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d19a-f544-4373-bdfc-be72a908406d tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:56.096048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:56.096691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:56.097012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:56.097328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:56.098124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:56.104588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:56.144779 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3372/6766] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 02:56:56 2022] GET /identity/v3/projects => generated 6912 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:56.148649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:56.160877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb708-6e73-42cc-a0ef-0c0a23300899 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:56.166809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:56.168599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:56.168599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:56.169235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:56.177008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:56.177773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:56.181889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:56.216685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:56.230031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3395/6767] 10.222.0.16 () {58 vars in 1166 bytes} [Wed Oct 5 02:56:56 2022] GET /identity/v3/projects?domain_id=default => generated 6581 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:56.234565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97d3e4-7538-4e10-b3f6-7b80dcc9b8e1 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:56.241031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:56.242012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:56.242381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:56.242761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:56.243566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:56.246810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:56.279750 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3373/6768] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 02:56:56 2022] GET /identity/v3/projects => generated 6912 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:56:56.284919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:56.296462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475a470-0daa-4f9c-9f53-fa95eaa9a9cd tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:56.302654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:56.303336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:56.303691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:56.304279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:56.305076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1337321620) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:56:56.305476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:56.307712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:56.334675 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3396/6769] 10.222.0.16 () {58 vars in 1232 bytes} [Wed Oct 5 02:56:56 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1337321620 => generated 537 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:56:56.341070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:56.355958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b91611-e071-4aeb-87a1-450919698fc0 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:56.364421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4692ce20ff74371a6c0c53b0fb90c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bbb6a98908c496889067d09fc2bef44', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:56.365117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:56.365520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:56.365694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] PATH_INFO: `/v3/projects/74e8eabdda484ff6b044fc9d4483af2b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:56.366997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74e8eabdda484ff6b044fc9d4483af2b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:56.369880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:56.549074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e8eabdda484ff6b044fc9d4483af2b', 'request_id': 'req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:56.575548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e8eabdda484ff6b044fc9d4483af2b', 'request_id': 'req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:56.583483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:56.588579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e8eabdda484ff6b044fc9d4483af2b', 'request_id': 'req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:56.612723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] The token cache is being invalidate because project 74e8eabdda484ff6b044fc9d4483af2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:56.613071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:56.618768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e264b8a-df15-4a7f-bfd9-4e4fb1af62de tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:56.625257 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3374/6770] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:56 2022] DELETE /identity/v3/projects/74e8eabdda484ff6b044fc9d4483af2b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:56.628210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:56.631332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:56.829141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6eef9-2cce-4e76-a1be-28c0d59cd2d2 tempest-ListProjectsStaticTestJSON-1620863300 tempest-ListProjectsStaticTestJSON-1620863300-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:56.913772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:56.914571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:56.914862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:56.915142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] PATH_INFO: `/v3/users/323decb12a0d4bcca95089416bd6dbb8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:56.916329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323decb12a0d4bcca95089416bd6dbb8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:56.918428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:57.030332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323decb12a0d4bcca95089416bd6dbb8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:57.071857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323decb12a0d4bcca95089416bd6dbb8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:57.074838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323decb12a0d4bcca95089416bd6dbb8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:57.082888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:57.098330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323decb12a0d4bcca95089416bd6dbb8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:57.098961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41b9722a-8066-4a52-b493-b49e4a6eb8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323decb12a0d4bcca95089416bd6dbb8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:57.131794 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3397/6771] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:56 2022] DELETE /identity/v3/users/323decb12a0d4bcca95089416bd6dbb8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:57.135940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:57.136779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:57.137315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:57.182860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:57.184524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:57.522625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:57.523136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:57.523611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:57.560145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] MFA Rules not processed for user `a031e94db13d4e7e8947f51abc36d629`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:56:57.561749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:57.726171 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3375/6772] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:57.737485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:57.740038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:57.747962 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3398/6773] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:56:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:56:57.903148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfe17a-b85d-4b02-90e4-2741d2b910fe None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:57.911332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:57.912272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:57.912737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:57.913167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:57.937069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:57.943522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:57.964851 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3376/6774] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:56:58.605251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:58.606873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:56:58.638132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1586f9d-5f71-4213-8f18-3b5b346ff2db None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:58.672936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:58.673815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:58.675531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:58.676188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] PATH_INFO: `/v3/projects/9a61af1551654944b943320e816b9d62` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:58.682488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a61af1551654944b943320e816b9d62)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:58.684547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:58.806646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a61af1551654944b943320e816b9d62', 'request_id': 'req-7974470f-11a7-408e-a7e5-f21d56a65ce0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:58.814219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a61af1551654944b943320e816b9d62', 'request_id': 'req-7974470f-11a7-408e-a7e5-f21d56a65ce0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:58.829483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a61af1551654944b943320e816b9d62', 'request_id': 'req-7974470f-11a7-408e-a7e5-f21d56a65ce0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:58.857364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] The token cache is being invalidate because project 9a61af1551654944b943320e816b9d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:56:58.857816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:58.858639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:58.863456 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3399/6775] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:56:58 2022] DELETE /identity/v3/projects/9a61af1551654944b943320e816b9d62 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:56:58.867640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:56:58.886024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da5a8d-7dca-4f0f-b998-dd89aa87dc6c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:56:59.067396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:56:59.068176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:56:59.068564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:56:59.068971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] PATH_INFO: `/v3/users/d4692ce20ff74371a6c0c53b0fb90c7a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:56:59.073513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4692ce20ff74371a6c0c53b0fb90c7a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:56:59.075611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:56:59.213976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:56:59.258708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4692ce20ff74371a6c0c53b0fb90c7a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:59.295433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4692ce20ff74371a6c0c53b0fb90c7a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:59.296304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4692ce20ff74371a6c0c53b0fb90c7a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:59.325347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4692ce20ff74371a6c0c53b0fb90c7a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:59.326444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ef71d92-40fe-4361-834d-0db090337412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4692ce20ff74371a6c0c53b0fb90c7a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:56:59.368730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3377/6776] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:56:58 2022] DELETE /identity/v3/users/d4692ce20ff74371a6c0c53b0fb90c7a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:00.473555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:00.475672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:00.491988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974470f-11a7-408e-a7e5-f21d56a65ce0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:00.568536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:00.569251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:00.569537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:00.570587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] PATH_INFO: `/v3/projects/1bbb6a98908c496889067d09fc2bef44` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:00.571893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbb6a98908c496889067d09fc2bef44)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:00.575475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:00.600978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:00.694082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbb6a98908c496889067d09fc2bef44', 'request_id': 'req-90e54554-2bfc-4406-9337-f5f87d852f2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:00.710664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbb6a98908c496889067d09fc2bef44', 'request_id': 'req-90e54554-2bfc-4406-9337-f5f87d852f2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:00.723758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbb6a98908c496889067d09fc2bef44', 'request_id': 'req-90e54554-2bfc-4406-9337-f5f87d852f2c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:00.747147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] The token cache is being invalidate because project 1bbb6a98908c496889067d09fc2bef44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:00.747859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:00.750045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90e54554-2bfc-4406-9337-f5f87d852f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:00.757354 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3400/6777] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:00 2022] DELETE /identity/v3/projects/1bbb6a98908c496889067d09fc2bef44 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:00.759511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:00.760681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:00.761846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:00.791565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:00.793186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:00.918359 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3378/6778] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:00.926391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:00.927250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:00.927646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:00.968665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:00.972920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:00.995775 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3401/6779] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:00.996613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.013486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19aee-7784-46a6-80f6-1f5f01dc9e1a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.022178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.022781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.023062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.023655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.023969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:01.024269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.025879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:01.047214 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3379/6780] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:01.052943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.081943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915535b3-f978-4a33-8246-9d7cace92b0a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.086928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.087544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.087826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.088098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.088740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.091878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:01.172361 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3402/6781] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:01 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:01.176751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.194705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75cbf0-1d95-491e-960c-6853bb37eb17 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.365864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.369743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.370345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.370812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.371658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.379919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:01.436988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3380/6782] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:01 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:01.440813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.458004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb049f24-b36d-4a5c-9990-9ae17fb2cbb7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.473622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.475210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.475786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.477042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.478207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.480504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:01.503491 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3403/6783] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:01.505083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.517001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3854ef-420e-4f54-8fa5-3e427f6b17a3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.522256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c57f2-a851-457c-b291-d2b680d9522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.523017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c57f2-a851-457c-b291-d2b680d9522a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.523302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c57f2-a851-457c-b291-d2b680d9522a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.523573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c57f2-a851-457c-b291-d2b680d9522a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.524215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c57f2-a851-457c-b291-d2b680d9522a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.526083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c57f2-a851-457c-b291-d2b680d9522a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:01.541529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3381/6784] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:01.542819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.555338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319055a-6aeb-4586-9e82-6da7587130ea admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.570199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.570893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.571932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.572227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] PATH_INFO: `/v3/projects/87539cef8333477b88ee917abb52f130/users/722ac05bb9484b87863f44eaeefc2946/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.605273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87539cef8333477b88ee917abb52f130, user_id=722ac05bb9484b87863f44eaeefc2946, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.607950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:01.644386 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3404/6785] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:01 2022] PUT /identity/v3/projects/87539cef8333477b88ee917abb52f130/users/722ac05bb9484b87863f44eaeefc2946/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:01.658412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.658704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.658979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.721734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] MFA Rules not processed for user `722ac05bb9484b87863f44eaeefc2946`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:01.723006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:01.729778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:01.879805 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3382/6786] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:01.884055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:01.986129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fb762-a155-4c91-9830-9117a04bb0e9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:01.991597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:01.992459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:01.992991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:01.993609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:01.994468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:01.996650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:02.042055 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3405/6787] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:01 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:02.045394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:02.061869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d63ae-adf0-4581-858b-1ed41459554d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:02.189626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:02.193609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:02.193902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:02.194189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:02.195025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:02.198209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:02.248025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3383/6788] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:02 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:02.256067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:02.267965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169343a-e059-448b-888c-de367079ef83 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:02.289353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:02.289983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:02.290263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:02.290545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:02.291197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:02.292812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:02.321007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3406/6789] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:02.321597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:02.341145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83aaf5-2299-4892-8e1f-f5630bfe6b58 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:02.350669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:02.351360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:02.351881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:02.352166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] PATH_INFO: `/v3/projects/ab8ab023a1e64afdbb4935bb11cf2c12/users/4767616244b5416eb3bd0474540974d3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:02.379386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8ab023a1e64afdbb4935bb11cf2c12, user_id=4767616244b5416eb3bd0474540974d3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:02.382528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:02.452816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3384/6790] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:02 2022] PUT /identity/v3/projects/ab8ab023a1e64afdbb4935bb11cf2c12/users/4767616244b5416eb3bd0474540974d3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:02.457795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:02.473804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d0c23-6c5b-4a79-b6b3-19e705ce953b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:02.486276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:02.647455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faff4c7-3792-4f13-a162-c394b526c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:02.648221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faff4c7-3792-4f13-a162-c394b526c330 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:02.654887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faff4c7-3792-4f13-a162-c394b526c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:02.654887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faff4c7-3792-4f13-a162-c394b526c330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:02.654887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faff4c7-3792-4f13-a162-c394b526c330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:02.663050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faff4c7-3792-4f13-a162-c394b526c330 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:02.694948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3407/6791] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:02.697801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:02.715599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a0bf-da0d-43d4-9408-eee34f6efc84 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:02.727639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:02.728446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:02.729062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:02.730856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] PATH_INFO: `/v3/projects/ab8ab023a1e64afdbb4935bb11cf2c12/users/4767616244b5416eb3bd0474540974d3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:02.736946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8ab023a1e64afdbb4935bb11cf2c12, user_id=4767616244b5416eb3bd0474540974d3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:02.741947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:02.768541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3385/6792] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:02 2022] PUT /identity/v3/projects/ab8ab023a1e64afdbb4935bb11cf2c12/users/4767616244b5416eb3bd0474540974d3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:02.778696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:02.778988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:02.779269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:02.854638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] MFA Rules not processed for user `4767616244b5416eb3bd0474540974d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:02.856808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:03.385893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3408/6793] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:03.391349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:03.416630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36639630-0dc3-4a48-9d56-eeb768f51832 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:03.428387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:03.429522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:03.429938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:03.430220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:03.430865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:03.439433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:03.572419 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3386/6794] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:03 2022] POST /identity/v3/projects => generated 359 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:03.573795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:03.590267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d07bae-92a2-4324-9be5-4e618f974ff2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:03.750391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:03.752884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:03.752884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:03.755208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:03.756077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:03.757982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:03.819644 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3409/6795] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:03 2022] POST /identity/v3/users => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:03.821144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:03.836434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4f7d8-2a93-405c-b657-fc80bab29fce tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:03.841639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:03.842301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:03.842580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:03.842854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/dd5fea941eba472e9a7a86a8c8069b94` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:03.879479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:get_user(user_id=dd5fea941eba472e9a7a86a8c8069b94)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:03.882338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:03.887104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3387/6796] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:57:03 2022] GET /identity/v3/users/dd5fea941eba472e9a7a86a8c8069b94 => generated 373 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:03.888855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:03.905751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59a3e0-b76c-47fd-8cda-bc01e188b7e4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:03.911365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:03.912167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:03.912455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:03.912732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/dd5fea941eba472e9a7a86a8c8069b94` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:03.913972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dd5fea941eba472e9a7a86a8c8069b94)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:03.916260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:03.944231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:03.981164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5fea941eba472e9a7a86a8c8069b94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.000246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5fea941eba472e9a7a86a8c8069b94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.003225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5fea941eba472e9a7a86a8c8069b94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.018154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5fea941eba472e9a7a86a8c8069b94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.019352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5fea941eba472e9a7a86a8c8069b94'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.044137 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3410/6797] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:03 2022] DELETE /identity/v3/users/dd5fea941eba472e9a7a86a8c8069b94 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:04.044935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.047225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:04.072886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583389-85fb-4af8-b989-731f101b843a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.097451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:04.180696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.181862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.182766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.183261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/3ee1a521e2d54a32b14aecf0e5b620bb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.185157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ee1a521e2d54a32b14aecf0e5b620bb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.187966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:04.256491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee1a521e2d54a32b14aecf0e5b620bb', 'request_id': 'req-3abad49b-1b39-4f78-8490-289258bf4424'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.271422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee1a521e2d54a32b14aecf0e5b620bb', 'request_id': 'req-3abad49b-1b39-4f78-8490-289258bf4424'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.286965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee1a521e2d54a32b14aecf0e5b620bb', 'request_id': 'req-3abad49b-1b39-4f78-8490-289258bf4424'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.307470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] The token cache is being invalidate because project 3ee1a521e2d54a32b14aecf0e5b620bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:04.307966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.308861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:04.315071 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3388/6798] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:04 2022] DELETE /identity/v3/projects/3ee1a521e2d54a32b14aecf0e5b620bb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:04.316802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.333114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a9fa-72e5-4ae7-80bd-4e5895a2d567 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.426628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.430008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.430548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.431184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.432230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.434383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:04.495522 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3411/6799] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:04 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:04.497247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.510151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:04.547558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abad49b-1b39-4f78-8490-289258bf4424 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.729943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.731307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.731972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.732473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.733530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.736815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:04.787212 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3389/6800] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:04 2022] POST /identity/v3/users => generated 417 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:04.791595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.805049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd852dc-529d-4a82-a587-1c581bef814b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.812011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.813001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.813424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.813847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.814762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.817004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:04.844439 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3412/6801] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:57:04 2022] POST /identity/v3/roles => generated 238 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:04.851167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.863996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ba28c-4510-4257-94da-b15043a2ea36 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.869422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.870215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.870596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.870969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/166befcd5f7841e6b0561c9cf581b064` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.888117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:get_user(user_id=166befcd5f7841e6b0561c9cf581b064)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.890557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:04.897882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.915913 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3390/6802] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:57:04 2022] GET /identity/v3/users/166befcd5f7841e6b0561c9cf581b064 => generated 417 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:04.920879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094be02-5790-4deb-964b-2b3ce9131c10 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.935172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.935549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.935899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.936243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/roles/2d8a370aad8e4595bfc505c1892d42cc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.938716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:get_role(role_id=2d8a370aad8e4595bfc505c1892d42cc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.942568 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:57:04.942568 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:57:04.942568 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:57:04.942568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:04.947215 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3413/6803] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:57:04 2022] GET /identity/v3/roles/2d8a370aad8e4595bfc505c1892d42cc => generated 238 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:04.951541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:04.974420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93db4e-89a7-4341-873c-dadf4ce86f6b tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:04.979341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:04.979961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:04.980240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:04.980517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:04.981216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:04.983190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.021988 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3391/6804] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:04 2022] POST /identity/v3/projects => generated 358 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:05.025821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.037207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13edf-0472-4bf0-8d68-9a65fe2a37c1 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.143417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.144698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.145124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.145880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/c14e2c03a8e84f18b485bdef24f83232` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.147784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:get_project(project_id=c14e2c03a8e84f18b485bdef24f83232)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.151468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.157480 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3414/6805] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:57:05 2022] GET /identity/v3/projects/c14e2c03a8e84f18b485bdef24f83232 => generated 358 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:05.159988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.166314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:05.175866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ee956-1e71-4c98-b96a-b350d682de55 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.181925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.182634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.184486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.184804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/c14e2c03a8e84f18b485bdef24f83232/users/166befcd5f7841e6b0561c9cf581b064/roles/2d8a370aad8e4595bfc505c1892d42cc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.187483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c14e2c03a8e84f18b485bdef24f83232, user_id=166befcd5f7841e6b0561c9cf581b064, role_id=2d8a370aad8e4595bfc505c1892d42cc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.192776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.212714 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3392/6806] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:05 2022] PUT /identity/v3/projects/c14e2c03a8e84f18b485bdef24f83232/users/166befcd5f7841e6b0561c9cf581b064/roles/2d8a370aad8e4595bfc505c1892d42cc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:05.214392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.240807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a88eb-c0b5-490e-aeed-2339d687f2e6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.245438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:05.326619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.327272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.327559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.327838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.328474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.331088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.370909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3415/6807] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:05 2022] POST /identity/v3/projects => generated 359 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:05.372937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.385250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b85d1-7143-4071-b7d7-544ada3776dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.475417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.476076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.476366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.476807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/2d1cb65fb8c54d00bc5e061be4eca297` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.478165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:get_project(project_id=2d1cb65fb8c54d00bc5e061be4eca297)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.482171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.485354 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3393/6808] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 02:57:05 2022] GET /identity/v3/projects/2d1cb65fb8c54d00bc5e061be4eca297 => generated 359 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:05.490125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.510259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fb20c-6492-4c50-8d1b-e7a1a95945ec tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.530929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.531705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.532010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.532352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/2d1cb65fb8c54d00bc5e061be4eca297/users/166befcd5f7841e6b0561c9cf581b064/roles/2d8a370aad8e4595bfc505c1892d42cc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.535116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d1cb65fb8c54d00bc5e061be4eca297, user_id=166befcd5f7841e6b0561c9cf581b064, role_id=2d8a370aad8e4595bfc505c1892d42cc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.540647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.578497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3416/6809] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:05 2022] PUT /identity/v3/projects/2d1cb65fb8c54d00bc5e061be4eca297/users/166befcd5f7841e6b0561c9cf581b064/roles/2d8a370aad8e4595bfc505c1892d42cc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:05.580947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.591627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3260-71a7-43ba-9e26-fb9e8639bfc6 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.702266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.703714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.705424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.705860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/166befcd5f7841e6b0561c9cf581b064/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.707306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=166befcd5f7841e6b0561c9cf581b064)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.710304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.776193 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3394/6810] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 02:57:05 2022] GET /identity/v3/users/166befcd5f7841e6b0561c9cf581b064/projects => generated 841 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:05.779982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.794025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716ca5e-d83c-4416-819d-6c9eae9ab570 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:05.802400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:05.802967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:05.803261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:05.803544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/2d1cb65fb8c54d00bc5e061be4eca297` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:05.805657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d1cb65fb8c54d00bc5e061be4eca297)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:05.807612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:05.897218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1cb65fb8c54d00bc5e061be4eca297', 'request_id': 'req-b2bff0da-fb21-4ac6-a45e-795e18a190d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:05.903726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1cb65fb8c54d00bc5e061be4eca297', 'request_id': 'req-b2bff0da-fb21-4ac6-a45e-795e18a190d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:05.913228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1cb65fb8c54d00bc5e061be4eca297', 'request_id': 'req-b2bff0da-fb21-4ac6-a45e-795e18a190d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:05.937486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] The token cache is being invalidate because project 2d1cb65fb8c54d00bc5e061be4eca297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:05.939702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:05.940182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:05.944060 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3417/6811] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:05 2022] DELETE /identity/v3/projects/2d1cb65fb8c54d00bc5e061be4eca297 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:05.948237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:05.950774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:05.973292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68b547-f71b-4966-ba81-33772bdabfb5 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:06.052566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:06.053542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:06.053542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:06.054123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/c14e2c03a8e84f18b485bdef24f83232` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:06.055337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c14e2c03a8e84f18b485bdef24f83232)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:06.057520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:06.060984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:06.151976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14e2c03a8e84f18b485bdef24f83232', 'request_id': 'req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.169867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14e2c03a8e84f18b485bdef24f83232', 'request_id': 'req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.180147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14e2c03a8e84f18b485bdef24f83232', 'request_id': 'req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.200135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] The token cache is being invalidate because project c14e2c03a8e84f18b485bdef24f83232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:06.200494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.202515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.205364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3395/6812] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:05 2022] DELETE /identity/v3/projects/c14e2c03a8e84f18b485bdef24f83232 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:06.209323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:06.221410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff0da-fb21-4ac6-a45e-795e18a190d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:06.355428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:06.356848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:06.358036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:06.358338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/roles/2d8a370aad8e4595bfc505c1892d42cc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:06.360774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2d8a370aad8e4595bfc505c1892d42cc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:06.363848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:06.366910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:06.432091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invalidating the token cache because role 2d8a370aad8e4595bfc505c1892d42cc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:06.432582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.433338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.437963 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3418/6813] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:06 2022] DELETE /identity/v3/roles/2d8a370aad8e4595bfc505c1892d42cc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:06.443733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:06.445974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:06.482402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f0c5-f69b-4a6b-8d28-de5944e8c1dd tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:06.578888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:06.579754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:06.580180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:06.580558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/166befcd5f7841e6b0561c9cf581b064` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:06.581920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_user(user_id=166befcd5f7841e6b0561c9cf581b064)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:06.584107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:06.646946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166befcd5f7841e6b0561c9cf581b064'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.704785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166befcd5f7841e6b0561c9cf581b064'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.714619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166befcd5f7841e6b0561c9cf581b064'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.726084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166befcd5f7841e6b0561c9cf581b064'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.727173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166befcd5f7841e6b0561c9cf581b064'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.751800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:06.752363 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3396/6814] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:06 2022] DELETE /identity/v3/users/166befcd5f7841e6b0561c9cf581b064 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:06.753539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:06.771931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6825628-6122-449c-b7b8-72c7d225e387 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:06.849166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:06.850814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:06.851274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:06.852085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/6b6a13eaad894e73b08c58b4a74e86d5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:06.854830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b6a13eaad894e73b08c58b4a74e86d5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:06.856870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:06.923919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6a13eaad894e73b08c58b4a74e86d5', 'request_id': 'req-bce91243-e560-4ff4-97ed-d396f1aa4ef2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.930679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6a13eaad894e73b08c58b4a74e86d5', 'request_id': 'req-bce91243-e560-4ff4-97ed-d396f1aa4ef2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.938016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6a13eaad894e73b08c58b4a74e86d5', 'request_id': 'req-bce91243-e560-4ff4-97ed-d396f1aa4ef2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.967014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] The token cache is being invalidate because project 6b6a13eaad894e73b08c58b4a74e86d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:06.967384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.968118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bce91243-e560-4ff4-97ed-d396f1aa4ef2 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:06.970138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3419/6815] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:06 2022] DELETE /identity/v3/projects/6b6a13eaad894e73b08c58b4a74e86d5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:06.975646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:06.977640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:06.992057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee2fde-99c9-4173-b214-33ad74173ece tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:07.002211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:07.060882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:07.061551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.061835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.062112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/722ac05bb9484b87863f44eaeefc2946` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.063406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:update_user(user_id=722ac05bb9484b87863f44eaeefc2946)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:07.065382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:07.103153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.113676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invalidating the token cache because user 722ac05bb9484b87863f44eaeefc2946 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:07.114511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.115146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.117238 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3397/6816] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 5 02:57:06 2022] PATCH /identity/v3/users/722ac05bb9484b87863f44eaeefc2946 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:07.121807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.122257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.124109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.158642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] MFA Rules not processed for user `722ac05bb9484b87863f44eaeefc2946`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:07.160052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:07.163467 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3420/6817] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:07 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:57:07.167671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:07.169197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:07.183647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4c34-edf0-4e8b-a34d-acb0e5691b9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:07.187741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:07.189029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.189492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.189998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/722ac05bb9484b87863f44eaeefc2946` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.191710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:update_user(user_id=722ac05bb9484b87863f44eaeefc2946)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:07.193691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:07.233344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.243604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invalidating the token cache because user 722ac05bb9484b87863f44eaeefc2946 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:07.243902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.244718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ccef4b38-3ce2-475b-be80-4f2f23b42c9f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.246784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3398/6818] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 5 02:57:07 2022] PATCH /identity/v3/users/722ac05bb9484b87863f44eaeefc2946 => generated 297 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:07.250611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:07.263684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e6ae0-82c6-49cd-add3-cbe1e0fee718 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:07.269624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:07.270287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.270568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.270847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/722ac05bb9484b87863f44eaeefc2946` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.286921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:update_user(user_id=722ac05bb9484b87863f44eaeefc2946)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:07.288012 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 05 02:57:07.288012 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 02:57:07.288012 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 02:57:07.289368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:07.326853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.328830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:07.338996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invalidating the token cache because user 722ac05bb9484b87863f44eaeefc2946 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:07.339560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.340849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.348221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.348565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.348857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.352955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3421/6819] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 5 02:57:07 2022] PATCH /identity/v3/users/722ac05bb9484b87863f44eaeefc2946 => generated 297 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:07.391769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] MFA Rules not processed for user `722ac05bb9484b87863f44eaeefc2946`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:07.392986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:07.396307 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3399/6820] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:07 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:57:07.400811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:07.402402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:07.417428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdfd3d-6ab2-407d-8619-e8e108518852 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:07.423881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:07.424632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.425064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.425226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/722ac05bb9484b87863f44eaeefc2946` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.426520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:update_user(user_id=722ac05bb9484b87863f44eaeefc2946)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:07.429672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:07.468447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.487745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invalidating the token cache because user 722ac05bb9484b87863f44eaeefc2946 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:07.488011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.489340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.492087 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3422/6821] 10.222.0.16 () {60 vars in 1243 bytes} [Wed Oct 5 02:57:07 2022] PATCH /identity/v3/users/722ac05bb9484b87863f44eaeefc2946 => generated 297 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:07.497408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:07.523127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c5755-e9c3-4171-b137-4f6eddc7c442 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:07.527621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c2028-6c4b-4cbc-9d3c-689659a4a9a4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:07.528357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2028-6c4b-4cbc-9d3c-689659a4a9a4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.528735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2028-6c4b-4cbc-9d3c-689659a4a9a4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.529191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c2028-6c4b-4cbc-9d3c-689659a4a9a4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.529919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2028-6c4b-4cbc-9d3c-689659a4a9a4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:07.531892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c2028-6c4b-4cbc-9d3c-689659a4a9a4 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:07.568382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:07.570230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:07.572563 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3400/6822] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 02:57:07 2022] POST /identity/v3/users => generated 265 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:07.586358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53a8e7-368d-4dc6-b225-cffcd46411d3 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:07.591729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:07.592511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:07.592894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:07.593342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/83a0266e02444bb7bc787d5ffd77216a/password` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:07.667405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '83a0266e02444bb7bc787d5ffd77216a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:07.681473 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3423/6823] 10.222.0.16 () {60 vars in 1269 bytes} [Wed Oct 5 02:57:07 2022] POST /identity/v3/users/83a0266e02444bb7bc787d5ffd77216a/password => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:08.688042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:08.689615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:08.689982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:08.711845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] MFA Rules not processed for user `83a0266e02444bb7bc787d5ffd77216a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:08.713545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:08.719829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3401/6824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:08 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 05 02:57:08.721755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:08.735375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550f7c-8231-4fe2-ab65-a805cfce1fd0 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:08.741881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:08.742716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:08.743175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:08.743634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:08.750514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:08.753680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:08.760459 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3424/6825] 10.222.0.16 () {56 vars in 1263 bytes} [Wed Oct 5 02:57:08 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 05 02:57:08.764740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:08.778432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a518f7-7fbe-455e-af06-6d78e0268469 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:08.784213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:08.785110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:08.785387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:08.785729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/83a0266e02444bb7bc787d5ffd77216a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:08.786985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_user(user_id=83a0266e02444bb7bc787d5ffd77216a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:08.789216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:08.845657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a0266e02444bb7bc787d5ffd77216a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:08.863007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a0266e02444bb7bc787d5ffd77216a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:08.863879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a0266e02444bb7bc787d5ffd77216a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:08.869098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=78,keystone:UPDATE=2,keystone:INSERT=8,keystone:DELETE=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:08.877278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a0266e02444bb7bc787d5ffd77216a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:08.878106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a0266e02444bb7bc787d5ffd77216a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:08.900992 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3402/6826] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:08 2022] DELETE /identity/v3/users/83a0266e02444bb7bc787d5ffd77216a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:08.902195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:08.913748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4686c3-24a5-4b40-88d8-0fb76a30cae8 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:08.977577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:08.978369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:08.978822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:08.979184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:08.979926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:08.982016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.013575 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3425/6827] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:08 2022] POST /identity/v3/users => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:09.017955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:09.019460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:09.034361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc2cce-3a31-4f39-9095-48eb0d09283f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:09.039319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:09.039941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.040231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.040514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.041229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:09.043074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.086456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:09.087240 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3403/6828] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:09 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:09.099816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850df6d-61c2-49e6-b9cf-e85c46de7e84 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:09.159688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=8,keystone:DELETE=4,keystone:SELECT=86,keystone:UPDATE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:09.176180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:09.177263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.177730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.178081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/6c3a074e352941e38350c8bf0e6f72a1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.195093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:update_user(user_id=6c3a074e352941e38350c8bf0e6f72a1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:09.197583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.234275 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3426/6829] 10.222.0.16 () {60 vars in 1244 bytes} [Wed Oct 5 02:57:09 2022] PATCH /identity/v3/users/6c3a074e352941e38350c8bf0e6f72a1 => generated 523 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:09.238878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:09.250499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bce742-599f-4862-9a6c-780fe6665278 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:09.255914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:09.256546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.256829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.257141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/6c3a074e352941e38350c8bf0e6f72a1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.276820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:get_user(user_id=6c3a074e352941e38350c8bf0e6f72a1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:09.279646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.281668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3404/6830] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Oct 5 02:57:09 2022] GET /identity/v3/users/6c3a074e352941e38350c8bf0e6f72a1 => generated 389 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:09.286867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:09.299296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1ba1-1704-4987-abe0-9accd9a4ca0f tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:09.306250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:09.307042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.307397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.307745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/projects/8226a2a0228a40729834697e071f9b0e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.308991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8226a2a0228a40729834697e071f9b0e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:09.310997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.365991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8226a2a0228a40729834697e071f9b0e', 'request_id': 'req-309dd964-0e6f-49e2-89fc-63bb8538a046'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.373305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8226a2a0228a40729834697e071f9b0e', 'request_id': 'req-309dd964-0e6f-49e2-89fc-63bb8538a046'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.383266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8226a2a0228a40729834697e071f9b0e', 'request_id': 'req-309dd964-0e6f-49e2-89fc-63bb8538a046'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.399343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] The token cache is being invalidate because project 8226a2a0228a40729834697e071f9b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:09.399641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.400395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.402036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3427/6831] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:09 2022] DELETE /identity/v3/projects/8226a2a0228a40729834697e071f9b0e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:09.406550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:09.409476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:09.423371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fb8dc-5dcb-46a0-a7de-ca48d11f949a tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:09.491438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4767616244b5416eb3bd0474540974d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:09.492112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.492318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.492593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] PATH_INFO: `/v3/users/6c3a074e352941e38350c8bf0e6f72a1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.493826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6c3a074e352941e38350c8bf0e6f72a1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:09.495838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.550686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3a074e352941e38350c8bf0e6f72a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.578547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3a074e352941e38350c8bf0e6f72a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.579785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3a074e352941e38350c8bf0e6f72a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.589172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3a074e352941e38350c8bf0e6f72a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.590041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbe57c80-ade3-4557-8e22-925793832e7d tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3a074e352941e38350c8bf0e6f72a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.605851 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3405/6832] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:09 2022] DELETE /identity/v3/users/6c3a074e352941e38350c8bf0e6f72a1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:09.611779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:09.613627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:09.729677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309dd964-0e6f-49e2-89fc-63bb8538a046 tempest-UsersV3TestJSON-1555120982 tempest-UsersV3TestJSON-1555120982-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:09.792673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:09.805214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:09.806270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.806771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.807526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] PATH_INFO: `/v3/users/722ac05bb9484b87863f44eaeefc2946` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.825135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] RBAC: Authorizing `identity:delete_user(user_id=722ac05bb9484b87863f44eaeefc2946)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:09.826884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:09.887436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.906998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.907733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.917689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.918738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722ac05bb9484b87863f44eaeefc2946'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:09.934552 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3428/6833] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:09 2022] DELETE /identity/v3/users/722ac05bb9484b87863f44eaeefc2946 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:09.940315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:09.940943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:09.941045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:09.964315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:09.965708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:09.992508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:10.037694 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3406/6834] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:10.048713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:10.050191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:10.111937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66f90d-112a-45fe-afb8-17ee4f8588db admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:10.115724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:10.116355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:10.116637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:10.116935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:10.127449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:10.128946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:10.139692 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3429/6835] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:10.447652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:10.452210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:10.465625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8eb857-fa7b-4cc7-8885-02438ce3a548 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:10.471971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:10.472662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:10.472996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:10.473259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] PATH_INFO: `/v3/projects/87539cef8333477b88ee917abb52f130` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:10.474884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87539cef8333477b88ee917abb52f130)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:10.477004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:10.547496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87539cef8333477b88ee917abb52f130', 'request_id': 'req-6ec9b876-914f-4824-88eb-2a474fd39a93'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.560076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87539cef8333477b88ee917abb52f130', 'request_id': 'req-6ec9b876-914f-4824-88eb-2a474fd39a93'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.569389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87539cef8333477b88ee917abb52f130', 'request_id': 'req-6ec9b876-914f-4824-88eb-2a474fd39a93'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.585289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] The token cache is being invalidate because project 87539cef8333477b88ee917abb52f130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:10.585616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.591625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.593799 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3407/6836] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:10 2022] DELETE /identity/v3/projects/87539cef8333477b88ee917abb52f130 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:10.598340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:10.612949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837a1e-61fd-408c-8fb0-6bf55726f057 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:10.723420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:10.724064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:10.724348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:10.724651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] PATH_INFO: `/v3/users/4767616244b5416eb3bd0474540974d3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:10.725906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4767616244b5416eb3bd0474540974d3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:10.727836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:10.730589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:10.832266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4767616244b5416eb3bd0474540974d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.862462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4767616244b5416eb3bd0474540974d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.863951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4767616244b5416eb3bd0474540974d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.879259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4767616244b5416eb3bd0474540974d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.880651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9084f5b3-910c-4248-abc2-fb55a4926ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4767616244b5416eb3bd0474540974d3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:10.903874 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3430/6837] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:10 2022] DELETE /identity/v3/users/4767616244b5416eb3bd0474540974d3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:11.380303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:11.382442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:11.408257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9b876-914f-4824-88eb-2a474fd39a93 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:11.552049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:11.553000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:11.553690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:11.554118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] PATH_INFO: `/v3/projects/ab8ab023a1e64afdbb4935bb11cf2c12` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:11.555395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8ab023a1e64afdbb4935bb11cf2c12)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:11.557751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:11.620005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'request_id': 'req-7294de89-b578-4d43-aa3a-0f35257f7d37'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:11.625383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:11.634428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'request_id': 'req-7294de89-b578-4d43-aa3a-0f35257f7d37'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:11.646066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8ab023a1e64afdbb4935bb11cf2c12', 'request_id': 'req-7294de89-b578-4d43-aa3a-0f35257f7d37'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:11.668013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] The token cache is being invalidate because project ab8ab023a1e64afdbb4935bb11cf2c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:11.668481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:11.669444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7294de89-b578-4d43-aa3a-0f35257f7d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:11.671503 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3408/6838] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:11 2022] DELETE /identity/v3/projects/ab8ab023a1e64afdbb4935bb11cf2c12 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:11.676320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:11.676609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:11.677474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:11.701870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:11.703376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:11.787814 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3431/6839] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:11.796165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:11.796592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:11.797005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:11.825994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:11.827378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:11.841514 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3409/6840] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:11.843136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:11.854250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4745f8f-9cf8-496f-ac42-7883a4c75a17 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:11.859438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:11.860096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:11.860742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:11.861050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:11.861920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:11.862232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:11.863831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:11.881080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3432/6841] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:11.882203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:11.895241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e696891-5316-4354-a2cf-5bcf521ec647 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:11.900976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:11.901765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:11.902056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:11.902330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:11.903046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:11.904981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:11.963216 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3410/6842] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:11 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:11.964555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:11.976781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3732c8-6ea2-4de5-bebf-39dc46a40c22 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.080587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.082018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.082534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.083157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.084058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.086679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.109304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:12.121573 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3433/6843] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:11 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:12.125288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.141169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61c5d-3598-4d55-81a5-281d16cb7718 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.148122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.149328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.149966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.150469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.151541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.153953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.169267 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3411/6844] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:12.173165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.187516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b397-834a-4c48-95ed-81dca48edd81 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.194062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33b106-24dc-4f16-9e92-3fad79422cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.194699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33b106-24dc-4f16-9e92-3fad79422cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.195135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33b106-24dc-4f16-9e92-3fad79422cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.195426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33b106-24dc-4f16-9e92-3fad79422cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.196088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33b106-24dc-4f16-9e92-3fad79422cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.197794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33b106-24dc-4f16-9e92-3fad79422cd0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.212795 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3434/6845] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:12.217398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.232772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696339e6-b9d7-47cd-a5df-230e195419f0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.247330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.248345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.248793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.249251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] PATH_INFO: `/v3/projects/afe5e4b070c04150a1fde07658fabb1a/users/480d446fe2bc4c02ad790632eb06283f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.274408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe5e4b070c04150a1fde07658fabb1a, user_id=480d446fe2bc4c02ad790632eb06283f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.278275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.321544 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3412/6846] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:12 2022] PUT /identity/v3/projects/afe5e4b070c04150a1fde07658fabb1a/users/480d446fe2bc4c02ad790632eb06283f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:12.332814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.333121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.333704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.429026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] MFA Rules not processed for user `480d446fe2bc4c02ad790632eb06283f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:12.434017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:12.569768 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3435/6847] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:12.575086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.589261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7d944-9d58-4f6f-bebe-0937a3b8deee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.595706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.596388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.596680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.597021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.597709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:create_application_credential(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.599069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.748289 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3413/6848] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 5 02:57:12 2022] POST /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials => generated 920 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:12.753104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.763119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c35603-7dc9-4303-b48b-0ebe5b7ce229 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.768775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.769498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.769780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.770055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules/c0c4f0cf4ef548a8b0ca6f4e62c277e7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.771224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:delete_access_rule(user_id=480d446fe2bc4c02ad790632eb06283f, access_rule_id=c0c4f0cf4ef548a8b0ca6f4e62c277e7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.772571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application session.delete(ref) Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application yield resource Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application next(self.gen) Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.session.rollback() Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.force_reraise() Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 02:57:12.810455 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise self.value Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application session.commit() Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._prepare_impl() Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.session.flush() Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._flush(objects) Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 02:57:12.812048 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application compat.raise_( Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application flush_context.execute() Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rec.execute(self) Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self._synchronize( Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise AssertionError( Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 05 02:57:12.813060 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 02:57:12.814195 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 02:57:12.815389 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3436/6849] 10.222.0.16 () {58 vars in 1362 bytes} [Wed Oct 5 02:57:12 2022] DELETE /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules/c0c4f0cf4ef548a8b0ca6f4e62c277e7 => generated 89 bytes in 59 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 05 02:57:12.815843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.825746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c605d2c-5b6d-4c22-a5ca-f144007a223a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.831088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.831864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.832287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.832722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials/77ddd9d927ab4225b4de4fd55e485b41` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.845352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:delete_application_credential(user_id=480d446fe2bc4c02ad790632eb06283f, application_credential_id=77ddd9d927ab4225b4de4fd55e485b41)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.847043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.874995 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3414/6850] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 02:57:12 2022] DELETE /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials/77ddd9d927ab4225b4de4fd55e485b41 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:12.880248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.890581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae992a-635e-4fb7-902f-b3d44153111d tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.895200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.896003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.896360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.896707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.898021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:list_access_rules(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.899667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.906306 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3437/6851] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:57:12 2022] GET /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules => generated 369 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:12.910293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.922065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dd23c-58a8-42d2-893a-6ebc9b717f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:12.926629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:12.927414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:12.927817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:12.928171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules/c0c4f0cf4ef548a8b0ca6f4e62c277e7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:12.929459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:delete_access_rule(user_id=480d446fe2bc4c02ad790632eb06283f, access_rule_id=c0c4f0cf4ef548a8b0ca6f4e62c277e7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:12.931054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:12.959181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3415/6852] 10.222.0.16 () {58 vars in 1362 bytes} [Wed Oct 5 02:57:12 2022] DELETE /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules/c0c4f0cf4ef548a8b0ca6f4e62c277e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:12.960771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:12.988828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bfccb-a939-4895-adab-4b2baf79e2c1 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:13.007162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:13.007983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.008380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.008803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:13.017975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:list_access_rules(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:13.017975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:13.029596 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3438/6853] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:57:12 2022] GET /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules => generated 158 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:13.039793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:13.045979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:13.058746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205470-e864-49f3-84c9-c63055e3fadd tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:13.072064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:13.072854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.073265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.074486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:13.075435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:create_application_credential(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:13.079000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:13.214296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3416/6854] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 5 02:57:13 2022] POST /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials => generated 920 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:13.218845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:13.231119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cf29b-17c1-48ff-8a5a-890d370b5f09 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:13.244937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:13.244937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.244937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.245471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:13.245601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:list_access_rules(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:13.247112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:13.262276 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3439/6855] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Oct 5 02:57:13 2022] GET /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules => generated 369 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:13.267910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:13.278517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9fcaa-dd50-47eb-a4b8-22e40fcb929b tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:13.283972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:13.284694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.285103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.285447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:13.286250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:create_application_credential(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:13.287743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:13.395032 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3417/6856] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 5 02:57:13 2022] POST /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/application_credentials => generated 921 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:13.395977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:13.407443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389c3af-b9c4-4319-bc19-5eacd4483f2a tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:13.412662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be14fbd-2e0d-4427-af67-af2d4967ee85 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '480d446fe2bc4c02ad790632eb06283f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe5e4b070c04150a1fde07658fabb1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:13.413695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14fbd-2e0d-4427-af67-af2d4967ee85 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.414490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14fbd-2e0d-4427-af67-af2d4967ee85 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.415056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14fbd-2e0d-4427-af67-af2d4967ee85 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules/648454fef1fb46dfa1a2fe2aee17f00e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:13.416480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be14fbd-2e0d-4427-af67-af2d4967ee85 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorizing `identity:get_access_rule(user_id=480d446fe2bc4c02ad790632eb06283f, access_rule_id=648454fef1fb46dfa1a2fe2aee17f00e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:13.418201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be14fbd-2e0d-4427-af67-af2d4967ee85 tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:13.425695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3440/6857] 10.222.0.16 () {58 vars in 1359 bytes} [Wed Oct 5 02:57:13 2022] GET /identity/v3/users/480d446fe2bc4c02ad790632eb06283f/access_rules/648454fef1fb46dfa1a2fe2aee17f00e => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:13.432119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:13.613532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b556b-69f7-4b40-bb1c-309be939ecee tempest-AccessRulesV3Test-1901532865 tempest-AccessRulesV3Test-1901532865-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:13.633043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:13.633709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.633990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.634264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] PATH_INFO: `/v3/users/480d446fe2bc4c02ad790632eb06283f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:13.635418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=480d446fe2bc4c02ad790632eb06283f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:13.637370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:13.684028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:13.755629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480d446fe2bc4c02ad790632eb06283f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:13.885608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480d446fe2bc4c02ad790632eb06283f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:13.888492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480d446fe2bc4c02ad790632eb06283f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:13.910787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480d446fe2bc4c02ad790632eb06283f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:13.912042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480d446fe2bc4c02ad790632eb06283f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:13.959157 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3418/6858] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:13 2022] DELETE /identity/v3/users/480d446fe2bc4c02ad790632eb06283f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:13.961304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:13.962122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:13.962438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:14.001110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:14.002398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:14.121763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3441/6859] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:14.130169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:14.131629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:14.209227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b840-1ce6-49a2-aed2-2af22351bcaf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:14.213445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d7def-7d5a-42c8-9feb-1f54c004f8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:14.214133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7def-7d5a-42c8-9feb-1f54c004f8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:14.214855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7def-7d5a-42c8-9feb-1f54c004f8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:14.215134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7def-7d5a-42c8-9feb-1f54c004f8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:14.228038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d7def-7d5a-42c8-9feb-1f54c004f8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:14.230355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d7def-7d5a-42c8-9feb-1f54c004f8a0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:14.258187 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3419/6860] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:14.868238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:14.870301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:14.892558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817d88-0cb3-492d-bb74-418f25c9f8db None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:14.900828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:14.905405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:14.906030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:14.908402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] PATH_INFO: `/v3/projects/afe5e4b070c04150a1fde07658fabb1a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:14.910216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe5e4b070c04150a1fde07658fabb1a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:14.913397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:14.995389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:15.025190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe5e4b070c04150a1fde07658fabb1a', 'request_id': 'req-ef5eb024-c010-41a3-ad6d-f90a71aba21b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:15.031846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe5e4b070c04150a1fde07658fabb1a', 'request_id': 'req-ef5eb024-c010-41a3-ad6d-f90a71aba21b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:15.039446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe5e4b070c04150a1fde07658fabb1a', 'request_id': 'req-ef5eb024-c010-41a3-ad6d-f90a71aba21b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:15.072679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] The token cache is being invalidate because project afe5e4b070c04150a1fde07658fabb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:15.073075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:15.077526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ef5eb024-c010-41a3-ad6d-f90a71aba21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:15.083780 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3442/6861] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:14 2022] DELETE /identity/v3/projects/afe5e4b070c04150a1fde07658fabb1a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:15.086755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.087209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.087565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.142039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:15.147045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:15.287408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3420/6862] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:15.289241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.289687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.290122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.311772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:15.313387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:15.325533 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3443/6863] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:15.326784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:15.339151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da700c-86ea-4d71-a842-04213aac7b37 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:15.344614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:15.346068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.346068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.346068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.346686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:15.347017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:15.348625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:15.358247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:15.375266 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3421/6864] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:15.380310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:15.393321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7047c-9663-4ebf-b3c1-9b9ecda2543a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:15.399725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:15.400681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.401341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.401972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.402958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:15.405348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:15.450658 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3444/6865] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:15 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:15.454645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:15.482317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fec2b6-4569-44b2-ba3d-7e4c6a3a9f39 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:15.603352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:15.604996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.605246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.605535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.606190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:15.609041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:15.640236 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3422/6866] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:15 2022] POST /identity/v3/users => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:15.644428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:15.658730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14311be1-fa14-47d7-8844-54778d47fae5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:15.664440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:15.681213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.681999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.684534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.686510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:15.694590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:15.725922 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3445/6867] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:15.730578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:15.743324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb3624-3a2b-4fed-94b9-349603c7141d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:15.777520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:15.778664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.779161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.779636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] PATH_INFO: `/v3/projects/f828760bfd314e4490cf9c854e750cb2/users/cf5cd44446eb4841ac7a096a0a1762f9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.812884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f828760bfd314e4490cf9c854e750cb2, user_id=cf5cd44446eb4841ac7a096a0a1762f9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:15.817079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:15.852756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3423/6868] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:15 2022] PUT /identity/v3/projects/f828760bfd314e4490cf9c854e750cb2/users/cf5cd44446eb4841ac7a096a0a1762f9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:15.856566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:15.877177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a00ea-6221-42f0-8303-f51d2455434b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:15.978012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc436da-0740-41f6-a333-ee469f175c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:15.990394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc436da-0740-41f6-a333-ee469f175c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:15.995053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc436da-0740-41f6-a333-ee469f175c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:15.995459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc436da-0740-41f6-a333-ee469f175c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:15.996868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc436da-0740-41f6-a333-ee469f175c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:15.998915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc436da-0740-41f6-a333-ee469f175c6b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.017591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3446/6869] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:16.017871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:16.030590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320771-2f24-48c6-9ee6-f161987f33c5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:16.036564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:16.037544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.037991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.038361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] PATH_INFO: `/v3/projects/f828760bfd314e4490cf9c854e750cb2/users/cf5cd44446eb4841ac7a096a0a1762f9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.040801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f828760bfd314e4490cf9c854e750cb2, user_id=cf5cd44446eb4841ac7a096a0a1762f9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:16.043776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.073533 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3424/6870] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:16 2022] PUT /identity/v3/projects/f828760bfd314e4490cf9c854e750cb2/users/cf5cd44446eb4841ac7a096a0a1762f9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:16.160249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.160742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.161172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.206186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] MFA Rules not processed for user `cf5cd44446eb4841ac7a096a0a1762f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:16.210363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:16.355575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:16.372267 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3447/6871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:16.379402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:16.473376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea890-deab-40ce-a159-34b52d853557 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:16.482027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:16.482698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.482985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.483306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.484083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:16.486359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.529186 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3425/6872] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:16 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:16.532152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:16.546240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6848c-21bb-42f5-b49a-9b9b2322d33f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:16.671120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:16.671927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.672314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.673339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.674294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:16.676367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.723996 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3448/6873] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:16 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:16.725500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:16.744556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd3d1a-d20c-41df-9a46-4c315289fd40 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:16.755866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:16.756504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.756787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.757140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.757796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:16.759394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.773409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3426/6874] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:16.774632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:16.786680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df730e9c-1480-441b-9a77-ef61a1ad409f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:16.803177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808c626-5091-4217-88aa-aa0dd23efd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:16.803871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808c626-5091-4217-88aa-aa0dd23efd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.804222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808c626-5091-4217-88aa-aa0dd23efd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.804567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808c626-5091-4217-88aa-aa0dd23efd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.805610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808c626-5091-4217-88aa-aa0dd23efd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:16.807361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808c626-5091-4217-88aa-aa0dd23efd65 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.837231 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3449/6875] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:16.837354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:16.848244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b6751-48af-4589-a530-4fc9bfb7d614 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:16.853100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:16.853847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.854203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.854551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] PATH_INFO: `/v3/projects/72a6f742d8fe45fc869c0c79c89c2576/users/d004a6ccc7794154bf00470794e39f81/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.871165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a6f742d8fe45fc869c0c79c89c2576, user_id=d004a6ccc7794154bf00470794e39f81, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:16.873950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:16.891248 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3427/6876] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:16 2022] PUT /identity/v3/projects/72a6f742d8fe45fc869c0c79c89c2576/users/d004a6ccc7794154bf00470794e39f81/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:16.901787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:16.902214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:16.902568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:16.938371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] MFA Rules not processed for user `d004a6ccc7794154bf00470794e39f81`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:16.940251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:17.057361 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3450/6877] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:17.070969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:17.072733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:17.078303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:17.148552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0fc7-f774-4bd1-9981-5bf382916a93 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:17.153881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc1881-7d58-431b-8162-e29b2483d8df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:17.154542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc1881-7d58-431b-8162-e29b2483d8df service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:17.154833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc1881-7d58-431b-8162-e29b2483d8df service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:17.155112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc1881-7d58-431b-8162-e29b2483d8df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:17.238595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc1881-7d58-431b-8162-e29b2483d8df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:17.241629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc1881-7d58-431b-8162-e29b2483d8df service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:17.265044 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3428/6878] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:18.654307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:18.768163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28f68e-8de7-4cec-8143-3f38a865f972 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:18.775656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:18.776950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:18.777771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:18.778200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] PATH_INFO: `/v3/users/cf5cd44446eb4841ac7a096a0a1762f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:18.780746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5cd44446eb4841ac7a096a0a1762f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:18.783937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:18.789826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:18.941781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5cd44446eb4841ac7a096a0a1762f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:18.984283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5cd44446eb4841ac7a096a0a1762f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:18.985160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5cd44446eb4841ac7a096a0a1762f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:19.028929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5cd44446eb4841ac7a096a0a1762f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:19.029768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5cd44446eb4841ac7a096a0a1762f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:19.067152 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3451/6879] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:18 2022] DELETE /identity/v3/users/cf5cd44446eb4841ac7a096a0a1762f9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:19.071993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:19.072821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:19.072821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:19.103092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:19.104348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:19.261600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3429/6880] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:19.292000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:19.294203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:19.421778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d87c5-51b6-4d3d-9284-4e69b6b49081 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:19.432848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:19.433485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:19.433760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:19.434021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:19.453487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:19.455169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:19.482108 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3452/6881] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:20.482720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:20.486890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:20.513481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df870b-b8cb-42c5-877c-2e207c770364 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:20.528451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:20.531173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:20.531173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:20.531173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] PATH_INFO: `/v3/projects/f828760bfd314e4490cf9c854e750cb2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:20.535010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f828760bfd314e4490cf9c854e750cb2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:20.535010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:20.599431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:20.601887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f828760bfd314e4490cf9c854e750cb2', 'request_id': 'req-d9e6ed91-370b-44da-bafb-7388676a87f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:20.622626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f828760bfd314e4490cf9c854e750cb2', 'request_id': 'req-d9e6ed91-370b-44da-bafb-7388676a87f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:20.642862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f828760bfd314e4490cf9c854e750cb2', 'request_id': 'req-d9e6ed91-370b-44da-bafb-7388676a87f6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:20.678779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] The token cache is being invalidate because project f828760bfd314e4490cf9c854e750cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:20.679075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:20.679802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:20.681415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3430/6882] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:20 2022] DELETE /identity/v3/projects/f828760bfd314e4490cf9c854e750cb2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:20.685606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:20.701755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1869c5-69ea-4ffc-8144-fa0ab05745c4 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:20.866548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:20.868061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:20.868061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:20.868061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] PATH_INFO: `/v3/users/d004a6ccc7794154bf00470794e39f81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:20.869216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d004a6ccc7794154bf00470794e39f81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:20.871395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:20.922204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:20.970158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd004a6ccc7794154bf00470794e39f81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:21.014852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd004a6ccc7794154bf00470794e39f81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:21.015524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd004a6ccc7794154bf00470794e39f81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:21.037801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd004a6ccc7794154bf00470794e39f81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:21.041213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d525851-b5af-4848-b258-85e07025b75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd004a6ccc7794154bf00470794e39f81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:21.090752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3453/6883] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:20 2022] DELETE /identity/v3/users/d004a6ccc7794154bf00470794e39f81 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:21.612341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:21.623006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:21.678727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ed91-370b-44da-bafb-7388676a87f6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:21.825859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:21.831697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:21.833407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:21.833867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] PATH_INFO: `/v3/projects/72a6f742d8fe45fc869c0c79c89c2576` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:21.839022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a6f742d8fe45fc869c0c79c89c2576)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:21.847519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:21.965697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a6f742d8fe45fc869c0c79c89c2576', 'request_id': 'req-4858cc19-cc65-4273-9f09-57ec986dc8f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:21.995483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a6f742d8fe45fc869c0c79c89c2576', 'request_id': 'req-4858cc19-cc65-4273-9f09-57ec986dc8f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:22.035401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a6f742d8fe45fc869c0c79c89c2576', 'request_id': 'req-4858cc19-cc65-4273-9f09-57ec986dc8f7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:22.075980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] The token cache is being invalidate because project 72a6f742d8fe45fc869c0c79c89c2576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:22.076301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:22.077270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4858cc19-cc65-4273-9f09-57ec986dc8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:22.080939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3431/6884] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:21 2022] DELETE /identity/v3/projects/72a6f742d8fe45fc869c0c79c89c2576 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:22.086283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:22.086836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:22.086929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:22.114231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:22.115795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:22.192709 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3454/6885] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:22.202295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:22.202683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:22.203258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:22.260672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:22.262076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:22.301829 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3432/6886] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:22.304655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:22.402935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232143-c638-4b2c-b7ba-0a3525f29659 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:22.476380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:22.481253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:22.481766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:22.482461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:22.485455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:22.485823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:22.495895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:22.543203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3455/6887] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:22.550088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:22.567178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d60ae-63b1-4fce-ae99-09b7ffc316ea None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:22.581495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:22.582336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:22.582336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:22.583104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:22.583416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:22.585459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:22.646217 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3433/6888] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:22 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:22.656376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:22.707405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386730f-fec5-4db2-8292-cc145e8b144b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:22.927245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:22.927890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:22.928180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:22.928463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:22.933369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:22.945888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:23.000133 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3456/6889] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:22 2022] POST /identity/v3/users => generated 305 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:23.006879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:23.020477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab42926-3e80-4486-907b-6a3a75401d64 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:23.051755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:23.053182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:23.058730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:23.058956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:23.060115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:23.063622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:23.085316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3434/6890] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:23.087093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:23.099661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667ce3-d39c-4904-ac9b-bf1ae1f134ff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:23.104862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:23.105642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:23.105924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:23.106197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] PATH_INFO: `/v3/projects/c29af8a5556f4c0a88e520d4b28a7249/users/4a2e93d8bfd5403588176df9a0767341/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:23.151620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29af8a5556f4c0a88e520d4b28a7249, user_id=4a2e93d8bfd5403588176df9a0767341, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:23.154724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:23.175889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:23.187002 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3457/6891] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:23 2022] PUT /identity/v3/projects/c29af8a5556f4c0a88e520d4b28a7249/users/4a2e93d8bfd5403588176df9a0767341/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:23.193611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:23.224400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc5222-3850-4d41-9d41-9075fdccb6be admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:23.347855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:23.454026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b362c5-755b-4f76-9b87-bc94070cb5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:23.455076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b362c5-755b-4f76-9b87-bc94070cb5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:23.455717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b362c5-755b-4f76-9b87-bc94070cb5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:23.456165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b362c5-755b-4f76-9b87-bc94070cb5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:23.457195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b362c5-755b-4f76-9b87-bc94070cb5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:23.459086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b362c5-755b-4f76-9b87-bc94070cb5a6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:23.501383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3435/6892] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:23.503049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:23.524198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1382c-f776-4204-9c20-3720f9371149 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:23.536542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:23.537750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:23.538442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:23.538733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] PATH_INFO: `/v3/projects/c29af8a5556f4c0a88e520d4b28a7249/users/4a2e93d8bfd5403588176df9a0767341/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:23.555884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29af8a5556f4c0a88e520d4b28a7249, user_id=4a2e93d8bfd5403588176df9a0767341, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:23.565381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:23.593085 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3458/6893] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:23 2022] PUT /identity/v3/projects/c29af8a5556f4c0a88e520d4b28a7249/users/4a2e93d8bfd5403588176df9a0767341/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:23.608400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:23.608704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:23.609175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:23.681027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] MFA Rules not processed for user `4a2e93d8bfd5403588176df9a0767341`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:23.684376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:24.083663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:24.094380 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3436/6894] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:24.275946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3922d-7510-459e-adef-b66f37d6ba38 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:24.291932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:24.293373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.293886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.295273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:24.296100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:24.300322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:24.377695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3459/6895] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:24 2022] POST /identity/v3/projects => generated 397 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:24.380578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:24.415400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63b27a-b493-444b-9f46-2bf71c38f6ca None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:24.513479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:24.514115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.514401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.514676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:24.515318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:24.517386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:24.570989 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3437/6896] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:24 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:24.575867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:24.600587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d9e01-1ef5-488a-9f93-0c32e03b7587 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:24.613919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:24.615142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.615454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.617504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:24.618482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:24.621574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:24.642596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:24.644096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3460/6897] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:24.662324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915fe1-4905-457d-9064-cfa2d17a5425 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:24.668109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd112e-b889-4be0-ab95-7648190cd869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:24.668945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd112e-b889-4be0-ab95-7648190cd869 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.669488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd112e-b889-4be0-ab95-7648190cd869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.669926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd112e-b889-4be0-ab95-7648190cd869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:24.671334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd112e-b889-4be0-ab95-7648190cd869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:24.674569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd112e-b889-4be0-ab95-7648190cd869 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:24.687455 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3438/6898] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:24.691867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:24.702348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1017009-f97a-451e-a4d6-68f2fd688931 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:24.709213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:24.709976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.710322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.710667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] PATH_INFO: `/v3/projects/42720bc78e654b5da666101173168acd/users/79532e411b8345a4b91c7c9505d80323/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:24.728353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42720bc78e654b5da666101173168acd, user_id=79532e411b8345a4b91c7c9505d80323, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:24.731122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:24.756409 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3461/6899] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:24 2022] PUT /identity/v3/projects/42720bc78e654b5da666101173168acd/users/79532e411b8345a4b91c7c9505d80323/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:24.761504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943ffef-fb38-4a01-a72b-3e6d7a4b2ed0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.761819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943ffef-fb38-4a01-a72b-3e6d7a4b2ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.762096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943ffef-fb38-4a01-a72b-3e6d7a4b2ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:24.793078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c943ffef-fb38-4a01-a72b-3e6d7a4b2ed0 None None] MFA Rules not processed for user `79532e411b8345a4b91c7c9505d80323`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:24.794314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c943ffef-fb38-4a01-a72b-3e6d7a4b2ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:24.809190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:24.877413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3439/6900] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:24.889854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:24.891866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:24.976857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576328bf-81bb-4545-9847-9c8ebe6c1a1f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:24.987841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:24.988484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:24.988779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:24.989095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:25.059367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:25.083493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:25.083807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:25.084066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:25.091368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:25.093136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:25.111075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] MFA Rules not processed for user `de963cdc932941c7bac32406ee190634`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:25.112117 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3462/6901] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:24 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:25.120862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:25.227703 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3440/6902] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:25.603324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:25.605481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:25.767204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc44f-dc1c-4546-bf03-85d1f53437a6 service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:25.778197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:25.779148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:25.779647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:25.780698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:25.784409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:25.811242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:25.813580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af61a7-fde0-4c62-9329-3dd8f27cfbc8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:25.815603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:25.841554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3463/6903] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:25.976933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5432c68-846e-4a2a-a8a0-bf8f6bfa0768 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:25.976933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:25.976933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:25.976933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:25.977384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] PATH_INFO: `/v3/users/4a2e93d8bfd5403588176df9a0767341` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:25.977384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2e93d8bfd5403588176df9a0767341)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:25.978738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:26.071213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2e93d8bfd5403588176df9a0767341'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.087297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:26.088719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2e93d8bfd5403588176df9a0767341'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.089567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2e93d8bfd5403588176df9a0767341'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.103967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2e93d8bfd5403588176df9a0767341'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.104691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2e93d8bfd5403588176df9a0767341'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.126036 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3441/6904] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:25 2022] DELETE /identity/v3/users/4a2e93d8bfd5403588176df9a0767341 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:26.127772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:26.128075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:26.128683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:26.159436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:26.161180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:26.270245 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3464/6905] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:26.282144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:26.284261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:26.402688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e58e-5e1c-47a6-bdf2-3920a1ad93f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:26.407670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a809c-b642-495c-a7a5-dea7bd0d25c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:26.408702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a809c-b642-495c-a7a5-dea7bd0d25c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:26.409265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a809c-b642-495c-a7a5-dea7bd0d25c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:26.409714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a809c-b642-495c-a7a5-dea7bd0d25c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:26.420578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a809c-b642-495c-a7a5-dea7bd0d25c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:26.422745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a809c-b642-495c-a7a5-dea7bd0d25c7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:26.460605 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3442/6906] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:26.622132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:26.625268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:26.648887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1526e-3ad8-438c-ae7c-e45ab449ff1d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:26.656049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:26.658140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:26.658862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:26.659442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] PATH_INFO: `/v3/users/3a1109d8ce5742beb240a5fb78fb88a5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:26.661607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1109d8ce5742beb240a5fb78fb88a5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:26.665231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:26.759667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1109d8ce5742beb240a5fb78fb88a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.785781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1109d8ce5742beb240a5fb78fb88a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.787579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1109d8ce5742beb240a5fb78fb88a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.803889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1109d8ce5742beb240a5fb78fb88a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.805809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1109d8ce5742beb240a5fb78fb88a5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:26.820018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:26.839771 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3465/6907] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:26 2022] DELETE /identity/v3/users/3a1109d8ce5742beb240a5fb78fb88a5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:26.841699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:26.842176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:26.842293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:26.868347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:26.870565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:26.972662 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3443/6908] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:26.985711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:26.989852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:26.994041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:27.003610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:27.046689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2f42-a7c1-4567-a497-bea8d3744e4d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:27.069593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:27.070257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:27.070538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:27.070827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] PATH_INFO: `/v3/projects/c29af8a5556f4c0a88e520d4b28a7249` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:27.073832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29af8a5556f4c0a88e520d4b28a7249)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:27.075782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:27.158798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29af8a5556f4c0a88e520d4b28a7249', 'request_id': 'req-f2eeda15-e587-4922-aec2-92cddcce80b8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.171075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29af8a5556f4c0a88e520d4b28a7249', 'request_id': 'req-f2eeda15-e587-4922-aec2-92cddcce80b8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.173834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200935d-7fc2-43e6-bd6f-70c09c14b28c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:27.179634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29af8a5556f4c0a88e520d4b28a7249', 'request_id': 'req-f2eeda15-e587-4922-aec2-92cddcce80b8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.196059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] The token cache is being invalidate because project c29af8a5556f4c0a88e520d4b28a7249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:27.196059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.196725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.201649 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3444/6909] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:26 2022] DELETE /identity/v3/projects/c29af8a5556f4c0a88e520d4b28a7249 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:27.203088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:27.204677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:27.218473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:27.269120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:27.269837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:27.270462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:27.270856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:27.273500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:27.331253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eeda15-e587-4922-aec2-92cddcce80b8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:27.340692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:27.341853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:27.342773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:27.343218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] PATH_INFO: `/v3/users/79532e411b8345a4b91c7c9505d80323` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:27.348518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79532e411b8345a4b91c7c9505d80323)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:27.353368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:27.401188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:27.403170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:27.436809 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3466/6910] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:27.487908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79532e411b8345a4b91c7c9505d80323'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.523262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79532e411b8345a4b91c7c9505d80323'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.525677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79532e411b8345a4b91c7c9505d80323'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.542350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79532e411b8345a4b91c7c9505d80323'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.552882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79532e411b8345a4b91c7c9505d80323'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:27.589451 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3445/6911] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:27 2022] DELETE /identity/v3/users/79532e411b8345a4b91c7c9505d80323 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:28.021186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:28.025952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.078348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a6e0a-8eca-4930-b021-f01f39497d18 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:28.238254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:28.241813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:28.242094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:28.242427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] PATH_INFO: `/v3/projects/02a3e30e2f4b43d68fb9a64497e2548f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:28.247955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a3e30e2f4b43d68fb9a64497e2548f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:28.250975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:28.263077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:28.263970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:28.266052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.285746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9e811-0841-4e10-b870-a9d7f942e047 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:28.292995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:28.293885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:28.294327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:28.294775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] PATH_INFO: `/v3/projects/42720bc78e654b5da666101173168acd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:28.296229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42720bc78e654b5da666101173168acd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:28.300643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:28.345900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a3e30e2f4b43d68fb9a64497e2548f', 'request_id': 'req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.354242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a3e30e2f4b43d68fb9a64497e2548f', 'request_id': 'req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.369254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a3e30e2f4b43d68fb9a64497e2548f', 'request_id': 'req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.398321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] The token cache is being invalidate because project 02a3e30e2f4b43d68fb9a64497e2548f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:28.399196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.401683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.404841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42720bc78e654b5da666101173168acd', 'request_id': 'req-dbd6433f-c680-468d-9844-40b4cddbd56c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.410902 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3467/6912] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:28 2022] DELETE /identity/v3/projects/02a3e30e2f4b43d68fb9a64497e2548f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:28.412499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:28.415946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.427312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42720bc78e654b5da666101173168acd', 'request_id': 'req-dbd6433f-c680-468d-9844-40b4cddbd56c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.438917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42720bc78e654b5da666101173168acd', 'request_id': 'req-dbd6433f-c680-468d-9844-40b4cddbd56c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.466932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] The token cache is being invalidate because project 42720bc78e654b5da666101173168acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:28.467365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.468695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-dbd6433f-c680-468d-9844-40b4cddbd56c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.471615 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3446/6913] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:28 2022] DELETE /identity/v3/projects/42720bc78e654b5da666101173168acd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:28.478866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:28.479171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:28.479429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:28.540614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:28.542683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.555001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:28.579137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb87cb-bde1-4566-97b6-9ca4a59261ac admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:28.693402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3447/6914] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:28.694428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:28.695884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.715206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:28.716160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:28.716445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:28.716724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] PATH_INFO: `/v3/users/1a45188117fe468b889b1f72cfe9861b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:28.717915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a45188117fe468b889b1f72cfe9861b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:28.720029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:28.779208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bf4ca-5f8b-4e08-8366-bbab7896f6ce None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:28.784054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:28.784795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:28.785294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:28.785665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:28.788162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.799334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:28.802240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a45188117fe468b889b1f72cfe9861b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.807016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:28.808658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1aa6-0cca-451f-bbb1-a4e3305392b0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:28.823712 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3448/6915] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:28.825631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:28.826013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:28.826384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:28.831969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a45188117fe468b889b1f72cfe9861b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.832711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a45188117fe468b889b1f72cfe9861b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.849266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a45188117fe468b889b1f72cfe9861b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.851094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a45188117fe468b889b1f72cfe9861b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:28.855591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:28.857137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:28.867951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3468/6916] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:28 2022] DELETE /identity/v3/users/1a45188117fe468b889b1f72cfe9861b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:28.875983 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3449/6917] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:28.880578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.010262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39d186-bb32-4a44-8ca8-c8922e8d0d07 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.016579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.017442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.017781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.018068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.019313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:29.019640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.021338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.045327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3469/6918] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:29.046623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.060176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49079f1-140c-440e-b851-08364288c4f0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.067300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.069157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.069805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.070762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.071812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.074351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.117204 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3450/6919] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:29 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:29.117663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.133994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc9bd4-564d-4201-b2a3-cddc52d8a89f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.249406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.250043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.250572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.251041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.251830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.252199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.254016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.254547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:29.290333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3470/6920] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:29 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:29.293980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.306866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409322d-3f01-47bb-bbbd-c328f80481cb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.322784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.323415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.323698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.323976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.324851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.326641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.353853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3471/6921] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:29.355009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.382863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b17d8-8091-46d1-821d-441a9f3bc477 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.383378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb49dc-fac7-4c0e-af1e-5eb082db1f8f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.388043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.388212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.388842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.389090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.389209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.389422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] PATH_INFO: `/v3/projects/3995618781854de68a7aee4367a58420/users/72bd29c133ab4d36a1b72c77ad88ddb7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.389648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.391806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.394820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:29.414186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.416710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.427143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3995618781854de68a7aee4367a58420, user_id=72bd29c133ab4d36a1b72c77ad88ddb7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.429910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.444562 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3451/6922] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:57:29.448153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.449670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:29.462071 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3472/6923] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:29 2022] PUT /identity/v3/projects/3995618781854de68a7aee4367a58420/users/72bd29c133ab4d36a1b72c77ad88ddb7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:29.466127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.491090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:29.498284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476bb9c-db4a-4d43-b4ea-ac4dee5917c6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.541771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:29.611499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.612147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.612434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.612713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] PATH_INFO: `/v3/projects/270b5e657b03432ab66a3f0cbcfc178e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.618280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6848ff2-5aef-4449-b590-0da19d008706 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.622493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270b5e657b03432ab66a3f0cbcfc178e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.623807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.630987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.632100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.632383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.632717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.633798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.635352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.684023 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3473/6924] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:29.689790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:29.714701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a06ea2-74d2-47b9-983c-bb999a75acf7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:29.725547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270b5e657b03432ab66a3f0cbcfc178e', 'request_id': 'req-4f4f5b86-9ea8-4485-8d9d-a062d860d802'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:29.749663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270b5e657b03432ab66a3f0cbcfc178e', 'request_id': 'req-4f4f5b86-9ea8-4485-8d9d-a062d860d802'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:29.758116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270b5e657b03432ab66a3f0cbcfc178e', 'request_id': 'req-4f4f5b86-9ea8-4485-8d9d-a062d860d802'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:29.782917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] The token cache is being invalidate because project 270b5e657b03432ab66a3f0cbcfc178e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:29.783223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:29.785297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f4f5b86-9ea8-4485-8d9d-a062d860d802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:29.793207 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3452/6925] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:29 2022] DELETE /identity/v3/projects/270b5e657b03432ab66a3f0cbcfc178e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:29.796704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179d11-8488-42bd-8100-79e2f336626a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.797056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179d11-8488-42bd-8100-79e2f336626a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.797359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179d11-8488-42bd-8100-79e2f336626a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.840352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7d179d11-8488-42bd-8100-79e2f336626a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:29.841733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d179d11-8488-42bd-8100-79e2f336626a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:29.865249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c825948-a7a4-4812-aa04-6dd9d875e3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:29.866263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825948-a7a4-4812-aa04-6dd9d875e3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.868090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825948-a7a4-4812-aa04-6dd9d875e3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.868550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c825948-a7a4-4812-aa04-6dd9d875e3a0 admin admin] PATH_INFO: `/v3/projects/3995618781854de68a7aee4367a58420/users/72bd29c133ab4d36a1b72c77ad88ddb7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.873063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825948-a7a4-4812-aa04-6dd9d875e3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3995618781854de68a7aee4367a58420, user_id=72bd29c133ab4d36a1b72c77ad88ddb7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:29.884600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c825948-a7a4-4812-aa04-6dd9d875e3a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:29.908114 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3474/6926] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:29 2022] PUT /identity/v3/projects/3995618781854de68a7aee4367a58420/users/72bd29c133ab4d36a1b72c77ad88ddb7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:29.931666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:29.932327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:29.932888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:29.987288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] MFA Rules not processed for user `72bd29c133ab4d36a1b72c77ad88ddb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:29.989289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:29.991267 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3453/6927] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:30.003448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.003741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.004025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.070092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:30.071320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:30.139528 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3475/6928] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:30.143831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.147948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:30.178672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:30.199721 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3454/6929] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:30.214280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.232137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:30.236329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e928209-9fcb-43c3-b407-69ee8860b48d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.250108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.250772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.251689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.251981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.252646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:30.253003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.255721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.273192 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3455/6930] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:30.276001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.290978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a142ade-d54d-4e91-a133-d19109f6c672 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.327563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.329325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.330132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.331191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.332315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2f6f3-7765-4a13-a68d-36ac9d721a0c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.336525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.341293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.343960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.346052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.348109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.348565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.351007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.358998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.451740 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3456/6931] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:30.453192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.457783 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3476/6932] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/projects => generated 387 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:30.466461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.573723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154077c2-2df5-42eb-ae0d-dda1413fd823 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.607382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54be8b-3de0-4056-9a85-be35add44bb1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.621735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.622713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.623007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.623291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.623943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.626823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.646796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.648520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.649021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.649531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.650351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.653242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.681819 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3477/6933] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:30.683560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.700933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbc477-cfd0-4ca6-9830-290e2d6da3ed admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.701668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3457/6934] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:30.705949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.718225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.719462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.720069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.720069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.721787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.722799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.730083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654017db-aae8-4ff3-be08-d6ebff448b88 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.736026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.736759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.737095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.737354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.739008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.739613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.748498 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3478/6935] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:30.753000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.755020 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3458/6936] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:30.758954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.773051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b40e1-b73d-4525-9afa-f909f772b13d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.780253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136eb5c8-f6c2-49f7-87bd-c689182d7749 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.785135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.785765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.786050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.786331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.786990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.789716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.794514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.795128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.795413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.795693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.796347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.799763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.817068 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3479/6937] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:30.821547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.822377 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3459/6938] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:30.825435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:30.841701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86792b-3656-442a-a347-c28b91710d97 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.847161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eea95-5745-4110-92af-69283f96100e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:30.853137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b52e2-ff32-4b72-bd97-195da0c18207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.854452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b52e2-ff32-4b72-bd97-195da0c18207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.855351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b52e2-ff32-4b72-bd97-195da0c18207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.856127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b52e2-ff32-4b72-bd97-195da0c18207 admin admin] PATH_INFO: `/v3/projects/3a74ae5e99914a128604cbe2f699df85/users/b5cbcf0e0a8f4c768a143c0146066e8e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.858300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa0fe-1445-4339-98f1-711716000dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:30.859320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa0fe-1445-4339-98f1-711716000dae admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.861726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa0fe-1445-4339-98f1-711716000dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.862242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa0fe-1445-4339-98f1-711716000dae admin admin] PATH_INFO: `/v3/projects/1a3115082ca343f0a0752df88125b42b/users/236d3cc395f24bc1b648e4d9072d7d80/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.891520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b52e2-ff32-4b72-bd97-195da0c18207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a74ae5e99914a128604cbe2f699df85, user_id=b5cbcf0e0a8f4c768a143c0146066e8e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.894553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b52e2-ff32-4b72-bd97-195da0c18207 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.898485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfa0fe-1445-4339-98f1-711716000dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3115082ca343f0a0752df88125b42b, user_id=236d3cc395f24bc1b648e4d9072d7d80, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:30.901553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfa0fe-1445-4339-98f1-711716000dae admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:30.936141 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3480/6939] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:30 2022] PUT /identity/v3/projects/3a74ae5e99914a128604cbe2f699df85/users/b5cbcf0e0a8f4c768a143c0146066e8e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:30.937498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3460/6940] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:30 2022] PUT /identity/v3/projects/1a3115082ca343f0a0752df88125b42b/users/236d3cc395f24bc1b648e4d9072d7d80/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:30.947207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.947501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.947780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:30.950359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:30.950653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:30.950931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.037905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:31.042170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] MFA Rules not processed for user `b5cbcf0e0a8f4c768a143c0146066e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:31.043592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:31.046384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] MFA Rules not processed for user `236d3cc395f24bc1b648e4d9072d7d80`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:31.051934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:31.132595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:31.166014 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3481/6941] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:31.179272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:31.181386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:31.295209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599552d-f317-448b-9c7f-a21508edf358 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:31.299259 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3461/6942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:31.301505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:31.302564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:31.303072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:31.303539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.304175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:31.402910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:31.405007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:31.416303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a2938-28fc-4626-a00b-c0b0674e4f20 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:31.421266 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3482/6943] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:31.444858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:31.445557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:31.445842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:31.446121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.446820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:31.448730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:31.550400 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3462/6944] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:31 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:31.551623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:31.578105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b1b80-3f01-4c6d-9772-297522b739de service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:31.722205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:31.723995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:31.725147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:31.726110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.727456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:31.730570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:31.785498 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3483/6945] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:31 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:31.785963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:31.801391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5394-49df-4f32-81eb-07872cd75730 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:31.812819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:31.814715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:31.819897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:31.820170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.820963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:31.823116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:31.841433 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3463/6946] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:31.847247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:31.866341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68cb0-a7c4-4115-a0df-33f3c0cf2243 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:31.875150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:31.875150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:31.876410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:31.876606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] PATH_INFO: `/v3/projects/94fec1d5b96f44eab4894f43f89755fb/users/f43a70f4d99f48dbae96784d5a41fecd/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.884813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:31.898172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5521a-12a2-415e-aecd-94cb0dc29c4b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:31.912807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:31.914707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:31.915007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:31.915285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] PATH_INFO: `/v3/users/72bd29c133ab4d36a1b72c77ad88ddb7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:31.918004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72bd29c133ab4d36a1b72c77ad88ddb7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:31.921456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:31.935273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fec1d5b96f44eab4894f43f89755fb, user_id=f43a70f4d99f48dbae96784d5a41fecd, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:31.941219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:31.965485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:31.973354 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3484/6947] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:31 2022] PUT /identity/v3/projects/94fec1d5b96f44eab4894f43f89755fb/users/f43a70f4d99f48dbae96784d5a41fecd/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:31.977569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:32.009084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72bd29c133ab4d36a1b72c77ad88ddb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:32.035814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72bd29c133ab4d36a1b72c77ad88ddb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:32.041392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72bd29c133ab4d36a1b72c77ad88ddb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:32.054937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72bd29c133ab4d36a1b72c77ad88ddb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:32.055951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70ba98d0-3434-4171-bcb1-ead4c74120b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72bd29c133ab4d36a1b72c77ad88ddb7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:32.059071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:32.087337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3464/6948] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:31 2022] DELETE /identity/v3/users/72bd29c133ab4d36a1b72c77ad88ddb7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:32.091548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:32.091865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:32.092112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:32.098468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c579c-16a1-476c-91e1-2200a1df542c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:32.113867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:32.115175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:32.187328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:32.188959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:32.189253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:32.189665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:32.190591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:32.192661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:32.205971 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3485/6949] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:32.211755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:32.214788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:32.218616 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3465/6950] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:32.226007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:32.227537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:32.233505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003cd903-6b16-4f09-8413-29290056e09c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:32.239283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f62e9-cdf5-477a-a455-a539562f791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:32.241328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f62e9-cdf5-477a-a455-a539562f791d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:32.241930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f62e9-cdf5-477a-a455-a539562f791d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:32.242392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f62e9-cdf5-477a-a455-a539562f791d admin admin] PATH_INFO: `/v3/projects/94fec1d5b96f44eab4894f43f89755fb/users/f43a70f4d99f48dbae96784d5a41fecd/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:32.245171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f62e9-cdf5-477a-a455-a539562f791d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fec1d5b96f44eab4894f43f89755fb, user_id=f43a70f4d99f48dbae96784d5a41fecd, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:32.248166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f62e9-cdf5-477a-a455-a539562f791d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:32.261986 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3486/6951] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:32 2022] PUT /identity/v3/projects/94fec1d5b96f44eab4894f43f89755fb/users/f43a70f4d99f48dbae96784d5a41fecd/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:32.273613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:32.274671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:32.275153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:32.310057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475f23d-c39e-4caf-96de-0bbf80bfef33 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:32.322540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] MFA Rules not processed for user `f43a70f4d99f48dbae96784d5a41fecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:32.324282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:32.384962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:32.385596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:32.385868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:32.386141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:32.400728 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3487/6952] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:32.413653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:32.415702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:32.433223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0d81f-f2c6-47d0-bebc-6c891c626a93 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:32.438670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:32.439292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:32.439570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:32.439860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:32.454072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:32.455690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:32.474154 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3488/6953] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:57:32.474643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:32.485340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:32.486839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:32.499394 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3466/6954] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:57:33.023337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:33.024962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:33.049722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:33.062120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaba56-2999-4784-9e3c-b47777a7a59c service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:33.076580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:33.077246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:33.077532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:33.077808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] PATH_INFO: `/v3/projects/3995618781854de68a7aee4367a58420` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:33.079482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3995618781854de68a7aee4367a58420)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:33.081421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:33.230205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3995618781854de68a7aee4367a58420', 'request_id': 'req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.258935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3995618781854de68a7aee4367a58420', 'request_id': 'req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.268842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3995618781854de68a7aee4367a58420', 'request_id': 'req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.293021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] The token cache is being invalidate because project 3995618781854de68a7aee4367a58420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:33.293935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.296533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.304155 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3489/6955] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:33 2022] DELETE /identity/v3/projects/3995618781854de68a7aee4367a58420 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:33.305235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:33.316959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48865a-bfee-4da1-b894-f23a21333e67 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:33.430460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:33.431253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:33.431668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:33.431956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] PATH_INFO: `/v3/users/b5cbcf0e0a8f4c768a143c0146066e8e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:33.433204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cbcf0e0a8f4c768a143c0146066e8e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:33.435296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:33.511898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cbcf0e0a8f4c768a143c0146066e8e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.527075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cbcf0e0a8f4c768a143c0146066e8e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.527826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cbcf0e0a8f4c768a143c0146066e8e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.536628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cbcf0e0a8f4c768a143c0146066e8e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.537381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ca10e647-e936-4aa5-b326-697326ea19be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cbcf0e0a8f4c768a143c0146066e8e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:33.553240 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3467/6956] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:33 2022] DELETE /identity/v3/users/b5cbcf0e0a8f4c768a143c0146066e8e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:33.948205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:33.951957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:33.986531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb7ee5-0515-42f4-82a2-0fb9bff281f2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:34.198776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:34.202518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:34.203286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:34.204513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] PATH_INFO: `/v3/projects/3a74ae5e99914a128604cbe2f699df85` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:34.207062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a74ae5e99914a128604cbe2f699df85)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:34.214341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:34.374778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a74ae5e99914a128604cbe2f699df85', 'request_id': 'req-57f061b1-d433-4a19-b5df-1cd6e2d37f37'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:34.390083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a74ae5e99914a128604cbe2f699df85', 'request_id': 'req-57f061b1-d433-4a19-b5df-1cd6e2d37f37'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:34.408291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a74ae5e99914a128604cbe2f699df85', 'request_id': 'req-57f061b1-d433-4a19-b5df-1cd6e2d37f37'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:34.438230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] The token cache is being invalidate because project 3a74ae5e99914a128604cbe2f699df85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:34.440048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:34.442095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-57f061b1-d433-4a19-b5df-1cd6e2d37f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:34.448334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3490/6957] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:33 2022] DELETE /identity/v3/projects/3a74ae5e99914a128604cbe2f699df85 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:34.453357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:34.454005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:34.454468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:34.525278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:34.526527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:34.694202 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3468/6958] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:34.695882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:34.696167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:34.696448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:34.734007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:34.735797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:34.762175 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3491/6959] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:34.767283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:34.778536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba02e-7a23-4aed-8524-6438d261dd88 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:34.794641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:34.795411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:34.795695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:34.795968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:34.796629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:34.796959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:34.799140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:34.838407 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3469/6960] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:34.840174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:34.855297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d448d4-1327-483c-a412-d51d2f6cfc29 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:34.866726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:34.867371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:34.867650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:34.867923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:34.868571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:34.870557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:34.886624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:34.933684 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3492/6961] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:34 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:34.935326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:34.943142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:34.952303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e3040-d150-402d-8124-b77dfd31fc03 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:35.097391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:35.098215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:35.098933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:35.098933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:35.099675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:35.101791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:35.135741 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3470/6962] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:34 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:35.137371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:35.148957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a0bd8-b882-4a6b-8799-68241c61b0aa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:35.171772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:35.173044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:35.173367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:35.173746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:35.174417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:35.176059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:35.204359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3493/6963] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:35.205900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:35.277915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9812396-5dcb-43b6-944a-570783415bf3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:35.296076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93f70a-b7fc-40a6-b957-f4c096b8edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:35.298320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93f70a-b7fc-40a6-b957-f4c096b8edc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:35.298999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93f70a-b7fc-40a6-b957-f4c096b8edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:35.300041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93f70a-b7fc-40a6-b957-f4c096b8edc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:35.301581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93f70a-b7fc-40a6-b957-f4c096b8edc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:35.306789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93f70a-b7fc-40a6-b957-f4c096b8edc5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:35.337371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3471/6964] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:35.341805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:35.356146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29228aa-0670-46af-9a8d-a0ddac07fc12 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:35.374218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:35.375305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:35.376525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:35.376673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] PATH_INFO: `/v3/projects/7bf177c7027043e6bb9507ffeecddeb9/users/6048ff60543a40f19b890ab2249f2d93/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:35.428211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf177c7027043e6bb9507ffeecddeb9, user_id=6048ff60543a40f19b890ab2249f2d93, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:35.430913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:35.463713 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3494/6965] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:35 2022] PUT /identity/v3/projects/7bf177c7027043e6bb9507ffeecddeb9/users/6048ff60543a40f19b890ab2249f2d93/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:35.474128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aea0b-f1b5-4166-b6f9-f4afed55fd5e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:35.474706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aea0b-f1b5-4166-b6f9-f4afed55fd5e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:35.474848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aea0b-f1b5-4166-b6f9-f4afed55fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:35.560346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4f3aea0b-f1b5-4166-b6f9-f4afed55fd5e None None] MFA Rules not processed for user `6048ff60543a40f19b890ab2249f2d93`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:35.561806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f3aea0b-f1b5-4166-b6f9-f4afed55fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:35.743778 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3472/6966] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:35.758910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:35.761510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:35.916098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc223d1-7f00-496c-82e5-8fa6aab00c12 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:35.928067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:35.929666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:35.932594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:35.933199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:35.956038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:35.957935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:35.989723 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3495/6967] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:36.281112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:36.281899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:36.282525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:36.350655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:36.351882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:36.527626 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3473/6968] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:57:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:36.601333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:36.602778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:36.743764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:36.745229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:36.765481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:36.805626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea5c8f-ae8b-405c-bb6c-340b8c898afd service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:36.816431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0971-f22e-4829-a2ab-127073458a9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:36.817094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0971-f22e-4829-a2ab-127073458a9a service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:36.817379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0971-f22e-4829-a2ab-127073458a9a service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:36.817677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0971-f22e-4829-a2ab-127073458a9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:36.840277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0971-f22e-4829-a2ab-127073458a9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:36.842217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0971-f22e-4829-a2ab-127073458a9a service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:36.863469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3496/6969] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:36.989166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e912ad-e138-48b4-a281-20e5f1179db7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:37.007533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:37.011412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:37.012020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:37.013238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] PATH_INFO: `/v3/users/2c718657bb1146cf9fd001d38193714f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:37.019220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c718657bb1146cf9fd001d38193714f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:37.024094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:37.166815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c718657bb1146cf9fd001d38193714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:37.204413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c718657bb1146cf9fd001d38193714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:37.206497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c718657bb1146cf9fd001d38193714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:37.238529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c718657bb1146cf9fd001d38193714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:37.239373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-acf654ee-3ddc-4e04-ae8d-cd7f2737b555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c718657bb1146cf9fd001d38193714f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:37.288145 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3474/6970] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:36 2022] DELETE /identity/v3/users/2c718657bb1146cf9fd001d38193714f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:37.290184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:37.290524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:37.290868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:37.343534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:37.350470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:37.466606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:37.512135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3497/6971] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:37.521817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbdd7-9a4e-4021-8e07-c50cc0040c5b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:37.522129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbdd7-9a4e-4021-8e07-c50cc0040c5b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:37.522412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbdd7-9a4e-4021-8e07-c50cc0040c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:37.527797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:37.529924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:37.572183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aabfbdd7-9a4e-4021-8e07-c50cc0040c5b None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:37.577227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aabfbdd7-9a4e-4021-8e07-c50cc0040c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:37.620705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ffb22-1aa5-4312-8480-2fcab89a8029 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:37.626811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:37.628196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:37.628827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:37.629496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:37.645304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:37.647807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:37.669441 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3498/6972] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:37.678387 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3475/6973] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:57:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:37.686353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:37.688201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:37.854688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d84e-790d-4c75-866f-c7c995255ce0 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:37.861192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:37.862287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:37.862732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:37.863495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:37.874987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:37.877389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:37.892288 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3499/6974] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:38.362157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:38.362581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:38.362949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:38.401631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:38.403060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:38.418083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3476/6975] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:38.425353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:38.440998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb286727-8b54-428d-a64c-9b19b4efcbbc service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:38.447592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37e953-fd01-41aa-96cd-3927f2edae53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:38.448473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37e953-fd01-41aa-96cd-3927f2edae53 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:38.448849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37e953-fd01-41aa-96cd-3927f2edae53 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:38.449253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37e953-fd01-41aa-96cd-3927f2edae53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:38.463781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37e953-fd01-41aa-96cd-3927f2edae53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:38.466163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37e953-fd01-41aa-96cd-3927f2edae53 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:38.506892 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3500/6976] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:38.547044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:38.548829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:38.599797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b771f-cdfd-4023-8cc8-5cc93e3206ab None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:38.613623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:38.614362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:38.614653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:38.617125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] PATH_INFO: `/v3/projects/02baca83fe9e4234b0d09a5e7f6d1581` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:38.618551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02baca83fe9e4234b0d09a5e7f6d1581)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:38.623669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:38.682322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:38.738547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02baca83fe9e4234b0d09a5e7f6d1581', 'request_id': 'req-639eb889-1759-412e-a8c8-5ef3ad0f2581'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:38.752953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02baca83fe9e4234b0d09a5e7f6d1581', 'request_id': 'req-639eb889-1759-412e-a8c8-5ef3ad0f2581'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:38.793728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02baca83fe9e4234b0d09a5e7f6d1581', 'request_id': 'req-639eb889-1759-412e-a8c8-5ef3ad0f2581'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:38.808313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] The token cache is being invalidate because project 02baca83fe9e4234b0d09a5e7f6d1581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:38.809046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:38.809940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-639eb889-1759-412e-a8c8-5ef3ad0f2581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:38.812057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3477/6977] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:38 2022] DELETE /identity/v3/projects/02baca83fe9e4234b0d09a5e7f6d1581 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:38.818179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70742c-0d3d-45ab-b90c-bf3fd0411c94 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:38.819379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70742c-0d3d-45ab-b90c-bf3fd0411c94 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:38.819644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70742c-0d3d-45ab-b90c-bf3fd0411c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:38.846251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2e70742c-0d3d-45ab-b90c-bf3fd0411c94 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:38.847805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2e70742c-0d3d-45ab-b90c-bf3fd0411c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:38.964459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:38.965020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:38.965450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.008384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3501/6978] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:39.009965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:39.011371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:39.017707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.018439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.018887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.041272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:39.063974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:39.065151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:39.096575 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3502/6979] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:39.098670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.113374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97fbb5-2e7f-4f54-870f-1231f6ba41f9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.122438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.123577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.124265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.125320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.126943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:39.127741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.132311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.154735 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3503/6980] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:39.157527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.162137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3478/6981] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:39.172615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db02b6-123d-490b-9f3c-c45fdcabb894 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.178293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.179936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:39.182425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.183566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.184121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.184631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.185698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.188479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.222037 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3504/6982] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:39 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:39.226629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.300359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624d984-b2a1-4651-b832-c7b99b5750e4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.325567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41042c1-ef1b-428e-8673-2a72544611db admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.331444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.332267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.332719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.333208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.334020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.336187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.367788 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3505/6983] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:39 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:39.371154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:39.372565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.388394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb71c28-2f7a-4872-8202-c5bbd845bc02 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.389267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd3917-bd45-4143-ba06-e7f8802ca3e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.391361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3917-bd45-4143-ba06-e7f8802ca3e9 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.392942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3917-bd45-4143-ba06-e7f8802ca3e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.393842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd3917-bd45-4143-ba06-e7f8802ca3e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.395542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.396467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.396941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.397372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.398273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.400398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.422932 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3506/6984] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:39.428445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.444221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fd16b-752f-4147-bd8c-dbedd546683c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.450658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.451540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.452120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.452959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.454187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.456623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.477866 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3507/6985] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:39.483173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.503038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eae69e-14dc-4194-9f9d-0d8a10be1f42 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.513718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.515205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.515779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.516231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] PATH_INFO: `/v3/projects/259ca05c46454743a9819915d50370a7/users/7cb038e111434aa581b9ebc7a578b196/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.536591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3917-bd45-4143-ba06-e7f8802ca3e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.538592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd3917-bd45-4143-ba06-e7f8802ca3e9 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.542013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=259ca05c46454743a9819915d50370a7, user_id=7cb038e111434aa581b9ebc7a578b196, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.547995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.553968 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3479/6986] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:39.568722 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3508/6987] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:39 2022] PUT /identity/v3/projects/259ca05c46454743a9819915d50370a7/users/7cb038e111434aa581b9ebc7a578b196/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:39.574420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a688-0e1f-465d-9111-493d093839db None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.574713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a688-0e1f-465d-9111-493d093839db None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.575258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a688-0e1f-465d-9111-493d093839db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.610329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f2c0a688-0e1f-465d-9111-493d093839db None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:39.612019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f2c0a688-0e1f-465d-9111-493d093839db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:39.768304 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3480/6988] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:39.779906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:39.781821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:39.903501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea423478-ce0b-4401-b186-4c22d845eed2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:39.908662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:39.909643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.910330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.910789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:39.931914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:39.933417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:39.951780 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3509/6989] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:39.984262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:39.984723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:39.985060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:40.019907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:40.024418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:40.169232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:40.179931 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3481/6990] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:40.185308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:40.243628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:40.276126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361434-1939-450e-b9e1-5583d68be2e2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:40.286217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:40.287092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:40.287560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:40.289388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:40.291798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:40.316403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:40.318247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4123e9-f1a7-43f9-8981-27d81256452a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:40.334897 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3482/6991] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:40.342988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce69a9-615d-4d3f-b65c-57ba8a4489bb service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:40.357919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:40.377955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:40.378111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:40.378309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:40.395182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:40.396861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:40.462303 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3510/6992] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:40.819258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:40.820270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:40.820815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:40.859877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:40.866774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:40.880803 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3483/6993] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:57:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:40.898052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:40.916088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8f2db-e581-4f0b-86e9-679d1c2fbf95 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:40.924472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9da1b-d7a8-493e-adce-3116e3d0867c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:40.925307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9da1b-d7a8-493e-adce-3116e3d0867c service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:40.925763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9da1b-d7a8-493e-adce-3116e3d0867c service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:40.926767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9da1b-d7a8-493e-adce-3116e3d0867c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:40.943267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9da1b-d7a8-493e-adce-3116e3d0867c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:40.945395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9da1b-d7a8-493e-adce-3116e3d0867c service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:40.959777 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3511/6994] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:41.521095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:41.522925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:41.570657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:41.629143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c47c15-bef0-4a85-a872-a51d7540250d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:41.644701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a70f4d99f48dbae96784d5a41fecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fec1d5b96f44eab4894f43f89755fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:41.659311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:41.669422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:41.669798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:41.670650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:41.671055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:41.677576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:41.693310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:41.693921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:41.694424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:41.725819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3484/6995] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:41.726909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:41.748676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] MFA Rules not processed for user `7cb038e111434aa581b9ebc7a578b196`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:41.753643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb36214-a91e-440a-9b8f-37dbe6fa44b2 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:41.754540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:41.769131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a70f4d99f48dbae96784d5a41fecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fec1d5b96f44eab4894f43f89755fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:41.770285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:41.770819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:41.771329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:41.774049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:41.776592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:41.873580 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3485/6996] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:41 2022] POST /identity/v3/projects => generated 347 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:41.879036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:41.989224 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3512/6997] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:42.001750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:42.006440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:42.145348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2182c0b-cd34-4ef3-9f0e-3db132fdf26c tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:42.166930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a70f4d99f48dbae96784d5a41fecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fec1d5b96f44eab4894f43f89755fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:42.169147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:42.169763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:42.171534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:42.173490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:42.176150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:42.187435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:42.238629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3486/6998] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:42.277337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2617f-e237-4b06-81ef-fd39273d0f8b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:42.404190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:42.459298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb5746-e1b6-48e7-8a7d-1c4929214739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:42.459934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5746-e1b6-48e7-8a7d-1c4929214739 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:42.460225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5746-e1b6-48e7-8a7d-1c4929214739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:42.460510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5746-e1b6-48e7-8a7d-1c4929214739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:42.670071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5746-e1b6-48e7-8a7d-1c4929214739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:42.671538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb5746-e1b6-48e7-8a7d-1c4929214739 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:42.691636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3513/6999] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:43.098696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:43.113398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4dffe-8135-44d9-a230-fafeacbdf9cd tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:43.117225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:43.117709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:43.118101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:43.122271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a70f4d99f48dbae96784d5a41fecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fec1d5b96f44eab4894f43f89755fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:43.122934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:43.123240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:43.123507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] PATH_INFO: `/v3/projects/0d4206203dfa4bb48eea1f36b71c80d9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:43.126158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d4206203dfa4bb48eea1f36b71c80d9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:43.129009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:43.179938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:43.181970 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:43.252238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4206203dfa4bb48eea1f36b71c80d9', 'request_id': 'req-2a0d0652-20c9-4c5d-8b5b-dd164c347873'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:43.290538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4206203dfa4bb48eea1f36b71c80d9', 'request_id': 'req-2a0d0652-20c9-4c5d-8b5b-dd164c347873'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:43.301929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4206203dfa4bb48eea1f36b71c80d9', 'request_id': 'req-2a0d0652-20c9-4c5d-8b5b-dd164c347873'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:43.316346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] The token cache is being invalidate because project 0d4206203dfa4bb48eea1f36b71c80d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:43.316666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:43.317389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:43.325480 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3487/7000] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:43 2022] DELETE /identity/v3/projects/0d4206203dfa4bb48eea1f36b71c80d9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:43.333691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:43.337518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:43.348841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3514/7001] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:57:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:43.365335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:43.366908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:43.397364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:43.541849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:43.566934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f03354-cd97-4c01-b544-d2efd58af5d0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:43.587605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d0652-20c9-4c5d-8b5b-dd164c347873 tempest-RoutersIpV6AdminTest-955305510 tempest-RoutersIpV6AdminTest-955305510-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:43.597587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:43.598459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:43.598560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:43.598754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:43.603632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:43.745643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:43.746388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:43.746775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:43.747311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:43.758211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:43.759919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660f55c-d790-42e1-a942-7f2e00f22a2d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:43.773856 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3488/7002] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:43.868998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:43.870809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:43.897488 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3515/7003] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:44.096480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10eb6f-e1cc-4063-adf0-ea9b6f7a82e1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:44.096830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10eb6f-e1cc-4063-adf0-ea9b6f7a82e1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:44.097439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10eb6f-e1cc-4063-adf0-ea9b6f7a82e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:44.138886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7f10eb6f-e1cc-4063-adf0-ea9b6f7a82e1 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:44.140928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f10eb6f-e1cc-4063-adf0-ea9b6f7a82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:44.160826 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3489/7004] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:44.177853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:44.195599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdece19-9995-4d89-937c-41e53cf34a30 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:44.208787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:44.210645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:44.214192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:44.214639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:44.225328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:44.228433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:44.260956 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3516/7005] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:44.477778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b0db0-122b-4d9a-ba07-8c03cd48be12 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:44.478061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b0db0-122b-4d9a-ba07-8c03cd48be12 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:44.478578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b0db0-122b-4d9a-ba07-8c03cd48be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:44.525853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-558b0db0-122b-4d9a-ba07-8c03cd48be12 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:44.528609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-558b0db0-122b-4d9a-ba07-8c03cd48be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:44.553199 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3490/7006] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:44.573165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:44.594405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f84a8-3733-43df-ac36-a5c09121ccdf service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:44.603327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:44.604229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:44.604666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:44.605216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:44.675301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:44.677982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:44.709329 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3517/7007] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:45.034034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ec411-3ebd-4938-a03d-ee83fba49f26 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.034314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ec411-3ebd-4938-a03d-ee83fba49f26 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.034769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ec411-3ebd-4938-a03d-ee83fba49f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.085066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c33ec411-3ebd-4938-a03d-ee83fba49f26 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:45.087144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c33ec411-3ebd-4938-a03d-ee83fba49f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:45.121995 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3491/7008] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:45.138604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:45.153153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700a8e0-adff-4748-9e21-f2e0630b6a26 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:45.161458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:45.162312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.163189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.163624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.175408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:45.177286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:45.189838 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3518/7009] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:45.410126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c7db-e061-40ee-8788-edd4c4abf31b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.411528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c7db-e061-40ee-8788-edd4c4abf31b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.412173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c7db-e061-40ee-8788-edd4c4abf31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.440014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1f33c7db-e061-40ee-8788-edd4c4abf31b None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:45.441282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1f33c7db-e061-40ee-8788-edd4c4abf31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:45.459070 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3492/7010] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:45.466169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:45.482867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc2ea-0a2e-4f93-981e-927391dc9643 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:45.488859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c375cd2-3e6c-416d-8a88-52a5f21a72d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:45.489681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375cd2-3e6c-416d-8a88-52a5f21a72d3 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.490028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375cd2-3e6c-416d-8a88-52a5f21a72d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.490382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375cd2-3e6c-416d-8a88-52a5f21a72d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.515228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c375cd2-3e6c-416d-8a88-52a5f21a72d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:45.517764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c375cd2-3e6c-416d-8a88-52a5f21a72d3 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:45.531027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3519/7011] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:45.620483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.620800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.621114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.646167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] MFA Rules not processed for user `7cb038e111434aa581b9ebc7a578b196`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:45.647873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:45.795295 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3493/7012] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:45.803599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.803899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.804185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.834118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:45.835350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:45.865477 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3520/7013] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:45.881596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:45.904339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7566d1-0aee-458e-a2d1-7a07448774f5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:45.911283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:45.912131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:45.912574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:45.913052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:45.931536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:45.933491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:45.967671 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3494/7014] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:57:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:57:46.137625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:46.139341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:46.229793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:46.258340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22048e1d-3ce3-4b66-a8c2-ff023dca2bd4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:46.264841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:46.265984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:46.267073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:46.267598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] PATH_INFO: `/v3/users/6048ff60543a40f19b890ab2249f2d93` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:46.271861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6048ff60543a40f19b890ab2249f2d93)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:46.273972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:46.351317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6048ff60543a40f19b890ab2249f2d93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:46.369659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6048ff60543a40f19b890ab2249f2d93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:46.371578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6048ff60543a40f19b890ab2249f2d93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:46.377520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:46.379831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:46.402754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1964bf-37b0-497b-b837-1473cc2c8b04 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:46.407512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:46.408679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:46.409226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:46.409954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:46.411205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6048ff60543a40f19b890ab2249f2d93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:46.412219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3903bd1a-534c-445e-8cce-e902bac640a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6048ff60543a40f19b890ab2249f2d93'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:46.412764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:46.429537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:46.432827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:46.445060 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3521/7015] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:46 2022] DELETE /identity/v3/users/6048ff60543a40f19b890ab2249f2d93 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:46.446691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:46.446995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:46.447277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:46.468575 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3495/7016] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:57:46.472473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:46.473773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:46.590475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3522/7017] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:46.608886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:46.611402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:46.636079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82341b4c-e643-47d6-b9f9-64c12333210e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:46.658973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:46.713992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3e79-d0f2-4238-9c30-6c4d812162c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:46.715019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3e79-d0f2-4238-9c30-6c4d812162c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:46.715532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3e79-d0f2-4238-9c30-6c4d812162c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:46.716095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3e79-d0f2-4238-9c30-6c4d812162c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:46.732016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3e79-d0f2-4238-9c30-6c4d812162c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:46.734213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3e79-d0f2-4238-9c30-6c4d812162c0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:46.764766 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3496/7018] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:47.388200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:47.390292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:47.417751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e343058-3cbc-4041-8bfc-ae3f6df4623d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:47.431296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:47.434268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:47.434623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:47.436586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] PATH_INFO: `/v3/projects/7bf177c7027043e6bb9507ffeecddeb9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:47.441729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf177c7027043e6bb9507ffeecddeb9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:47.446200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:47.523297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf177c7027043e6bb9507ffeecddeb9', 'request_id': 'req-36d3096f-8733-48c4-a98d-d932012a67fd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:47.530934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:47.542842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf177c7027043e6bb9507ffeecddeb9', 'request_id': 'req-36d3096f-8733-48c4-a98d-d932012a67fd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:47.555019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf177c7027043e6bb9507ffeecddeb9', 'request_id': 'req-36d3096f-8733-48c4-a98d-d932012a67fd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:47.596192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] The token cache is being invalidate because project 7bf177c7027043e6bb9507ffeecddeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:47.596498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:47.612236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36d3096f-8733-48c4-a98d-d932012a67fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:47.617108 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3523/7019] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:47 2022] DELETE /identity/v3/projects/7bf177c7027043e6bb9507ffeecddeb9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:47.626065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:47.626559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:47.626656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:47.677301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:47.681511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:47.858941 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3497/7020] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:47.866808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:47.867230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:47.867587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:47.905384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:47.906686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:47.919609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3524/7021] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:47.920864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:47.935353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418f722-77b5-456a-b1f2-a1cd54e0b261 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:47.944633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:47.945656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:47.946098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:47.946564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:47.947407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:47.959639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:47.966201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.014205 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3498/7022] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:48.020022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.060982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59384b07-5fd1-4a54-b75f-1af8082629f7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:48.074399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:48.075240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.075671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.076314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.077229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:48.080442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.122365 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3525/7023] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:48 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:48.126893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.137619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e20aac-00e5-4874-ac39-4e62773da429 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:48.216378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:48.217278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.217802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.218329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.220650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:48.223481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.269315 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3499/7024] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:48 2022] POST /identity/v3/users => generated 278 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:48.273564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.298925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99abde2-1884-4bce-ac96-1f55bab5b498 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:48.312091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:48.313977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.327100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.327386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.328860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:48.330583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.366728 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3526/7025] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:48.370985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.386447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a346c9-3c58-4c83-9b82-ef80393cd3ce admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:48.402828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1573c-40c8-494d-9b01-837bfaa9e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:48.403456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1573c-40c8-494d-9b01-837bfaa9e098 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.403744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1573c-40c8-494d-9b01-837bfaa9e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.404093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1573c-40c8-494d-9b01-837bfaa9e098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.404756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1573c-40c8-494d-9b01-837bfaa9e098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:48.411331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1573c-40c8-494d-9b01-837bfaa9e098 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.436847 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3500/7026] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:57:48.441388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.462332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e2c93-ba27-4481-9766-67f4ab3b4371 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:48.475374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:48.476202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.476561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.476926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] PATH_INFO: `/v3/projects/0e4b356774984a99b7ba4839959c47b3/users/e313081ca2074bf1abd7a4a7a11769f4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.503188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b356774984a99b7ba4839959c47b3, user_id=e313081ca2074bf1abd7a4a7a11769f4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:48.506958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.535660 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3527/7027] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:48 2022] PUT /identity/v3/projects/0e4b356774984a99b7ba4839959c47b3/users/e313081ca2074bf1abd7a4a7a11769f4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:48.546498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.546855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.547658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.610959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] MFA Rules not processed for user `e313081ca2074bf1abd7a4a7a11769f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:48.612800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:48.633050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:48.737196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3501/7028] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:48.741829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.877735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33b3d5-930a-47af-8f3e-79703ba8fc47 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:48.895720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:48.896620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:48.897042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:48.897501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:48.898318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:48.905687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:48.963588 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3528/7029] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:48 2022] POST /identity/v3/projects => generated 357 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:48.968445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:48.988318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffe2c-1e6a-4608-a120-5f0ef4a379fb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.099420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.100038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.100316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.100587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.101440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.103374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.133034 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3502/7030] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:48 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:49.137597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.152503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b32abe-f5ff-492b-a7e1-27b4606de60f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.158533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.159230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.159577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.160056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.160811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.163564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.186289 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3529/7031] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:49.187055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.200565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10c8de-bcc7-4295-baaf-81a4988280c7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.205872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.207130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.207410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.207685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] PATH_INFO: `/v3/projects/f7703e5f3d1a4366bc12d396f0d10fd5/users/194ddbd0aeb649bcba090fa7ee3d37b2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.227308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7703e5f3d1a4366bc12d396f0d10fd5, user_id=194ddbd0aeb649bcba090fa7ee3d37b2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.230937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.251277 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3503/7032] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:49 2022] PUT /identity/v3/projects/f7703e5f3d1a4366bc12d396f0d10fd5/users/194ddbd0aeb649bcba090fa7ee3d37b2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:49.255265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.267647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65be6d9-dc88-4b96-8fa7-c55958d584fa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.329992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:49.341162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61de280-199d-4777-ae36-67e46ae9055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.341963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61de280-199d-4777-ae36-67e46ae9055f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.342244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61de280-199d-4777-ae36-67e46ae9055f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.342664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61de280-199d-4777-ae36-67e46ae9055f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.343325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61de280-199d-4777-ae36-67e46ae9055f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.346242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61de280-199d-4777-ae36-67e46ae9055f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.361194 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3530/7033] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:49.366289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.381056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e8d6b-2729-44fd-9389-f9ebeb43d0b9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.387328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.388711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.389260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.389641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] PATH_INFO: `/v3/projects/f7703e5f3d1a4366bc12d396f0d10fd5/users/194ddbd0aeb649bcba090fa7ee3d37b2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.392133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7703e5f3d1a4366bc12d396f0d10fd5, user_id=194ddbd0aeb649bcba090fa7ee3d37b2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.395048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.419163 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3504/7034] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:49 2022] PUT /identity/v3/projects/f7703e5f3d1a4366bc12d396f0d10fd5/users/194ddbd0aeb649bcba090fa7ee3d37b2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:49.430102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.430601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.430878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.462442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] MFA Rules not processed for user `194ddbd0aeb649bcba090fa7ee3d37b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:49.463675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:49.565430 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3531/7035] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:49.570281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.585147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed14baf-d70e-41a6-9922-580381a9800d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.590876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '194ddbd0aeb649bcba090fa7ee3d37b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.591736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.592117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.592488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.593378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:49.594540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.601249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.632849 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3505/7036] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:49.637422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.649712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6102b-dbb7-458a-b1d0-0a7263d6a10e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.663765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '194ddbd0aeb649bcba090fa7ee3d37b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.664550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.664982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.665381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.666128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.668264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.759608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3532/7037] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:49 2022] POST /identity/v3/projects => generated 348 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:49.762058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.775310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdaf0d-7672-4946-89d9-ecc612e413da tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:49.883791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:49.904813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '194ddbd0aeb649bcba090fa7ee3d37b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:49.905236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:49.905683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:49.905960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:49.907311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:49.907706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:49.915563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:49.932300 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3506/7038] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:49.944917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:49.946755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:50.085700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf61a9-2501-4469-ab49-b62139d974ad tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:50.093121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:50.095375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:50.095920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:50.096478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:50.111408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:50.113324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:50.136725 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3533/7039] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:50.434205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:50.448317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9ff59-f5c7-49da-ad52-b5bc2d7239e0 tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:50.459591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '194ddbd0aeb649bcba090fa7ee3d37b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:50.461296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:50.461990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:50.462435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] PATH_INFO: `/v3/projects/10e0583d5c9945acb6bd7dd015e8c3d4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:50.466372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10e0583d5c9945acb6bd7dd015e8c3d4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:50.473448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:50.570965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e0583d5c9945acb6bd7dd015e8c3d4', 'request_id': 'req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:50.583881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e0583d5c9945acb6bd7dd015e8c3d4', 'request_id': 'req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:50.596255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e0583d5c9945acb6bd7dd015e8c3d4', 'request_id': 'req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:50.614700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] The token cache is being invalidate because project 10e0583d5c9945acb6bd7dd015e8c3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:50.615001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:50.615727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d3734e2e-7482-47f7-b4d6-41d13b69f5ed tempest-QuotasTest-1867093984 tempest-QuotasTest-1867093984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:50.620975 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3507/7040] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:50 2022] DELETE /identity/v3/projects/10e0583d5c9945acb6bd7dd015e8c3d4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:50.863429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:50.992372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:51.011280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504e4b-45fa-4a25-8015-d0a90aad0a7a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:51.135614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:51.137343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:51.141335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:51.141765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] PATH_INFO: `/v3/users/e313081ca2074bf1abd7a4a7a11769f4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:51.145910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e313081ca2074bf1abd7a4a7a11769f4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:51.148991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:51.216980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e313081ca2074bf1abd7a4a7a11769f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:51.239169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e313081ca2074bf1abd7a4a7a11769f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:51.239933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e313081ca2074bf1abd7a4a7a11769f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:51.250854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e313081ca2074bf1abd7a4a7a11769f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:51.252109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e313081ca2074bf1abd7a4a7a11769f4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:51.292532 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3534/7041] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:50 2022] DELETE /identity/v3/users/e313081ca2074bf1abd7a4a7a11769f4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:51.297627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:51.298167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:51.298471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:51.327445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:51.328807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:51.403817 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3508/7042] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:51.414090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:51.415930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:51.497811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74aadb-02a9-4ce8-8b14-1aae734b5474 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:51.503958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:51.505078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:51.505078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:51.505078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:51.522725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:51.524193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:51.540786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3535/7043] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:52.260204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:52.261814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:52.275241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017a9d-0821-43a9-8c73-016bedf403fd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:52.280435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:52.282190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:52.282646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:52.283147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] PATH_INFO: `/v3/projects/0e4b356774984a99b7ba4839959c47b3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:52.284555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4b356774984a99b7ba4839959c47b3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:52.286881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:52.362507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4b356774984a99b7ba4839959c47b3', 'request_id': 'req-5f922bf9-0c69-40c6-9b7d-57418b593559'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.381341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4b356774984a99b7ba4839959c47b3', 'request_id': 'req-5f922bf9-0c69-40c6-9b7d-57418b593559'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.392070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4b356774984a99b7ba4839959c47b3', 'request_id': 'req-5f922bf9-0c69-40c6-9b7d-57418b593559'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.401386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:52.415247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] The token cache is being invalidate because project 0e4b356774984a99b7ba4839959c47b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:52.415519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.416423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.418592 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3509/7044] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:52 2022] DELETE /identity/v3/projects/0e4b356774984a99b7ba4839959c47b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:52.422442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:52.441199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a01a9-21b9-4a52-a8b0-33ddd8fd07e7 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:52.475790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:52.534563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:52.535483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:52.535940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:52.536392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] PATH_INFO: `/v3/users/194ddbd0aeb649bcba090fa7ee3d37b2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:52.538470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194ddbd0aeb649bcba090fa7ee3d37b2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:52.542207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:52.614322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194ddbd0aeb649bcba090fa7ee3d37b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.640231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194ddbd0aeb649bcba090fa7ee3d37b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.641105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194ddbd0aeb649bcba090fa7ee3d37b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.658512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194ddbd0aeb649bcba090fa7ee3d37b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.659151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194ddbd0aeb649bcba090fa7ee3d37b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:52.686620 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3536/7045] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:52 2022] DELETE /identity/v3/users/194ddbd0aeb649bcba090fa7ee3d37b2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:53.146509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:53.148130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:53.181493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f922bf9-0c69-40c6-9b7d-57418b593559 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:53.366708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:53.367441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:53.367942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:53.368382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] PATH_INFO: `/v3/users/ef5ed582f9d74e2f9bd5ea39f41a5017` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:53.371094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5ed582f9d74e2f9bd5ea39f41a5017)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:53.377492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:53.449332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:53.451643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:53.475314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534059-7b70-4bcf-9c7a-5a33f33d41e8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:53.482758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:53.483924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:53.485256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:53.485850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] PATH_INFO: `/v3/projects/f7703e5f3d1a4366bc12d396f0d10fd5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:53.487952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7703e5f3d1a4366bc12d396f0d10fd5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:53.492301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:53.500105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5ed582f9d74e2f9bd5ea39f41a5017'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.530639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5ed582f9d74e2f9bd5ea39f41a5017'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.532003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5ed582f9d74e2f9bd5ea39f41a5017'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.543456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5ed582f9d74e2f9bd5ea39f41a5017'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.544264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-36649375-a05e-42ea-bcbf-90076ee04b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5ed582f9d74e2f9bd5ea39f41a5017'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.571281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'request_id': 'req-693698e3-d033-41e0-af52-3bd41e0b5587'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.579873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'request_id': 'req-693698e3-d033-41e0-af52-3bd41e0b5587'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.582688 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3510/7046] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:53 2022] DELETE /identity/v3/users/ef5ed582f9d74e2f9bd5ea39f41a5017 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:53.586636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7703e5f3d1a4366bc12d396f0d10fd5', 'request_id': 'req-693698e3-d033-41e0-af52-3bd41e0b5587'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.611094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] The token cache is being invalidate because project f7703e5f3d1a4366bc12d396f0d10fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:53.611452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.612163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-693698e3-d033-41e0-af52-3bd41e0b5587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:53.617700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3537/7047] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:53 2022] DELETE /identity/v3/projects/f7703e5f3d1a4366bc12d396f0d10fd5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:53.620645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:53.620970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:53.621255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:53.679753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:53.681064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:53.772947 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3511/7048] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:53.777450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:53.777809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:53.778316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:53.810691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:53.812081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:53.827217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:53.838512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3538/7049] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:53.850868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182ac2-a9cf-4bff-86ed-a59f98b8a600 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:53.861078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:53.862017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:53.862447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:53.862822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:53.867868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:53.869139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:53.871480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:53.897497 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3512/7050] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:57:53.898923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:53.910274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b864928-28a2-4583-9798-856bdc857c1b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:53.916509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:53.917181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:53.917468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:53.917744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:53.918395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:53.920410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:53.963655 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3539/7051] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:53 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:53.963655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:53.965109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:53.979813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:54.004604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2f6c-9992-4183-b372-617375b73d41 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.053783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.057638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.075986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.076874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.077281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.078551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.079366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.081641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.112960 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3513/7052] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:53 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:57:54.115551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.143001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e045cd-0ca5-46dc-9a9c-dd0ea323d3df admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.150732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.155579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.155891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.156218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.157422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.157847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201aea1-02b6-49a6-9b95-bb4fa8094ab5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.159255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.164123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.165259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.165714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.166151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] PATH_INFO: `/v3/projects/df7f497ef84645d3bead6c2e54a7603d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.167555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7f497ef84645d3bead6c2e54a7603d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.169677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.196993 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3514/7053] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:54.197953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.217539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4808d-15df-4249-9bd6-9069f1e95436 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.223958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.224714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.225035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.225313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.226633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.229237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.242555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3515/7054] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:54.246915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.247084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7f497ef84645d3bead6c2e54a7603d', 'request_id': 'req-5f245a4d-1955-40a9-a2c9-105f8f79eb60'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.272691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dac1ec-be36-4240-93c0-9c78be96d1de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.274107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7f497ef84645d3bead6c2e54a7603d', 'request_id': 'req-5f245a4d-1955-40a9-a2c9-105f8f79eb60'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.283410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7f497ef84645d3bead6c2e54a7603d', 'request_id': 'req-5f245a4d-1955-40a9-a2c9-105f8f79eb60'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.304623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] The token cache is being invalidate because project df7f497ef84645d3bead6c2e54a7603d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:54.305128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.305813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.307352 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3540/7055] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:54 2022] DELETE /identity/v3/projects/df7f497ef84645d3bead6c2e54a7603d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:54.312219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.316476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.358531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fb05-0f3d-40fe-b109-a7ee3a4bd4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.359283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fb05-0f3d-40fe-b109-a7ee3a4bd4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.359684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fb05-0f3d-40fe-b109-a7ee3a4bd4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.360186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fb05-0f3d-40fe-b109-a7ee3a4bd4c5 admin admin] PATH_INFO: `/v3/projects/e04c5902c7b94a6ea0c4b643ec0e2900/users/fe13857fdbb24f0db9bbc7190fedaf24/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.379144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fb05-0f3d-40fe-b109-a7ee3a4bd4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04c5902c7b94a6ea0c4b643ec0e2900, user_id=fe13857fdbb24f0db9bbc7190fedaf24, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.382663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fb05-0f3d-40fe-b109-a7ee3a4bd4c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.412526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f245a4d-1955-40a9-a2c9-105f8f79eb60 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.416981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3516/7056] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:54 2022] PUT /identity/v3/projects/e04c5902c7b94a6ea0c4b643ec0e2900/users/fe13857fdbb24f0db9bbc7190fedaf24/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:54.427386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.429412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.430468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.474115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:54.479155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] MFA Rules not processed for user `fe13857fdbb24f0db9bbc7190fedaf24`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:54.480546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.516956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.517622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.517903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.518190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] PATH_INFO: `/v3/users/5d9af0269a6b459ca7f74d5a0ed18ffb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.519615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9af0269a6b459ca7f74d5a0ed18ffb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.521840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.543771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:54.606635 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3517/7057] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:54.608350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.609994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.612038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9af0269a6b459ca7f74d5a0ed18ffb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.633031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8711330-d3fe-4e8c-9b73-43e4150547da None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.635088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9af0269a6b459ca7f74d5a0ed18ffb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.635915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9af0269a6b459ca7f74d5a0ed18ffb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.640524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.641885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.643002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.643547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.644445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.647062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.656605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9af0269a6b459ca7f74d5a0ed18ffb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.658229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9af0269a6b459ca7f74d5a0ed18ffb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:54.677000 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3541/7058] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:57:54 2022] DELETE /identity/v3/users/5d9af0269a6b459ca7f74d5a0ed18ffb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:54.701375 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3518/7059] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:54.705492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.707546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.781899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.784089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.817429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef74a6-74aa-4ab0-82f5-1b91512e1176 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.913260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.914576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.914576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.914798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.915519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.916606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c9328-2e3e-4330-b119-da3297f02e55 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.918030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:54.930393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:54.942037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.943880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.944308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.944772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.947712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.956654 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3542/7060] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:54 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:54.957966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:54.960765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:54.977672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb334a5-ad34-44d3-a262-7ac6bbdf8bfc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:54.983110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:54.983994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:54.985733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:54.986529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] PATH_INFO: `/v3/projects/08356cdfc83e4d13a0e0db4b4f5f80c0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:54.987935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08356cdfc83e4d13a0e0db4b4f5f80c0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:54.990188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.075254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08356cdfc83e4d13a0e0db4b4f5f80c0', 'request_id': 'req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:55.080289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.082376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.087537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08356cdfc83e4d13a0e0db4b4f5f80c0', 'request_id': 'req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:55.095775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08356cdfc83e4d13a0e0db4b4f5f80c0', 'request_id': 'req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:55.104504 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3519/7061] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:55.106014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.117307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] The token cache is being invalidate because project 08356cdfc83e4d13a0e0db4b4f5f80c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:57:55.117657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:55.118724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29fe4fa0-fc8d-4c63-b478-c17cf8b1a7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:57:55.120551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3543/7062] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:57:54 2022] DELETE /identity/v3/projects/08356cdfc83e4d13a0e0db4b4f5f80c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:55.126794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7624f-cd26-4e03-a219-9974e7218195 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.127905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7624f-cd26-4e03-a219-9974e7218195 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.128191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7624f-cd26-4e03-a219-9974e7218195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.148006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebda7-dbb0-496f-a103-435c1120430b service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.152574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54c7624f-cd26-4e03-a219-9974e7218195 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:55.154261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54c7624f-cd26-4e03-a219-9974e7218195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:55.251922 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3544/7063] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:57:55.257913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.258204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.258485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.271681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:55.287591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.288544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.288956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.290418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.291267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.293381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.301942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:55.303159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:55.309541 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3520/7064] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:55.314542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.317890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:55.324253 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3545/7065] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:55.329896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.337882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478456-d661-4332-acb7-260bb37739b3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.345188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.346048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.347736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.348132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] PATH_INFO: `/v3/projects/acd253ae45db4f419e3bce8f2b6c50ca/users/4ac3ec9496284bb3a3bbc7b51612143f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.351153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7755b2d-40fc-43cb-bff1-56d8978a60a1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.365749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.366391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.366660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.366923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.367584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:57:55.367887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.369827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.373589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd253ae45db4f419e3bce8f2b6c50ca, user_id=4ac3ec9496284bb3a3bbc7b51612143f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.377133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.388894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3546/7066] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:57:55.398284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.408453 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3521/7067] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:55 2022] PUT /identity/v3/projects/acd253ae45db4f419e3bce8f2b6c50ca/users/4ac3ec9496284bb3a3bbc7b51612143f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:57:55.410111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.412150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bcd41-2658-467f-9a94-b496d4335490 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.480787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:55.492270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.493528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.495888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.496023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd460f0-b49e-4192-94a8-b2432108eb7d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.496519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.497777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.502019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.503240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.503934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.504277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.504621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.505365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.507402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.521665 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3522/7068] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:55.526141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.539125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d295d-a8f0-4723-90c2-f9cb72bd8b41 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.545891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5185b-dd3d-4f72-a0a4-89c8f8c4cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.546513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5185b-dd3d-4f72-a0a4-89c8f8c4cf89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.546822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5185b-dd3d-4f72-a0a4-89c8f8c4cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.547104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5185b-dd3d-4f72-a0a4-89c8f8c4cf89 admin admin] PATH_INFO: `/v3/projects/acd253ae45db4f419e3bce8f2b6c50ca/users/4ac3ec9496284bb3a3bbc7b51612143f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.550962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5185b-dd3d-4f72-a0a4-89c8f8c4cf89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd253ae45db4f419e3bce8f2b6c50ca, user_id=4ac3ec9496284bb3a3bbc7b51612143f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.553689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5185b-dd3d-4f72-a0a4-89c8f8c4cf89 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.562533 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3547/7069] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:57:55 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:55.566978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.569161 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3523/7070] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:55 2022] PUT /identity/v3/projects/acd253ae45db4f419e3bce8f2b6c50ca/users/4ac3ec9496284bb3a3bbc7b51612143f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:55.580762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.581971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.581971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.625983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] MFA Rules not processed for user `4ac3ec9496284bb3a3bbc7b51612143f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:55.627436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:55.677589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99021f83-b0b6-4a12-96f1-51ca096fbd6a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.683626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.684736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.685288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.685929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.686667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.689092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.789299 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3548/7071] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:57:55 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:57:55.790566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.809958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa930b07-9b3b-45be-8bed-62d17c160bf3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.823096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.823823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.824179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.824529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.825301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.827165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.828982 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3524/7072] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:55.843446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.849464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:55.850042 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3549/7073] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:55.854726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.879554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a7f64-809a-497b-9bf3-810f39ee86ec admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.905936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.907354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.907930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.908378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:55.909226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:55.911157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:55.942168 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3550/7074] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:57:55.945454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:55.961194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:57:55.973640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57d076-f5be-4273-8992-44ffc6bf5201 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:55.982127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52aed-2a5e-40d9-b7d9-a3b213073a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:55.983291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52aed-2a5e-40d9-b7d9-a3b213073a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:55.983910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52aed-2a5e-40d9-b7d9-a3b213073a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:55.986171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52aed-2a5e-40d9-b7d9-a3b213073a2c admin admin] PATH_INFO: `/v3/projects/1d8dfc2b9fa14888ad008ee075da8170/users/78ecb250db344080990dd801dacbde48/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:56.020923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9701a9-f6ea-47cc-bcaf-633bbde3261e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:56.034438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:56.035313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:56.035313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:56.035540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:56.038494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52aed-2a5e-40d9-b7d9-a3b213073a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8dfc2b9fa14888ad008ee075da8170, user_id=78ecb250db344080990dd801dacbde48, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:56.041584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52aed-2a5e-40d9-b7d9-a3b213073a2c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:56.077854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:56.078967 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3551/7075] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:57:55 2022] PUT /identity/v3/projects/1d8dfc2b9fa14888ad008ee075da8170/users/78ecb250db344080990dd801dacbde48/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:57:56.079858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:56.086403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:56.086816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:56.087213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:56.101014 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3525/7076] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:57:56.135399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:57:56.136613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:56.264051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3552/7077] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:57:56.272479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:57:56.274625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:57:56.302246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaa31b-16f8-4884-b3a1-2116cb7372f6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:57:56.392274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:57:56.393279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:57:56.393761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:57:56.394232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:57:56.413794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:57:56.416928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:57:56.456971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3526/7078] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:01.965799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:01.967420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:02.048524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:02.168633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dbcb2-9b06-4b3b-a5dc-2dcdd503823d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:02.191455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:02.192091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:02.192383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:02.192666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:02.205921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:02.230531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:02.232211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:02.273364 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3553/7079] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:02.662539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:02.682520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f451d-4b8a-4c15-bcc5-03c9f5eab9cd service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:02.701272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:02.701272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:02.701272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:02.701272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:02.706005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:02.880526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:02.883015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59218-c342-4cea-9610-8ac0878ae951 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:02.918470 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3527/7080] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:05.046099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:05.058495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665941bc-0b27-4ee0-b196-872c57174edf service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:05.064116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:05.065219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:05.065661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:05.066093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] PATH_INFO: `/v3/users/fe13857fdbb24f0db9bbc7190fedaf24` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:05.067427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe13857fdbb24f0db9bbc7190fedaf24)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:05.069577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:05.132628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe13857fdbb24f0db9bbc7190fedaf24'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:05.149496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe13857fdbb24f0db9bbc7190fedaf24'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:05.149496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe13857fdbb24f0db9bbc7190fedaf24'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:05.160895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe13857fdbb24f0db9bbc7190fedaf24'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:05.165054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe13857fdbb24f0db9bbc7190fedaf24'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:05.184961 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3554/7081] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:05 2022] DELETE /identity/v3/users/fe13857fdbb24f0db9bbc7190fedaf24 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:05.189268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:05.189770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:05.190141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:05.247766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:05.253769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:05.362864 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3528/7082] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:05.460432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:05.472175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:05.623814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867cf08-44bf-422c-a681-7d97ded547ed admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:05.641408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:05.645067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:05.645369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:05.647699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:05.762663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:05.765742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:05.803234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3555/7083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:06.868032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:06.870028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:06.910073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a25780-c0db-4982-8ebc-777ce317d3a4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:06.923883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:06.924762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:06.925286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:06.925821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] PATH_INFO: `/v3/projects/e04c5902c7b94a6ea0c4b643ec0e2900` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:06.927443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04c5902c7b94a6ea0c4b643ec0e2900)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:06.929536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:06.978170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:07.041275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:07.048384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04c5902c7b94a6ea0c4b643ec0e2900', 'request_id': 'req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.065217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063711-ac62-4f2b-9c0c-32b6bd3e5e29 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:07.083345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04c5902c7b94a6ea0c4b643ec0e2900', 'request_id': 'req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.100594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04c5902c7b94a6ea0c4b643ec0e2900', 'request_id': 'req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.156397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:07.157848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] The token cache is being invalidate because project e04c5902c7b94a6ea0c4b643ec0e2900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:58:07.158155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.163127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.174354 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3529/7084] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:58:06 2022] DELETE /identity/v3/projects/e04c5902c7b94a6ea0c4b643ec0e2900 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:07.175821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:07.177498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:07.243441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:07.244271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:07.244660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:07.245084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:07.253036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:07.318313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc633d4-6a97-4fd3-b532-ee26c940b5a1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:07.326684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:07.327642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:07.328856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:07.329478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] PATH_INFO: `/v3/users/4ac3ec9496284bb3a3bbc7b51612143f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:07.332733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac3ec9496284bb3a3bbc7b51612143f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:07.335245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:07.432605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:07.434519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:07.466647 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3556/7085] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:58:07.500655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac3ec9496284bb3a3bbc7b51612143f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.525522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac3ec9496284bb3a3bbc7b51612143f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.526649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac3ec9496284bb3a3bbc7b51612143f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.541913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac3ec9496284bb3a3bbc7b51612143f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.545327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-00a55b47-7d55-4d5e-a5ff-72975cc86a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac3ec9496284bb3a3bbc7b51612143f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:07.579302 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3530/7086] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:07 2022] DELETE /identity/v3/users/4ac3ec9496284bb3a3bbc7b51612143f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:07.877046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:07.895394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c24eb-c511-4476-9496-7920d518c464 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.008891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.009584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.009866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.010144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] PATH_INFO: `/v3/projects/acd253ae45db4f419e3bce8f2b6c50ca` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.011611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd253ae45db4f419e3bce8f2b6c50ca)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.013504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.124012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd253ae45db4f419e3bce8f2b6c50ca', 'request_id': 'req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:08.131752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd253ae45db4f419e3bce8f2b6c50ca', 'request_id': 'req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:08.146786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd253ae45db4f419e3bce8f2b6c50ca', 'request_id': 'req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:08.167289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] The token cache is being invalidate because project acd253ae45db4f419e3bce8f2b6c50ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:58:08.167601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:08.168274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ef94f7-69f2-4e54-bd23-7b7d7d65f631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:08.182379 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3557/7087] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:58:07 2022] DELETE /identity/v3/projects/acd253ae45db4f419e3bce8f2b6c50ca => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:08.192091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.192612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.192726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.231452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:08.233208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:08.259357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:08.336528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3531/7088] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:08.344892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.345208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.345489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.356934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:08.372344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:08.374824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:08.399758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:08.413109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3558/7089] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:08.414354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094e7a3-52f7-4258-8982-4f25391daa48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.419261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.419989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.420482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.420826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.421822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:58:08.422275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.424535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.443027 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3532/7090] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:58:08.444320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:08.458020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c153de-fbcf-420a-b350-1afc2dca8f94 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.463305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.464162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.464455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.464721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.465401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.467761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.511025 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3559/7091] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:58:08 2022] POST /identity/v3/projects => generated 395 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:58:08.512418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:08.540013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adf427-1551-4c2b-aad0-21bcd13d884d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.620017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.620973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.621483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.621947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.622819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.625793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.679226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3533/7092] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:58:08 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:58:08.680934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:08.700049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82f2a7-620b-45d3-a5a1-1418d76861d9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.705865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.706502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.706781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.707256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.707920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.709955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.724431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3560/7093] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:58:08.728813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:08.745529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc727-5bed-4cac-9729-5b9ccd9f6cfb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.752537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ea2ea-22ed-4e3e-ba16-456dbe89cfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.754002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea2ea-22ed-4e3e-ba16-456dbe89cfad admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.754779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea2ea-22ed-4e3e-ba16-456dbe89cfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.755118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ea2ea-22ed-4e3e-ba16-456dbe89cfad admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.760571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ea2ea-22ed-4e3e-ba16-456dbe89cfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.766934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ea2ea-22ed-4e3e-ba16-456dbe89cfad admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.812572 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3534/7094] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:58:08.815449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:08.832290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0a9e3-2a74-4dfc-9de2-a01d4d1ec1a7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:08.840249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:08.853013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.853665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.853952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] PATH_INFO: `/v3/projects/d8e8954a01bc40fb976463650660e668/users/89ef5e2acb4a41febdd407036a9b62a2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.881952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e8954a01bc40fb976463650660e668, user_id=89ef5e2acb4a41febdd407036a9b62a2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:08.884776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:08.906179 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3561/7095] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:58:08 2022] PUT /identity/v3/projects/d8e8954a01bc40fb976463650660e668/users/89ef5e2acb4a41febdd407036a9b62a2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:08.916010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134cb5-5352-4138-9abe-815544ee334b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:08.916560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134cb5-5352-4138-9abe-815544ee334b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:08.919507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11134cb5-5352-4138-9abe-815544ee334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:08.966790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-11134cb5-5352-4138-9abe-815544ee334b None None] MFA Rules not processed for user `89ef5e2acb4a41febdd407036a9b62a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:08.968036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-11134cb5-5352-4138-9abe-815544ee334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:09.104969 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3535/7096] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:09.116652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:09.118430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:09.208498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280c73-23a7-44d4-a593-2443da14c423 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:09.215725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df5319-238b-4080-84c7-239a63c63f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:09.216543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df5319-238b-4080-84c7-239a63c63f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:09.220795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df5319-238b-4080-84c7-239a63c63f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:09.221427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df5319-238b-4080-84c7-239a63c63f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:09.243836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df5319-238b-4080-84c7-239a63c63f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:09.245354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df5319-238b-4080-84c7-239a63c63f06 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:09.273656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3562/7097] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:09 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:09.901008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:09.901513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:09.902112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:09.948988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] MFA Rules not processed for user `78ecb250db344080990dd801dacbde48`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:09.950312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:09.966824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:10.117385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3536/7098] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:10.128159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:10.128684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:10.129250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:10.165987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] MFA Rules not processed for user `78ecb250db344080990dd801dacbde48`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:10.168366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:10.214995 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3563/7099] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:10.221337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:10.223254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:10.407086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea86fb7-342e-4573-8e18-003495b2406a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:10.414934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ff683-002b-4073-8709-c72a3d8ccbce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:10.420521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff683-002b-4073-8709-c72a3d8ccbce service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:10.421049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff683-002b-4073-8709-c72a3d8ccbce service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:10.422069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff683-002b-4073-8709-c72a3d8ccbce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:10.446163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ff683-002b-4073-8709-c72a3d8ccbce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:10.451794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ff683-002b-4073-8709-c72a3d8ccbce service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:10.501659 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3537/7100] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:12.089392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:12.093703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:12.308425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58359-97df-4d78-bcb7-2cc1438fd728 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:12.349344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:12.350287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:12.351482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:12.352205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:12.357627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:12.384135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:12.385409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:12.403007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3564/7101] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:14.013958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:14.014547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:14.014547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:14.059079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] MFA Rules not processed for user `7cb038e111434aa581b9ebc7a578b196`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:14.060246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:14.295471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3538/7102] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:22.395479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:24.242286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=82 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:30.634961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:30.636527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:30.736725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330b101-952d-488c-b6c0-185f62f5e488 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:30.741343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:30.741976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:30.742264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:30.742545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] PATH_INFO: `/v3/users/f23b56d519224b22802f978442c7289f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:30.743674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23b56d519224b22802f978442c7289f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:30.746520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:30.850477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23b56d519224b22802f978442c7289f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:30.879599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23b56d519224b22802f978442c7289f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:30.881685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23b56d519224b22802f978442c7289f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:30.900339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23b56d519224b22802f978442c7289f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:30.901473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23b56d519224b22802f978442c7289f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:30.939512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3565/7103] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:30 2022] DELETE /identity/v3/users/f23b56d519224b22802f978442c7289f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:31.020561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:31.058985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee45a6-ee50-4a9b-a2e2-e6c930ced371 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:31.179178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:31.179805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:31.180089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:31.180365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:31.182248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:31.197721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:31.199925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:31.212491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3539/7104] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:31.419313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:31.421057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:31.569937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc06e-d800-427b-a40d-04610547f3cf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:31.591076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:31.592155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:31.592619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:31.593156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] PATH_INFO: `/v3/projects/cfa67de433dc46a595baea99d927d156` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:31.597417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa67de433dc46a595baea99d927d156)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:31.600693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:31.640190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:31.701000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa67de433dc46a595baea99d927d156', 'request_id': 'req-576daecc-7178-41aa-9417-7e5d54bdd363'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.708697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa67de433dc46a595baea99d927d156', 'request_id': 'req-576daecc-7178-41aa-9417-7e5d54bdd363'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.719077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa67de433dc46a595baea99d927d156', 'request_id': 'req-576daecc-7178-41aa-9417-7e5d54bdd363'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.741254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] The token cache is being invalidate because project cfa67de433dc46a595baea99d927d156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:58:31.741795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.742719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.746007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3566/7105] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:58:31 2022] DELETE /identity/v3/projects/cfa67de433dc46a595baea99d927d156 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:31.750503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:31.763789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d727b-e114-4dc9-a3d7-a65c9ace7c3a service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:31.835700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:31.836352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:31.836633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:31.836928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] PATH_INFO: `/v3/users/81392d1632f64d5f90cd9cd0836110f1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:31.838096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81392d1632f64d5f90cd9cd0836110f1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:31.840202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:31.901904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81392d1632f64d5f90cd9cd0836110f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.926971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81392d1632f64d5f90cd9cd0836110f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.927867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81392d1632f64d5f90cd9cd0836110f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.938640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81392d1632f64d5f90cd9cd0836110f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.939841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-46a84f84-ec4f-4137-a4b6-573c4b162c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81392d1632f64d5f90cd9cd0836110f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:31.955304 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3540/7106] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:31 2022] DELETE /identity/v3/users/81392d1632f64d5f90cd9cd0836110f1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:32.441122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:32.442710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:32.470392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576daecc-7178-41aa-9417-7e5d54bdd363 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:32.604142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:32.604738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:32.605055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:32.605331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] PATH_INFO: `/v3/projects/126daf070e3e43478d08a02f39e6abda` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:32.609636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126daf070e3e43478d08a02f39e6abda)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:32.611706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:32.724017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126daf070e3e43478d08a02f39e6abda', 'request_id': 'req-41a25632-e1bb-470b-96a3-973f693d8f99'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:32.738209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126daf070e3e43478d08a02f39e6abda', 'request_id': 'req-41a25632-e1bb-470b-96a3-973f693d8f99'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:32.751069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126daf070e3e43478d08a02f39e6abda', 'request_id': 'req-41a25632-e1bb-470b-96a3-973f693d8f99'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:32.787309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] The token cache is being invalidate because project 126daf070e3e43478d08a02f39e6abda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:58:32.787613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:32.789625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-41a25632-e1bb-470b-96a3-973f693d8f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:32.796686 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3567/7107] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:58:32 2022] DELETE /identity/v3/projects/126daf070e3e43478d08a02f39e6abda => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:32.798854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:32.799334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:32.799447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:32.813786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:32.852557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:32.859155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:33.043584 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3541/7108] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:33.056484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.057107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.057605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.114128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:33.115683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:33.127440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3568/7109] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:33.131534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.151200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63b245-c4b5-4f2f-80d4-d6cf15393664 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:33.168730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:33.169262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.169637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.170040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.171095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:58:33.171626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:33.173505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:33.200930 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3542/7110] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:58:33.206366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.220487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7477ae-cfe3-4c77-ac48-153770e53bc6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:33.234517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:33.235243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.235594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.235937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.236669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:33.239437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:33.294461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3569/7111] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:58:33 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:58:33.299168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.312945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085e79-2ea0-40c6-afeb-5c1db6c8f2dd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:33.398775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:33.399857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.400131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.400614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.401444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:33.404137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:33.454309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3543/7112] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:58:33 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:58:33.456760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.474536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab646-dd73-4635-8318-5c48617a8555 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:33.482870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:33.484773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.485227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.485597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.486882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:33.493869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:33.503519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:33.518497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3570/7113] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:58:33.519606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.534171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8bdad-648d-4274-a5dc-e785a13fbc4c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:33.543773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ab005-9e9f-4b37-a280-69e874d93e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:33.544422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ab005-9e9f-4b37-a280-69e874d93e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.544871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ab005-9e9f-4b37-a280-69e874d93e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.545195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ab005-9e9f-4b37-a280-69e874d93e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.547283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ab005-9e9f-4b37-a280-69e874d93e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:33.550569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ab005-9e9f-4b37-a280-69e874d93e40 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:33.567018 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3544/7114] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:58:33.568341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.581292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfbfb4-df32-46a2-a434-23287aa78007 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:33.590173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:33.592153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.592442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.593596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] PATH_INFO: `/v3/projects/feef1976405a442eb7ee441d12c9a1d9/users/329523b6f089401face7b477d08ca7d6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.615506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feef1976405a442eb7ee441d12c9a1d9, user_id=329523b6f089401face7b477d08ca7d6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:33.619644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:33.643323 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3571/7115] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:58:33 2022] PUT /identity/v3/projects/feef1976405a442eb7ee441d12c9a1d9/users/329523b6f089401face7b477d08ca7d6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:33.645460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:33.645760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:33.646043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:33.688191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:33.690306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:33.869025 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3545/7116] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:33.886271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:33.888191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:34.011141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a88c8-1efe-4b02-b50f-13069ce41311 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:34.015277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:34.016122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:34.016477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:34.016876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:34.029834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:34.032049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:34.052084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3572/7117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:41.322942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:41.324418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:41.348877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:41.570028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dda88-8e98-4d99-8935-f94c6de02bca None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:41.585579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:41.586558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:41.587248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:41.587733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:41.601624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:41.621963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:41.624603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:41.654723 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3546/7118] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:41.844298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:41.845838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:41.851432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:41.872563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97d0e7-acca-48da-9145-2a26244b7efc service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:41.889920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:41.891085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:41.891380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:41.891656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:41.892633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288136e-ad09-446f-8080-7a9917bf2f5b service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:41.908474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:41.914017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:41.914836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:41.916189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:41.916504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] PATH_INFO: `/v3/users/89ef5e2acb4a41febdd407036a9b62a2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:41.921404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ef5e2acb4a41febdd407036a9b62a2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:41.928021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:41.931693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:41.933193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2af087-9908-48ad-b3dd-7ea91743d3af service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:41.957782 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3547/7119] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:42.074323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ef5e2acb4a41febdd407036a9b62a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:42.114624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ef5e2acb4a41febdd407036a9b62a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:42.117281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ef5e2acb4a41febdd407036a9b62a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:42.143298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ef5e2acb4a41febdd407036a9b62a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:42.145438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ef5e2acb4a41febdd407036a9b62a2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:42.166840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3573/7120] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:41 2022] DELETE /identity/v3/users/89ef5e2acb4a41febdd407036a9b62a2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:42.171613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:42.171909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:42.172284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:42.211468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:42.212692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:42.348744 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3548/7121] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:42.469964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:42.471661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:42.626361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d95bea-5c54-4402-91c6-9bec5b11df17 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:42.636540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d779c6-f29a-4b3a-8801-42fe0c058494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:42.645320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d779c6-f29a-4b3a-8801-42fe0c058494 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:42.646935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d779c6-f29a-4b3a-8801-42fe0c058494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:42.647636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d779c6-f29a-4b3a-8801-42fe0c058494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:42.663396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:42.682046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d779c6-f29a-4b3a-8801-42fe0c058494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:42.683694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d779c6-f29a-4b3a-8801-42fe0c058494 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:42.706874 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3574/7122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:43.428421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:43.429907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:43.478213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2a9c9-3dc3-4e29-bf7a-6da10439d912 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:43.500403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:43.502778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:43.507926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:43.508429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] PATH_INFO: `/v3/projects/d8e8954a01bc40fb976463650660e668` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:43.509927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e8954a01bc40fb976463650660e668)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:43.512084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:43.623313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e8954a01bc40fb976463650660e668', 'request_id': 'req-a03f5878-812c-40b8-9d34-df321f7b192b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:43.646737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e8954a01bc40fb976463650660e668', 'request_id': 'req-a03f5878-812c-40b8-9d34-df321f7b192b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:43.654540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e8954a01bc40fb976463650660e668', 'request_id': 'req-a03f5878-812c-40b8-9d34-df321f7b192b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:43.697218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] The token cache is being invalidate because project d8e8954a01bc40fb976463650660e668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:58:43.697766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:43.698692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a03f5878-812c-40b8-9d34-df321f7b192b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:43.701477 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3549/7123] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:58:43 2022] DELETE /identity/v3/projects/d8e8954a01bc40fb976463650660e668 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:43.707069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:43.707598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:43.707715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:43.761268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:43.762619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:43.933457 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3575/7124] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:43.935112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:43.935567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:43.936004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:43.984475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:43.986153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:44.010673 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3550/7125] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:44.015271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:44.028727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7256ff-a4c0-4a2d-b061-bb2dd5f77557 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:44.039983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:44.040734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.041147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.041528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.042884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:58:44.043776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:44.049584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:44.084934 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3576/7126] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:58:44.088678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:44.104996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:44.115142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b710fc-d966-468c-95ef-8c081c5de90d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:44.153130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:44.158349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.162434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.162916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.163759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:44.169405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:44.322792 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3551/7127] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:58:44 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:58:44.324822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:44.349596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855f4aa-f24d-4aac-a7de-2805636426c3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:44.554084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:44.554745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.555026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.555303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.561962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:44.564205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:44.615628 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3577/7128] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:58:44 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:58:44.616466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:44.631300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eef9f-d170-499d-86a7-9d71a3c3b2ec admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:44.656969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:44.657974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.658471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.659716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.660603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:44.662498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:44.697925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:44.705837 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3552/7129] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:58:44.726668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99353472-5186-4025-9967-10ca7c688ab7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:44.741091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ec7af-4622-4eac-9fe0-8084235a83c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:44.741915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ec7af-4622-4eac-9fe0-8084235a83c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.742651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ec7af-4622-4eac-9fe0-8084235a83c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.743102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ec7af-4622-4eac-9fe0-8084235a83c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.745981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ec7af-4622-4eac-9fe0-8084235a83c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:44.750348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ec7af-4622-4eac-9fe0-8084235a83c3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:44.782613 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3578/7130] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:58:44.789534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:44.831907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.833306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.834429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.846665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a033c8-40a8-4440-a8c8-480adbe5516a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:44.896419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019d0c-77bf-4a94-83e8-cddda3a54b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:44.897269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019d0c-77bf-4a94-83e8-cddda3a54b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:44.897399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019d0c-77bf-4a94-83e8-cddda3a54b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:44.900668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019d0c-77bf-4a94-83e8-cddda3a54b70 admin admin] PATH_INFO: `/v3/projects/592ddf905dbe44e9a8b8103a1039b838/users/cc4457be6ac6435691f5f5ff11801114/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:44.979950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:44.981212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:44.987563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019d0c-77bf-4a94-83e8-cddda3a54b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592ddf905dbe44e9a8b8103a1039b838, user_id=cc4457be6ac6435691f5f5ff11801114, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:44.996583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019d0c-77bf-4a94-83e8-cddda3a54b70 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:45.031588 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3553/7131] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:58:44 2022] PUT /identity/v3/projects/592ddf905dbe44e9a8b8103a1039b838/users/cc4457be6ac6435691f5f5ff11801114/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:58:45.043122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:45.044515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:45.044930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:45.142226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] MFA Rules not processed for user `cc4457be6ac6435691f5f5ff11801114`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:45.146387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:45.296537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3579/7132] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 02:58:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:45.396551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:45.399488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:45.410589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:45.433786 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3554/7133] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:58:45.497109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:45.500047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:45.716835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fe021-44d5-413c-ad72-0d05263afec1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:45.726739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91a8b2-7faa-4bde-99e2-806163d19a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:45.732225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a8b2-7faa-4bde-99e2-806163d19a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:45.732577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a8b2-7faa-4bde-99e2-806163d19a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:45.733239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91a8b2-7faa-4bde-99e2-806163d19a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:45.771691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a8b2-7faa-4bde-99e2-806163d19a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:45.780411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91a8b2-7faa-4bde-99e2-806163d19a92 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:45.822774 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3555/7134] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:58:45.900291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493e416-3d75-4c08-a2e0-f432a7c78741 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:46.081276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:46.082172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:46.082462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:46.082742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:46.226237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:46.231565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:46.279479 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3580/7135] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:58:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 883 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:58:48.331999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:48.333298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:48.333782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:48.420131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] MFA Rules not processed for user `329523b6f089401face7b477d08ca7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:48.421789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:48.699976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:48.889190 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3556/7136] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:48.891352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:48.893136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:49.218963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:49.261188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd0f9e-3fee-4265-9f41-665387ba7f65 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:49.280558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:49.285602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:49.286078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:49.286449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:49.291469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:49.298234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:49.389540 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3581/7137] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:58:48 2022] POST /identity/v3/projects => generated 379 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:58:49.390163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:49.406051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94166c-4df1-44e9-9fee-5004f49a2010 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:49.662334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:49.664213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:49.664507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:49.665948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:49.666667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:49.674441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:49.735610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3557/7138] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:58:49 2022] POST /identity/v3/users => generated 296 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:58:49.736830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:49.758811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355341d-0898-4a4d-9a50-af726db4bcec admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:49.792236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:49.800993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:49.803531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:49.803663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:49.804310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:49.814244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:49.890695 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3582/7139] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:58:49.895137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:49.910205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a597e-281c-46e7-b7fe-47ca31c5b0be admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:49.921490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:49.923122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:49.923122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:49.923122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] PATH_INFO: `/v3/projects/e6dcde85b18e4b409653b874d3d914d2/users/7f14ba0f38324bc4bf89f4c4f64364b5/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:49.957529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dcde85b18e4b409653b874d3d914d2, user_id=7f14ba0f38324bc4bf89f4c4f64364b5, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:49.960107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:49.994427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3558/7140] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:58:49 2022] PUT /identity/v3/projects/e6dcde85b18e4b409653b874d3d914d2/users/7f14ba0f38324bc4bf89f4c4f64364b5/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:49.995402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:50.009118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfe427-4105-479f-9927-139c650d85c8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:50.140896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:50.141554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:50.141821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:50.142900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:50.143579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:50.145227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:50.173393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:50.182612 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3583/7141] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:58:50.186697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94cadc-8f25-4215-af00-5f5087d5f362 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:50.199279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c105-a8de-4211-97ac-c117ef541c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:50.199983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c105-a8de-4211-97ac-c117ef541c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:50.200268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c105-a8de-4211-97ac-c117ef541c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:50.200546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c105-a8de-4211-97ac-c117ef541c99 admin admin] PATH_INFO: `/v3/projects/e6dcde85b18e4b409653b874d3d914d2/users/7f14ba0f38324bc4bf89f4c4f64364b5/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:50.206351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c105-a8de-4211-97ac-c117ef541c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6dcde85b18e4b409653b874d3d914d2, user_id=7f14ba0f38324bc4bf89f4c4f64364b5, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:50.209268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c105-a8de-4211-97ac-c117ef541c99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:50.241270 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3559/7142] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:58:50 2022] PUT /identity/v3/projects/e6dcde85b18e4b409653b874d3d914d2/users/7f14ba0f38324bc4bf89f4c4f64364b5/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:56.190965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:56.193535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:56.231247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf34c3-1fd2-4087-a9ad-aac86f927b2d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:56.390498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:56.392475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:56.394372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:56.394855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] PATH_INFO: `/v3/users/236d3cc395f24bc1b648e4d9072d7d80` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:56.397930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236d3cc395f24bc1b648e4d9072d7d80)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:56.402655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:56.541058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236d3cc395f24bc1b648e4d9072d7d80'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:56.570612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:56.581491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236d3cc395f24bc1b648e4d9072d7d80'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:56.583605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236d3cc395f24bc1b648e4d9072d7d80'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:56.604065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236d3cc395f24bc1b648e4d9072d7d80'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:56.605460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236d3cc395f24bc1b648e4d9072d7d80'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:56.621612 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3584/7143] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:56 2022] DELETE /identity/v3/users/236d3cc395f24bc1b648e4d9072d7d80 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:56.627266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:56.627785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:56.628058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:56.740143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:58:56.749426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:56.963003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3560/7144] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:58:57.025044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:57.028022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:57.214055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eada04-8e54-45fd-8746-18a3dd370fd1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:57.226475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:57.228491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:57.229273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:57.229909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:57.299076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:57.302078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:57.338795 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3585/7145] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:58:59.592255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:59.594944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:58:59.642913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc8a3b-6800-412f-ab2c-4506286b6e16 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:58:59.683202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:58:59.685791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:58:59.687986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:58:59.688938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] PATH_INFO: `/v3/projects/1a3115082ca343f0a0752df88125b42b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:58:59.693447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3115082ca343f0a0752df88125b42b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:58:59.697391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:58:59.764495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:58:59.851142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3115082ca343f0a0752df88125b42b', 'request_id': 'req-308382bd-e70e-473e-a40d-3a08366685e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:59.876267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3115082ca343f0a0752df88125b42b', 'request_id': 'req-308382bd-e70e-473e-a40d-3a08366685e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:59.893356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3115082ca343f0a0752df88125b42b', 'request_id': 'req-308382bd-e70e-473e-a40d-3a08366685e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:59.930396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] The token cache is being invalidate because project 1a3115082ca343f0a0752df88125b42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:58:59.931033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:59.931958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:58:59.941172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:58:59.960664 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3561/7146] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:58:59 2022] DELETE /identity/v3/projects/1a3115082ca343f0a0752df88125b42b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:58:59.962144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca3129-12e1-4c0d-b247-f753c7758ba5 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:00.173223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:00.173901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:00.174192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:00.174479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] PATH_INFO: `/v3/users/f43a70f4d99f48dbae96784d5a41fecd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:00.191272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43a70f4d99f48dbae96784d5a41fecd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:00.205661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:00.394786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43a70f4d99f48dbae96784d5a41fecd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:00.412805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43a70f4d99f48dbae96784d5a41fecd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:00.413596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43a70f4d99f48dbae96784d5a41fecd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:00.429644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43a70f4d99f48dbae96784d5a41fecd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:00.430337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43a70f4d99f48dbae96784d5a41fecd'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:00.465705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:00.474469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3586/7147] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:58:59 2022] DELETE /identity/v3/users/f43a70f4d99f48dbae96784d5a41fecd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:01.659264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:01.670173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:01.878799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:01.880284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:02.015450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308382bd-e70e-473e-a40d-3a08366685e7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:02.236156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09692ad-a1c9-444c-94b9-0b3a5ccc3e00 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:02.265623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:02.266215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:02.266580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:02.266859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] PATH_INFO: `/v3/users/a031e94db13d4e7e8947f51abc36d629` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:02.268923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a031e94db13d4e7e8947f51abc36d629)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:02.286232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:02.302487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:02.303123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:02.303411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:02.303755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:02.329561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:02.379804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:02.381662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:02.429882 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3562/7148] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:02.430578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:02.432896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:02.451236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a031e94db13d4e7e8947f51abc36d629'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.483908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1baa16-cc3c-47d6-8d15-bd31e54edd90 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:02.501869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:02.502520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:02.502800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:02.503073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] PATH_INFO: `/v3/projects/94fec1d5b96f44eab4894f43f89755fb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:02.504167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a031e94db13d4e7e8947f51abc36d629'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.506023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a031e94db13d4e7e8947f51abc36d629'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.508319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fec1d5b96f44eab4894f43f89755fb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:02.519218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:02.538500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a031e94db13d4e7e8947f51abc36d629'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.538500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ca4556e4-2182-4039-861d-4a6a2b3f2c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a031e94db13d4e7e8947f51abc36d629'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.576495 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3587/7149] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:59:01 2022] DELETE /identity/v3/users/a031e94db13d4e7e8947f51abc36d629 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:02.645574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:02.673684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fec1d5b96f44eab4894f43f89755fb', 'request_id': 'req-41f569d5-55f1-4934-83a3-1c72db2aa302'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.689595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fec1d5b96f44eab4894f43f89755fb', 'request_id': 'req-41f569d5-55f1-4934-83a3-1c72db2aa302'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.697568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fec1d5b96f44eab4894f43f89755fb', 'request_id': 'req-41f569d5-55f1-4934-83a3-1c72db2aa302'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.725903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] The token cache is being invalidate because project 94fec1d5b96f44eab4894f43f89755fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:59:02.726343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.727128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41f569d5-55f1-4934-83a3-1c72db2aa302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:02.731511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3563/7150] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:59:02 2022] DELETE /identity/v3/projects/94fec1d5b96f44eab4894f43f89755fb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:02.737536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:02.738074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:02.738541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:02.782393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:02.783652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:02.961209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3588/7151] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:02.963107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:02.963496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:02.963869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.012630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:03.023376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:03.057654 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3564/7152] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:03.062671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.088596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69d708-23fd-4c6e-a32c-2c5be9e35e23 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.101395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.102290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.102732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.103195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.104044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:59:03.104510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.106419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.140182 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3589/7153] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:59:03.144743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.154732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88163cb7-7528-4ae8-b957-ff23b989b409 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.173267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.175196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:03.184425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.186409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.187390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.187916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.189953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.198036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.205497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d269e2-d101-4949-8796-c7306475b353 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.244663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.249679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.250308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.250799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] PATH_INFO: `/v3/users/78ecb250db344080990dd801dacbde48` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.261171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ecb250db344080990dd801dacbde48)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.268988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.279055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:03.339512 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3565/7154] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:59:03 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:03.344025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.454383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ecb250db344080990dd801dacbde48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:03.515787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ecb250db344080990dd801dacbde48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:03.521444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ecb250db344080990dd801dacbde48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:03.545023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ecb250db344080990dd801dacbde48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:03.546310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ecb250db344080990dd801dacbde48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:03.571244 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3590/7155] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:59:03 2022] DELETE /identity/v3/users/78ecb250db344080990dd801dacbde48 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:03.592014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84d5c4-e57e-48ec-a951-3920fe33b26d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.699411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.700938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:03.743162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.743793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.744075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.745279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.745279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.747162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.793348 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3566/7156] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:59:03 2022] POST /identity/v3/users => generated 294 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:03.795194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.799012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:03.820390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa9147-499c-4a0c-acf7-f9fad111fdab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.837581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.838137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.838417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.838690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.839337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.840967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.884758 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3567/7157] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:03.886283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:03.922467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789dfc-4f93-4b58-ba2d-97915d5d5ba8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.937494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f05e-2388-4309-948e-0b82097ee805 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:03.937662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.938354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.938641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.938954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.939666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.943579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.950106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:03.950762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:03.951067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:03.951330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] PATH_INFO: `/v3/projects/129b5343573f4f9fa648e984a68b6760` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:03.957819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=129b5343573f4f9fa648e984a68b6760)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:03.959994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:03.996798 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3568/7158] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:59:03.997820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:04.043345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7345f-2469-43da-8a72-68e905e217f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:04.068523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6eb5d-5311-4ba1-aaa0-f34351014411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:04.069661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6eb5d-5311-4ba1-aaa0-f34351014411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.070413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6eb5d-5311-4ba1-aaa0-f34351014411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.071495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6eb5d-5311-4ba1-aaa0-f34351014411 admin admin] PATH_INFO: `/v3/projects/0bc2b54c470545ae999622e71a38f17e/users/52648e3992194682bbf5245ae7357671/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.084336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:04.117470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129b5343573f4f9fa648e984a68b6760', 'request_id': 'req-29f8fde4-4035-47d7-ad93-246c67daa61c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.118947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6eb5d-5311-4ba1-aaa0-f34351014411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc2b54c470545ae999622e71a38f17e, user_id=52648e3992194682bbf5245ae7357671, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:04.125677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6eb5d-5311-4ba1-aaa0-f34351014411 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:04.132214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129b5343573f4f9fa648e984a68b6760', 'request_id': 'req-29f8fde4-4035-47d7-ad93-246c67daa61c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.155160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129b5343573f4f9fa648e984a68b6760', 'request_id': 'req-29f8fde4-4035-47d7-ad93-246c67daa61c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.180700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] The token cache is being invalidate because project 129b5343573f4f9fa648e984a68b6760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:59:04.181066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.181698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.187042 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3591/7159] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:59:03 2022] DELETE /identity/v3/projects/129b5343573f4f9fa648e984a68b6760 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:59:04.187958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:04.191864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.213005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3569/7160] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:59:03 2022] PUT /identity/v3/projects/0bc2b54c470545ae999622e71a38f17e/users/52648e3992194682bbf5245ae7357671/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:04.215750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:04.217004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d33cae-6045-479c-8b91-90dda92d773c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.218970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d33cae-6045-479c-8b91-90dda92d773c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.219262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d33cae-6045-479c-8b91-90dda92d773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.289748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c2d33cae-6045-479c-8b91-90dda92d773c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:04.291384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c2d33cae-6045-479c-8b91-90dda92d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.323100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8fde4-4035-47d7-ad93-246c67daa61c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:04.417250 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3570/7161] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:04.418560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83933528-99d6-4330-8db8-29c032bc65bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.418935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83933528-99d6-4330-8db8-29c032bc65bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.419115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83933528-99d6-4330-8db8-29c032bc65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.448021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:04.448656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.448999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.449238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] PATH_INFO: `/v3/projects/1d8dfc2b9fa14888ad008ee075da8170` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.452198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8dfc2b9fa14888ad008ee075da8170)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:04.454309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:04.470823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-83933528-99d6-4330-8db8-29c032bc65bc None None] MFA Rules not processed for user `52648e3992194682bbf5245ae7357671`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:04.474500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83933528-99d6-4330-8db8-29c032bc65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.599236 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3571/7162] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:04.600828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a395b-7e6e-4ce7-963c-aebd624596bc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.601149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a395b-7e6e-4ce7-963c-aebd624596bc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.601425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a395b-7e6e-4ce7-963c-aebd624596bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.618944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8dfc2b9fa14888ad008ee075da8170', 'request_id': 'req-a6f41406-5d47-4276-8ee2-09086cba7de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.632319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8dfc2b9fa14888ad008ee075da8170', 'request_id': 'req-a6f41406-5d47-4276-8ee2-09086cba7de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.656146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-371a395b-7e6e-4ce7-963c-aebd624596bc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:04.662291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-371a395b-7e6e-4ce7-963c-aebd624596bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.668924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8dfc2b9fa14888ad008ee075da8170', 'request_id': 'req-a6f41406-5d47-4276-8ee2-09086cba7de4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.708064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] The token cache is being invalidate because project 1d8dfc2b9fa14888ad008ee075da8170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:59:04.709483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.713873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:04.730053 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3592/7163] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:59:04 2022] DELETE /identity/v3/projects/1d8dfc2b9fa14888ad008ee075da8170 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:04.737418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:04.738951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.864938 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3572/7164] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:04.864938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.864938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.864938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.906603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:04.906603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.916152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:04.927461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41406-5d47-4276-8ee2-09086cba7de4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:04.937751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:04.938705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.938953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.939194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.940050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3573/7165] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:04.941187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:04.946370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:04.953302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca40b4b-3149-4589-94da-0c00d65cc0bf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:04.976299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:04.978824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:04.979354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:04.981310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:04.982454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:59:04.983679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:04.989021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667827a-cffd-46e8-83cd-137ae5dbd94f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:04.995402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:05.025349 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3574/7166] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:59:05.031223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.031754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.032275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.087809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:05.092647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:05.135942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3575/7167] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:05.141103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.143040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.143449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.173603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0310a73-e5d4-4dc2-a1b1-6e6dfd3f9dd4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.173832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3593/7168] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:05.174833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.186452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.188225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.190208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.190784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.192948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.200363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.212091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aa09e-e83a-40af-ab78-2a2d4f3eebd8 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.232184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.233207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.235752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.236035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.236920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:59:05.237230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.241632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.279174 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3594/7169] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:59:05.283922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.311040 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3576/7170] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:59:05 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:05.313500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.316423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2fd89-afef-45df-a109-af1065699006 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.477615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.477615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.478197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.479241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.480174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.495758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.528308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143f6a1-8c52-4bb5-8e7e-d494750855dc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.534180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.535003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.535284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.536446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.537223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.539200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.561820 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3595/7171] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:59:05 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:05.566301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.573879 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3577/7172] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:59:05 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:05.580971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.617840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b848ae6-8bff-4b25-a8ca-05ede1cf70de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.759465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbdbfc-f5bb-45e6-9b14-a4ca8aa49e35 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.773667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.774158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.774519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.774808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.775632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.777668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.814741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.815352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.815640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.815916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.824292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.826094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.884320 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3596/7173] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:59:05 2022] POST /identity/v3/users => generated 286 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 02:59:05.886114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.889729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3578/7174] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:05.894020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.899102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:05.913471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33029d70-0a2e-45e5-8c83-9361e955cb0d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.930684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.933896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.934838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.935124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.937449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddbd7c-9c78-43e1-9d6a-b16c448315a9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:05.939125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.941356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.951477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:05.953937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:05.955801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:05.957288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:05.965918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:05.973349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:05.974055 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3597/7175] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:05.975456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:05.989025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847664c-2f60-4fe7-a37a-a9b4109857bb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:06.006060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:06.007820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.008072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.008351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.009044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:06.010733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:06.029825 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3598/7176] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:06.030930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:06.049312 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3579/7177] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:06.053548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:06.053868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fe8e8-5125-430f-9e0e-425539017b8d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:06.069400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256578b-441c-434b-9371-400fafdd1520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:06.072439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256578b-441c-434b-9371-400fafdd1520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.076399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256578b-441c-434b-9371-400fafdd1520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.078336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256578b-441c-434b-9371-400fafdd1520 admin admin] PATH_INFO: `/v3/projects/daa97e7f606c4374a629c460de97aed9/users/d80cfe5906384b0db35364d904725750/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.084701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eb406-ccf4-4498-bf75-e9c21c4499d0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:06.104537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3f350-6596-45e2-8163-7ec2723f9c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:06.106687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f350-6596-45e2-8163-7ec2723f9c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.107370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f350-6596-45e2-8163-7ec2723f9c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.108608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3f350-6596-45e2-8163-7ec2723f9c49 admin admin] PATH_INFO: `/v3/projects/f477959bd24b4db881b62dab54861aa5/users/12d0128e850f4f22a2172800c44074a4/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.122117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256578b-441c-434b-9371-400fafdd1520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa97e7f606c4374a629c460de97aed9, user_id=d80cfe5906384b0db35364d904725750, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:06.141806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256578b-441c-434b-9371-400fafdd1520 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:06.150655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f350-6596-45e2-8163-7ec2723f9c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f477959bd24b4db881b62dab54861aa5, user_id=12d0128e850f4f22a2172800c44074a4, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:06.154405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3f350-6596-45e2-8163-7ec2723f9c49 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:06.184842 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3580/7178] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:59:06 2022] PUT /identity/v3/projects/f477959bd24b4db881b62dab54861aa5/users/12d0128e850f4f22a2172800c44074a4/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:06.187221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.187525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.187925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.208686 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3599/7179] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:59:06 2022] PUT /identity/v3/projects/daa97e7f606c4374a629c460de97aed9/users/d80cfe5906384b0db35364d904725750/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:06.220717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0d02d-c27d-4c32-a51a-057307310e03 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.221389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0d02d-c27d-4c32-a51a-057307310e03 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.221741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0d02d-c27d-4c32-a51a-057307310e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.234624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:06.243505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:06.265045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:06.293158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-75c0d02d-c27d-4c32-a51a-057307310e03 None None] MFA Rules not processed for user `d80cfe5906384b0db35364d904725750`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:06.297099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-75c0d02d-c27d-4c32-a51a-057307310e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:06.416394 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3581/7180] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:06.423204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:06.546308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3600/7181] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:59:06.557825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.558455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.558985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.579197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34633ce-0256-4808-9793-32a8f50eb0af None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:06.601456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7ac32-8746-43e3-94d8-6ec5d6206f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:06.614958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ac32-8746-43e3-94d8-6ec5d6206f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.615261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ac32-8746-43e3-94d8-6ec5d6206f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.617953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7ac32-8746-43e3-94d8-6ec5d6206f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:06.637090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] MFA Rules not processed for user `d80cfe5906384b0db35364d904725750`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:06.640763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:06.655196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7ac32-8746-43e3-94d8-6ec5d6206f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:06.655196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7ac32-8746-43e3-94d8-6ec5d6206f8f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:06.670029 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3601/7182] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:06.682208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:06.684224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:06.697118 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3582/7183] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:06.955514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165986f-556b-4b16-8a39-29ed4d89b356 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:06.985469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86d4a-4bdb-416c-a517-a7024b13ca20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:06.987509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86d4a-4bdb-416c-a517-a7024b13ca20 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:06.988059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86d4a-4bdb-416c-a517-a7024b13ca20 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:06.988351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86d4a-4bdb-416c-a517-a7024b13ca20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:07.032155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86d4a-4bdb-416c-a517-a7024b13ca20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:07.042265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86d4a-4bdb-416c-a517-a7024b13ca20 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:07.107095 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3602/7184] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 02:59:07.740793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:07.741494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:07.741494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:07.780951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] MFA Rules not processed for user `d80cfe5906384b0db35364d904725750`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:07.782409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:07.800072 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3583/7185] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:16.932602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b328bc-30af-4414-a740-b5457c9d13ab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:16.933172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b328bc-30af-4414-a740-b5457c9d13ab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:16.933283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b328bc-30af-4414-a740-b5457c9d13ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:17.024241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d3b328bc-30af-4414-a740-b5457c9d13ab None None] MFA Rules not processed for user `7f14ba0f38324bc4bf89f4c4f64364b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:17.025500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d3b328bc-30af-4414-a740-b5457c9d13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:17.073748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:17.303123 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3603/7186] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:17.316543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:17.318856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:17.589554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99671-bcb8-40a4-a2a5-73538a638ce8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:17.604622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:17.610251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:17.613516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:17.613944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:17.621446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:17.895126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:17.901566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd777169-83d7-4c51-8804-47ede086e17b service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:17.959004 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3584/7187] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:27.294288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=23 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:27.921717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:28.900277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:28.900915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:28.900915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:29.041296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:29.042477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:29.283173 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3604/7188] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:29.293919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:29.295485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:29.296042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:29.334240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:29.337277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:29.347605 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3585/7189] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:29.365091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:29.418754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55fdbb-5b10-4d62-b2bb-70fd1afe8530 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:29.438587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce432-2968-466f-a234-2dd90bb812a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:29.439423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce432-2968-466f-a234-2dd90bb812a6 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:29.439812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce432-2968-466f-a234-2dd90bb812a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:29.440348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce432-2968-466f-a234-2dd90bb812a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:29.462351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ce432-2968-466f-a234-2dd90bb812a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:29.464862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ce432-2968-466f-a234-2dd90bb812a6 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:29.519797 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3605/7190] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:30.683802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:30.687354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:30.755487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9a8fb-eddc-4b44-8d1c-08117e309216 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:30.766641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:30.767651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:30.768111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:30.768552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] PATH_INFO: `/v3/users/cc4457be6ac6435691f5f5ff11801114` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:30.771552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4457be6ac6435691f5f5ff11801114)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:30.774664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:30.892611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4457be6ac6435691f5f5ff11801114'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:30.929663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4457be6ac6435691f5f5ff11801114'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:30.930826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4457be6ac6435691f5f5ff11801114'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:30.952878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4457be6ac6435691f5f5ff11801114'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:30.956738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4457be6ac6435691f5f5ff11801114'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:31.002030 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3586/7191] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:59:30 2022] DELETE /identity/v3/users/cc4457be6ac6435691f5f5ff11801114 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:31.003916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:31.004466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:31.004864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:31.043770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:31.049995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:31.228630 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3606/7192] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:31.239244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:31.241920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:31.410829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52b2b-cad6-47a5-97d3-d17edef71ecf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:31.422063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba3c9a-f6ad-4f46-9f1f-9ce4bb9e0088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:31.422902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3c9a-f6ad-4f46-9f1f-9ce4bb9e0088 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:31.423190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3c9a-f6ad-4f46-9f1f-9ce4bb9e0088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:31.423484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3c9a-f6ad-4f46-9f1f-9ce4bb9e0088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:31.451781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba3c9a-f6ad-4f46-9f1f-9ce4bb9e0088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:31.453192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba3c9a-f6ad-4f46-9f1f-9ce4bb9e0088 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:31.477620 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3587/7193] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:32.012570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:32.014980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:32.039430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa69f4-9861-4fd6-a1e0-2618319cbcdf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:32.072101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:32.072855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:32.073174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:32.073457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] PATH_INFO: `/v3/projects/592ddf905dbe44e9a8b8103a1039b838` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:32.079423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592ddf905dbe44e9a8b8103a1039b838)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:32.081416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:32.254002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592ddf905dbe44e9a8b8103a1039b838', 'request_id': 'req-4b15e4fc-ba31-41b2-a345-30f784706cf8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:32.267802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592ddf905dbe44e9a8b8103a1039b838', 'request_id': 'req-4b15e4fc-ba31-41b2-a345-30f784706cf8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:32.288416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592ddf905dbe44e9a8b8103a1039b838', 'request_id': 'req-4b15e4fc-ba31-41b2-a345-30f784706cf8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:32.312567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:32.316963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] The token cache is being invalidate because project 592ddf905dbe44e9a8b8103a1039b838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:59:32.317314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:32.317990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4b15e4fc-ba31-41b2-a345-30f784706cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:32.321767 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3607/7194] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:59:32 2022] DELETE /identity/v3/projects/592ddf905dbe44e9a8b8103a1039b838 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:32.327728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:32.330168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:32.330746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:32.391056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:32.394759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:32.583101 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3588/7195] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:32.583904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:32.584191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:32.584469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:32.646273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:32.647671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:32.688656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3608/7196] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:32.689838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:32.705716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ddd6-60c1-45a6-a02f-8f00f01bec39 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:32.716072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:32.717063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:32.718877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:32.719255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:32.721252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:59:32.721658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:32.726744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:32.730502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:32.750605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:32.766190 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3589/7197] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 02:59:32.816963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc09fc3-5fb6-41c7-be3c-efe2d560e732 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:32.854394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:32.855051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:32.855337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:32.874469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:32.875713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:32.879872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:32.957762 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3609/7198] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:59:32 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:32.961250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:32.975715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce686d34-f426-4ad4-a00c-f6a8df673efa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:33.199205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:33.200646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:33.202275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:33.202800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:33.203885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:33.207112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:33.262163 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3590/7199] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:59:32 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:33.268243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:33.289541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e77d1-88f2-43c1-9d60-00a137f322b1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:33.309998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:33.311539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:33.311863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:33.312083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:33.313086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:33.314575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:33.352265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3610/7200] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:33.354827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:33.394047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4ce1f-aa80-420d-a9ab-b297cbb12aca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:33.414906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b389c5-7f7a-48cc-b9fc-b8fc59b57c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:33.417600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b389c5-7f7a-48cc-b9fc-b8fc59b57c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:33.417890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b389c5-7f7a-48cc-b9fc-b8fc59b57c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:33.418173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b389c5-7f7a-48cc-b9fc-b8fc59b57c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:33.418851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b389c5-7f7a-48cc-b9fc-b8fc59b57c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:33.424984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b389c5-7f7a-48cc-b9fc-b8fc59b57c0f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:33.462984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3591/7201] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 02:59:33.463979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:33.487657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19b1c-1033-4340-b458-52d13e3e15a7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:33.507969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:33.509209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:33.510757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:33.511978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] PATH_INFO: `/v3/projects/f135ae20332547848ccc2603c51b47a6/users/3cefbbae813b42569b4b9cbd1d37eca3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:33.562025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f135ae20332547848ccc2603c51b47a6, user_id=3cefbbae813b42569b4b9cbd1d37eca3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:33.570497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:33.601786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3611/7202] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:59:33 2022] PUT /identity/v3/projects/f135ae20332547848ccc2603c51b47a6/users/3cefbbae813b42569b4b9cbd1d37eca3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:33.614569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af750e29-097f-4891-97ed-316087b2ade9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:33.614860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af750e29-097f-4891-97ed-316087b2ade9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:33.615134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af750e29-097f-4891-97ed-316087b2ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:33.706963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-af750e29-097f-4891-97ed-316087b2ade9 None None] MFA Rules not processed for user `3cefbbae813b42569b4b9cbd1d37eca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:33.709235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-af750e29-097f-4891-97ed-316087b2ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:33.890607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3592/7203] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:33.899574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:33.901496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:34.083969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defac73b-6d51-4848-b2fd-5f998c6b8da4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:34.092513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:34.093322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:34.093710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:34.094087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:34.106119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:34.108199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:34.120716 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3612/7204] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:40.462228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:40.462780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:40.462780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:40.531550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:40.539306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:40.748508 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3593/7205] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 02:59:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:40.767194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:40.769569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:40.912739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a9d26-b181-4fa2-bd12-64c7e3cea4f3 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:40.920791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5d85-913e-410e-b90c-945fd3fd0084 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:40.921612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5d85-913e-410e-b90c-945fd3fd0084 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:40.921992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5d85-913e-410e-b90c-945fd3fd0084 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:40.922374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5d85-913e-410e-b90c-945fd3fd0084 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:40.932823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5d85-913e-410e-b90c-945fd3fd0084 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:40.949258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5d85-913e-410e-b90c-945fd3fd0084 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:40.971348 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3613/7206] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 02:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 02:59:42.644634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:42.646975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:42.660385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:42.805019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fb4b6-3433-4199-9abd-ab87b11c1864 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:42.814070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:42.815054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:42.815503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:42.816131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] PATH_INFO: `/v3/users/52648e3992194682bbf5245ae7357671` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:42.817601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52648e3992194682bbf5245ae7357671)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:42.820515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:42.924127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52648e3992194682bbf5245ae7357671'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:42.979495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52648e3992194682bbf5245ae7357671'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:42.981693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52648e3992194682bbf5245ae7357671'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:43.018206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52648e3992194682bbf5245ae7357671'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:43.019555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52648e3992194682bbf5245ae7357671'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:43.076259 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3594/7207] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:59:42 2022] DELETE /identity/v3/users/52648e3992194682bbf5245ae7357671 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:43.081058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:43.081842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:43.081842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:43.103261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:43.104778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:43.133844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:43.207567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3614/7208] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 02:59:43.239788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:43.241918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:43.410295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc75c2-d72e-4829-8141-8b05ac3572a5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:43.427275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284a951-38dc-4f6a-86da-d2b7b992748d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:43.432981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a951-38dc-4f6a-86da-d2b7b992748d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:43.433308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a951-38dc-4f6a-86da-d2b7b992748d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:43.433593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a951-38dc-4f6a-86da-d2b7b992748d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:43.460931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284a951-38dc-4f6a-86da-d2b7b992748d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:43.468165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284a951-38dc-4f6a-86da-d2b7b992748d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:43.496980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3595/7209] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:44.727046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:44.730026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:44.754939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5bfc-efa6-4f99-a896-db88198fda64 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:44.773137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:44.774114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:44.774836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:44.775280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] PATH_INFO: `/v3/projects/0bc2b54c470545ae999622e71a38f17e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:44.778162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc2b54c470545ae999622e71a38f17e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:44.789682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:44.889604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc2b54c470545ae999622e71a38f17e', 'request_id': 'req-992abcbe-8dfd-4be0-95d4-874e2c2844f6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:44.902911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc2b54c470545ae999622e71a38f17e', 'request_id': 'req-992abcbe-8dfd-4be0-95d4-874e2c2844f6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:44.911477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc2b54c470545ae999622e71a38f17e', 'request_id': 'req-992abcbe-8dfd-4be0-95d4-874e2c2844f6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:44.947688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] The token cache is being invalidate because project 0bc2b54c470545ae999622e71a38f17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:59:44.949183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:44.950168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-992abcbe-8dfd-4be0-95d4-874e2c2844f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:44.959315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:44.959880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:44.960007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:44.965572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3615/7210] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:59:44 2022] DELETE /identity/v3/projects/0bc2b54c470545ae999622e71a38f17e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:44.997033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:45.005624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:45.058801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:45.131546 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3596/7211] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:45.134042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.134571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.135011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.173492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:45.175349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:45.206064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:45.214093 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3616/7212] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:45.220108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58408b-3c75-4edf-ae16-80fc305f0632 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:45.237589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:45.238326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.238611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.238885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.241933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 02:59:45.242286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:45.244305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:45.279979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:45.293509 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3597/7213] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 02:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 02:59:45.296123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593b58-00ad-4d85-a46c-67f868474d04 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:45.306942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:45.307576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.307859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.308132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.313265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:45.320058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:45.372581 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3617/7214] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 02:59:45 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:45.377579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:45.391745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc41b8-2047-44e1-abd1-5caf5343754b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:45.524946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:45.524946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.525321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.525633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.526278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:45.528489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:45.569449 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3598/7215] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 02:59:45 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 02:59:45.570759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:45.584179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d882207-7c67-4633-b13c-9a7d2ecb3599 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:45.601738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:45.602772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.602772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.603005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.603557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:45.605296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:45.635084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3618/7216] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:45.636483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:45.677132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fd350-82c6-4a6e-b5fd-44087d0d31c5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:45.697446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cc38d-0432-40cb-a982-0de98d49d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:45.698127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc38d-0432-40cb-a982-0de98d49d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.698415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc38d-0432-40cb-a982-0de98d49d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.699073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc38d-0432-40cb-a982-0de98d49d3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.699778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cc38d-0432-40cb-a982-0de98d49d3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:45.709146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cc38d-0432-40cb-a982-0de98d49d3bb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:45.746549 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3599/7217] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 02:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 02:59:45.749585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:45.777490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0fef8-10a2-401d-a264-5a5abb5e7658 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:45.808458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:45.813635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.814442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.814913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] PATH_INFO: `/v3/projects/f4c715bc62ac4739b13e365286998577/users/4a2b0c86ab554fe09b1b160693ff1852/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.845537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c715bc62ac4739b13e365286998577, user_id=4a2b0c86ab554fe09b1b160693ff1852, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:45.850602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:45.919271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d85266-0aca-4109-b561-775498c8f759 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:45.920385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d85266-0aca-4109-b561-775498c8f759 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:45.920853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d85266-0aca-4109-b561-775498c8f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:45.922249 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3619/7218] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 02:59:45 2022] PUT /identity/v3/projects/f4c715bc62ac4739b13e365286998577/users/4a2b0c86ab554fe09b1b160693ff1852/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:45.987422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-01d85266-0aca-4109-b561-775498c8f759 None None] MFA Rules not processed for user `4a2b0c86ab554fe09b1b160693ff1852`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:45.992072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-01d85266-0aca-4109-b561-775498c8f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:46.258883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:46.262196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:46.272073 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3600/7219] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:46.436666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:46.444005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2142-49dc-48fc-a2d8-0713c4fc7d27 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:46.453579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:46.454351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:46.454725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:46.455005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:46.476462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:46.485857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:46.565881 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3620/7220] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:47.922253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d85266-0aca-4109-b561-775498c8f759 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:47.943445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-01d85266-0aca-4109-b561-775498c8f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:48.193440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 02:59:48.294971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d85266-0aca-4109-b561-775498c8f759 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:48.339492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:48.345309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:48.346744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:48.347784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:48.355932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:48.461771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:48.478476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:48.687579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:48.692786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:48.778149 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3601/7221] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 02:59:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 854 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 02:59:48.892129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb0683-f175-48b6-a20b-daba00f25a54 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:48.919339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:48.920931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:48.921237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:48.921528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] PATH_INFO: `/v3/users/7cb038e111434aa581b9ebc7a578b196` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:48.929869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb038e111434aa581b9ebc7a578b196)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:48.931931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:49.228145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb038e111434aa581b9ebc7a578b196'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:49.273834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb038e111434aa581b9ebc7a578b196'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:49.279389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb038e111434aa581b9ebc7a578b196'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:49.308740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb038e111434aa581b9ebc7a578b196'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:49.309725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-46fee6a4-f8d7-4a9d-ac05-175e8bc7fa9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb038e111434aa581b9ebc7a578b196'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:49.335042 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3621/7222] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:59:48 2022] DELETE /identity/v3/users/7cb038e111434aa581b9ebc7a578b196 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 02:59:49.985939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:50.000931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae2292-d98a-4681-9d52-ef7e91586764 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 02:59:50.261651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 02:59:50.262391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:50.262676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:50.262950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] PATH_INFO: `/v3/projects/259ca05c46454743a9819915d50370a7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:50.277189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259ca05c46454743a9819915d50370a7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 02:59:50.286983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 02:59:50.521235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259ca05c46454743a9819915d50370a7', 'request_id': 'req-b6693627-8b04-46e1-a7ab-3688f5aa8b45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:50.546748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259ca05c46454743a9819915d50370a7', 'request_id': 'req-b6693627-8b04-46e1-a7ab-3688f5aa8b45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:50.559519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259ca05c46454743a9819915d50370a7', 'request_id': 'req-b6693627-8b04-46e1-a7ab-3688f5aa8b45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:50.605999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] The token cache is being invalidate because project 259ca05c46454743a9819915d50370a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 02:59:50.606226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:50.609132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 02:59:50.614178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3602/7223] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 02:59:49 2022] DELETE /identity/v3/projects/259ca05c46454743a9819915d50370a7 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 02:59:57.307411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 02:59:57.307897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 02:59:57.308022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 02:59:57.339141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 02:59:57.340685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:57.576653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3622/7224] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 02:59:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 02:59:59.920109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 02:59:59.922798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 02:59:59.981396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:00.241527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693627-8b04-46e1-a7ab-3688f5aa8b45 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:00.257855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:00.258779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:00.259068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:00.259345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] PATH_INFO: `/v3/users/3cefbbae813b42569b4b9cbd1d37eca3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:00.273559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cefbbae813b42569b4b9cbd1d37eca3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:00.276862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:00.436768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:00.454735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:00.502761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cefbbae813b42569b4b9cbd1d37eca3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:00.527786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:00.552918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cefbbae813b42569b4b9cbd1d37eca3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:00.598729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cefbbae813b42569b4b9cbd1d37eca3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:00.643122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cefbbae813b42569b4b9cbd1d37eca3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:00.644534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ebdb17c7-1748-4388-9c6e-e13e275b1ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cefbbae813b42569b4b9cbd1d37eca3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:00.702543 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3603/7225] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 02:59:59 2022] DELETE /identity/v3/users/3cefbbae813b42569b4b9cbd1d37eca3 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:00.707506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:00.708046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:00.708486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:00.743519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1b25-d776-4cdb-8421-a3961b6d8c44 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:00.771902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:00.773163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:00.913118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:00.914832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:00.915343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:00.916209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:00.918427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:00.937508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:00.940087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:00.954508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3623/7226] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:00.956841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:00.958357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:00.974330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3604/7227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:00.988186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164090-660a-44d7-a8f1-3efee06ebfef service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:00.990065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:00.993445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:01.005937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:01.006530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:01.006813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:01.007166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:01.015442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:01.055692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:01.072523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:01.074171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd590241-ee4a-4d5a-b0fa-5ecfeb941ba4 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:01.098928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f546-8f0d-4cf8-ae6b-bb9363017cde None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:01.106352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:01.108489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:01.109635 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3624/7228] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:01.110176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:01.110683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:01.111046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bd1f-29a1-42d4-af37-63b9d70e69b2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:01.111337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bd1f-29a1-42d4-af37-63b9d70e69b2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:01.111617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987bd1f-29a1-42d4-af37-63b9d70e69b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:01.155176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:01.156016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6987bd1f-29a1-42d4-af37-63b9d70e69b2 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:01.157735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6987bd1f-29a1-42d4-af37-63b9d70e69b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:01.161510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:01.188696 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3605/7229] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:01.320327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3625/7230] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:02.193703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:02.195427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:02.219983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfa52f-0454-4423-8511-80800614594b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:02.237208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:02.237858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:02.238915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:02.239394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] PATH_INFO: `/v3/projects/f135ae20332547848ccc2603c51b47a6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:02.240851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f135ae20332547848ccc2603c51b47a6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:02.243001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:02.351376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f135ae20332547848ccc2603c51b47a6', 'request_id': 'req-bd23df26-e6f5-488e-ac12-2ea0b31592e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:02.363682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f135ae20332547848ccc2603c51b47a6', 'request_id': 'req-bd23df26-e6f5-488e-ac12-2ea0b31592e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:02.374173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f135ae20332547848ccc2603c51b47a6', 'request_id': 'req-bd23df26-e6f5-488e-ac12-2ea0b31592e7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:02.394705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] The token cache is being invalidate because project f135ae20332547848ccc2603c51b47a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:02.395257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:02.396087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bd23df26-e6f5-488e-ac12-2ea0b31592e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:02.398718 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3606/7231] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:02 2022] DELETE /identity/v3/projects/f135ae20332547848ccc2603c51b47a6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:02.407526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:02.408013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:02.408137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:02.433572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:02.435497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:02.490529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:02.551710 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3626/7232] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:02.566923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:02.567216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:02.567497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:02.616639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:02.618046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:02.637210 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3607/7233] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:02.641888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:02.656255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c6994-f29b-4f2c-9a44-3af08860378c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:02.664296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:02.664983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:02.665271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:02.665544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:02.666492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:02.666795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:02.668561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:02.698529 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3627/7234] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:02.703396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:02.722258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2aa8-22fd-41c4-8a70-14ccf599cd57 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:02.749497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:02.750291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:02.750684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:02.751066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:02.752169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:02.754100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:02.822310 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3608/7235] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:02 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:02.826641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:02.843166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607f8f0-bdd1-4e99-8fe7-0b314babcd75 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:02.995750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:02.996750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:03.003888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:03.004434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:03.007465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:03.012430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:03.080268 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3628/7236] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:02 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:03.084738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:03.101811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da541d7-f106-4e8a-a1c4-de29f9a49995 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:03.107450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:03.108854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:03.109321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:03.109781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:03.110595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:03.113058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:03.166572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:03.173368 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3609/7237] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:03.182750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5638916-986a-4bd3-b38e-324fdbe7f2bd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:03.204036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dee9d-20bd-4283-a6e2-a73d74ccebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:03.204871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dee9d-20bd-4283-a6e2-a73d74ccebff admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:03.205197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dee9d-20bd-4283-a6e2-a73d74ccebff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:03.220927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dee9d-20bd-4283-a6e2-a73d74ccebff admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:03.220927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dee9d-20bd-4283-a6e2-a73d74ccebff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:03.220927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dee9d-20bd-4283-a6e2-a73d74ccebff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:03.278223 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3629/7238] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:03.283199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:03.298100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d3eda-b196-4727-aeda-307645bf7228 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:03.308312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:03.309068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:03.309351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:03.309636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] PATH_INFO: `/v3/projects/7880bfbd22e74e74aaa56bc0ddc44614/users/16e7f912ab8643d2918a1f2e28a6ccc5/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:03.351220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7880bfbd22e74e74aaa56bc0ddc44614, user_id=16e7f912ab8643d2918a1f2e28a6ccc5, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:03.366944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:03.419185 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3610/7239] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:03 2022] PUT /identity/v3/projects/7880bfbd22e74e74aaa56bc0ddc44614/users/16e7f912ab8643d2918a1f2e28a6ccc5/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:03.431002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:03.431917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:03.432362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:03.493052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] MFA Rules not processed for user `16e7f912ab8643d2918a1f2e28a6ccc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:03.494488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:03.631009 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3630/7240] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:03.636649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:03.752739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:03.775977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428156d-06e4-471c-acd7-33487c93380e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:03.786730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:03.787609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:03.788095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:03.788555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:03.789628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:03.792389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:03.847198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:03.859178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3611/7241] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:03 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:03.878245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46d971-3c71-4653-a6f6-f856e33d1eba None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:03.893656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:03.897149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:03.962238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:04.067626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09ad0-99a7-4abd-af28-5a4e52417519 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:04.073131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:04.073930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.074400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.074911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.083269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:04.101827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:04.102509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.102732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.103006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.103645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:04.124260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:04.192327 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3631/7242] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:03 2022] POST /identity/v3/users => generated 297 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:04.196078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:04.221355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc85db-da87-419b-be2d-3c264035180a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:04.238252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:04.239991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.240721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.243121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.244105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:04.250266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:04.303887 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3632/7243] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:04.308150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:04.317969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:04.320109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:04.333585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415eb2f-be0b-4146-863f-c7f765d4914b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:04.350030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:04.350960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.351291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.351885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] PATH_INFO: `/v3/projects/c5cfecf6fc95414e98a5cf36f18ac899/users/49085a6595de4731967703e3d3d3afac/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.355719 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3612/7244] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:04.416488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cfecf6fc95414e98a5cf36f18ac899, user_id=49085a6595de4731967703e3d3d3afac, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:04.420167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:04.463428 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3633/7245] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:04 2022] PUT /identity/v3/projects/c5cfecf6fc95414e98a5cf36f18ac899/users/49085a6595de4731967703e3d3d3afac/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:04.464836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:04.482434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d6405-49e9-4525-8c41-544ff658c20e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:04.705321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39370be7-41df-4539-8da7-d76aa59826af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:04.706315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370be7-41df-4539-8da7-d76aa59826af admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.706778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370be7-41df-4539-8da7-d76aa59826af admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.707249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39370be7-41df-4539-8da7-d76aa59826af admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.709464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370be7-41df-4539-8da7-d76aa59826af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:04.713261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39370be7-41df-4539-8da7-d76aa59826af admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:04.745561 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3613/7246] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:04.746965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:04.769949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0381e-38ae-4360-888f-77a5f2a1f3c2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:04.783078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:04.784402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.784930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.786214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] PATH_INFO: `/v3/projects/c5cfecf6fc95414e98a5cf36f18ac899/users/49085a6595de4731967703e3d3d3afac/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.788728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cfecf6fc95414e98a5cf36f18ac899, user_id=49085a6595de4731967703e3d3d3afac, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:04.791705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:04.814358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3634/7247] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:04 2022] PUT /identity/v3/projects/c5cfecf6fc95414e98a5cf36f18ac899/users/49085a6595de4731967703e3d3d3afac/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:04.816813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:04.817261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:04.817735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:04.864426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] MFA Rules not processed for user `49085a6595de4731967703e3d3d3afac`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:04.865905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:04.885620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:05.015251 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3614/7248] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:05.022124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:05.023921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:05.147005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887d248-eccc-43c6-8dab-d484cbecde8f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:05.152326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:05.153406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:05.155940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:05.156378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:05.268754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:05.270601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:05.300597 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3635/7249] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:05.420085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:05.422533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:05.644827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc16791-0db2-4ee6-921a-057853caa000 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:05.664080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:05.664080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:05.664080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:05.664080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] PATH_INFO: `/v3/users/de963cdc932941c7bac32406ee190634` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:05.667339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de963cdc932941c7bac32406ee190634)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:05.687180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:05.838369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de963cdc932941c7bac32406ee190634'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:05.861411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de963cdc932941c7bac32406ee190634'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:05.862231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de963cdc932941c7bac32406ee190634'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:05.877928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de963cdc932941c7bac32406ee190634'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:05.879001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de963cdc932941c7bac32406ee190634'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:05.921283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:05.922813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:05.935677 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3615/7250] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:05 2022] DELETE /identity/v3/users/de963cdc932941c7bac32406ee190634 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:05.957935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cb8e4-61de-42fe-ab09-0c6647c8be52 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:06.075205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:06.180231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:06.188001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.188001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.188001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] PATH_INFO: `/v3/users/d80cfe5906384b0db35364d904725750` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.189561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80cfe5906384b0db35364d904725750)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:06.191772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:06.301386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80cfe5906384b0db35364d904725750'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.365136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:06.366641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:06.369197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80cfe5906384b0db35364d904725750'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.370030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80cfe5906384b0db35364d904725750'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.392657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80cfe5906384b0db35364d904725750'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.394144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f0b3fefa-4298-43fa-8c8c-1038604da066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80cfe5906384b0db35364d904725750'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.398976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6658d1-a583-4081-b53e-deedc6e5eb2a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:06.412403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:06.414528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.414902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.415339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] PATH_INFO: `/v3/projects/6345a777ff224f558120171bee710f6a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.418175 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3636/7251] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:05 2022] DELETE /identity/v3/users/d80cfe5906384b0db35364d904725750 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:06.422702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6345a777ff224f558120171bee710f6a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:06.423226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.423468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.423686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.424666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:06.468443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:06.472578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:06.510988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:06.589537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6345a777ff224f558120171bee710f6a', 'request_id': 'req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.609227 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3637/7252] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:06.613330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6345a777ff224f558120171bee710f6a', 'request_id': 'req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.620879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:06.623552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:06.626840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6345a777ff224f558120171bee710f6a', 'request_id': 'req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.660871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] The token cache is being invalidate because project 6345a777ff224f558120171bee710f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:06.661196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.669177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-8ca9021c-31ec-49fe-87f1-e1bb9e3edc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:06.676137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3616/7253] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:06 2022] DELETE /identity/v3/projects/6345a777ff224f558120171bee710f6a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:06.677616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80337-bea2-4b5d-84a6-d6714e04c3f1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.678286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80337-bea2-4b5d-84a6-d6714e04c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.678286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80337-bea2-4b5d-84a6-d6714e04c3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.726233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a6f80337-bea2-4b5d-84a6-d6714e04c3f1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:06.727453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a6f80337-bea2-4b5d-84a6-d6714e04c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:06.780270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57148850-d0ec-4336-a84c-9b34c7387da5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:06.787582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:06.878539 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3617/7254] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:06.887459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.889034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.889584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.923615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:06.924921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.925716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.927100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.931881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:06.935991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:06.937843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:06.958453 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3618/7255] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:06.959487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:06.961667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:06.964536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:06.980111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba913523-2e75-4ccb-af78-b2f705c4be80 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:06.989364 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3638/7256] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:06.994413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:06.995110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:06.995389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:06.995662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:06.996385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:06.996696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:06.999040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:07.014940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3619/7257] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:07.019262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:07.041946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b40526-0faa-41ea-b2e4-15e82c52c9da service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:07.060882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:07.061612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:07.061902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:07.062170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:07.062895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:07.064989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:07.131078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3639/7258] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:07 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:07.131177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:07.157987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cadf46-d5f3-408b-aa3a-a4d8ba9de54f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:07.384200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:07.387154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:07.389921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:07.390321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:07.393748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:07.395967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:07.456084 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3620/7259] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:07 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:07.457473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:07.473925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dc580-e40e-4b5e-a81a-77dc2230a062 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:07.489334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:07.489978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:07.490568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:07.490850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:07.491563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:07.495715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:07.519522 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3640/7260] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:07.523744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:07.538783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea5749-1d0c-4f73-9365-ae276f60d6f8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:07.547884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c8a7b-1df2-4cf9-bd4d-2245573fa95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:07.548641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8a7b-1df2-4cf9-bd4d-2245573fa95c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:07.549032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8a7b-1df2-4cf9-bd4d-2245573fa95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:07.549415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8a7b-1df2-4cf9-bd4d-2245573fa95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:07.550140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c8a7b-1df2-4cf9-bd4d-2245573fa95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:07.551958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c8a7b-1df2-4cf9-bd4d-2245573fa95c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:07.573743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:07.574656 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3621/7261] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:07.584478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f0978-b850-4f91-95e2-5a90753c934a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:07.603877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:07.604804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:07.605178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:07.605550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] PATH_INFO: `/v3/projects/a5b588576c6940099f523d0b2bcc7907/users/f34919fa438e4522bf4260e254e4f78c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:07.643208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b588576c6940099f523d0b2bcc7907, user_id=f34919fa438e4522bf4260e254e4f78c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:07.646145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:07.690341 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3641/7262] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:07 2022] PUT /identity/v3/projects/a5b588576c6940099f523d0b2bcc7907/users/f34919fa438e4522bf4260e254e4f78c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:07.697366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b516a-78a0-47df-8c33-217489e75792 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:07.697704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b516a-78a0-47df-8c33-217489e75792 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:07.697987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b516a-78a0-47df-8c33-217489e75792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:07.735142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-292b516a-78a0-47df-8c33-217489e75792 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:07.736657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-292b516a-78a0-47df-8c33-217489e75792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:07.750495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:07.944330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3622/7263] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:08.062859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:08.065176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:08.211095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bf479-4e31-4bed-ad30-6621e45ff26d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:08.222759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dbb6-16c0-426a-85b1-8c8c28c52b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:08.223891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dbb6-16c0-426a-85b1-8c8c28c52b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:08.224200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dbb6-16c0-426a-85b1-8c8c28c52b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:08.224479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dbb6-16c0-426a-85b1-8c8c28c52b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:08.237105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75dbb6-16c0-426a-85b1-8c8c28c52b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:08.238778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75dbb6-16c0-426a-85b1-8c8c28c52b26 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:08.251665 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3642/7264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:08.432756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b516a-78a0-47df-8c33-217489e75792 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:08.434760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-292b516a-78a0-47df-8c33-217489e75792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:08.456877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b516a-78a0-47df-8c33-217489e75792 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:08.467134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:08.467803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:08.468080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:08.468543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] PATH_INFO: `/v3/projects/daa97e7f606c4374a629c460de97aed9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:08.474081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa97e7f606c4374a629c460de97aed9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:08.476827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:08.578138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa97e7f606c4374a629c460de97aed9', 'request_id': 'req-e05b3eb8-0e84-4644-9783-1b0512477b89'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:08.612926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa97e7f606c4374a629c460de97aed9', 'request_id': 'req-e05b3eb8-0e84-4644-9783-1b0512477b89'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:08.632198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa97e7f606c4374a629c460de97aed9', 'request_id': 'req-e05b3eb8-0e84-4644-9783-1b0512477b89'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:08.678209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] The token cache is being invalidate because project daa97e7f606c4374a629c460de97aed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:08.681561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:08.683092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e05b3eb8-0e84-4644-9783-1b0512477b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:08.691696 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3623/7265] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:08 2022] DELETE /identity/v3/projects/daa97e7f606c4374a629c460de97aed9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:08.693948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:08.694520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:08.694688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:08.732894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:08.735897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:08.897915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:08.929188 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3643/7266] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:08.933646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:08.933931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:08.934484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:08.977802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:08.990993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:09.006461 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3624/7267] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:09.011245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.027110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51223cf-8678-4c53-a7a6-5cf269e59bcd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.046281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:09.047076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.057377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.057833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.065867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:09.066504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:09.068077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:09.093619 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3644/7268] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:09.100656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.124238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbc78e-5c80-40ae-a0da-b0aa4135f862 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.139966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:09.140868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.141327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.141760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.142607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:09.144687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:09.214819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3625/7269] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:09 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:09.218972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.232212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff275f-0176-49e9-8bae-e1599daf2894 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.385238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:09.386223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.386667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.387585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.389918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:09.392534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:09.455539 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3645/7270] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:09 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:09.456520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.471664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9764-2480-4e8d-9285-9373e3a0b450 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.483888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:09.484857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.485384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.487093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.492160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:09.494126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:09.524585 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3626/7271] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:09.529737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.563605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62118483-402d-4655-a161-f015d1db2639 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.572496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.578051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:09.588357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:09.589129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.589420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.589710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.590407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:09.612186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:09.681951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3646/7272] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:09.682973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:09.719975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f549b85-33d0-4ea5-8f9d-ea25f11faae6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.749012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafc627-571f-4909-9dda-d0959c70ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:09.751203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafc627-571f-4909-9dda-d0959c70ee9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.757912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafc627-571f-4909-9dda-d0959c70ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.759205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafc627-571f-4909-9dda-d0959c70ee9b admin admin] PATH_INFO: `/v3/projects/25bc22d99bae4392879d5f512122cc17/users/ee9d4a38c95141adabe86ee86fdcf397/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.814836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafc627-571f-4909-9dda-d0959c70ee9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bc22d99bae4392879d5f512122cc17, user_id=ee9d4a38c95141adabe86ee86fdcf397, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:09.819630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafc627-571f-4909-9dda-d0959c70ee9b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:09.820322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:09.860757 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3647/7273] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:09 2022] PUT /identity/v3/projects/25bc22d99bae4392879d5f512122cc17/users/ee9d4a38c95141adabe86ee86fdcf397/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:09.874292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:09.874685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:09.875035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:09.889549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a05cef-964e-4d51-b2b0-5fdb3184dd7a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:09.952474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] MFA Rules not processed for user `ee9d4a38c95141adabe86ee86fdcf397`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:09.955637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:10.066249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:10.067057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:10.067429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:10.067807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:10.071589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:10.113616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:10.121522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:10.122005 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3648/7274] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:10.131020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:10.132751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:10.149665 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3627/7275] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:10.164751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067971e-a4b9-4fd5-a0d5-704cd5ce2884 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:10.175704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8e3f0-4b3e-4d4d-8a71-0f10ac54cb0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:10.176958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e3f0-4b3e-4d4d-8a71-0f10ac54cb0c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:10.177481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e3f0-4b3e-4d4d-8a71-0f10ac54cb0c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:10.177997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e3f0-4b3e-4d4d-8a71-0f10ac54cb0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:10.189394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8e3f0-4b3e-4d4d-8a71-0f10ac54cb0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:10.192598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8e3f0-4b3e-4d4d-8a71-0f10ac54cb0c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:10.216843 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3649/7276] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:10.261696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:10.340746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d36689-43ca-43be-9db1-5215559e1a7f service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:10.348799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:10.349512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:10.349798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:10.350079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] PATH_INFO: `/v3/users/ee9d4a38c95141adabe86ee86fdcf397` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:10.352007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9d4a38c95141adabe86ee86fdcf397)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:10.354011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:10.434570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9d4a38c95141adabe86ee86fdcf397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:10.449325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9d4a38c95141adabe86ee86fdcf397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:10.450361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9d4a38c95141adabe86ee86fdcf397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:10.464495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9d4a38c95141adabe86ee86fdcf397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:10.465387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9d4a38c95141adabe86ee86fdcf397'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:10.495193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:10.502365 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3628/7277] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:10 2022] DELETE /identity/v3/users/ee9d4a38c95141adabe86ee86fdcf397 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:10.507324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:10.507609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:10.507967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:10.553365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:10.556526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:10.567695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:10.733753 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3650/7278] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:10.798541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:10.806451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:11.043506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3285dea-d4dd-405d-bd75-26e506621497 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:11.056078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:11.056713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:11.057015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:11.057293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:11.129860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:11.131349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:11.189314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3629/7279] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:11.907427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:11.909756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:11.924595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:11.926837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:11.972194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4273139-193e-46a4-aa0b-7d7aeada0e9c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:11.978246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:11.979198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:11.980036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:11.980545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] PATH_INFO: `/v3/projects/25bc22d99bae4392879d5f512122cc17` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:11.982888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bc22d99bae4392879d5f512122cc17)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:11.994134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.036289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538e4eb-b766-4b87-b727-e03cc1fe8739 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:12.041806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:12.042932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.043395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.043826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.050765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:12.086462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bc22d99bae4392879d5f512122cc17', 'request_id': 'req-7f097ea2-7730-43a2-9a30-97ac6748d5a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:12.097738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bc22d99bae4392879d5f512122cc17', 'request_id': 'req-7f097ea2-7730-43a2-9a30-97ac6748d5a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:12.110934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bc22d99bae4392879d5f512122cc17', 'request_id': 'req-7f097ea2-7730-43a2-9a30-97ac6748d5a0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:12.133690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] The token cache is being invalidate because project 25bc22d99bae4392879d5f512122cc17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:12.134654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:12.136086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7f097ea2-7730-43a2-9a30-97ac6748d5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:12.140001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3651/7280] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:11 2022] DELETE /identity/v3/projects/25bc22d99bae4392879d5f512122cc17 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:12.146286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.146955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.147455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.179090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:12.182021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:12.230623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:12.233090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efb997-5dde-4670-bdc7-16daec623144 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.260766 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3630/7281] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:12.327944 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3652/7282] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:12.336289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.337312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.337912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.402303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:12.406850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:12.436573 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3631/7283] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:12.441961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:12.456553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce9e95-63ed-433a-a84c-65b1cae6d215 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:12.470405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:12.471057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.471342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.471624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.482871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:12.482871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:12.484930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.519632 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3653/7284] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:00:12.523896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:12.538429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f0e77-fe2a-4f9c-8e4b-8be9f63a34b7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:12.550246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:12.551293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.551711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.551992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.552642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:12.554674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.610501 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3632/7285] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:12 2022] POST /identity/v3/projects => generated 403 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:12.615297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:12.630906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704a3a2-135c-4d9f-a113-bb29172f692d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:12.677951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:12.761326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:12.762235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.763188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.763624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.764620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:12.766780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.829545 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3654/7286] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:12 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:12.833588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:12.856158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8474f-1398-4a1f-a9d2-aa9d2d8ad343 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:12.870739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:12.871707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.872849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.873344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.874301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:12.876124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.898366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3633/7287] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:12.902203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:12.918221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de564e-a1c0-4653-afbf-4f0b971b0d9d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:12.931649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5728b-663b-4a3a-8f17-71cf175db829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:12.933813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5728b-663b-4a3a-8f17-71cf175db829 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:12.934179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5728b-663b-4a3a-8f17-71cf175db829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:12.934894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5728b-663b-4a3a-8f17-71cf175db829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:12.936209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5728b-663b-4a3a-8f17-71cf175db829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:12.942640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5728b-663b-4a3a-8f17-71cf175db829 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:12.971656 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3655/7288] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:12.975569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:12.992669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96410e6b-5571-4a4d-bfa2-a1a6e21f1f73 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.012119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.013195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.013640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.014362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] PATH_INFO: `/v3/projects/0033d72dd25f4f5ca66d60b6af835bcb/users/4ba8c142a14741e78c9768492437d6cf/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.033492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:13.049053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0033d72dd25f4f5ca66d60b6af835bcb, user_id=4ba8c142a14741e78c9768492437d6cf, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.056531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.104261 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3634/7289] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:12 2022] PUT /identity/v3/projects/0033d72dd25f4f5ca66d60b6af835bcb/users/4ba8c142a14741e78c9768492437d6cf/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:13.118424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.119401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.119999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.160712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] MFA Rules not processed for user `4ba8c142a14741e78c9768492437d6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:13.162021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:13.245839 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3656/7290] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:13.250991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:13.386993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f9983-9154-4e7b-872f-81d8ce65fb2f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.395892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.396621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.397017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.397366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.398089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.400369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.446692 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3635/7291] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:13 2022] POST /identity/v3/projects => generated 401 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:13.451122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:13.463889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a6cf-9ac0-41f2-a531-6e875a60c754 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.564504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.565870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.566162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.566442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.567915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.570559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.614420 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3657/7292] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:13 2022] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:13.615796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:13.631575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3182232-1d0c-4e24-a16e-1c40fe3394ae admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.641736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.642808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.644216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.644742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.645946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.648858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.686014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:13.696775 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3636/7293] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:13.699669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd8bd-4245-4560-919f-de474234a77d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.706106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.706813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.707150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.707428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] PATH_INFO: `/v3/projects/70053d34763744e2a537c0f403ca1ac3/users/a21537859e1944d591c867e91cce6663/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.735968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70053d34763744e2a537c0f403ca1ac3, user_id=a21537859e1944d591c867e91cce6663, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.739085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.753862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:13.764861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3658/7294] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:13 2022] PUT /identity/v3/projects/70053d34763744e2a537c0f403ca1ac3/users/a21537859e1944d591c867e91cce6663/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:13.766612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:13.777582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be54b0-3a52-440c-b9f2-f93d57be92c2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.887822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577b993-9f9a-4f17-83fb-611b436a8869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.893439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577b993-9f9a-4f17-83fb-611b436a8869 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.893883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577b993-9f9a-4f17-83fb-611b436a8869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.894269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577b993-9f9a-4f17-83fb-611b436a8869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.896129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577b993-9f9a-4f17-83fb-611b436a8869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.899293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577b993-9f9a-4f17-83fb-611b436a8869 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.925092 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3637/7295] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:13.926064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:13.945146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a8939-e76b-46d9-8c76-f84d0859fcc8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:13.961940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:13.962601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:13.963040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:13.964727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] PATH_INFO: `/v3/projects/70053d34763744e2a537c0f403ca1ac3/users/a21537859e1944d591c867e91cce6663/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:13.967887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70053d34763744e2a537c0f403ca1ac3, user_id=a21537859e1944d591c867e91cce6663, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:13.974538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:13.997476 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3659/7296] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:13 2022] PUT /identity/v3/projects/70053d34763744e2a537c0f403ca1ac3/users/a21537859e1944d591c867e91cce6663/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:14.008022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:14.012492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:14.014000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:14.074677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] MFA Rules not processed for user `a21537859e1944d591c867e91cce6663`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:14.077424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:14.191960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:14.231139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3638/7297] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:14 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:14.237260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:14.264822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9864e74-27fb-49b3-82cf-38fcc60a17d7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:14.280048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21537859e1944d591c867e91cce6663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70053d34763744e2a537c0f403ca1ac3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:14.281799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:14.282378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:14.283386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:14.286959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:14.291845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:14.328334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3660/7298] 10.222.0.16 () {60 vars in 1143 bytes} [Wed Oct 5 03:00:14 2022] POST /identity/v3/roles => generated 240 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:14.332687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:14.353577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298822-80b8-4ee2-aeff-ada079e22934 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:14.362879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9453b-5492-47b1-bb2d-dd2dca99375d tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21537859e1944d591c867e91cce6663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70053d34763744e2a537c0f403ca1ac3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:14.363829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9453b-5492-47b1-bb2d-dd2dca99375d tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:14.365006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9453b-5492-47b1-bb2d-dd2dca99375d tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:14.367154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9453b-5492-47b1-bb2d-dd2dca99375d tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] PATH_INFO: `/v3/projects/0033d72dd25f4f5ca66d60b6af835bcb/users/4ba8c142a14741e78c9768492437d6cf/roles/2705cbcd3d484cdbbafe5e4dae4c1dca` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:14.371754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9453b-5492-47b1-bb2d-dd2dca99375d tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0033d72dd25f4f5ca66d60b6af835bcb, user_id=4ba8c142a14741e78c9768492437d6cf, role_id=2705cbcd3d484cdbbafe5e4dae4c1dca)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:14.376018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9453b-5492-47b1-bb2d-dd2dca99375d tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:14.401457 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3639/7299] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:14 2022] PUT /identity/v3/projects/0033d72dd25f4f5ca66d60b6af835bcb/users/4ba8c142a14741e78c9768492437d6cf/roles/2705cbcd3d484cdbbafe5e4dae4c1dca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:14.406286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:14.550965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676727a8-2645-4265-8e7c-f65a26a7b957 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:14.691810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba8c142a14741e78c9768492437d6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0033d72dd25f4f5ca66d60b6af835bcb', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-2033215797', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:14.692585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:14.692942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:14.693278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] PATH_INFO: `/v3/users/4ba8c142a14741e78c9768492437d6cf/application_credentials` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:14.694368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] RBAC: Authorizing `identity:create_application_credential(user_id=4ba8c142a14741e78c9768492437d6cf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:14.695897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:14.803712 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3661/7300] 10.222.0.16 () {60 vars in 1315 bytes} [Wed Oct 5 03:00:14 2022] POST /identity/v3/users/4ba8c142a14741e78c9768492437d6cf/application_credentials => generated 660 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:14.808005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:14.808481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:14.808769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:14.854465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] MFA Rules not processed for user `4ba8c142a14741e78c9768492437d6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:14.855979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:15.038614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3640/7301] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:14 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 05 03:00:15.040605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:15.059618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c17f8-cc87-40e1-ace4-f6e49eaccc53 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:15.066538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ba8c142a14741e78c9768492437d6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0033d72dd25f4f5ca66d60b6af835bcb', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-2033215797', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:15.067706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:15.068611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:15.069109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] PATH_INFO: `/v3/users/4ba8c142a14741e78c9768492437d6cf/application_credentials/895d550c256942b5884657382928b332` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:15.074107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] RBAC: Authorizing `identity:delete_application_credential(user_id=4ba8c142a14741e78c9768492437d6cf, application_credential_id=895d550c256942b5884657382928b332)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:15.077789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:15.093586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:15.128769 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3662/7302] 10.222.0.16 () {58 vars in 1395 bytes} [Wed Oct 5 03:00:15 2022] DELETE /identity/v3/users/4ba8c142a14741e78c9768492437d6cf/application_credentials/895d550c256942b5884657382928b332 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:15.141255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:15.303567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018290-d17c-488f-a718-4b2b1275dae1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:15.313970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21537859e1944d591c867e91cce6663', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '70053d34763744e2a537c0f403ca1ac3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:15.315433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:15.316337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:15.316857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] PATH_INFO: `/v3/roles/2705cbcd3d484cdbbafe5e4dae4c1dca` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:15.319566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2705cbcd3d484cdbbafe5e4dae4c1dca)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:15.322824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:15.337611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:15.418555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] Invalidating the token cache because role 2705cbcd3d484cdbbafe5e4dae4c1dca has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:15.419964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.420769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48d5e090-9e81-40cc-83ef-c166e924b830 tempest-ApplicationCredentialsV3AdminTest-465862061 tempest-ApplicationCredentialsV3AdminTest-465862061-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.429609 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3641/7303] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:15 2022] DELETE /identity/v3/roles/2705cbcd3d484cdbbafe5e4dae4c1dca => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:15.432683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:15.436051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:15.624043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564256b5-2c82-444e-af20-dfede146e237 tempest-ApplicationCredentialsV3AdminTest-1824882822 tempest-ApplicationCredentialsV3AdminTest-1824882822-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:15.709785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:15.710440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:15.710725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:15.711007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] PATH_INFO: `/v3/users/4ba8c142a14741e78c9768492437d6cf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:15.712509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba8c142a14741e78c9768492437d6cf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:15.714521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:15.813789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba8c142a14741e78c9768492437d6cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.840512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba8c142a14741e78c9768492437d6cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.844952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba8c142a14741e78c9768492437d6cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.864949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba8c142a14741e78c9768492437d6cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.865607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba8c142a14741e78c9768492437d6cf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:15.891623 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3663/7304] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:15 2022] DELETE /identity/v3/users/4ba8c142a14741e78c9768492437d6cf => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:15.895869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:15.896326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:15.896653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:15.966852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:15.967889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:15.968293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:15.969974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:16.029306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:16.142438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44e0b-03a9-4ed7-a039-ae10e0c82469 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:16.151573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:16.152221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:16.152506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:16.152784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:16.155444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:16.175781 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3642/7305] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:16.227504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:16.229934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:16.246583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:16.249730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:16.265539 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3664/7306] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:16.481423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac885c2a-87d5-4b2a-b32b-eca59bcf52f2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:16.500501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:16.503357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:16.503357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:16.503357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:16.610753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:16.617206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:16.682510 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3643/7307] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:18.101242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:18.102837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:18.128191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58527a-4d26-4160-8c98-e4ea57a25db8 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:18.135998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:18.137375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:18.140450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:18.140974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] PATH_INFO: `/v3/projects/0033d72dd25f4f5ca66d60b6af835bcb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:18.142436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0033d72dd25f4f5ca66d60b6af835bcb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:18.148399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:18.251702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0033d72dd25f4f5ca66d60b6af835bcb', 'request_id': 'req-234bd900-b982-493f-9828-7655b988ee52'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.266656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0033d72dd25f4f5ca66d60b6af835bcb', 'request_id': 'req-234bd900-b982-493f-9828-7655b988ee52'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.276510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0033d72dd25f4f5ca66d60b6af835bcb', 'request_id': 'req-234bd900-b982-493f-9828-7655b988ee52'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.308780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] The token cache is being invalidate because project 0033d72dd25f4f5ca66d60b6af835bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:18.309229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.311330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.313058 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3665/7308] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:18 2022] DELETE /identity/v3/projects/0033d72dd25f4f5ca66d60b6af835bcb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:18.318065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:18.338311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694d64-9c9f-44e9-b455-5576450c75eb service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:18.473026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:18.473770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:18.474119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:18.474461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] PATH_INFO: `/v3/users/a21537859e1944d591c867e91cce6663` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:18.476419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21537859e1944d591c867e91cce6663)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:18.480698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:18.535114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:18.629463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21537859e1944d591c867e91cce6663'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.654878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21537859e1944d591c867e91cce6663'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.655834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21537859e1944d591c867e91cce6663'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.676423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21537859e1944d591c867e91cce6663'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.677171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-65255a6c-3ca7-4599-9bca-1cea5dc70e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21537859e1944d591c867e91cce6663'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:18.709020 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3644/7309] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:18 2022] DELETE /identity/v3/users/a21537859e1944d591c867e91cce6663 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:20.352347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:20.356178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:20.398368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bd900-b982-493f-9828-7655b988ee52 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:20.563408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:20.587781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:20.608240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:20.609086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:20.610374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] PATH_INFO: `/v3/projects/70053d34763744e2a537c0f403ca1ac3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:20.616757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70053d34763744e2a537c0f403ca1ac3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:20.620709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:20.773031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70053d34763744e2a537c0f403ca1ac3', 'request_id': 'req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:20.789174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70053d34763744e2a537c0f403ca1ac3', 'request_id': 'req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:20.801533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70053d34763744e2a537c0f403ca1ac3', 'request_id': 'req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:20.832939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] The token cache is being invalidate because project 70053d34763744e2a537c0f403ca1ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:20.833399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:20.835275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cdb6f185-7fc9-4ac6-9fa3-ca94ebbe7700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:20.838525 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3666/7310] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:20 2022] DELETE /identity/v3/projects/70053d34763744e2a537c0f403ca1ac3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:20.843307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:20.844247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:20.844757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:20.886556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:20.888415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:21.109808 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3645/7311] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:21.117814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.118533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.119051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.179540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:21.181205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:21.207886 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3667/7312] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:21.208750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:21.221887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045679-1b85-4baf-a3eb-1d59bf878936 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:21.239015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:21.239660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.243060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.243360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.244059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:21.244372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:21.251548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:21.291170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3646/7313] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:21.295461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:21.310723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dab48-09ea-46a1-831d-f4ec897da903 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:21.328455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:21.330919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.331368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.332738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.335245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:21.339751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:21.424591 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3668/7314] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:21 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:21.428968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:21.444663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f5e6-a8b0-4de6-8792-4893814d11f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:21.644618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:21.645582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.647199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.648173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.667730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:21.678216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:21.751338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3647/7315] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:21 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:21.754572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:21.772839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c63d60-ca8e-47cf-9467-113039e45fd8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:21.785216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:21.785858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.786153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.786435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.787103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:21.792330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:21.834056 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3669/7316] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:21.838857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:21.858332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a654c3-f906-46f6-beeb-66650f094d23 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:21.866079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5936e-16c8-41c7-a9e3-e4e109aa2c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:21.866771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5936e-16c8-41c7-a9e3-e4e109aa2c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.867003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5936e-16c8-41c7-a9e3-e4e109aa2c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.867286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5936e-16c8-41c7-a9e3-e4e109aa2c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.867945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5936e-16c8-41c7-a9e3-e4e109aa2c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:21.869613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5936e-16c8-41c7-a9e3-e4e109aa2c34 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:21.886835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:21.903512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:21.909002 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3648/7317] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:21.918334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c8f62-8de5-49fa-876b-da8ce9e2de87 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:21.944939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:21.945231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:21.945426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:21.945932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] PATH_INFO: `/v3/projects/4d0396c511b34ae1869b9b4ce7ab9949/users/c4435eed4f07445684a6a9be68630de6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:21.990284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0396c511b34ae1869b9b4ce7ab9949, user_id=c4435eed4f07445684a6a9be68630de6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:21.993196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:22.037083 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3670/7318] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:21 2022] PUT /identity/v3/projects/4d0396c511b34ae1869b9b4ce7ab9949/users/c4435eed4f07445684a6a9be68630de6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:22.041272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8eb39-d727-459f-92a5-040858417c35 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.041686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8eb39-d727-459f-92a5-040858417c35 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.042074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8eb39-d727-459f-92a5-040858417c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.102482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d2f8eb39-d727-459f-92a5-040858417c35 None None] MFA Rules not processed for user `c4435eed4f07445684a6a9be68630de6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:22.103844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d2f8eb39-d727-459f-92a5-040858417c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:22.230229 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3649/7319] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:22.234637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:22.369716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e3428-49a8-43bd-b7ba-d835eb2c52cd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:22.381120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:22.382124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.382639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.383149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.388187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:22.390797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:22.432761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.433205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.433538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.438066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:22.469117 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3671/7320] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:22 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:22.470128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:22.527532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] MFA Rules not processed for user `f34919fa438e4522bf4260e254e4f78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:22.532271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:22.651012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7b10-0821-48d5-8e0d-a0b30930b3f9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:22.668349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:22.670872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.671403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.672329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.675246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:22.678474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:22.722218 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3650/7321] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:22.727383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:22.730800 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3672/7322] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:22 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:22.737229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:22.739664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:22.761566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a99c-580b-4443-b386-ddc3b3e182e2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:22.784271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:22.785865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.786406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.786908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.789381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:22.791908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:22.792853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d562a1-1aa6-47f1-939b-75d9af00ef51 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:22.806457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:22.808176 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3673/7323] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:22.811752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.811910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.812193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.813456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:22.815291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:22.823747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:22.833076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25183b90-7116-40bb-8336-40b7ee7a27af admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:22.840517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:22.845177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:22.845583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:22.846429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] PATH_INFO: `/v3/projects/3ec6eebf3e8143089455b741a4adfcc4/users/78f46534cf954e24be4c0ee3d28ab290/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:22.888680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec6eebf3e8143089455b741a4adfcc4, user_id=78f46534cf954e24be4c0ee3d28ab290, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:22.893598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:22.926453 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3674/7324] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:22 2022] PUT /identity/v3/projects/3ec6eebf3e8143089455b741a4adfcc4/users/78f46534cf954e24be4c0ee3d28ab290/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:22.929745 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3651/7325] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:22 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:22.930409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:22.930788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.122758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7002f11-1e50-488f-8417-1be08d9baefb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.261373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:23.267641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.268394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.268674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.268964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.269950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:23.271570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:23.274686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a652d-2921-4af8-9ee5-38d6ea1b2d7e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.280567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:23.287288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.288042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.288193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.288477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.295797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:23.298173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:23.324629 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3675/7326] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:23.331367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.384557 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3652/7327] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:22 2022] POST /identity/v3/users => generated 297 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:23.389597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b022d5-d5f8-410a-8dee-a0fda330d25b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.391478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.406180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7a198-2670-4ce8-8234-d41bea6c9cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.406833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a198-2670-4ce8-8234-d41bea6c9cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.409175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a198-2670-4ce8-8234-d41bea6c9cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.409584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7a198-2670-4ce8-8234-d41bea6c9cc1 admin admin] PATH_INFO: `/v3/projects/3ec6eebf3e8143089455b741a4adfcc4/users/78f46534cf954e24be4c0ee3d28ab290/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.414538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7a198-2670-4ce8-8234-d41bea6c9cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec6eebf3e8143089455b741a4adfcc4, user_id=78f46534cf954e24be4c0ee3d28ab290, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:23.416504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44496651-7bff-4fbc-abcb-1defe8c5cd82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.422088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7a198-2670-4ce8-8234-d41bea6c9cc1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:23.423937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.424884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.425423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.425918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.427264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:23.444492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:23.465065 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3676/7328] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:23 2022] PUT /identity/v3/projects/3ec6eebf3e8143089455b741a4adfcc4/users/78f46534cf954e24be4c0ee3d28ab290/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:23.472403 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3653/7329] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:23.474503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.475173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.475604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.476111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.495862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a506b7-7854-4961-b798-a8b582f9ff9f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.590075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] MFA Rules not processed for user `78f46534cf954e24be4c0ee3d28ab290`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:23.603539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:23.637311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.641827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.642302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.643391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] PATH_INFO: `/v3/projects/abf4ead6fb0c444482b5470326e83bdb/users/090cbbcbe7654c46ae5fa6a0b631e6a7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.673357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf4ead6fb0c444482b5470326e83bdb, user_id=090cbbcbe7654c46ae5fa6a0b631e6a7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:23.677302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:23.714358 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3654/7330] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:23 2022] PUT /identity/v3/projects/abf4ead6fb0c444482b5470326e83bdb/users/090cbbcbe7654c46ae5fa6a0b631e6a7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:23.720304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.864882 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3677/7331] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:23.870528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.876040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224a2e-87c0-43c3-8563-0ce649d9ff29 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.881796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd1d5-72bf-44be-abd5-ae6262148cbd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.890680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.891435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.891723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.891996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.896566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:23.898173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:23.928864 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3655/7332] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:23.933618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:23.958621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170a4f-bd4a-4e59-8cf6-c8f7a0fa9660 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:23.978744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:23.978744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:23.978744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:23.978744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] PATH_INFO: `/v3/projects/abf4ead6fb0c444482b5470326e83bdb/users/090cbbcbe7654c46ae5fa6a0b631e6a7/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:23.991561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf4ead6fb0c444482b5470326e83bdb, user_id=090cbbcbe7654c46ae5fa6a0b631e6a7, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:24.005074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:24.060161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:24.061193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:24.061680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:24.062178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:24.063026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:24.063772 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3656/7333] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:23 2022] PUT /identity/v3/projects/abf4ead6fb0c444482b5470326e83bdb/users/090cbbcbe7654c46ae5fa6a0b631e6a7/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:24.065714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:24.144535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3678/7334] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:23 2022] POST /identity/v3/projects => generated 334 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:24.149572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:24.257844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:24.284415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604dd0e-67fd-4094-aaa7-a15988349736 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:24.376733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:24.379279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:24.379702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:24.380084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:24.380968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:24.386509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:24.445699 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3657/7335] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 03:00:24 2022] POST /identity/v3/projects => generated 333 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:24.453743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:24.474230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eed0a-643f-468c-a1a3-6ce1c882725d tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:24.641888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:24.687596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:24.688877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:24.690027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:24.690592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:24.691921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:24.695744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:24.852290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3679/7336] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:24 2022] POST /identity/v3/projects => generated 358 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:24.853167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:24.874861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d688aab-3629-4be3-9217-5c16e4a9f522 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:25.025659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:25.028591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:25.032699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:25.033669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:25.036353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:25.042481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:25.071596 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3658/7337] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 03:00:24 2022] GET /identity/v3/projects => generated 7194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:25.077784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:25.092724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438770-9029-4f99-a5ff-1e641f6e3c97 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:25.099632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:25.101992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:25.102467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:25.102955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:25.104707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:25.105727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:25.108444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:25.142505 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3680/7338] 10.222.0.16 () {58 vars in 1158 bytes} [Wed Oct 5 03:00:25 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:25.145436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:25.164221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488422f-76ff-47c7-a1f1-4c263a5c1d2f tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:25.179172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:25.179806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:25.180234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:25.180519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:25.181237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Adding query filter params (parent_id=ee4b3c1dfbef4648a649ecb4cff23978) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:25.181544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:25.183646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:25.249359 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3659/7339] 10.222.0.16 () {58 vars in 1216 bytes} [Wed Oct 5 03:00:25 2022] GET /identity/v3/projects?parent_id=ee4b3c1dfbef4648a649ecb4cff23978 => generated 498 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:25.250599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:25.276019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc3b47-82bf-46a6-aa97-8b8637e00aab tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:25.306839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:25.307504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:25.307807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:25.308070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects/f3d2f2ca48c34df3b87abca4e0da09cd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:25.309344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3d2f2ca48c34df3b87abca4e0da09cd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:25.312626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:25.416926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d2f2ca48c34df3b87abca4e0da09cd', 'request_id': 'req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.425077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d2f2ca48c34df3b87abca4e0da09cd', 'request_id': 'req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.438967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d2f2ca48c34df3b87abca4e0da09cd', 'request_id': 'req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.469419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] The token cache is being invalidate because project f3d2f2ca48c34df3b87abca4e0da09cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:25.469741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.471889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.478677 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3681/7340] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:25 2022] DELETE /identity/v3/projects/f3d2f2ca48c34df3b87abca4e0da09cd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:25.480576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:25.482915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:25.501606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f54ddd-a2e3-4b5d-9149-73223a609806 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:25.679939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:25.698841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:25.701371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:25.701683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:25.703966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects/ee4b3c1dfbef4648a649ecb4cff23978` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:25.707079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee4b3c1dfbef4648a649ecb4cff23978)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:25.712833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:25.816392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4b3c1dfbef4648a649ecb4cff23978', 'request_id': 'req-176a646e-2850-41f3-a454-e68d31129158'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.827822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4b3c1dfbef4648a649ecb4cff23978', 'request_id': 'req-176a646e-2850-41f3-a454-e68d31129158'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.835676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4b3c1dfbef4648a649ecb4cff23978', 'request_id': 'req-176a646e-2850-41f3-a454-e68d31129158'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.853266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] The token cache is being invalidate because project ee4b3c1dfbef4648a649ecb4cff23978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:25.854057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.855206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:25.860945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3660/7341] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:25 2022] DELETE /identity/v3/projects/ee4b3c1dfbef4648a649ecb4cff23978 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:25.862146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:25.876642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6c264-2542-485e-b7c4-cacc05b1f0aa tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:26.022695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78f46534cf954e24be4c0ee3d28ab290', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ec6eebf3e8143089455b741a4adfcc4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:26.023356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:26.023639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:26.023916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] PATH_INFO: `/v3/projects/1b9a8af956b84ad390cabd2a3d2c61ff` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:26.025921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b9a8af956b84ad390cabd2a3d2c61ff)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:26.027855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:26.132374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:26.142279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9a8af956b84ad390cabd2a3d2c61ff', 'request_id': 'req-b1fa088e-2993-438d-a522-416aa300c4b1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.158324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9a8af956b84ad390cabd2a3d2c61ff', 'request_id': 'req-b1fa088e-2993-438d-a522-416aa300c4b1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.168170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9a8af956b84ad390cabd2a3d2c61ff', 'request_id': 'req-b1fa088e-2993-438d-a522-416aa300c4b1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.199335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] The token cache is being invalidate because project 1b9a8af956b84ad390cabd2a3d2c61ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:26.199644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.201997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.204895 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3682/7342] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:25 2022] DELETE /identity/v3/projects/1b9a8af956b84ad390cabd2a3d2c61ff => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:26.209510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:26.211290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:26.417677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a646e-2850-41f3-a454-e68d31129158 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:26.430113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:26.432394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:26.570753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa088e-2993-438d-a522-416aa300c4b1 tempest-ListProjectsTestJSON-1417511646 tempest-ListProjectsTestJSON-1417511646-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:26.576037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:26.577021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:26.577386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:26.577833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] PATH_INFO: `/v3/users/16e7f912ab8643d2918a1f2e28a6ccc5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:26.579926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e7f912ab8643d2918a1f2e28a6ccc5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:26.582047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:26.638837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:26.640640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:26.645051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:26.646850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] PATH_INFO: `/v3/users/c4435eed4f07445684a6a9be68630de6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:26.650522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4435eed4f07445684a6a9be68630de6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:26.652450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e7f912ab8643d2918a1f2e28a6ccc5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.658825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:26.702413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e7f912ab8643d2918a1f2e28a6ccc5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.708132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e7f912ab8643d2918a1f2e28a6ccc5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.750171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e7f912ab8643d2918a1f2e28a6ccc5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.751085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a6bbc197-4a47-4e9f-b972-c6b7a411c8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e7f912ab8643d2918a1f2e28a6ccc5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.784347 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3683/7343] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:26 2022] DELETE /identity/v3/users/16e7f912ab8643d2918a1f2e28a6ccc5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:26.789284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:26.789607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:26.789893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:26.805168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:26.837525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4435eed4f07445684a6a9be68630de6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.863433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:26.867198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:26.870801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4435eed4f07445684a6a9be68630de6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.871873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4435eed4f07445684a6a9be68630de6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.893822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4435eed4f07445684a6a9be68630de6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.894626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d46feb68-1ac0-4b5e-9341-5815c6cd3e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4435eed4f07445684a6a9be68630de6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:26.930890 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3661/7344] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:26 2022] DELETE /identity/v3/users/c4435eed4f07445684a6a9be68630de6 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:26.936547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:26.938033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:26.938337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:27.038922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:27.054203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:27.060226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:27.076149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3684/7345] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:27.098742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:27.100402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:27.275830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3662/7346] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:27.307573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509068-5be2-41da-8758-a9cb6d835bc3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:27.339054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:27.341297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:27.473814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:27.474517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:27.474808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:27.475124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:27.517585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:27.522051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5bc93-dca8-450b-bf25-c54f7458034b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:27.526720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:27.536862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:27.537533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:27.537810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:27.538093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:27.592511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:27.593512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3685/7347] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:27.595745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:27.607073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:27.611954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:27.638120 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3663/7348] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:27.806406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e11c6f-3f23-4bd9-bb34-835976b8d65d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:27.822592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:27.824485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:27.825909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:27.826772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:27.831143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:27.865878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:27.867829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:27.897331 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3686/7349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:28.967841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:28.970836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:28.998676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ea823-0b15-4163-809e-9e34da1fc0d6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:29.020049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:29.032736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:29.033117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:29.033460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] PATH_INFO: `/v3/projects/7880bfbd22e74e74aaa56bc0ddc44614` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:29.038387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7880bfbd22e74e74aaa56bc0ddc44614)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:29.041812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:29.152078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7880bfbd22e74e74aaa56bc0ddc44614', 'request_id': 'req-924e58c6-f367-4875-90ec-40010bb35fa6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.155460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:29.200718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7880bfbd22e74e74aaa56bc0ddc44614', 'request_id': 'req-924e58c6-f367-4875-90ec-40010bb35fa6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.227659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7880bfbd22e74e74aaa56bc0ddc44614', 'request_id': 'req-924e58c6-f367-4875-90ec-40010bb35fa6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.275654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] The token cache is being invalidate because project 7880bfbd22e74e74aaa56bc0ddc44614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:29.275896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.277465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-924e58c6-f367-4875-90ec-40010bb35fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.287017 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3664/7350] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:28 2022] DELETE /identity/v3/projects/7880bfbd22e74e74aaa56bc0ddc44614 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:29.291252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:29.324629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83832c24-295f-4f07-be2f-48da2f4a97c1 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:29.445187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:29.445809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:29.446329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:29.466484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:29.536670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:29.539378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:29.565953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:29.569059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:29.569505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:29.569891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] PATH_INFO: `/v3/users/49085a6595de4731967703e3d3d3afac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:29.572745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49085a6595de4731967703e3d3d3afac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:29.580302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:29.708200 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3665/7351] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:29.710647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49085a6595de4731967703e3d3d3afac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.728508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49085a6595de4731967703e3d3d3afac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.729475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49085a6595de4731967703e3d3d3afac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.742989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49085a6595de4731967703e3d3d3afac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.745275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49085a6595de4731967703e3d3d3afac'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:29.774177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3687/7352] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:29 2022] DELETE /identity/v3/users/49085a6595de4731967703e3d3d3afac => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:30.292364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:30.296772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:30.370746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c90f5-fa49-441b-94df-22eb259260e0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:30.565331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:30.566018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:30.566303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:30.566579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] PATH_INFO: `/v3/projects/4d0396c511b34ae1869b9b4ce7ab9949` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:30.569259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0396c511b34ae1869b9b4ce7ab9949)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:30.571235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:30.704207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0396c511b34ae1869b9b4ce7ab9949', 'request_id': 'req-970a5ddf-166e-4edd-8979-a0c576b55441'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:30.722368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0396c511b34ae1869b9b4ce7ab9949', 'request_id': 'req-970a5ddf-166e-4edd-8979-a0c576b55441'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:30.742096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0396c511b34ae1869b9b4ce7ab9949', 'request_id': 'req-970a5ddf-166e-4edd-8979-a0c576b55441'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:30.771184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] The token cache is being invalidate because project 4d0396c511b34ae1869b9b4ce7ab9949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:30.771482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:30.774702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:30.778847 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3666/7353] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:30 2022] DELETE /identity/v3/projects/4d0396c511b34ae1869b9b4ce7ab9949 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:30.784189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:30.785945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:30.819312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936f1c8-4cdd-4e71-9e5d-80839c48fe04 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:30.927941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:30.928565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:30.988972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:30.990333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:30.990859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:30.991361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] PATH_INFO: `/v3/users/78f46534cf954e24be4c0ee3d28ab290` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:30.992838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f46534cf954e24be4c0ee3d28ab290)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:30.995839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:30.997115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:31.128005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f46534cf954e24be4c0ee3d28ab290'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.151315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:31.170847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f46534cf954e24be4c0ee3d28ab290'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.172329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f46534cf954e24be4c0ee3d28ab290'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.193866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f46534cf954e24be4c0ee3d28ab290'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.195048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eb15e49a-6d6a-44aa-9ac8-f481a81349cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f46534cf954e24be4c0ee3d28ab290'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.262876 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3688/7354] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:30 2022] DELETE /identity/v3/users/78f46534cf954e24be4c0ee3d28ab290 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:31.266971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5ddf-166e-4edd-8979-a0c576b55441 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:31.480041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:31.483736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:31.485208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:31.485720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] PATH_INFO: `/v3/projects/c5cfecf6fc95414e98a5cf36f18ac899` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:31.488320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cfecf6fc95414e98a5cf36f18ac899)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:31.491047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:31.676360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cfecf6fc95414e98a5cf36f18ac899', 'request_id': 'req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.707063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cfecf6fc95414e98a5cf36f18ac899', 'request_id': 'req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.721199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cfecf6fc95414e98a5cf36f18ac899', 'request_id': 'req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.780575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] The token cache is being invalidate because project c5cfecf6fc95414e98a5cf36f18ac899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:31.782292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.821524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f0cb5164-ed27-4e93-85a8-5e1f8fff5ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:31.831188 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3667/7355] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:30 2022] DELETE /identity/v3/projects/c5cfecf6fc95414e98a5cf36f18ac899 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:31.832737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:31.833660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:31.834113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:31.873989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:31.880563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:32.106080 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3689/7356] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:32.117837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.118189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.118420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.130304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.131906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:32.196054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1417c6-62a1-4cac-a253-7df1011a4fec None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.198792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:32.200844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:32.220494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3668/7357] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:32.221753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.226042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:32.226745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.227196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.227676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] PATH_INFO: `/v3/projects/3ec6eebf3e8143089455b741a4adfcc4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.229374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec6eebf3e8143089455b741a4adfcc4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:32.239521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:32.243585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31a2d9-edac-4946-a3d7-898f6a2882c7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.266226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:32.267133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.267578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.268043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.268868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:32.269376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:32.271895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:32.310629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3669/7358] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:32.312063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.335912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461c4e2-6923-40b2-af71-6c9ad0629611 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.342899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:32.343855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.344313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.344825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.346527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:32.349683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:32.404844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec6eebf3e8143089455b741a4adfcc4', 'request_id': 'req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:32.416262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec6eebf3e8143089455b741a4adfcc4', 'request_id': 'req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:32.431972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec6eebf3e8143089455b741a4adfcc4', 'request_id': 'req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:32.435644 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3670/7359] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:32 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:32.449609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.466834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] The token cache is being invalidate because project 3ec6eebf3e8143089455b741a4adfcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:32.467585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:32.468556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fe2ada0b-e16c-49ad-95cc-a28d7a891bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:32.473181 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3690/7360] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:32 2022] DELETE /identity/v3/projects/3ec6eebf3e8143089455b741a4adfcc4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:32.486193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459689b-0f9f-46fc-92ad-8991fa3d8223 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.487328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459689b-0f9f-46fc-92ad-8991fa3d8223 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.488429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459689b-0f9f-46fc-92ad-8991fa3d8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.504249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:32.549610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1459689b-0f9f-46fc-92ad-8991fa3d8223 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:32.557561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1459689b-0f9f-46fc-92ad-8991fa3d8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:32.657106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2ca1-b6b8-49d5-8488-6302eecbe262 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.689433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:32.692742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.694266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.694558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.697794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:32.703986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:32.769049 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3671/7361] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:32 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:32.772847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.777202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:32.787287 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3691/7362] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:32.800886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.801345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.801789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.815003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c92a2f-ae11-4af5-bf6c-0499b6ee250e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.828593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:32.829124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.829403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.831329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:32.833153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.833153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:32.837339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:32.863823 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3672/7363] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:32.866023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.883329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:32.885624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:32.892929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e3bc7-b981-44f6-97c5-e74abc5eb6a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.909740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:32.910378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:32.910658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:32.911995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:32.913598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:32.921556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:32.924616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3692/7364] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:32.929141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:32.982490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bf91f-eff5-4366-94e0-a246e01bbdc1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:32.985871 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3673/7365] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:32.989326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.011044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.018169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe1112-ffd0-4dd6-af74-4d76a7bc02fd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.018569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.019862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.020472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.027277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:33.028001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.030179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.041509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774ac0-f752-403e-b0e5-d1f42e9bb35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.042811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ac0-f752-403e-b0e5-d1f42e9bb35b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.043098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ac0-f752-403e-b0e5-d1f42e9bb35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.043376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ac0-f752-403e-b0e5-d1f42e9bb35b admin admin] PATH_INFO: `/v3/projects/50dbc2c68f4043f2818a258e2f8adfd6/users/868b39fd84d7468580f1d2df84062d6c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.072565 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3693/7366] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:33.076843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.104009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52698186-38b6-4077-9e68-a4c069448751 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.121699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.123580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.123973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.124619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.125420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774ac0-f752-403e-b0e5-d1f42e9bb35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dbc2c68f4043f2818a258e2f8adfd6, user_id=868b39fd84d7468580f1d2df84062d6c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.127241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.129432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.129575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774ac0-f752-403e-b0e5-d1f42e9bb35b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.169003 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3674/7367] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:32 2022] PUT /identity/v3/projects/50dbc2c68f4043f2818a258e2f8adfd6/users/868b39fd84d7468580f1d2df84062d6c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:33.179869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.180158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.180602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.208334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3694/7368] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:33 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:33.211072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.275178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] MFA Rules not processed for user `868b39fd84d7468580f1d2df84062d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:33.277492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:33.435665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08240d3f-2d5b-488a-9f03-cf4c27db31c3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.442862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.443607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.444072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.444471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.445455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.447777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.466479 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3675/7369] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:33.470965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.490023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb4712-fe4e-4f49-ae1a-8578a4a39770 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.501494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.502292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.502581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.503177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.503838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.507939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.522096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3695/7370] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:33 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:33.523237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.585235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3676/7371] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:33 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:33.585801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9a3c-fb31-46a1-80fc-1676e78486bd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.586598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.632309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:33.742813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14540de2-0d0f-44d6-8d8f-bdb7d9e3df62 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.759376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.760192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.761380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.763214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.764667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.770034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.779144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.780565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.780991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.781888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.786798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.789108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.810445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3696/7372] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:33.812136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.825283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4f5d-37ee-4ecb-9431-56700b1477a8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.828129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3677/7373] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:33 2022] POST /identity/v3/users => generated 300 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:33.831550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.833514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.834367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.834761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.835177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.836029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.838286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.845148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c2a0-689a-4126-89dc-a85ce1830f8c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.859410 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3697/7374] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:33.860239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.861342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.861639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.861917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.862582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.864194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.872761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.885591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6029-f080-4998-917c-3def8e001b78 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.890678 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3678/7375] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:33.891511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.892790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.894791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.894791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] PATH_INFO: `/v3/projects/fd4f6bd5484041468e5a7291e0ef86a2/users/df053352d1574e7d97004e10d8fb235b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.895054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:33.917303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71986f73-f417-4227-86c6-60725e085b17 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:33.924309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4f6bd5484041468e5a7291e0ef86a2, user_id=df053352d1574e7d97004e10d8fb235b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:33.933194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:33.933771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d320f-3be7-4e51-b869-878264f1c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:33.935011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d320f-3be7-4e51-b869-878264f1c734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:33.935291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d320f-3be7-4e51-b869-878264f1c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:33.936252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d320f-3be7-4e51-b869-878264f1c734 admin admin] PATH_INFO: `/v3/projects/c467a0add83f4ea786ce5b4eca5f8b91/users/f3d24e9eafd2483daebe0d0cac0fcff6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:33.964429 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3698/7376] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:33 2022] PUT /identity/v3/projects/fd4f6bd5484041468e5a7291e0ef86a2/users/df053352d1574e7d97004e10d8fb235b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:33.995993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d320f-3be7-4e51-b869-878264f1c734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c467a0add83f4ea786ce5b4eca5f8b91, user_id=f3d24e9eafd2483daebe0d0cac0fcff6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:34.007035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d320f-3be7-4e51-b869-878264f1c734 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:34.047171 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3679/7377] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:33 2022] PUT /identity/v3/projects/c467a0add83f4ea786ce5b4eca5f8b91/users/f3d24e9eafd2483daebe0d0cac0fcff6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:34.053098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:34.072710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:34.073022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:34.073302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:34.093621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:34.111674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] MFA Rules not processed for user `df053352d1574e7d97004e10d8fb235b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:34.112916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:34.305788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3680/7378] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:34.316435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:34.316651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18bb89-e124-4674-83ae-560becfb7626 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:34.509193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31619fbc-8e34-4d79-adba-899a7224e482 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:34.515749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:34.516443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:34.516791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:34.517094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:34.517911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:34.528466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:34.532386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:34.533742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:34.533742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:34.533742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:34.538423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:34.541143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:34.545470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:34.581186 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3699/7379] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:34.582729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:34.603275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063e5d4-08a6-4702-95e0-0ef14f8694e0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:34.615138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca55fca-1fd8-47e7-a9e5-7a8ced21ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:34.616115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca55fca-1fd8-47e7-a9e5-7a8ced21ecc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:34.618091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca55fca-1fd8-47e7-a9e5-7a8ced21ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:34.618793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca55fca-1fd8-47e7-a9e5-7a8ced21ecc3 admin admin] PATH_INFO: `/v3/projects/c467a0add83f4ea786ce5b4eca5f8b91/users/f3d24e9eafd2483daebe0d0cac0fcff6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:34.623746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca55fca-1fd8-47e7-a9e5-7a8ced21ecc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c467a0add83f4ea786ce5b4eca5f8b91, user_id=f3d24e9eafd2483daebe0d0cac0fcff6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:34.631397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca55fca-1fd8-47e7-a9e5-7a8ced21ecc3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:34.652704 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3681/7380] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:34 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:34.654108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:34.669396 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3700/7381] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:34 2022] PUT /identity/v3/projects/c467a0add83f4ea786ce5b4eca5f8b91/users/f3d24e9eafd2483daebe0d0cac0fcff6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:34.671451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:34.672088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:34.672475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:34.770191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] MFA Rules not processed for user `f3d24e9eafd2483daebe0d0cac0fcff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:34.775607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:34.790635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2572e74-ab1b-4fde-a934-6c9ce573f8c0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:34.966008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:34.967126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:34.967416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:34.967912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:34.980996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:34.995297 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3701/7382] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:35.009365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:35.011330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.012988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:35.111292 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3682/7383] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:34 2022] POST /identity/v3/users => generated 295 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:35.112685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:35.130851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5035003-0799-4df5-bfc5-b1fe31229618 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:35.161552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:35.164298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:35.165699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.167421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.168021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.172527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:35.174427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.203339 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3683/7384] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:35.208237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:35.247340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64bb74-6f8d-47d4-a3b0-4555621cdd8e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:35.257297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:35.259501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.260188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.264831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.284021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8326a-14a1-4f99-92c6-cf8e92503d9e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:35.290616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:35.292291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.307216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:35.308180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.309811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.311495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] PATH_INFO: `/v3/projects/2be68ad7cbff473f93a8cfb1645565be/users/50537fbd094b478e87fa39a717e3f1b9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.320592 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3702/7385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:35.355696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be68ad7cbff473f93a8cfb1645565be, user_id=50537fbd094b478e87fa39a717e3f1b9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:35.361341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.391824 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3684/7386] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:35 2022] PUT /identity/v3/projects/2be68ad7cbff473f93a8cfb1645565be/users/50537fbd094b478e87fa39a717e3f1b9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:35.395663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:35.415067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f7bd-68ab-4125-b42b-a2b27cb3cbb3 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:35.561247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:35.562323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.562669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.563011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.564512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:35.568650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.598554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3703/7387] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:35.600549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:35.656830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:35.669928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f3f0f-59a7-4556-bed7-d9c22eae6884 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:35.675911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbecf4-2149-4d6b-8b48-ca32e486e8bb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:35.688713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:35.689420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.689711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.689996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] PATH_INFO: `/v3/users/868b39fd84d7468580f1d2df84062d6c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.691159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c9192-500b-4b9a-97bd-b4dfa7f978b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:35.692159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c9192-500b-4b9a-97bd-b4dfa7f978b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.692446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c9192-500b-4b9a-97bd-b4dfa7f978b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.692730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c9192-500b-4b9a-97bd-b4dfa7f978b1 admin admin] PATH_INFO: `/v3/projects/2be68ad7cbff473f93a8cfb1645565be/users/50537fbd094b478e87fa39a717e3f1b9/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.705049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868b39fd84d7468580f1d2df84062d6c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:35.705987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c9192-500b-4b9a-97bd-b4dfa7f978b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be68ad7cbff473f93a8cfb1645565be, user_id=50537fbd094b478e87fa39a717e3f1b9, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:35.707013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.712439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c9192-500b-4b9a-97bd-b4dfa7f978b1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:35.755293 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3685/7388] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:35 2022] PUT /identity/v3/projects/2be68ad7cbff473f93a8cfb1645565be/users/50537fbd094b478e87fa39a717e3f1b9/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:35.767039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.767410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.767595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.826234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868b39fd84d7468580f1d2df84062d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:35.837367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] MFA Rules not processed for user `50537fbd094b478e87fa39a717e3f1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:35.838784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:35.853776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868b39fd84d7468580f1d2df84062d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:35.854563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868b39fd84d7468580f1d2df84062d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:35.875113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868b39fd84d7468580f1d2df84062d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:35.875880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-17ef3f4b-23d6-41da-9781-f3efcf534bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868b39fd84d7468580f1d2df84062d6c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:35.901315 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3704/7389] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:35 2022] DELETE /identity/v3/users/868b39fd84d7468580f1d2df84062d6c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:35.905560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:35.905859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:35.906134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:35.919246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:35.951437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:35.964014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:36.039676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:36.044574 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3686/7390] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:36.049549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.073815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8dacd-cf79-428c-a6a9-cb92fa056dfd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.110109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3705/7391] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:36.123934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.125196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:36.204619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.205352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.205642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.206701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.208118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.210363 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:36.210363 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:36.210363 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:36.212851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.244495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3687/7392] 10.222.0.16 () {60 vars in 1185 bytes} [Wed Oct 5 03:00:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:36.250573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.250959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edc481-e996-4578-ada7-c2ad122763fa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.254891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.255517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.255797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.256071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.266435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.268535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.278053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3e490-4920-4615-9179-f4363d610693 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.278901 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3706/7393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:36.297177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.297805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.298101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.299844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1ef79a7970f649e6a6196cdd6dc58c72` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.300640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=1ef79a7970f649e6a6196cdd6dc58c72)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.306116 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:36.306116 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:36.306116 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:36.307060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.379123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3688/7394] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 03:00:36 2022] GET /identity/v3/OS-OAUTH1/consumers/1ef79a7970f649e6a6196cdd6dc58c72 => generated 220 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:36.383876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.399168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb2a72-c7cb-4697-94b8-afe86a7ecf33 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.426399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.427075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.427367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.427648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1ef79a7970f649e6a6196cdd6dc58c72` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.428250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1ef79a7970f649e6a6196cdd6dc58c72)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.429311 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:36.429311 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:36.429311 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:36.430219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.430492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invalidating token cache because consumer 1ef79a7970f649e6a6196cdd6dc58c72 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:36.430777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:36.434006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:36.502719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1ef79a7970f649e6a6196cdd6dc58c72', 'request_id': 'req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:36.526580 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3707/7395] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 03:00:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1ef79a7970f649e6a6196cdd6dc58c72 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:36.531773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.534046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:36.561765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947e0f-12c2-457a-a1a1-572cc8d53d52 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.581444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.582088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.582377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.582654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.583329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.585060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.621342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3689/7396] 10.222.0.16 () {60 vars in 1185 bytes} [Wed Oct 5 03:00:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:36.623470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.637674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcbe3e-2898-40ea-8b0d-2dd41dba5672 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.650217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.650967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.651317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.651667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.652268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fc2eabfc775048a6b30eccc83f1fe8ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.653987 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:36.653987 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:36.653987 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:36.655006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.687515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.687976 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3708/7397] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 03:00:36 2022] GET /identity/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba => generated 221 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:36.725467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882c1a7-e1ae-4310-82d9-e75e03665f80 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.756522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.760248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.761854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.763133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.764089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fc2eabfc775048a6b30eccc83f1fe8ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.770048 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:36.770048 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:36.770048 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:36.771290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.771875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invalidating token cache because consumer fc2eabfc775048a6b30eccc83f1fe8ba has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:36.772460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:36.773531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:36.858723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'fc2eabfc775048a6b30eccc83f1fe8ba', 'request_id': 'req-d2337c42-a30a-471b-a6e4-08536c1054f3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:36.898038 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3690/7398] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 03:00:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:36.902508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:36.905662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:36.929782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97621c7b-97ab-41e8-a3ab-4bef0023b25e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:36.942366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:36.943084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:36.943440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:36.943955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:36.944760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=fc2eabfc775048a6b30eccc83f1fe8ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:36.946604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 05 03:00:36.986550 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 05 03:00:36.987991 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 03:00:36.988601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3709/7399] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 03:00:36 2022] GET /identity/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba => generated 74 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 03:00:36.992107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.007029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337c42-a30a-471b-a6e4-08536c1054f3 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.013363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.014103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.015140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.015523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.016204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=fc2eabfc775048a6b30eccc83f1fe8ba)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.021957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.022324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invalidating token cache because consumer fc2eabfc775048a6b30eccc83f1fe8ba has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:37.022688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.024787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 05 03:00:37.056191 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 05 03:00:37.057410 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 03:00:37.062554 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3691/7400] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 03:00:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/fc2eabfc775048a6b30eccc83f1fe8ba => generated 74 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 05 03:00:37.066676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.068848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:37.104468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a076a09-5d4a-4a45-8965-864887c00979 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.125328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.125999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.126292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.126576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.127257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.128479 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:37.128479 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:37.128479 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:37.129813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.172192 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3710/7401] 10.222.0.16 () {60 vars in 1185 bytes} [Wed Oct 5 03:00:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:37.175679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.190201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ab96-ad32-42e3-8706-40c1f3fc3add tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.207066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.208232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.208817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.209287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.210333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.213367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.256189 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3692/7402] 10.222.0.16 () {60 vars in 1185 bytes} [Wed Oct 5 03:00:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:37.259522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.278771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0bd57-e286-45ac-b4b5-67cdf6849f37 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.297853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.298770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.302194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.302673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.303852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.305087 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:37.305087 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:37.305087 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:37.309326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.326639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3711/7403] 10.222.0.16 () {58 vars in 1164 bytes} [Wed Oct 5 03:00:37 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:37.330449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.362508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae0251-37c1-48d4-9ef4-d302a3ff7ed7 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.375435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.376635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.377331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.377696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/192c56e60e46479aa86c96460a98acfe` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.378423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=192c56e60e46479aa86c96460a98acfe)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.380988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.381352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invalidating token cache because consumer 192c56e60e46479aa86c96460a98acfe has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:37.381898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.383031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.419746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '192c56e60e46479aa86c96460a98acfe', 'request_id': 'req-6f24d8b6-702b-4c31-ba70-dc256f5ed077'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.459471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3693/7404] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 03:00:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/192c56e60e46479aa86c96460a98acfe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:37.461305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.463189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:37.501369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753de07-f997-4572-83a7-aed3bac8c546 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.527241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.528619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.529029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.529572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8992964cb6d841bc937d80dccb95e105` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.530444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8992964cb6d841bc937d80dccb95e105)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.532805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.537620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invalidating token cache because consumer 8992964cb6d841bc937d80dccb95e105 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:37.538072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.540675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.570459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8992964cb6d841bc937d80dccb95e105', 'request_id': 'req-970f962c-9e48-434d-84b8-0208a88f6180'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:37.603423 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3712/7405] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 03:00:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8992964cb6d841bc937d80dccb95e105 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:37.610404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.627490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d8b6-702b-4c31-ba70-dc256f5ed077 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.640334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.642483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.643082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.643653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.644558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.647149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.683628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.685506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:37.692275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3694/7406] 10.222.0.16 () {60 vars in 1185 bytes} [Wed Oct 5 03:00:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:37.716603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f962c-9e48-434d-84b8-0208a88f6180 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.733169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.733169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.733169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.733559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6b0ffe1c255b45a9a4adc9b637267bbf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.733559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=6b0ffe1c255b45a9a4adc9b637267bbf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.734564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.736474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:37.742219 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:37.742219 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:37.742219 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:37.743151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.750817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:37.776000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa255424-2959-464e-ae4f-9a4e8035515e tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.806019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.806689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.806970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.816985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] PATH_INFO: `/v3/projects/50dbc2c68f4043f2818a258e2f8adfd6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.821776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50dbc2c68f4043f2818a258e2f8adfd6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.823706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.825431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3713/7407] 10.222.0.16 () {60 vars in 1285 bytes} [Wed Oct 5 03:00:37 2022] PATCH /identity/v3/OS-OAUTH1/consumers/6b0ffe1c255b45a9a4adc9b637267bbf => generated 221 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:37.829975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.875117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89112fb-adf7-4da8-8b66-8b093d1276c5 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:37.896016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:37.896482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:37.896771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:37.897081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6b0ffe1c255b45a9a4adc9b637267bbf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:37.897683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=6b0ffe1c255b45a9a4adc9b637267bbf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:37.906339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:37.958448 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3714/7408] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Oct 5 03:00:37 2022] GET /identity/v3/OS-OAUTH1/consumers/6b0ffe1c255b45a9a4adc9b637267bbf => generated 221 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:37.961615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:37.982004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f93c-1f02-44d2-b255-03c7c4ebf937 tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:38.012790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:38.013695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50dbc2c68f4043f2818a258e2f8adfd6', 'request_id': 'req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.033276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50dbc2c68f4043f2818a258e2f8adfd6', 'request_id': 'req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.041638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50dbc2c68f4043f2818a258e2f8adfd6', 'request_id': 'req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.072307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] The token cache is being invalidate because project 50dbc2c68f4043f2818a258e2f8adfd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:38.072649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.078414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.080750 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3695/7409] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:37 2022] DELETE /identity/v3/projects/50dbc2c68f4043f2818a258e2f8adfd6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:38.087554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:38.091557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:38.115368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50537fbd094b478e87fa39a717e3f1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2be68ad7cbff473f93a8cfb1645565be', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:38.116756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:38.117283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:38.117805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6b0ffe1c255b45a9a4adc9b637267bbf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:38.118635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6b0ffe1c255b45a9a4adc9b637267bbf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:38.122815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:38.123480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invalidating token cache because consumer 6b0ffe1c255b45a9a4adc9b637267bbf has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:38.125108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.126266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.159450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '6b0ffe1c255b45a9a4adc9b637267bbf', 'request_id': 'req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.192280 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3715/7410] 10.222.0.16 () {58 vars in 1266 bytes} [Wed Oct 5 03:00:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/6b0ffe1c255b45a9a4adc9b637267bbf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:38.197692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:38.199873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:38.231301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7e30c-dbfe-4bc1-94dd-ac20ac9e2ba4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:38.242389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:38.242971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:38.243252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:38.243529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] PATH_INFO: `/v3/users/f3d24e9eafd2483daebe0d0cac0fcff6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:38.245909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d24e9eafd2483daebe0d0cac0fcff6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:38.246152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c8ab8-5ad5-4d0f-a48f-33e807d98e3c tempest-OAUTHConsumersV3Test-1293505113 tempest-OAUTHConsumersV3Test-1293505113-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:38.248388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:38.258964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:38.261583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:38.263136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:38.264973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] PATH_INFO: `/v3/users/df053352d1574e7d97004e10d8fb235b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:38.269485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df053352d1574e7d97004e10d8fb235b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:38.278825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:38.360838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d24e9eafd2483daebe0d0cac0fcff6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.387891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d24e9eafd2483daebe0d0cac0fcff6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.389955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d24e9eafd2483daebe0d0cac0fcff6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.405734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d24e9eafd2483daebe0d0cac0fcff6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.406834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af428260-9834-4f25-9f1d-ce0ecd3b60f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d24e9eafd2483daebe0d0cac0fcff6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.412193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df053352d1574e7d97004e10d8fb235b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.447111 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3696/7411] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:38 2022] DELETE /identity/v3/users/f3d24e9eafd2483daebe0d0cac0fcff6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:38.458302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df053352d1574e7d97004e10d8fb235b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.459943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df053352d1574e7d97004e10d8fb235b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.483658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df053352d1574e7d97004e10d8fb235b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.484363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df053352d1574e7d97004e10d8fb235b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:38.513498 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3716/7412] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:38 2022] DELETE /identity/v3/users/df053352d1574e7d97004e10d8fb235b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:38.518142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be902-5093-4286-b179-c044531f03ee None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:38.518652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be902-5093-4286-b179-c044531f03ee None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:38.519092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be902-5093-4286-b179-c044531f03ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:38.530538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:38.558748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6b8be902-5093-4286-b179-c044531f03ee None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:38.560675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b8be902-5093-4286-b179-c044531f03ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:38.690144 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3697/7413] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:38.721882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:38.724424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:38.920931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e396-09d3-4339-8225-48954113a0f0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:38.934975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdf7b3-88e9-4354-a6c1-92705dc09fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:38.935655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf7b3-88e9-4354-a6c1-92705dc09fac service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:38.935944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf7b3-88e9-4354-a6c1-92705dc09fac service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:38.936226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdf7b3-88e9-4354-a6c1-92705dc09fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:38.948677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdf7b3-88e9-4354-a6c1-92705dc09fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:38.952576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdf7b3-88e9-4354-a6c1-92705dc09fac service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:38.963678 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3717/7414] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:40.175072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be902-5093-4286-b179-c044531f03ee None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:40.177129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b8be902-5093-4286-b179-c044531f03ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:40.204344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be902-5093-4286-b179-c044531f03ee None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:40.217321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:40.218215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:40.218705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:40.219190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] PATH_INFO: `/v3/projects/c467a0add83f4ea786ce5b4eca5f8b91` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:40.221509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c467a0add83f4ea786ce5b4eca5f8b91)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:40.223716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:40.354247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c467a0add83f4ea786ce5b4eca5f8b91', 'request_id': 'req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:40.369406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c467a0add83f4ea786ce5b4eca5f8b91', 'request_id': 'req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:40.380249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c467a0add83f4ea786ce5b4eca5f8b91', 'request_id': 'req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:40.406333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] The token cache is being invalidate because project c467a0add83f4ea786ce5b4eca5f8b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:40.406333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:40.415624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d0e4bd4-e1a3-4b0b-b0c3-f99f1ea3a67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:40.420682 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3698/7415] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:40 2022] DELETE /identity/v3/projects/c467a0add83f4ea786ce5b4eca5f8b91 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:40.423746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5ec35-75e5-47d2-8f5e-7c4f3d0f7912 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:40.423746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5ec35-75e5-47d2-8f5e-7c4f3d0f7912 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:40.423746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5ec35-75e5-47d2-8f5e-7c4f3d0f7912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:40.456207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f9f5ec35-75e5-47d2-8f5e-7c4f3d0f7912 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:40.457517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f9f5ec35-75e5-47d2-8f5e-7c4f3d0f7912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:40.482919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:40.600893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3718/7416] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:40.603055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:40.603455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:40.603762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:40.650956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:40.653729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:40.680993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:40.681743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:40.682051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:40.688031 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3699/7417] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:40.692695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:40.711552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f15e5-aa76-4317-8738-e5f7999224ad None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:40.723368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:40.724453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:40.725632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:40.726170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:40.727460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:40.730074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:40.735505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:40.755521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] MFA Rules not processed for user `090cbbcbe7654c46ae5fa6a0b631e6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:40.758093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:40.776990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3700/7418] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:40.782210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:40.811427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bed23b-0c10-40ff-9db4-56ad3e53a3f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:40.826005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:40.826890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:40.828030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:40.828466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:40.829968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:40.837152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:40.914128 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3701/7419] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:40 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:40.915281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:40.920217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:40.989322 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3719/7420] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:40.990604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:41.010115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ddc6-7f39-4962-b770-9cd9f7574d9e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:41.078503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:41.103083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92ddfe-e209-41dd-b5eb-baf21d3f307a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:41.110064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:41.111255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:41.111685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:41.112261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] PATH_INFO: `/v3/projects/fd4f6bd5484041468e5a7291e0ef86a2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:41.113905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4f6bd5484041468e5a7291e0ef86a2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:41.118967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:41.122588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:41.124801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:41.125219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:41.126514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:41.127176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:41.132418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:41.190508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3720/7421] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:40 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:41.193812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:41.198905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:41.233634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4f6bd5484041468e5a7291e0ef86a2', 'request_id': 'req-24bbd78a-318f-4b24-b917-470b7db5de84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.260841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4f6bd5484041468e5a7291e0ef86a2', 'request_id': 'req-24bbd78a-318f-4b24-b917-470b7db5de84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.270027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4f6bd5484041468e5a7291e0ef86a2', 'request_id': 'req-24bbd78a-318f-4b24-b917-470b7db5de84'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.302803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] The token cache is being invalidate because project fd4f6bd5484041468e5a7291e0ef86a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:41.303181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.304532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.332408 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3702/7422] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:40 2022] DELETE /identity/v3/projects/fd4f6bd5484041468e5a7291e0ef86a2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:41.334794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:41.344526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:41.349125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:41.476096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125d3fc-3c72-4436-b636-18f39e9a7136 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:41.556966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbd78a-318f-4b24-b917-470b7db5de84 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:41.568201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:41.568821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:41.569129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:41.578611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:41.579351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:41.583097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:41.641004 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3703/7423] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:41.643884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:41.647679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:41.704474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:41.704743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e87fc-ff98-458e-82d4-68a0b47401aa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:41.705540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:41.705933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:41.706325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:41.711921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:41.727381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:41.728211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:41.728377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:41.728598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] PATH_INFO: `/v3/users/50537fbd094b478e87fa39a717e3f1b9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:41.735661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50537fbd094b478e87fa39a717e3f1b9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:41.737785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:41.864540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50537fbd094b478e87fa39a717e3f1b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.900001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:41.905603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:41.917620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50537fbd094b478e87fa39a717e3f1b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.919575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50537fbd094b478e87fa39a717e3f1b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.925449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:41.932731 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3721/7424] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:41.936408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:41.938403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50537fbd094b478e87fa39a717e3f1b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.939155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50537fbd094b478e87fa39a717e3f1b9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:41.961878 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3704/7425] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:41 2022] DELETE /identity/v3/users/50537fbd094b478e87fa39a717e3f1b9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:41.964243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bff7b-f5ca-4f2e-a539-13c556b3e0dc service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:42.180479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67810732-9652-47bf-adfa-c6eae33dbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:42.181159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810732-9652-47bf-adfa-c6eae33dbee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:42.181448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810732-9652-47bf-adfa-c6eae33dbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:42.182252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67810732-9652-47bf-adfa-c6eae33dbee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:42.182931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810732-9652-47bf-adfa-c6eae33dbee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:42.185830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67810732-9652-47bf-adfa-c6eae33dbee8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:42.209759 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3722/7426] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:42.214005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:42.216886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:42.255471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbbf42-6957-4ec5-99e7-3585861854c0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:42.273773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:42.274557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:42.274850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:42.275135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] PATH_INFO: `/v3/projects/a578b6bb49b24996b84664862e6b3d3a/users/827d56f08105400f9667bb1131ba8ceb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:42.329908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a578b6bb49b24996b84664862e6b3d3a, user_id=827d56f08105400f9667bb1131ba8ceb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:42.332740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:42.370662 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3705/7427] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:42 2022] PUT /identity/v3/projects/a578b6bb49b24996b84664862e6b3d3a/users/827d56f08105400f9667bb1131ba8ceb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:42.381616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:42.381921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:42.382451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:42.393595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:42.483449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] MFA Rules not processed for user `827d56f08105400f9667bb1131ba8ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:42.486342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:42.742804 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3723/7428] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:42.748863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:42.861515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991499-2b40-4995-8be7-49a5f61d959d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:42.869028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:42.871523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:42.872526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:42.872823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:42.874073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:42.876927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:42.915310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:42.918251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:42.967557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad459e-a7cb-4a18-af83-61489531cce6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:42.969992 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3706/7429] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:42 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:42.973519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:43.135257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:43.136081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.136467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.137921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] PATH_INFO: `/v3/projects/2be68ad7cbff473f93a8cfb1645565be` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.139587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be68ad7cbff473f93a8cfb1645565be)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:43.141691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:43.159024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1197d-2904-4faf-8574-cb67e4e224e0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:43.172409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:43.173382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.173382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.173627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.174254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:43.176219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:43.229255 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3707/7430] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:42 2022] POST /identity/v3/users => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:43.233037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:43.249165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e706f6-11fc-4ce4-90db-9cc1f4f10cbf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:43.269712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:43.271130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.271581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.272161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.273390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:43.275257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:43.292509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be68ad7cbff473f93a8cfb1645565be', 'request_id': 'req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:43.310341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be68ad7cbff473f93a8cfb1645565be', 'request_id': 'req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:43.318478 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3708/7431] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:43.323702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:43.325441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be68ad7cbff473f93a8cfb1645565be', 'request_id': 'req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:43.348158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356455d0-6d82-4e8d-a0dc-047d6ae73bf4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:43.374549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] The token cache is being invalidate because project 2be68ad7cbff473f93a8cfb1645565be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:43.375755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:43.377350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d4f70d82-3fc4-486f-a1c2-a73d973cb3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:43.382500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3724/7432] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:42 2022] DELETE /identity/v3/projects/2be68ad7cbff473f93a8cfb1645565be => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:43.393134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351700dd-ec75-4332-b1a2-2d9880c23b2a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.393707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351700dd-ec75-4332-b1a2-2d9880c23b2a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.396024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351700dd-ec75-4332-b1a2-2d9880c23b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.438514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:43.461267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-351700dd-ec75-4332-b1a2-2d9880c23b2a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:43.462555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-351700dd-ec75-4332-b1a2-2d9880c23b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:43.502684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:43.568669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:43.570345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.570620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.570908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] PATH_INFO: `/v3/projects/39f92feb17d04a78a8c2e6e1534801f7/users/3b009f6e5dba473d9893b6862683a282/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.625195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f92feb17d04a78a8c2e6e1534801f7, user_id=3b009f6e5dba473d9893b6862683a282, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:43.631042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:43.632608 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3725/7433] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:43.642302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.643061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.643541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.663756 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3709/7434] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:43 2022] PUT /identity/v3/projects/39f92feb17d04a78a8c2e6e1534801f7/users/3b009f6e5dba473d9893b6862683a282/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:43.667305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:43.670147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:43.684764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:43.691973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:43.860621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411219f2-6ab3-42ff-9e8e-da8e46784cbe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:43.889840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:43.890867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.893859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.895150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.896060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:43.896799 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3726/7435] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:43.900996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:43.902379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:43.933790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd9e52-9b68-46b4-8148-e5dec6c700b5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:43.939696 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3710/7436] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:43.943354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:43.951848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:43.953020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:43.953314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:43.953616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:43.954296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:43.958978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:43.962169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:43.980603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154776f9-86dc-4459-a493-5290181f0ba3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:43.998306 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3727/7437] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:44.003605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8ae5f-b229-4ccf-9884-f4b61f079b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.004427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8ae5f-b229-4ccf-9884-f4b61f079b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.004599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8ae5f-b229-4ccf-9884-f4b61f079b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.004885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8ae5f-b229-4ccf-9884-f4b61f079b0d admin admin] PATH_INFO: `/v3/projects/39f92feb17d04a78a8c2e6e1534801f7/users/3b009f6e5dba473d9893b6862683a282/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.011565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:44.014005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8ae5f-b229-4ccf-9884-f4b61f079b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f92feb17d04a78a8c2e6e1534801f7, user_id=3b009f6e5dba473d9893b6862683a282, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.016806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8ae5f-b229-4ccf-9884-f4b61f079b0d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.037996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b6baf-e72b-4f59-b8e6-99af4b2648bd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:44.053684 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3711/7438] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:43 2022] PUT /identity/v3/projects/39f92feb17d04a78a8c2e6e1534801f7/users/3b009f6e5dba473d9893b6862683a282/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:44.064452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.064855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.065282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.103682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] MFA Rules not processed for user `3b009f6e5dba473d9893b6862683a282`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:44.110275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:44.221113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.224291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.224291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.224291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.224291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.227131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.254494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3712/7439] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:44.269307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:44.270938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:44.301313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3728/7440] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:44 2022] POST /identity/v3/projects => generated 367 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:44.306013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:44.310821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:44.424423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fe0b8-5f1e-4bc6-b3cd-3c61151f9b7a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:44.433610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:44.495673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c58868-bc1f-4cba-a5b9-358bc680f6fb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:44.525173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.526520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.529340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.529925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.532158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.538190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.553975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.554705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.555132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.555485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.557468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:44.601251 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3729/7441] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:44 2022] POST /identity/v3/users => generated 284 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:44.604895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:44.626522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ef21-c181-4bd0-b67d-ea802764d70f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:44.637668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.638969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.639407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.640047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.641445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.643465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.673020 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3730/7442] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:44.677114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:44.701697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc8df9-376d-4150-a2a4-be56b5f6653b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:44.711361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.713001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.719925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9efc0-952f-4c1c-929b-6377d8852fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.720557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9efc0-952f-4c1c-929b-6377d8852fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.720841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9efc0-952f-4c1c-929b-6377d8852fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.721143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9efc0-952f-4c1c-929b-6377d8852fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.721803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9efc0-952f-4c1c-929b-6377d8852fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.723422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9efc0-952f-4c1c-929b-6377d8852fc7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.735189 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3713/7443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:44.759206 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3731/7444] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:44.764661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:44.783531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9d4cc-1f19-4a00-91d5-dfd8264d5575 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:44.797577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:44.798378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.798735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.799089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] PATH_INFO: `/v3/projects/778e98dfea984c759de882b1187f0b06/users/7fb9651a5f93475e87ff5293817f67b1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.831883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] RBAC: Authorizing `identity:create_grant(project_id=778e98dfea984c759de882b1187f0b06, user_id=7fb9651a5f93475e87ff5293817f67b1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:44.834937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:44.865148 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3714/7445] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:44 2022] PUT /identity/v3/projects/778e98dfea984c759de882b1187f0b06/users/7fb9651a5f93475e87ff5293817f67b1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:44.877982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:44.878358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:44.878708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:44.948678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] MFA Rules not processed for user `7fb9651a5f93475e87ff5293817f67b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:44.954101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:45.211581 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3732/7446] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:45.216611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:45.363653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82538305-89cb-4494-a8c3-12d12a47251f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:45.384274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:45.386029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:45.387899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:45.388326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:45.389581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:45.403739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:45.410697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:45.466296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3715/7447] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:45 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:45.475468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:45.501254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d815ea-63a7-47ce-89c6-bf2e61e5ee50 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:45.718823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:45.719603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:45.720165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:45.720506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:45.721467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:45.725433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:45.783149 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3733/7448] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:45 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:45.786860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:45.804596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676fdd6-70a2-4a76-973e-47088af7f20d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:45.817380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:45.818142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:45.818426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:45.818699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:45.819406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:45.822909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:45.851518 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3716/7449] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:45.855336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:45.873598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aad8e4-6cf3-468b-82de-3f8266f3b2fa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:45.884684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:45.885444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:45.885725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:45.886005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] PATH_INFO: `/v3/projects/47a7b97aa87c422f8988a6631d0191ba/users/50097be186ad451689bffcca808f0d75/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:45.932671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a7b97aa87c422f8988a6631d0191ba, user_id=50097be186ad451689bffcca808f0d75, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:45.943179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:45.959236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:45.971259 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3734/7450] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:45 2022] PUT /identity/v3/projects/47a7b97aa87c422f8988a6631d0191ba/users/50097be186ad451689bffcca808f0d75/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:45.972263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:45.991162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ba04-e0f8-4613-b32b-64ca275375e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:46.189870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745bdcb-ecf1-4726-a98e-9ffc488ea861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:46.190508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bdcb-ecf1-4726-a98e-9ffc488ea861 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:46.190790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bdcb-ecf1-4726-a98e-9ffc488ea861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:46.191067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745bdcb-ecf1-4726-a98e-9ffc488ea861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:46.191717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bdcb-ecf1-4726-a98e-9ffc488ea861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:46.197837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745bdcb-ecf1-4726-a98e-9ffc488ea861 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:46.223447 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3717/7451] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:46.226028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:46.244486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ed23-53a9-43ec-8ce3-ff9914e8379e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:46.256402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:46.258243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:46.259362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:46.260634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] PATH_INFO: `/v3/projects/47a7b97aa87c422f8988a6631d0191ba/users/50097be186ad451689bffcca808f0d75/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:46.265014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a7b97aa87c422f8988a6631d0191ba, user_id=50097be186ad451689bffcca808f0d75, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:46.273745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:46.310444 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3735/7452] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:46 2022] PUT /identity/v3/projects/47a7b97aa87c422f8988a6631d0191ba/users/50097be186ad451689bffcca808f0d75/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:46.312285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:46.312581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:46.312974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:46.394146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] MFA Rules not processed for user `50097be186ad451689bffcca808f0d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:46.395673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:46.629982 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3718/7453] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:46.630651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:46.657898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe812f17-9a92-46ea-a446-435314462db7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:46.677397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:46.682399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:46.682944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:46.683727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:46.686046 n-d-858272-3 devstack@keystone.service[81826]: WARNING oslo_log.versionutils [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:46.687343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:46.690714 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:46.690714 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:46.690714 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:46.700564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:46.750284 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3736/7454] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 03:00:46 2022] POST /identity/v3/policies => generated 230 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:46.757640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:46.784628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8b177-90de-4a24-80df-0e676ec478c4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:46.832423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:46.838265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:46.839256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:46.839551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies/27fd5f34b4ac4346af00e9f7d20fe04c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:46.840800 n-d-858272-3 devstack@keystone.service[81827]: WARNING oslo_log.versionutils [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:46.841343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=27fd5f34b4ac4346af00e9f7d20fe04c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:46.843256 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:46.843256 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:46.843256 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:46.844180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:46.927989 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3719/7455] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 03:00:46 2022] PATCH /identity/v3/policies/27fd5f34b4ac4346af00e9f7d20fe04c => generated 237 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:46.932178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:46.954986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279ed2e-bc85-439a-9bf9-309c5d728e81 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:46.989494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:46.990369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:46.990750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:46.991073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies/27fd5f34b4ac4346af00e9f7d20fe04c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:46.992040 n-d-858272-3 devstack@keystone.service[81826]: WARNING oslo_log.versionutils [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:46.992729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=27fd5f34b4ac4346af00e9f7d20fe04c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:46.996396 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:46.996396 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:46.996396 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:46.997726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.031832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3737/7456] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 03:00:46 2022] GET /identity/v3/policies/27fd5f34b4ac4346af00e9f7d20fe04c => generated 237 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:00:47.038287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.061688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c532c6-ea94-4759-909d-c9f4429808f7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.098292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.099335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.099869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.102115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies/27fd5f34b4ac4346af00e9f7d20fe04c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.105400 n-d-858272-3 devstack@keystone.service[81827]: WARNING oslo_log.versionutils [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:47.112198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=27fd5f34b4ac4346af00e9f7d20fe04c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.113994 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:47.113994 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:47.113994 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:47.115178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.169088 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3720/7457] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:47 2022] DELETE /identity/v3/policies/27fd5f34b4ac4346af00e9f7d20fe04c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:47.170005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.187984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9685c0-fad0-4c55-b795-67dc972eabde tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.213721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.215945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.216856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.217452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.220220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.222417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.263866 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3738/7458] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 03:00:47 2022] POST /identity/v3/policies => generated 230 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:47.268839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.292547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e838fa8-8968-47a1-836d-138d0e01c87c tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.315783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.316509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.321222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.322373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.325208 n-d-858272-3 devstack@keystone.service[81827]: WARNING oslo_log.versionutils [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:47.326058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.328020 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:47.328020 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:47.328020 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:47.332585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.379431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.390624 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3721/7459] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 03:00:47 2022] POST /identity/v3/policies => generated 229 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:47.396688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134637aa-bdf5-4a42-ba43-556e6e6b71d7 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.413536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.415541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.415838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.416489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.417810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.420641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.451026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3739/7460] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 03:00:47 2022] POST /identity/v3/policies => generated 229 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:47.455149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.471175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1976b-4d5a-4747-8936-48a137381c7d tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.477638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.478252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.478541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.478819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.479767 n-d-858272-3 devstack@keystone.service[81827]: WARNING oslo_log.versionutils [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:47.480473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.482251 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:47.482251 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:00:47.482251 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:00:47.483147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.498251 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3722/7461] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 03:00:47 2022] GET /identity/v3/policies => generated 764 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:47.499741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.513086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c13f-b9d7-4a8e-bd83-877fe9875225 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.519057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.519840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.520319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.520807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies/6e02c433680c4f4c9325f06a148e8bba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.522484 n-d-858272-3 devstack@keystone.service[81826]: WARNING oslo_log.versionutils [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 05 03:00:47.523119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6e02c433680c4f4c9325f06a148e8bba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.524629 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:00:47.524629 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:00:47.524629 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:00:47.525665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.552271 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3740/7462] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:47 2022] DELETE /identity/v3/policies/6e02c433680c4f4c9325f06a148e8bba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:47.553911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.579401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:47.584994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cfb82-aa72-4cd7-b85e-61fad30a93df tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.594204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.595121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.596218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.596792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies/812cde2017274aacb2c8772f522a5ee5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.598102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=812cde2017274aacb2c8772f522a5ee5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.601270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.625985 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3723/7463] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:47 2022] DELETE /identity/v3/policies/812cde2017274aacb2c8772f522a5ee5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:47.630897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.641153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825076d-2773-4ad6-ace3-7c6ff27573a2 tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.645880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295f4e4-41ea-4626-8cb1-5744512deeeb tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50097be186ad451689bffcca808f0d75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47a7b97aa87c422f8988a6631d0191ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.646512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295f4e4-41ea-4626-8cb1-5744512deeeb tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.646798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295f4e4-41ea-4626-8cb1-5744512deeeb tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.647076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295f4e4-41ea-4626-8cb1-5744512deeeb tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] PATH_INFO: `/v3/policies/f7d764c55186407dafae2c82c51a26a7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.648116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295f4e4-41ea-4626-8cb1-5744512deeeb tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=f7d764c55186407dafae2c82c51a26a7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.650589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295f4e4-41ea-4626-8cb1-5744512deeeb tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.698588 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3741/7464] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:47 2022] DELETE /identity/v3/policies/f7d764c55186407dafae2c82c51a26a7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:47.700124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:47.791194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63636a05-70c9-439d-8fb4-118ad9ec1e4a tempest-PoliciesTestJSON-1715107189 tempest-PoliciesTestJSON-1715107189-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:47.798796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:47.799585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:47.799875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:47.800294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] PATH_INFO: `/v3/users/7fb9651a5f93475e87ff5293817f67b1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:47.801562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb9651a5f93475e87ff5293817f67b1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:47.804326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:47.908043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb9651a5f93475e87ff5293817f67b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:47.938746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb9651a5f93475e87ff5293817f67b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:47.941982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb9651a5f93475e87ff5293817f67b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:47.997539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb9651a5f93475e87ff5293817f67b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:47.998613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb9651a5f93475e87ff5293817f67b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:48.037830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3724/7465] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:47 2022] DELETE /identity/v3/users/7fb9651a5f93475e87ff5293817f67b1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:48.041903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:48.042432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:48.042432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:48.107339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:48.109031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:48.289899 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3742/7466] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:48.343283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:48.345077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:48.513773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673639b4-6291-43b7-bded-c5e1cad7b2af admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:48.531017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:48.531817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:48.532113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:48.532390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:48.544859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:48.546717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:48.563490 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3725/7467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:49.579848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:49.582269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:49.608052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c41e0-1b09-4e11-bb90-181cb7e5d798 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:49.625231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:49.626751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:49.627432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:49.628267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] PATH_INFO: `/v3/projects/778e98dfea984c759de882b1187f0b06` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:49.633286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778e98dfea984c759de882b1187f0b06)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:49.644457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:49.782837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778e98dfea984c759de882b1187f0b06', 'request_id': 'req-39a3efed-fbf0-470d-902a-29dbc16a13c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:49.800378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778e98dfea984c759de882b1187f0b06', 'request_id': 'req-39a3efed-fbf0-470d-902a-29dbc16a13c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:49.805327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:49.816199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778e98dfea984c759de882b1187f0b06', 'request_id': 'req-39a3efed-fbf0-470d-902a-29dbc16a13c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:49.854447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] The token cache is being invalidate because project 778e98dfea984c759de882b1187f0b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:49.855104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:49.857644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:49.861790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3743/7468] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:49 2022] DELETE /identity/v3/projects/778e98dfea984c759de882b1187f0b06 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:49.866133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:49.885300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13336d9-3569-44d7-9501-0a79a788553e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:49.927601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:50.129470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:50.135154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:50.135634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:50.135930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] PATH_INFO: `/v3/users/50097be186ad451689bffcca808f0d75` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:50.138129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50097be186ad451689bffcca808f0d75)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:50.143139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:50.278325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50097be186ad451689bffcca808f0d75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:50.342541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50097be186ad451689bffcca808f0d75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:50.345342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50097be186ad451689bffcca808f0d75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:50.373152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50097be186ad451689bffcca808f0d75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:50.374681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5e355af7-a803-479f-abf9-f250196c4425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50097be186ad451689bffcca808f0d75'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:50.407592 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3726/7469] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:49 2022] DELETE /identity/v3/users/50097be186ad451689bffcca808f0d75 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:50.646718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:50.653556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:50.681787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3efed-fbf0-470d-902a-29dbc16a13c7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:50.842668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:50.843622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:50.853539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:50.853923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] PATH_INFO: `/v3/users/4a2b0c86ab554fe09b1b160693ff1852` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:50.855397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2b0c86ab554fe09b1b160693ff1852)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:50.859092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:50.986198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2b0c86ab554fe09b1b160693ff1852'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.043249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2b0c86ab554fe09b1b160693ff1852'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.044604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2b0c86ab554fe09b1b160693ff1852'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.055316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2b0c86ab554fe09b1b160693ff1852'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.056189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2b0c86ab554fe09b1b160693ff1852'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.079000 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3744/7470] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:50 2022] DELETE /identity/v3/users/4a2b0c86ab554fe09b1b160693ff1852 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:51.083578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.084091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.084210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.122543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:51.124389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:51.127146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:51.128980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:51.250951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cce7fb-5733-44c7-8d7c-7027e9dff83c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:51.260773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:51.261733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.262896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.265575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] PATH_INFO: `/v3/projects/47a7b97aa87c422f8988a6631d0191ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.270692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a7b97aa87c422f8988a6631d0191ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:51.274737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:51.303269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:51.308482 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3727/7471] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:51.319371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:51.321082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:51.392468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:51.406039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a7b97aa87c422f8988a6631d0191ba', 'request_id': 'req-90d32908-b533-4a81-b0f8-2d392899dd81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.420629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a7b97aa87c422f8988a6631d0191ba', 'request_id': 'req-90d32908-b533-4a81-b0f8-2d392899dd81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.444069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b426f-d4d0-4992-8c57-706e6241b971 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:51.445013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a7b97aa87c422f8988a6631d0191ba', 'request_id': 'req-90d32908-b533-4a81-b0f8-2d392899dd81'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.472595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] The token cache is being invalidate because project 47a7b97aa87c422f8988a6631d0191ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:51.473188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.476627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-90d32908-b533-4a81-b0f8-2d392899dd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:51.488981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3745/7472] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:51 2022] DELETE /identity/v3/projects/47a7b97aa87c422f8988a6631d0191ba => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:51.495824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fa32d-6057-4d99-b7ec-7cf29e15e4d6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.496336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fa32d-6057-4d99-b7ec-7cf29e15e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.497055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fa32d-6057-4d99-b7ec-7cf29e15e4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.537642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e79fa32d-6057-4d99-b7ec-7cf29e15e4d6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:51.538946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e79fa32d-6057-4d99-b7ec-7cf29e15e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:51.612259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:51.613381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.613678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.613964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.615996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:51.640951 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3746/7473] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:51.641547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:51.644412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.644708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.645007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.648910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:51.674383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3728/7474] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:00:51.707994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:51.709270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:51.740177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3747/7475] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:51.742603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:51.766401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8f00-2f65-43ed-8bff-1b3f7e773871 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:51.782279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:51.782916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.783206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.783483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.784150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:51.784456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:51.788153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:51.839170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3729/7476] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:00:51.841887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:51.855468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de1e1a-57da-4b12-ba30-aa7a60884519 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:51.867237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:51.867924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:51.868209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:51.868478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:51.869208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:51.873514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:51.961720 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3748/7477] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:51 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:51.966169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:51.991817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028d08-efc8-4784-97aa-0b95584b067e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.150471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.152457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:52.199289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:52.200484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.200717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.201359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.201627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:52.203623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:52.265545 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3730/7478] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:51 2022] POST /identity/v3/users => generated 294 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:52.277236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.310329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b4c8-73ae-4958-a1b4-2c39c67dd612 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.342386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:52.343026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.343297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.343577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.344240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:52.345975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:52.383835 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3731/7479] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:52.398932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.404594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a919-cefa-4dcb-878a-520687c6eab2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.413885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611dc21-30fd-41ed-8821-46fa8d2f00c0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.423767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:52.425133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.425499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.425855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] PATH_INFO: `/v3/projects/f4c715bc62ac4739b13e365286998577` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.426995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:52.427619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.427898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.428017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c715bc62ac4739b13e365286998577)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:52.428300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.429320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:52.430905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:52.431670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:52.457532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:52.462663 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3732/7480] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:52.467637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.482777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffe514-e29d-4a52-8d94-a25e4cec230e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.487960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e701d-6bb9-46bc-bfe1-6a2fdec423a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:52.488731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e701d-6bb9-46bc-bfe1-6a2fdec423a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.489118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e701d-6bb9-46bc-bfe1-6a2fdec423a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.489464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e701d-6bb9-46bc-bfe1-6a2fdec423a4 admin admin] PATH_INFO: `/v3/projects/9e189b3d83204da080298f6b92831740/users/3a605e678c47438b9353299badacd852/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.507709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e701d-6bb9-46bc-bfe1-6a2fdec423a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e189b3d83204da080298f6b92831740, user_id=3a605e678c47438b9353299badacd852, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:52.510988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e701d-6bb9-46bc-bfe1-6a2fdec423a4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:52.555932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c715bc62ac4739b13e365286998577', 'request_id': 'req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:52.558068 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3733/7481] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:52 2022] PUT /identity/v3/projects/9e189b3d83204da080298f6b92831740/users/3a605e678c47438b9353299badacd852/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:00:52.572374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.572374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.572374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.605809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c715bc62ac4739b13e365286998577', 'request_id': 'req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:52.613916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c715bc62ac4739b13e365286998577', 'request_id': 'req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:52.655636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] The token cache is being invalidate because project f4c715bc62ac4739b13e365286998577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:52.655967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:52.663291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e6b8ed3-02da-41f7-9e9b-9415381c2a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:52.663291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3749/7482] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:52 2022] DELETE /identity/v3/projects/f4c715bc62ac4739b13e365286998577 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:52.675808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e0142-a349-4a32-a2b4-4e863af76c7b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.676089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e0142-a349-4a32-a2b4-4e863af76c7b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.678091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e0142-a349-4a32-a2b4-4e863af76c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.683425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] MFA Rules not processed for user `3a605e678c47438b9353299badacd852`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:52.685435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:52.702362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:52.728840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e00e0142-a349-4a32-a2b4-4e863af76c7b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:52.730148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e00e0142-a349-4a32-a2b4-4e863af76c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:52.807783 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3734/7483] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:52.827092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.828979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:52.894838 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3750/7484] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:52.901992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.902286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.903522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.942063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:52.943515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:52.953622 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3751/7485] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:52.957483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.968321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caec372-b3b6-4a85-a019-0abe3cb9ebd9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.973177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:52.973794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:52.974081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:52.974646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:52.975441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:00:52.975756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:52.977420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:52.983903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9971-090c-4552-b8d0-18f5fe784e46 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:52.991671 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3752/7486] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:00:52.996060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:52.998820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.000127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.000127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.000127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.013101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:53.014727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:53.018090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770bb2-098c-4573-8c40-da6dfbd948f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:53.037682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.038311 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3735/7487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:53.038456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.038813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.039641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.039881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:53.041903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:53.103604 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3753/7488] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:00:52 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:00:53.106662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:53.130239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd28dd-208d-4619-b451-85184bcd212a service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:53.284818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a457a-be46-4548-b30f-93a869aa1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.285516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a457a-be46-4548-b30f-93a869aa1ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.285791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a457a-be46-4548-b30f-93a869aa1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.286094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a457a-be46-4548-b30f-93a869aa1ffa admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.286811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a457a-be46-4548-b30f-93a869aa1ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:53.289770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a457a-be46-4548-b30f-93a869aa1ffa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:53.343574 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3736/7489] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:00:53 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:00:53.344622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:53.358959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee331f1-244a-4c63-80c7-9af25d03a22f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:53.373177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.374367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.374851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.375326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.376599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:53.379377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee713c-830e-40a5-86a9-fe3abb15f5d0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.379676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee713c-830e-40a5-86a9-fe3abb15f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.379955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee713c-830e-40a5-86a9-fe3abb15f5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.382017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:53.405503 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3754/7490] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:00:53.408842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:53.422641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-46ee713c-830e-40a5-86a9-fe3abb15f5d0 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:53.423889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-46ee713c-830e-40a5-86a9-fe3abb15f5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:53.435851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29655683-9133-4e86-ac40-4e38d863fa5d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:53.456863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.457509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.457792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.458070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.459060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:53.460645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:53.512507 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3755/7491] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:00:53.516122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:53.518810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:53.532469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b94d1-a018-4d83-a460-a07a01951ca2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:53.541286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.541962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.542246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.542526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] PATH_INFO: `/v3/projects/f983edf383be4a019628841a969e1ae3/users/4c1f89942a9d4110b9626e0a20f7f54d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.566887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f983edf383be4a019628841a969e1ae3, user_id=4c1f89942a9d4110b9626e0a20f7f54d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:53.569912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:53.573275 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3737/7492] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:53.603167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3756/7493] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:00:53 2022] PUT /identity/v3/projects/f983edf383be4a019628841a969e1ae3/users/4c1f89942a9d4110b9626e0a20f7f54d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:53.613786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.614550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.614724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.672251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] MFA Rules not processed for user `4c1f89942a9d4110b9626e0a20f7f54d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:53.674212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:53.690959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:53.693542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:53.722507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:53.841596 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3738/7494] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:53.871012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61433-9fe1-4993-9c72-423ca3d0675b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:53.876288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:53.884913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:53.885213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:53.885498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:53.894727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:53.901926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:54.005861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a674886-f53b-45cb-9424-b4b508ad4739 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:54.012387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01124cf0-4af5-4ef7-a343-337412a65a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:54.013260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124cf0-4af5-4ef7-a343-337412a65a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:54.013545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124cf0-4af5-4ef7-a343-337412a65a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:54.013821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01124cf0-4af5-4ef7-a343-337412a65a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:54.036887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01124cf0-4af5-4ef7-a343-337412a65a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:54.038366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01124cf0-4af5-4ef7-a343-337412a65a4f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:54.049907 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3739/7495] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:54.070296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:54.073444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:54.099132 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3757/7496] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:00:54.748872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab7fbb-5540-45de-a53c-3951e70c0bf6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:54.749602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab7fbb-5540-45de-a53c-3951e70c0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:54.749602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab7fbb-5540-45de-a53c-3951e70c0bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:54.821148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a4ab7fbb-5540-45de-a53c-3951e70c0bf6 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:54.830413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a4ab7fbb-5540-45de-a53c-3951e70c0bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:54.852182 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3740/7497] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:00:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:54.877696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:54.894805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff839960-20e4-4913-af6f-2d82b8eba25d service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:54.910364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:54.911602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:54.912200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:54.912926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:54.944122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:54.947338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:54.980200 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3758/7498] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:55.706947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7542-9fb6-4a93-bd95-5462e299e90f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:55.707563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7542-9fb6-4a93-bd95-5462e299e90f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:55.708105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7542-9fb6-4a93-bd95-5462e299e90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:55.749861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-20bc7542-9fb6-4a93-bd95-5462e299e90f None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:55.753148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-20bc7542-9fb6-4a93-bd95-5462e299e90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:55.783842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:55.795277 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3741/7499] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:00:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:55.820810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27c3c-f7ec-4093-aba2-ef1b85c011a8 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:55.842492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:55.843497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:55.843937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:55.844395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:55.862328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:55.864280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:55.893238 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3759/7500] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:00:56.142389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de25d-6b2e-43bc-9ce2-8ea5457e9303 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:56.143144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de25d-6b2e-43bc-9ce2-8ea5457e9303 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:56.143634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21de25d-6b2e-43bc-9ce2-8ea5457e9303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:56.167575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e21de25d-6b2e-43bc-9ce2-8ea5457e9303 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:56.170991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e21de25d-6b2e-43bc-9ce2-8ea5457e9303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:56.196844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:56.201268 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3742/7501] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:56.214388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7c731-0344-4fd0-9938-a6ad468e1a81 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:56.220128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:56.221015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:56.221512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:56.221991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:56.232840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:56.234855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:56.251700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3760/7502] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:00:56.762994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926756-7ed3-4c42-970e-58eca635d799 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:56.764050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926756-7ed3-4c42-970e-58eca635d799 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:56.764524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2926756-7ed3-4c42-970e-58eca635d799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:56.801544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c2926756-7ed3-4c42-970e-58eca635d799 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:56.802851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c2926756-7ed3-4c42-970e-58eca635d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:56.821992 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3743/7503] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:00:56.837682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:56.855048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ac0c6-cd43-43ab-87bf-d62ec31d5458 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:56.878442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:56.879079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:56.879362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:56.879640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:56.909844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:56.922096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:56.938965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3761/7504] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:57.426477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:57.427034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:57.427418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:57.517311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:57.522953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:57.577209 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3744/7505] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:00:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:57.599136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:57.624722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09411dfb-2481-4801-96d5-e732be9b94d1 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:57.653774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af4268-ca04-4bb6-8594-d98dda1f2d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:57.654840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af4268-ca04-4bb6-8594-d98dda1f2d8c service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:57.655309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af4268-ca04-4bb6-8594-d98dda1f2d8c service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:57.655748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af4268-ca04-4bb6-8594-d98dda1f2d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:57.707958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af4268-ca04-4bb6-8594-d98dda1f2d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:57.727341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af4268-ca04-4bb6-8594-d98dda1f2d8c service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:57.751216 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3762/7506] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:00:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:00:58.022463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:58.024527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:58.117564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:58.197283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971247-4f52-495b-a5f1-28f87f34a8fb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:58.211884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:58.212984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:58.213483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:58.213920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] PATH_INFO: `/v3/users/3a605e678c47438b9353299badacd852` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:58.215881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a605e678c47438b9353299badacd852)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:58.218453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:58.291859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a605e678c47438b9353299badacd852'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:58.305003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a605e678c47438b9353299badacd852'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:58.322496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a605e678c47438b9353299badacd852'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:58.344230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a605e678c47438b9353299badacd852'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:58.345194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fcd4a6c0-a8ec-4e5c-ae79-7ffdd774b585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a605e678c47438b9353299badacd852'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:58.382731 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3745/7507] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:00:58 2022] DELETE /identity/v3/users/3a605e678c47438b9353299badacd852 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:58.384447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:58.385034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:58.385034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:58.422784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:58.424339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:58.604107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:58.635708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:58.636008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:58.636288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:58.651375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3763/7508] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:58.703345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:58.704639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:58.712831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:58.714348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:58.822339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb99b1-0d7b-4e13-8225-27dd66d77553 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:58.828066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340b20e-2b91-46ee-a978-9be57569120c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:58.829040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340b20e-2b91-46ee-a978-9be57569120c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:58.829485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340b20e-2b91-46ee-a978-9be57569120c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:58.830079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340b20e-2b91-46ee-a978-9be57569120c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:58.849685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340b20e-2b91-46ee-a978-9be57569120c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:58.851151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3746/7509] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:00:58.867940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340b20e-2b91-46ee-a978-9be57569120c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:58.896257 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3764/7510] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:00:59.492880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:00:59.495875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:00:59.585591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a1a26-b41c-4236-9776-a6a555ccca48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:00:59.609421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:00:59.610392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:59.610851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:59.611900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] PATH_INFO: `/v3/projects/9e189b3d83204da080298f6b92831740` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:59.613356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e189b3d83204da080298f6b92831740)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:00:59.616816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:00:59.738827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e189b3d83204da080298f6b92831740', 'request_id': 'req-a777fa73-07b4-4c43-ab19-e2df6933a129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:59.756879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:00:59.765046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e189b3d83204da080298f6b92831740', 'request_id': 'req-a777fa73-07b4-4c43-ab19-e2df6933a129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:59.791604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e189b3d83204da080298f6b92831740', 'request_id': 'req-a777fa73-07b4-4c43-ab19-e2df6933a129'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:59.834427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] The token cache is being invalidate because project 9e189b3d83204da080298f6b92831740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:00:59.834728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:59.837007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a777fa73-07b4-4c43-ab19-e2df6933a129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:00:59.845175 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3747/7511] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:00:59 2022] DELETE /identity/v3/projects/9e189b3d83204da080298f6b92831740 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:00:59.850040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:00:59.850553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:00:59.850677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:00:59.896629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:00:59.901347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:00.058130 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3765/7512] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:00.063187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.063477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.063758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.101762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:00.102975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:00.148819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.156628 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3748/7513] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:00.163845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f09ad1-067b-4c71-84e6-e5ce8fbdb98d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:00.173775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:00.175640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.176115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.177242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.178996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:00.180695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:00.185036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:00.226672 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3766/7514] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:00.231095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.253828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0769f-ccce-4a7a-bc5b-ba3546db1b6a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:00.264642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:00.266973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.267450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.268185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.270723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:00.276480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:00.377437 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3749/7515] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:00 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:00.381246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.398194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c430-6667-495f-81f5-64b4d29a685d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:00.535141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:00.535999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.536455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.539930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.540617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:00.542599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:00.593305 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3767/7516] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:00 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:00.598536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.618762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb056-2a47-4cc0-9094-8a4c2e161636 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:00.629297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:00.635048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.635498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.635953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.637488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:00.642108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:00.667729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3750/7517] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:00.671622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.692425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85495ac-38ac-4c51-9a34-b030bc3aa605 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:00.706742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8111f-7454-4d41-8512-7b57cc1d5fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:00.707384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8111f-7454-4d41-8512-7b57cc1d5fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.707724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8111f-7454-4d41-8512-7b57cc1d5fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.709259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8111f-7454-4d41-8512-7b57cc1d5fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.709918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8111f-7454-4d41-8512-7b57cc1d5fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:00.711553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8111f-7454-4d41-8512-7b57cc1d5fb3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:00.729730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:00.760371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3768/7518] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:00.764208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.788045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983594-8aee-453b-991c-d5b86775ef93 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:00.807776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:00.808461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.808830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.817052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] PATH_INFO: `/v3/projects/d1e137151f344e71abec67380997e7cf/users/4f61e0c58a524d96b83cec66903f03d9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.849277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e137151f344e71abec67380997e7cf, user_id=4f61e0c58a524d96b83cec66903f03d9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:00.852265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:00.881745 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3751/7519] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:00 2022] PUT /identity/v3/projects/d1e137151f344e71abec67380997e7cf/users/4f61e0c58a524d96b83cec66903f03d9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:00.894770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:00.895410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:00.895410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:00.956086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] MFA Rules not processed for user `4f61e0c58a524d96b83cec66903f03d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:00.957951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:00.976545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:00.979056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:01.136020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e79e1e-4212-4a5b-8cde-520e904ff9ac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.143333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.144374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.144833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.145344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] PATH_INFO: `/v3/users/f34919fa438e4522bf4260e254e4f78c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.146779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f34919fa438e4522bf4260e254e4f78c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.149471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.170555 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3769/7520] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:01.175161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:01.197335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c2af4-3d81-441e-b11a-25d15691e1d6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.206677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.207612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.208250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.208747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.210189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.213024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.249207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f34919fa438e4522bf4260e254e4f78c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:01.268601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f34919fa438e4522bf4260e254e4f78c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:01.269639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f34919fa438e4522bf4260e254e4f78c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:01.283571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f34919fa438e4522bf4260e254e4f78c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:01.284378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f34919fa438e4522bf4260e254e4f78c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:01.313725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:01.319649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3770/7521] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:01 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:01.324166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3752/7522] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:00 2022] DELETE /identity/v3/users/f34919fa438e4522bf4260e254e4f78c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:01.331235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:01.346168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:01.401962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:01.404143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:01.519249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ce145-ce17-4f5c-a601-be5333c9b799 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.579430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ddeb9-9109-4f60-a7ea-bc7fbf5dbbbb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.600615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.601334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.601643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.602294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.611288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:01.672372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.673046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.673329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.673602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.675612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.678322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.719547 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3771/7523] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:01 2022] POST /identity/v3/users => generated 284 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:01.723265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:01.741412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:01.746842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.753245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.754703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad70d-ef69-454c-b932-2c4900901892 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.769942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.770610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.770893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.771265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.772872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.781320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.786336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3753/7524] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:01:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:01:01.797122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:01.799238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:01.828653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3772/7525] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:01.829906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:01.853184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f3cdc-d781-44bd-8606-9db94a090fb6 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.868152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.869222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.872131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.872616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] PATH_INFO: `/v3/projects/a5b588576c6940099f523d0b2bcc7907` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.875413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7199d-a6f1-41d8-9785-920003a0de18 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:01.877344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b588576c6940099f523d0b2bcc7907)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.883148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.894472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:01.895232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:01.895828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:01.904058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:01.905851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:01.910440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:01.955993 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3773/7526] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:01.963443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:02.036444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc82b6-b5fe-4855-873c-d206de3bfc60 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:02.065945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92a591-88cd-4a89-ac27-49a24f806da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:02.067712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92a591-88cd-4a89-ac27-49a24f806da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:02.069228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92a591-88cd-4a89-ac27-49a24f806da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:02.070881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92a591-88cd-4a89-ac27-49a24f806da1 admin admin] PATH_INFO: `/v3/projects/90929921762a4c898ed18e7ba2fce8ae/users/ee336e814f1c4d60b102c3911d8088aa/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:02.085380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b588576c6940099f523d0b2bcc7907', 'request_id': 'req-c1d8e644-58bf-4116-bc43-8371721597e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.107652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92a591-88cd-4a89-ac27-49a24f806da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90929921762a4c898ed18e7ba2fce8ae, user_id=ee336e814f1c4d60b102c3911d8088aa, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:02.111198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92a591-88cd-4a89-ac27-49a24f806da1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:02.119291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b588576c6940099f523d0b2bcc7907', 'request_id': 'req-c1d8e644-58bf-4116-bc43-8371721597e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.140082 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3774/7527] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:01 2022] PUT /identity/v3/projects/90929921762a4c898ed18e7ba2fce8ae/users/ee336e814f1c4d60b102c3911d8088aa/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:02.141435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b588576c6940099f523d0b2bcc7907', 'request_id': 'req-c1d8e644-58bf-4116-bc43-8371721597e2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.151283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:02.151682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:02.152071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:02.170251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] The token cache is being invalidate because project a5b588576c6940099f523d0b2bcc7907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:02.170548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.173113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.174698 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3754/7528] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:01 2022] DELETE /identity/v3/projects/a5b588576c6940099f523d0b2bcc7907 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:02.178858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:02.189822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:02.204237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] MFA Rules not processed for user `ee336e814f1c4d60b102c3911d8088aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:02.205683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:02.255265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:02.376224 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3775/7529] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:02.389358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:02.392314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:02.411897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8e644-58bf-4116-bc43-8371721597e2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:02.508832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:02.509909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:02.510201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:02.510483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] PATH_INFO: `/v3/users/090cbbcbe7654c46ae5fa6a0b631e6a7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:02.512615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] RBAC: Authorizing `identity:delete_user(user_id=090cbbcbe7654c46ae5fa6a0b631e6a7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:02.514797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:02.542520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeba98e-f33a-4b9d-b73f-95cd192d9fab None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:02.553179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:02.556342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:02.556633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:02.556927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:02.563217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:02.615592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090cbbcbe7654c46ae5fa6a0b631e6a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.634423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090cbbcbe7654c46ae5fa6a0b631e6a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.635214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090cbbcbe7654c46ae5fa6a0b631e6a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.664127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090cbbcbe7654c46ae5fa6a0b631e6a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.665263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090cbbcbe7654c46ae5fa6a0b631e6a7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:02.666862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:02.669714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:02.677529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:02.691552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3755/7530] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:02 2022] DELETE /identity/v3/users/090cbbcbe7654c46ae5fa6a0b631e6a7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:02.714372 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3776/7531] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:03.049817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:03.051623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:03.219165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:03.237973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:03.238238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6284b3-81f9-4b25-9469-36c126db2a22 service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:03.262320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574271e-d391-441f-bbfb-0ada5a57718e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:03.271013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:03.272053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:03.272589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:03.273795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:03.278981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:03.338794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:03.340084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:03.340084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:03.341118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] PATH_INFO: `/v3/projects/abf4ead6fb0c444482b5470326e83bdb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:03.343096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf4ead6fb0c444482b5470326e83bdb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:03.345983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:03.393448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:03.394969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715da45-342d-4939-852d-3cdf02439352 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:03.422058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3756/7532] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:03.458407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf4ead6fb0c444482b5470326e83bdb', 'request_id': 'req-bfa58f71-8cfe-4067-b675-0aee642050bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:03.472754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf4ead6fb0c444482b5470326e83bdb', 'request_id': 'req-bfa58f71-8cfe-4067-b675-0aee642050bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:03.495486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf4ead6fb0c444482b5470326e83bdb', 'request_id': 'req-bfa58f71-8cfe-4067-b675-0aee642050bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:03.564312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] The token cache is being invalidate because project abf4ead6fb0c444482b5470326e83bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:03.564650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:03.569432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa58f71-8cfe-4067-b675-0aee642050bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:03.575884 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3777/7533] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:03 2022] DELETE /identity/v3/projects/abf4ead6fb0c444482b5470326e83bdb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:03.578457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:03.578749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:03.579028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:03.618979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:03.635259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:03.807598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:03.808009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:03.808345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:03.813098 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3757/7534] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:01:03.834658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:03.862362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:03.922856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:03.949916 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3778/7535] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:03.958806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879c1e5-2fa5-4137-bfeb-a5d2c9546f4f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:04.002641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:04.003162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.003445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.003714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.004534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:04.004850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:04.008796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:04.067648 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3758/7536] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:04.076205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:04.108657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336114e-75f5-450e-ad37-03b4aab61e1f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:04.127012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:04.127561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.127847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.128117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.128772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:04.130750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:04.208960 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3779/7537] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:04 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:04.213047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:04.224384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3cf6b-ada9-4b2f-b5aa-872b8c9bfd04 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:04.383616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:04.384551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.384835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.385161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.385795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:04.388561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:04.448472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3759/7538] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:04 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:04.454885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:04.482142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520c4a2-e69d-4d10-941b-ec4e08de7043 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:04.490111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:04.490900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.491286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.491662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.492588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:04.494457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:04.529689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3780/7539] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:04.532084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:04.547743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808e85-f1d8-40f5-a7d9-99f2a3b391d5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:04.571713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484041-6eb4-4340-868f-440220ec59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:04.585064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484041-6eb4-4340-868f-440220ec59f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.585372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484041-6eb4-4340-868f-440220ec59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.585661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484041-6eb4-4340-868f-440220ec59f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.588939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484041-6eb4-4340-868f-440220ec59f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:04.598950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484041-6eb4-4340-868f-440220ec59f4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:04.656476 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3760/7540] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:04.661618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:04.679244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bb228-de6e-4ba1-9f64-378cb05ab90c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:04.695792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:04.697005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.697578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.697787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] PATH_INFO: `/v3/projects/5152e5e306d2474bac12338a8e722a00/users/67c2b26730184ce58b866e37ebe43794/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.734264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152e5e306d2474bac12338a8e722a00, user_id=67c2b26730184ce58b866e37ebe43794, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:04.740439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:04.776344 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3781/7541] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:04 2022] PUT /identity/v3/projects/5152e5e306d2474bac12338a8e722a00/users/67c2b26730184ce58b866e37ebe43794/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:04.790078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:04.790680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:04.791531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:04.832715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:04.857059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] MFA Rules not processed for user `67c2b26730184ce58b866e37ebe43794`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:04.858694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:04.997043 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3761/7542] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:05.001945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:05.163568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:05.247281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a52ce1-b0ef-4de4-be13-f0f484ad23ef admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:05.260638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:05.261324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:05.261606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:05.264016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:05.275706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:05.275706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:05.348068 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3782/7543] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:05 2022] POST /identity/v3/projects => generated 373 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:05.351908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:05.373795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7ed85-9886-4067-af36-0237122c27fb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:05.494836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:05.495734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:05.496797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:05.497531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:05.498570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:05.503753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:05.540961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3762/7544] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:05 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:05.544854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:05.563510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2291-3c07-4a4c-853b-4bb5aa0c3239 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:05.586490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:05.588741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:05.589297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:05.590825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:05.601491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:05.603594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:05.628256 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3783/7545] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:05.632833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:05.647303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1c272-3e49-4629-a6e9-9b7d2597b586 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:05.654797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:05.655756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:05.656202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:05.657173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] PATH_INFO: `/v3/projects/1975ec952cd9497192efe90933a95204/users/6e29bfae20b14f55adfd6b13ed3e6fb8/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:05.695303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1975ec952cd9497192efe90933a95204, user_id=6e29bfae20b14f55adfd6b13ed3e6fb8, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:05.703676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:05.742579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:05.744076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3763/7546] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:05 2022] PUT /identity/v3/projects/1975ec952cd9497192efe90933a95204/users/6e29bfae20b14f55adfd6b13ed3e6fb8/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:05.758243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df01d41-cf99-4ec0-a0ad-f5309bbd142a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:05.891503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90717-7ec3-4ac9-a437-6c07d37f6c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:05.896483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90717-7ec3-4ac9-a437-6c07d37f6c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:05.897750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90717-7ec3-4ac9-a437-6c07d37f6c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:05.899629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90717-7ec3-4ac9-a437-6c07d37f6c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:05.905668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90717-7ec3-4ac9-a437-6c07d37f6c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:05.908821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90717-7ec3-4ac9-a437-6c07d37f6c64 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:05.933053 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3784/7547] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:05.936942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:05.953915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db2a0a-9f5f-4ee9-b4ae-65f406980be0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:05.971243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:05.971948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:05.972234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:05.972511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] PATH_INFO: `/v3/projects/1975ec952cd9497192efe90933a95204/users/6e29bfae20b14f55adfd6b13ed3e6fb8/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:05.982755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1975ec952cd9497192efe90933a95204, user_id=6e29bfae20b14f55adfd6b13ed3e6fb8, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:05.992796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:06.037260 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3764/7548] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:05 2022] PUT /identity/v3/projects/1975ec952cd9497192efe90933a95204/users/6e29bfae20b14f55adfd6b13ed3e6fb8/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:06.064866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:06.065686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:06.066320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:06.155369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] MFA Rules not processed for user `6e29bfae20b14f55adfd6b13ed3e6fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:06.156602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:06.357576 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3785/7549] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:06.361708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:06.366216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:06.430719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:06.432465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:06.486799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:06.499917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:06.546351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6006b-dd76-4cbc-952f-baba8dc5c09f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:06.556735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:06.558869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:06.559265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:06.560708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] PATH_INFO: `/v3/users/4f61e0c58a524d96b83cec66903f03d9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:06.561964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f61e0c58a524d96b83cec66903f03d9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:06.566502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:06.576491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f05a7a-77c9-4fe4-b589-0e0bc515fd36 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:06.592647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8f924-d65a-4dd3-a752-e3ec44c56aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:06.594090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8f924-d65a-4dd3-a752-e3ec44c56aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:06.595615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8f924-d65a-4dd3-a752-e3ec44c56aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:06.597863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8f924-d65a-4dd3-a752-e3ec44c56aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:06.692734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8f924-d65a-4dd3-a752-e3ec44c56aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:06.694454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8f924-d65a-4dd3-a752-e3ec44c56aa6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:06.714169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3786/7550] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:01:06.735547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f61e0c58a524d96b83cec66903f03d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:06.762453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f61e0c58a524d96b83cec66903f03d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:06.763507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f61e0c58a524d96b83cec66903f03d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:06.781714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f61e0c58a524d96b83cec66903f03d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:06.783054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f61e0c58a524d96b83cec66903f03d9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:06.805873 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3765/7551] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:06 2022] DELETE /identity/v3/users/4f61e0c58a524d96b83cec66903f03d9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:06.811782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:06.813448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:06.814012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:06.847298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:06.848787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:07.062637 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3787/7552] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:07.094859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:07.096509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:07.232821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd31d-7f5f-443c-985c-55afa31b7488 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:07.238451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:07.239214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:07.239506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:07.239856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:07.267062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:07.268552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:07.292811 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3766/7553] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:08.099522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:08.112656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:08.165289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11207855-7a5d-4ce5-8c36-10fc24ea5647 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:08.197242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:08.199908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:08.200302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:08.204472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] PATH_INFO: `/v3/projects/d1e137151f344e71abec67380997e7cf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:08.212151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e137151f344e71abec67380997e7cf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:08.221411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:08.338271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e137151f344e71abec67380997e7cf', 'request_id': 'req-d497e003-48d8-46d5-bcf9-c56c8e69fc03'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.353604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e137151f344e71abec67380997e7cf', 'request_id': 'req-d497e003-48d8-46d5-bcf9-c56c8e69fc03'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.379743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e137151f344e71abec67380997e7cf', 'request_id': 'req-d497e003-48d8-46d5-bcf9-c56c8e69fc03'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.442441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:08.473243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] The token cache is being invalidate because project d1e137151f344e71abec67380997e7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:08.473964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.474910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.478431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3788/7554] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:08 2022] DELETE /identity/v3/projects/d1e137151f344e71abec67380997e7cf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:08.482658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:08.494514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef1519-6894-408e-8bb5-0a091cfd7fd9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:08.628627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:08.629220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:08.631561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:08.632070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] PATH_INFO: `/v3/users/ee336e814f1c4d60b102c3911d8088aa` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:08.636410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee336e814f1c4d60b102c3911d8088aa)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:08.644941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:08.687525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:08.763307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee336e814f1c4d60b102c3911d8088aa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.789640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee336e814f1c4d60b102c3911d8088aa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.790431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee336e814f1c4d60b102c3911d8088aa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.813113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee336e814f1c4d60b102c3911d8088aa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.813886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b4ff63e6-1df1-4ddc-861a-27b40935a145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee336e814f1c4d60b102c3911d8088aa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:08.837335 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3767/7555] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:08 2022] DELETE /identity/v3/users/ee336e814f1c4d60b102c3911d8088aa => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:01:10.357570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:10.359769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:10.392088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e003-48d8-46d5-bcf9-c56c8e69fc03 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:10.548166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:10.548941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:10.549231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:10.549505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] PATH_INFO: `/v3/projects/90929921762a4c898ed18e7ba2fce8ae` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:10.550847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=90929921762a4c898ed18e7ba2fce8ae)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:10.552770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:10.689691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90929921762a4c898ed18e7ba2fce8ae', 'request_id': 'req-1f49da18-ccdf-4998-8254-9ef45bc948fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:10.704739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90929921762a4c898ed18e7ba2fce8ae', 'request_id': 'req-1f49da18-ccdf-4998-8254-9ef45bc948fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:10.713993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90929921762a4c898ed18e7ba2fce8ae', 'request_id': 'req-1f49da18-ccdf-4998-8254-9ef45bc948fb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:10.746633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] The token cache is being invalidate because project 90929921762a4c898ed18e7ba2fce8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:10.747894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:10.750390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1f49da18-ccdf-4998-8254-9ef45bc948fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:10.754028 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3789/7556] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:10 2022] DELETE /identity/v3/projects/90929921762a4c898ed18e7ba2fce8ae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:10.760630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:10.762198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:10.762766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:10.809505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:10.812590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:10.983001 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3768/7557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:10.991091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:10.991578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:10.991969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.045188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:11.046601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:11.076821 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3790/7558] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:11.080388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.092297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3e38b-8f16-4144-b40b-96b1477c6b88 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:11.098380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:11.099296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.099750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.100224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.101075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:11.102005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:11.104005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:11.125103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3769/7559] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:01:11.129442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.146640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8274-90be-4491-b0c2-26f6b5607171 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:11.190161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:11.191086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.192319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.193578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.194223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:11.196315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:11.261738 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3791/7560] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:11 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:11.266083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.281859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631eba-7f8a-4c31-8407-bc0a70940500 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:11.410930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:11.411550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.411831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.412105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.412738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:11.414777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:11.472008 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3770/7561] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:11 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:11.473559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.487936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abeac-fad4-4396-b759-f6868a19d4e3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:11.494580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:11.495410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.495917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.497298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.498343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:11.500547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:11.532619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.539839 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3792/7562] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:11.547510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03f64a-7b11-4cbf-9d5e-b3b97275a5e9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:11.561183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a9fb-02eb-4968-84eb-5786bd4a3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:11.562054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a9fb-02eb-4968-84eb-5786bd4a3580 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.562348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a9fb-02eb-4968-84eb-5786bd4a3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.562627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a9fb-02eb-4968-84eb-5786bd4a3580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.585503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a9fb-02eb-4968-84eb-5786bd4a3580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:11.594218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a9fb-02eb-4968-84eb-5786bd4a3580 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:11.601385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:11.626649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.658571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be6c05-6500-4cf6-a596-decc3b88333c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:11.659636 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3771/7563] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:11.672889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:11.673892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.674356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.674798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] PATH_INFO: `/v3/projects/4f2e534275d342f3aed7b7c54863a2c2/users/d101dce60a494ab381a2e8dea3414437/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.714227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2e534275d342f3aed7b7c54863a2c2, user_id=d101dce60a494ab381a2e8dea3414437, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:11.726091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:11.780177 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3793/7564] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:11 2022] PUT /identity/v3/projects/4f2e534275d342f3aed7b7c54863a2c2/users/d101dce60a494ab381a2e8dea3414437/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:11.792375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:11.794053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:11.794532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:11.836088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:11.837978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:11.866409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] MFA Rules not processed for user `d101dce60a494ab381a2e8dea3414437`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:11.869919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:11.939895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:12.051252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d3f5-1249-4972-9920-631d98a7ca3c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:12.062820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:12.063463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:12.063749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:12.064029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:12.074628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:12.120288 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3772/7565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:12.137295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:12.139225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:12.347710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:12.351791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:12.357201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03fb5b-77b7-465d-b8c3-2398dbddba06 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:12.367044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4bdd6-eeb6-49ec-a18b-5fef8b1aedcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:12.367688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4bdd6-eeb6-49ec-a18b-5fef8b1aedcc service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:12.369808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4bdd6-eeb6-49ec-a18b-5fef8b1aedcc service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:12.370639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4bdd6-eeb6-49ec-a18b-5fef8b1aedcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:12.378462 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3794/7566] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:01:12.393686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4bdd6-eeb6-49ec-a18b-5fef8b1aedcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:12.396411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4bdd6-eeb6-49ec-a18b-5fef8b1aedcc service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:12.412511 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3773/7567] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:12.586452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:12.770484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccbe42-f0f7-4233-92ba-d22935b611bd service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:12.783398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:12.784068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:12.784392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:12.784676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] PATH_INFO: `/v3/users/d101dce60a494ab381a2e8dea3414437` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:12.794145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d101dce60a494ab381a2e8dea3414437)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:12.800190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:12.919502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd101dce60a494ab381a2e8dea3414437'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:12.965509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd101dce60a494ab381a2e8dea3414437'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:12.966771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd101dce60a494ab381a2e8dea3414437'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:12.986403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd101dce60a494ab381a2e8dea3414437'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:12.987354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd101dce60a494ab381a2e8dea3414437'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:13.008935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:13.035765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3795/7568] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:12 2022] DELETE /identity/v3/users/d101dce60a494ab381a2e8dea3414437 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:13.037447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:13.037951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:13.038048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:13.100296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:13.101602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:13.247627 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3774/7569] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:13.263092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:13.265663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:13.440273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5856971-43d1-4b6d-9d31-ff332db2977c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:13.453225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431c87e-edb0-4be7-ac0e-9de9e7fb0b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:13.453929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c87e-edb0-4be7-ac0e-9de9e7fb0b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:13.454220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c87e-edb0-4be7-ac0e-9de9e7fb0b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:13.454498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431c87e-edb0-4be7-ac0e-9de9e7fb0b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:13.500125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c87e-edb0-4be7-ac0e-9de9e7fb0b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:13.501845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431c87e-edb0-4be7-ac0e-9de9e7fb0b67 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:13.542341 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3796/7570] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:14.754369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:14.756930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:14.806363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54edb3-5aa7-49f5-870a-6f4bb8d03887 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:14.847397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:14.849197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:14.850366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:14.854945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] PATH_INFO: `/v3/projects/4f2e534275d342f3aed7b7c54863a2c2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:14.858972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2e534275d342f3aed7b7c54863a2c2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:14.864657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:15.013775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:15.078957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2e534275d342f3aed7b7c54863a2c2', 'request_id': 'req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:15.102965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2e534275d342f3aed7b7c54863a2c2', 'request_id': 'req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:15.113133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2e534275d342f3aed7b7c54863a2c2', 'request_id': 'req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:15.141458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] The token cache is being invalidate because project 4f2e534275d342f3aed7b7c54863a2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:15.153189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:15.154428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1b0e3c47-fc48-4845-bf61-5fb2a3ee7117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:15.158614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3775/7571] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:14 2022] DELETE /identity/v3/projects/4f2e534275d342f3aed7b7c54863a2c2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:15.164173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:15.164668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:15.164759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:15.216680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:15.219785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:15.352355 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3797/7572] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:15.359709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:15.360144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:15.360544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:15.402733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:15.405013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:15.423797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3776/7573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:15.427716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:15.456198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2c633-7f4a-4fee-b06a-435e45abac3f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:15.477354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:15.478150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:15.479136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:15.479136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:15.479741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:15.480305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:15.490636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:15.517229 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3798/7574] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:15.518821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:15.531576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0c004-d45a-4cb0-b6ae-5c5b4e9ebf8a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:15.544674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:15.545500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:15.545893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:15.546294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:15.547180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:15.549578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:15.622301 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3777/7575] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:15 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:15.626389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:15.640403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404820d-c9f1-4976-b4c1-71c42153eaf8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:15.820751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:15.821511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:15.821808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:15.822139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:15.822837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:15.825309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:15.911108 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3799/7576] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:15 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:15.914869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:15.942956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a319c-1286-4e63-a3ba-8544b6b61fb8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:15.959302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:15.961102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:15.961391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:15.977237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:15.978070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:15.980556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:16.036499 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3778/7577] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:16.040194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:16.065888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1ea6e-4a8d-44c2-962f-46582ee21f68 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:16.073893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50beb159-e225-4c17-b6b1-d5ba4d8fcc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:16.075081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beb159-e225-4c17-b6b1-d5ba4d8fcc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.075373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beb159-e225-4c17-b6b1-d5ba4d8fcc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.077480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50beb159-e225-4c17-b6b1-d5ba4d8fcc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:16.081221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50beb159-e225-4c17-b6b1-d5ba4d8fcc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:16.085557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50beb159-e225-4c17-b6b1-d5ba4d8fcc30 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:16.112827 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3800/7578] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:16.116259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:16.131658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471dad5-194f-4e99-b4ed-2bea59d9495b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:16.141880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:16.142811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.143326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.144410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] PATH_INFO: `/v3/projects/f792e405f17249d1a434bc9e3017d7bf/users/2db31b7573c14036987dfd9849321313/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:16.173928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f792e405f17249d1a434bc9e3017d7bf, user_id=2db31b7573c14036987dfd9849321313, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:16.178666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:16.200832 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3779/7579] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:16 2022] PUT /identity/v3/projects/f792e405f17249d1a434bc9e3017d7bf/users/2db31b7573c14036987dfd9849321313/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:01:16.210980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.211527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.211618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:16.241340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:16.358651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] MFA Rules not processed for user `2db31b7573c14036987dfd9849321313`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:16.359994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:16.517241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3801/7580] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:16.522844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:16.638475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72b98b-70ce-4328-a27f-0fa7f12acf85 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:16.644564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:16.645537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.646003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.646456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:16.647287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:16.649869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:16.694536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3780/7581] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:16 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:16.701757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:16.716037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03c76-2412-4b36-962b-42f5a3b7c2ed None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:16.807185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:16.808126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.809356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.809810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:16.810662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:16.812643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:16.845552 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3802/7582] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:16 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:16.846548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:16.861947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eea541-1a82-479e-bf13-2f970f451fbc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:16.881810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:16.883617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.883915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.884195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:16.885140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:16.886819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:16.915288 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3781/7583] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:16.917516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:16.948449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763f63f-eb04-49a0-a89e-9bba1a18d970 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:16.971637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:16.972332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:16.972615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:16.972895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] PATH_INFO: `/v3/projects/a635f9e46fcd4799b38824af7636abb2/users/4e05c9515e65447f87851d67bc17b6b1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:17.006054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635f9e46fcd4799b38824af7636abb2, user_id=4e05c9515e65447f87851d67bc17b6b1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:17.008767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:17.048610 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3803/7584] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:16 2022] PUT /identity/v3/projects/a635f9e46fcd4799b38824af7636abb2/users/4e05c9515e65447f87851d67bc17b6b1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:17.052466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:17.066764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86dcf-baee-4abf-a0d4-b6c14af90c67 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:17.091344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:17.184548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833a256-2f0a-4ed9-93ff-056b8e5c1d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:17.185574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a256-2f0a-4ed9-93ff-056b8e5c1d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:17.186048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a256-2f0a-4ed9-93ff-056b8e5c1d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:17.186618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833a256-2f0a-4ed9-93ff-056b8e5c1d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:17.189610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a256-2f0a-4ed9-93ff-056b8e5c1d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:17.194329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833a256-2f0a-4ed9-93ff-056b8e5c1d62 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:17.212308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:17.220784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3782/7585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:17.226195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5523a51-057d-4040-9c81-ea5bba453059 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:17.265064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:17.266024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:17.266540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:17.267313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] PATH_INFO: `/v3/projects/a635f9e46fcd4799b38824af7636abb2/users/4e05c9515e65447f87851d67bc17b6b1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:17.272966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a635f9e46fcd4799b38824af7636abb2, user_id=4e05c9515e65447f87851d67bc17b6b1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:17.279264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:17.322865 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3804/7586] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:17 2022] PUT /identity/v3/projects/a635f9e46fcd4799b38824af7636abb2/users/4e05c9515e65447f87851d67bc17b6b1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:17.336983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eb5f2-14bf-4f18-9394-de1dc8664cb0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:17.337494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eb5f2-14bf-4f18-9394-de1dc8664cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:17.337964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eb5f2-14bf-4f18-9394-de1dc8664cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:17.394401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-703eb5f2-14bf-4f18-9394-de1dc8664cb0 None None] MFA Rules not processed for user `4e05c9515e65447f87851d67bc17b6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:17.396654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-703eb5f2-14bf-4f18-9394-de1dc8664cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:17.573381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3783/7587] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:17.587949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:17.592645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:17.748034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:17.763375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba1db-0a1d-4a29-9763-8596a6396774 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:17.768928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85813d4-a0e4-45ca-b00d-13febc47c59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:17.769973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85813d4-a0e4-45ca-b00d-13febc47c59a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:17.770263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85813d4-a0e4-45ca-b00d-13febc47c59a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:17.770597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85813d4-a0e4-45ca-b00d-13febc47c59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:17.958905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85813d4-a0e4-45ca-b00d-13febc47c59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:17.959830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85813d4-a0e4-45ca-b00d-13febc47c59a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:17.985650 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3805/7588] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:22.240340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:22.241279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:22.241883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:22.272441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:22.275434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:22.410077 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3784/7589] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:24.820255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:24.820761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:24.820761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:24.881627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] MFA Rules not processed for user `67c2b26730184ce58b866e37ebe43794`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:24.883241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:24.984169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3806/7590] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:25.331023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:25.349517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef904-a9db-4b00-a6e2-f5c8f80b2980 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:25.367991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:25.368629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:25.369036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:25.369793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:25.463085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:25.464821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:25.510158 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3785/7591] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:25 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:25.760060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:25.762542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:25.962480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a51f75-6732-4abb-b682-2ae7c7c13906 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:25.978663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:25.979717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:25.980723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:25.981265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:25.983827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:26.016700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:26.019528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b3b04-f141-4a78-8822-685fd4a89b9a service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:26.059636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3807/7592] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:01:33.383018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:33.478393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:33.580385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd604b5f-7890-423c-8999-aae43a5bd316 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:33.592847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:33.593797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:33.594669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:33.595185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] PATH_INFO: `/v3/users/2db31b7573c14036987dfd9849321313` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:33.596593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db31b7573c14036987dfd9849321313)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:33.600019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:33.718430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db31b7573c14036987dfd9849321313'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:33.741578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db31b7573c14036987dfd9849321313'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:33.742348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db31b7573c14036987dfd9849321313'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:33.760260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db31b7573c14036987dfd9849321313'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:33.760894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db31b7573c14036987dfd9849321313'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:33.790276 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3786/7593] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:33 2022] DELETE /identity/v3/users/2db31b7573c14036987dfd9849321313 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:33.792157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:33.793254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:33.793615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:33.844482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:33.847821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:33.929137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:34.067202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3808/7594] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:34.222621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:34.225789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:34.443586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee65d-fb19-4b9e-be7f-9c7e4300fca6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:34.453987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:34.455087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:34.455651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:34.456272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:34.492657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:34.497076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:34.516083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3787/7595] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:35.153989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:35.155628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:35.182563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd171c-be1b-4bf6-87ba-56fe6dabbe81 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:35.192844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:35.193946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:35.194456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:35.194976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] PATH_INFO: `/v3/projects/f792e405f17249d1a434bc9e3017d7bf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:35.196989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f792e405f17249d1a434bc9e3017d7bf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:35.203650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:35.306908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f792e405f17249d1a434bc9e3017d7bf', 'request_id': 'req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.320320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f792e405f17249d1a434bc9e3017d7bf', 'request_id': 'req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.334977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f792e405f17249d1a434bc9e3017d7bf', 'request_id': 'req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.364947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] The token cache is being invalidate because project f792e405f17249d1a434bc9e3017d7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:35.365820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.366660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.368649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3809/7596] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:35 2022] DELETE /identity/v3/projects/f792e405f17249d1a434bc9e3017d7bf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:35.373258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:35.387219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ae292-176a-47aa-aa53-bf254bb48c68 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:35.449346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:35.482763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:35.484382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:35.484947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:35.485527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] PATH_INFO: `/v3/users/4e05c9515e65447f87851d67bc17b6b1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:35.487549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e05c9515e65447f87851d67bc17b6b1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:35.489821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:35.555866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e05c9515e65447f87851d67bc17b6b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.590292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e05c9515e65447f87851d67bc17b6b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.590292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e05c9515e65447f87851d67bc17b6b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.598507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e05c9515e65447f87851d67bc17b6b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.599242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c98391e7-6326-42ae-9c6b-430d06cf82cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e05c9515e65447f87851d67bc17b6b1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:35.615368 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3788/7597] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:35 2022] DELETE /identity/v3/users/4e05c9515e65447f87851d67bc17b6b1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:01:36.019515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.021066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:36.045478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb274d9-8400-4bf4-92a9-6bbdd24d2edc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.132540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.133339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.133630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.133917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] PATH_INFO: `/v3/projects/a635f9e46fcd4799b38824af7636abb2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.135457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a635f9e46fcd4799b38824af7636abb2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.138232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.241092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a635f9e46fcd4799b38824af7636abb2', 'request_id': 'req-0f161401-d6d1-447c-9233-2e71c8996d70'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.257863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a635f9e46fcd4799b38824af7636abb2', 'request_id': 'req-0f161401-d6d1-447c-9233-2e71c8996d70'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.260441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:36.284482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a635f9e46fcd4799b38824af7636abb2', 'request_id': 'req-0f161401-d6d1-447c-9233-2e71c8996d70'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.304339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] The token cache is being invalidate because project a635f9e46fcd4799b38824af7636abb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:36.305096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.306228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0f161401-d6d1-447c-9233-2e71c8996d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.317610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.318123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.318833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.321858 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3810/7598] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:36 2022] DELETE /identity/v3/projects/a635f9e46fcd4799b38824af7636abb2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:36.342524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:36.344014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:36.416245 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3789/7599] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:36.424918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.425205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.425483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.451529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:36.452769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:36.468280 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3811/7600] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:36.473124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.485590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c80c8-7249-4efe-af61-0d474829734a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.491060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.491740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.492092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.492436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.493180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:36.493554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.495213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.515552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3790/7601] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:36.516036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.529266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd2563-ac87-4239-bda7-6e360ccc4a80 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.553664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.554886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.555406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.555953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.557020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.560866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.619543 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3812/7602] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:36 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:36.623411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.635937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77364726-7d50-40cb-9e4f-ff6ce21429e7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.706339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.712195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:36.725589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:36.747609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.748720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.749524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.750012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.750859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.753152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.782438 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3791/7603] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:36 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:36.787064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.801577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5c356-8198-4aa7-98a2-119f1b00a854 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.822039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.822892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.823160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.823385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.824083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.825764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.841043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864486d-a52f-468e-a3ed-afa2252f8e7e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.849098 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3792/7604] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:01:36.850025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.850263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.850675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.850954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.851236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] PATH_INFO: `/v3/users/4c1f89942a9d4110b9626e0a20f7f54d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.852422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1f89942a9d4110b9626e0a20f7f54d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.854408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.862910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfa91b-030d-4d81-b38c-435d46c11e7a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.867604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.868290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.868639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.869514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.870232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.873090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.885471 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3793/7605] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:36.890994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:36.902583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d99452-032c-4795-ab6a-d9aa06285a79 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:36.907548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422b4d-c2fa-406c-84c1-224c7bebba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:36.908374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422b4d-c2fa-406c-84c1-224c7bebba6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.908812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422b4d-c2fa-406c-84c1-224c7bebba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.913210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422b4d-c2fa-406c-84c1-224c7bebba6e admin admin] PATH_INFO: `/v3/projects/9558162c26944038be843cffe91636bf/users/ebd2392d1825405d8f2bd9720c2d5fdf/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.935961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422b4d-c2fa-406c-84c1-224c7bebba6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9558162c26944038be843cffe91636bf, user_id=ebd2392d1825405d8f2bd9720c2d5fdf, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:36.939120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422b4d-c2fa-406c-84c1-224c7bebba6e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:36.941623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1f89942a9d4110b9626e0a20f7f54d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.959056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1f89942a9d4110b9626e0a20f7f54d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.960203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1f89942a9d4110b9626e0a20f7f54d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.961448 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3794/7606] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:36 2022] PUT /identity/v3/projects/9558162c26944038be843cffe91636bf/users/ebd2392d1825405d8f2bd9720c2d5fdf/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:36.971679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1f89942a9d4110b9626e0a20f7f54d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.972368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c2c1d43a-c8a2-4556-b50d-a56bdd613121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1f89942a9d4110b9626e0a20f7f54d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:36.974639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.975649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.976178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:36.988981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3813/7607] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:36 2022] DELETE /identity/v3/users/4c1f89942a9d4110b9626e0a20f7f54d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:36.993439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:36.993803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:36.994156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.013662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] MFA Rules not processed for user `ebd2392d1825405d8f2bd9720c2d5fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:37.015179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:37.020271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:37.022253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:37.065772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:37.150563 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3814/7608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:01:37.157150 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3795/7609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:01:37.160660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.161856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.162435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:37.163695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:37.179021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56df8ef-f0ea-455f-bbb5-bca8f8c50922 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.185105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.185729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.186015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.186294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.186939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.189080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.239867 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3796/7610] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:37 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:37.244779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.252044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57291-1d71-4c0e-8213-f2092a379c65 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.335195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e74d5-94af-4868-8ef1-1810fe14ddff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.342360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.343246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.343961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.343961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.344807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.347033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.357872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:37.386909 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3797/7611] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:37 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:37.390558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.419412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.420053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.420338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.421117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee107b-a188-4a33-bb54-21894ef61eae admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.427695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.436196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.436848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.437281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.437787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.439242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.445400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.467295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.471141 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3798/7612] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:37.472168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.472569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.490752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3815/7613] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:37.504853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085dc9-2dac-4bdd-a43b-8013c77d6962 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.537985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.548765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.548765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.548765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] PATH_INFO: `/v3/projects/27be299bbf5e482eb9f39ca99a69a870/users/f5006828fb5a4553b8c7df0d843c3433/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.594470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27be299bbf5e482eb9f39ca99a69a870, user_id=f5006828fb5a4553b8c7df0d843c3433, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.597283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.636623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3799/7614] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:37 2022] PUT /identity/v3/projects/27be299bbf5e482eb9f39ca99a69a870/users/f5006828fb5a4553b8c7df0d843c3433/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:37.641662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.658257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de8cc-1ca7-46b5-8fda-e201ca54f38e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.810399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a523a02-c105-45ec-af66-714f7fda8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.811017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a523a02-c105-45ec-af66-714f7fda8af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.811286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a523a02-c105-45ec-af66-714f7fda8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.811564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a523a02-c105-45ec-af66-714f7fda8af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.812544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a523a02-c105-45ec-af66-714f7fda8af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.814806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a523a02-c105-45ec-af66-714f7fda8af5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.830093 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3816/7615] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:37.834823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:37.847272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b5a43-13eb-4792-8830-11949234f72a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:37.852848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:37.853819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.854337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.855393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] PATH_INFO: `/v3/projects/27be299bbf5e482eb9f39ca99a69a870/users/f5006828fb5a4553b8c7df0d843c3433/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.857974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=27be299bbf5e482eb9f39ca99a69a870, user_id=f5006828fb5a4553b8c7df0d843c3433, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:37.860956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:37.876325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3800/7616] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:37 2022] PUT /identity/v3/projects/27be299bbf5e482eb9f39ca99a69a870/users/f5006828fb5a4553b8c7df0d843c3433/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:37.887776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:37.888067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:37.888345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:37.921759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] MFA Rules not processed for user `f5006828fb5a4553b8c7df0d843c3433`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:37.923096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:37.952373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:38.008650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:38.010874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:38.022720 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3817/7617] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:38.033427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:38.157271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723ac3-7c88-443d-9e9f-f5dbdc22a10d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:38.169730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:38.172721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.172721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.172721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] PATH_INFO: `/v3/projects/f983edf383be4a019628841a969e1ae3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.173523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f983edf383be4a019628841a969e1ae3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:38.177904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:38.178546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d98e4-d38f-434c-b201-d54e453d3aab None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:38.182418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc227f9-a882-4e11-9729-7dd4b98633fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:38.183277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc227f9-a882-4e11-9729-7dd4b98633fe service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.183563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc227f9-a882-4e11-9729-7dd4b98633fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.184454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc227f9-a882-4e11-9729-7dd4b98633fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.194303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc227f9-a882-4e11-9729-7dd4b98633fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:38.195731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc227f9-a882-4e11-9729-7dd4b98633fe service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:38.205597 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3818/7618] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:38.233952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f983edf383be4a019628841a969e1ae3', 'request_id': 'req-32002055-8eb3-4111-a93d-4de512228918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:38.254765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f983edf383be4a019628841a969e1ae3', 'request_id': 'req-32002055-8eb3-4111-a93d-4de512228918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:38.262100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f983edf383be4a019628841a969e1ae3', 'request_id': 'req-32002055-8eb3-4111-a93d-4de512228918'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:38.274415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] The token cache is being invalidate because project f983edf383be4a019628841a969e1ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:38.274833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:38.275609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32002055-8eb3-4111-a93d-4de512228918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:38.281345 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3801/7619] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:38 2022] DELETE /identity/v3/projects/f983edf383be4a019628841a969e1ae3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:38.283006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.283522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.283799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.310026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:38.315163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:38.452942 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3819/7620] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:38.456940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.457249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.457551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.486009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:38.499602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:38.532593 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3802/7621] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:38.536745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:38.554153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f1583-021d-4eb1-94f1-227d2d7f35bf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:38.565680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:38.566586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.566586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.566892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.567504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:38.567811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:38.569461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:38.601528 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3820/7622] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:38.604341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:38.623438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b45c72-cf1d-4480-86ac-86804dd80f32 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:38.669675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:38.670633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.671131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.671748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.675331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:38.679834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:38.793822 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3803/7623] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:38 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:38.797747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:38.822992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c463b-91ad-49d7-ad8f-4a3f025656d3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:38.939316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:38.957852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:38.958582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:38.958733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:38.959018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:38.959670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:38.961635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:39.073224 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3821/7624] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:38 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:39.075112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:39.080870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:39.096236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe6ed-3dc5-405f-8957-367d8a2885da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:39.108789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:39.109813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:39.109955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:39.110504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:39.110809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:39.112629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:39.137876 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3804/7625] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:01:39.141825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:39.168893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3729c-6441-4ce9-b0f1-8e1bcb6c77c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:39.188842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc55034-eca1-4652-99db-1995a3846ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:39.189696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc55034-eca1-4652-99db-1995a3846ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:39.189985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc55034-eca1-4652-99db-1995a3846ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:39.190271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc55034-eca1-4652-99db-1995a3846ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:39.190936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc55034-eca1-4652-99db-1995a3846ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:39.201002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc55034-eca1-4652-99db-1995a3846ce1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:39.228106 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3822/7626] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:39.229412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:39.241237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e674459-c6f1-41fa-81e6-d8427410586e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:39.246402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:39.247063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:39.247341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:39.247614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] PATH_INFO: `/v3/projects/8605431775ed4440b135b316bfce4ab1/users/282c8f7259f14337ba6e4c1df5de804b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:39.265087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8605431775ed4440b135b316bfce4ab1, user_id=282c8f7259f14337ba6e4c1df5de804b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:39.268362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:39.299493 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3805/7627] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:39 2022] PUT /identity/v3/projects/8605431775ed4440b135b316bfce4ab1/users/282c8f7259f14337ba6e4c1df5de804b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:39.311825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:39.312414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:39.312414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:39.347840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] MFA Rules not processed for user `282c8f7259f14337ba6e4c1df5de804b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:39.349015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:39.429692 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3823/7628] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:39.511465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:39.513571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:39.626430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e17dd7-429c-47a9-b935-7309c9894bd6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:39.632651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:39.633540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:39.634030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:39.634366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:39.685998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:39.688318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:39.716168 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3806/7629] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:41.881943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:41.897013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810edfc-5ad3-4515-bbac-456183c5369a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:41.902415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:41.903606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:41.904070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:41.905741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:41.908038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:42.025812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:42.029596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f03e1-fdec-458e-887b-359738acfb2d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:42.055745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3824/7630] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:44.052520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:44.054712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:44.200592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82269e2c-19ed-47c0-b6a2-7ee33a0bd05a service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:44.207200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:44.208027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:44.208410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:44.208791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] PATH_INFO: `/v3/users/ebd2392d1825405d8f2bd9720c2d5fdf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:44.210271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd2392d1825405d8f2bd9720c2d5fdf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:44.212498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:44.302720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd2392d1825405d8f2bd9720c2d5fdf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:44.318323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd2392d1825405d8f2bd9720c2d5fdf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:44.319727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd2392d1825405d8f2bd9720c2d5fdf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:44.329406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd2392d1825405d8f2bd9720c2d5fdf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:44.330423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd2392d1825405d8f2bd9720c2d5fdf'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:44.332162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:44.355895 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3807/7631] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:44 2022] DELETE /identity/v3/users/ebd2392d1825405d8f2bd9720c2d5fdf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:44.360088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:44.360633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:44.360633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:44.391898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:44.393405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:44.519971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:44.546993 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3825/7632] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:44.559941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:44.561397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:44.696116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fcb51-6c05-4552-832f-78a1e8c5f48e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:44.700708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:44.701515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:44.701874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:44.702225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:44.713141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:44.715433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:44.727601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3808/7633] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:45.558729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:45.560441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:45.579307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc032c1-ebf0-49cd-94a6-de4f8d9b7a82 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:45.607531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:45.608679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:45.609389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:45.609938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] PATH_INFO: `/v3/projects/9558162c26944038be843cffe91636bf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:45.611812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9558162c26944038be843cffe91636bf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:45.615201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:45.697642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9558162c26944038be843cffe91636bf', 'request_id': 'req-2d964911-746a-42f0-b2f9-aab565115b44'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:45.707246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9558162c26944038be843cffe91636bf', 'request_id': 'req-2d964911-746a-42f0-b2f9-aab565115b44'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:45.716425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9558162c26944038be843cffe91636bf', 'request_id': 'req-2d964911-746a-42f0-b2f9-aab565115b44'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:45.737607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] The token cache is being invalidate because project 9558162c26944038be843cffe91636bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:45.737919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:45.738848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:45.744020 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3826/7634] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:45 2022] DELETE /identity/v3/projects/9558162c26944038be843cffe91636bf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:45.744917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:45.771836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac1666-2508-4e9a-afd2-971820f7091b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:45.899273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:45.900096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:45.900503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:45.900891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] PATH_INFO: `/v3/users/f5006828fb5a4553b8c7df0d843c3433` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:45.903150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5006828fb5a4553b8c7df0d843c3433)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:45.906766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:45.994038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5006828fb5a4553b8c7df0d843c3433'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:46.066050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5006828fb5a4553b8c7df0d843c3433'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:46.067775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5006828fb5a4553b8c7df0d843c3433'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:46.083592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5006828fb5a4553b8c7df0d843c3433'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:46.084201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e5821af7-0b4a-428c-a5e1-6c1f0a4384ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5006828fb5a4553b8c7df0d843c3433'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:46.105997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3809/7635] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:45 2022] DELETE /identity/v3/users/f5006828fb5a4553b8c7df0d843c3433 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:46.615872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:46.617508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:46.640246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d964911-746a-42f0-b2f9-aab565115b44 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:46.803193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:46.805012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:46.805299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:46.805576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] PATH_INFO: `/v3/projects/27be299bbf5e482eb9f39ca99a69a870` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:46.810628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27be299bbf5e482eb9f39ca99a69a870)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:46.820191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:46.976111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27be299bbf5e482eb9f39ca99a69a870', 'request_id': 'req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:46.989437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27be299bbf5e482eb9f39ca99a69a870', 'request_id': 'req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:47.008762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27be299bbf5e482eb9f39ca99a69a870', 'request_id': 'req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:47.036936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] The token cache is being invalidate because project 27be299bbf5e482eb9f39ca99a69a870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:47.036936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:47.038780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9cd56f0a-cb1b-4323-aa15-d7dcde0f2e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:47.040973 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3827/7636] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:46 2022] DELETE /identity/v3/projects/27be299bbf5e482eb9f39ca99a69a870 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:47.047647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:47.048104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:47.048227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:47.095598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:47.098428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:47.113273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:47.253870 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3810/7637] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:47.264989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:47.265349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:47.265582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:47.369441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:47.380097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:47.410709 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3828/7638] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:47.411869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:47.424823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5aea0-621f-4d03-ba9a-4567c66f1522 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:47.439270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:47.440494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:47.441122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:47.441582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:47.442427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:47.442910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:47.444743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:47.470253 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3811/7639] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:47.473695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:47.479821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:47.491484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e892f3-6a64-4efc-9fdc-8ef448e27da4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:47.514442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:47.515887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:47.516290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:47.516878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:47.517973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:47.523588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:47.641088 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3829/7640] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:47 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:47.646386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:47.666051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d59ad-0308-4378-ab6f-11f0e009d2ed admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:47.882364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:47.882944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:47.883768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:47.883768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:47.884134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:47.890339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:47.913313 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3812/7641] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:47 2022] POST /identity/v3/users => generated 295 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:47.918334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:47.935879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb82-63fc-4042-b97d-138aed169ac6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:47.943495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:47.944452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:47.945067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:47.945846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:47.946748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:47.950556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:47.999099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:48.002184 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3830/7642] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:01:48.016101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa06b2-d667-4703-ba25-a92327d70a7c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:48.024560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef0083-1874-453d-bc63-578c7708a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:48.025421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef0083-1874-453d-bc63-578c7708a5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:48.025710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef0083-1874-453d-bc63-578c7708a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:48.026151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef0083-1874-453d-bc63-578c7708a5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:48.027712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef0083-1874-453d-bc63-578c7708a5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:48.030829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef0083-1874-453d-bc63-578c7708a5a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:48.049743 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3813/7643] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:48.050628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:48.067131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aab185-0491-4173-9457-bbd040151cfb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:48.091437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:48.093539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:48.095215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:48.095575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] PATH_INFO: `/v3/projects/f632cd7c09814d7887b304fae42c6771/users/ec5b1377ed224bbb8459c69a296375ee/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:48.141277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f632cd7c09814d7887b304fae42c6771, user_id=ec5b1377ed224bbb8459c69a296375ee, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:48.150630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:48.181950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3831/7644] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:48 2022] PUT /identity/v3/projects/f632cd7c09814d7887b304fae42c6771/users/ec5b1377ed224bbb8459c69a296375ee/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:01:48.194995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:48.195281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:48.195778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:48.259172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] MFA Rules not processed for user `ec5b1377ed224bbb8459c69a296375ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:48.261353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:48.481725 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3814/7645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:48.503418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:48.505749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:48.615846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19c59-eaf0-4988-8674-33dd6db6f3b5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:48.638092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0ea5d-3de9-49de-a3ca-0f84bbed4a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:48.639246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ea5d-3de9-49de-a3ca-0f84bbed4a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:48.639532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ea5d-3de9-49de-a3ca-0f84bbed4a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:48.641511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0ea5d-3de9-49de-a3ca-0f84bbed4a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:48.658091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0ea5d-3de9-49de-a3ca-0f84bbed4a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:48.659884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0ea5d-3de9-49de-a3ca-0f84bbed4a3a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:48.679631 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3832/7646] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:48.732564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:48.744219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:48.878808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4cb1f-3354-4813-b039-1eec8faad51f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:48.884128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:48.884928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:48.885574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:48.885978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] PATH_INFO: `/v3/users/ec5b1377ed224bbb8459c69a296375ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:48.887238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5b1377ed224bbb8459c69a296375ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:48.889489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:49.001872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5b1377ed224bbb8459c69a296375ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:49.040187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5b1377ed224bbb8459c69a296375ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:49.041302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5b1377ed224bbb8459c69a296375ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:49.085091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5b1377ed224bbb8459c69a296375ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:49.086597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5b1377ed224bbb8459c69a296375ee'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:49.101841 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3815/7647] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:48 2022] DELETE /identity/v3/users/ec5b1377ed224bbb8459c69a296375ee => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:49.107443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:49.107739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:49.108023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:49.180844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:49.182020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:49.366414 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3833/7648] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:49.384551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:49.386524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:49.517478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0daffb-89d1-45cf-b6f3-a02ac43a6e4f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:49.525109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee76b0-7f99-4223-bc77-2b9bb07695e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:49.525995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee76b0-7f99-4223-bc77-2b9bb07695e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:49.526797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee76b0-7f99-4223-bc77-2b9bb07695e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:49.527275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee76b0-7f99-4223-bc77-2b9bb07695e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:49.548536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee76b0-7f99-4223-bc77-2b9bb07695e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:49.551984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee76b0-7f99-4223-bc77-2b9bb07695e0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:49.598072 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3816/7649] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:50.801835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:50.806416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:50.832392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cd18d-453b-46d1-8ec9-bfabec2b660b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:50.852730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:50.853736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:50.854224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:50.854908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] PATH_INFO: `/v3/projects/f632cd7c09814d7887b304fae42c6771` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:50.859404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f632cd7c09814d7887b304fae42c6771)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:50.866092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.020183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:51.035766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f632cd7c09814d7887b304fae42c6771', 'request_id': 'req-20523461-d907-44c2-afba-e78ffa740cc3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:51.058574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f632cd7c09814d7887b304fae42c6771', 'request_id': 'req-20523461-d907-44c2-afba-e78ffa740cc3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:51.090455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f632cd7c09814d7887b304fae42c6771', 'request_id': 'req-20523461-d907-44c2-afba-e78ffa740cc3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:51.157758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] The token cache is being invalidate because project f632cd7c09814d7887b304fae42c6771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:51.158266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:51.159007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:51.161051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3834/7650] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:50 2022] DELETE /identity/v3/projects/f632cd7c09814d7887b304fae42c6771 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:51.166277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396861-db92-40e3-998f-7e6f990204fb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.169729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396861-db92-40e3-998f-7e6f990204fb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.170258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396861-db92-40e3-998f-7e6f990204fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.203275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6c396861-db92-40e3-998f-7e6f990204fb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:51.205364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c396861-db92-40e3-998f-7e6f990204fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:51.319231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.321777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:51.341415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:51.470943 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3817/7651] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:51.473255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20523461-d907-44c2-afba-e78ffa740cc3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:51.478435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:51.478706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.479264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.479394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.479647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.480529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.480803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.483045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:51.507949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:51.510320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:51.521370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3818/7652] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:51.526249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.538683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3b6bb-1f91-4aa1-8202-48bf4f70055a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:51.545324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:51.546223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.546223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.546714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.547668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:51.548239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:51.550117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.568338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3819/7653] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:01:51.572989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.608435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d22e-6fd4-479d-a245-ac55b06eba29 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:51.627294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:51.628365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.628745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.630454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.632974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:51.637650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.680101 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3820/7654] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:51 2022] POST /identity/v3/projects => generated 359 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:01:51.684940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.698169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:51.700072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.743420 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3835/7655] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:51.788479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281142-9c57-4914-8080-5142405e04d2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:51.794561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:51.795233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.795777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.796153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.797225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:51.799254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.830341 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3821/7656] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:51 2022] POST /identity/v3/users => generated 280 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:51.834475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.846734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6805f-4df6-4ed7-a71f-098877102909 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:51.853160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:51.854076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.855113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.855648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.856537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:51.858791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.873081 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3836/7657] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:01:51.876884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.896370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e327c68-3dce-4594-a75d-658aeb7c11ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:51.914561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839431c-285e-42c1-9a36-fa517bed3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:51.916631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839431c-285e-42c1-9a36-fa517bed3deb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:51.917781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839431c-285e-42c1-9a36-fa517bed3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:51.918142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839431c-285e-42c1-9a36-fa517bed3deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:51.921338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839431c-285e-42c1-9a36-fa517bed3deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:51.938297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839431c-285e-42c1-9a36-fa517bed3deb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:51.980018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:51.980536 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3822/7658] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:01:51.996131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38083-658b-4528-af4c-733a26b0d5ae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:52.012567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:52.013305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:52.014271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:52.014271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] PATH_INFO: `/v3/projects/573d47b68fcf4a34ad72fe3f25765b8c/users/99484ade555448d68756f81a9c8475d3/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:52.034865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=573d47b68fcf4a34ad72fe3f25765b8c, user_id=99484ade555448d68756f81a9c8475d3, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:52.038872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:52.058214 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3837/7659] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:51 2022] PUT /identity/v3/projects/573d47b68fcf4a34ad72fe3f25765b8c/users/99484ade555448d68756f81a9c8475d3/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:52.069812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111392-1540-47e3-9235-31340326596f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:52.070205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111392-1540-47e3-9235-31340326596f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:52.070599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f111392-1540-47e3-9235-31340326596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:52.108781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8f111392-1540-47e3-9235-31340326596f None None] MFA Rules not processed for user `99484ade555448d68756f81a9c8475d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:52.110439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f111392-1540-47e3-9235-31340326596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:52.233115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:52.264875 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3823/7660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:52.278277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:52.347679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:52.399796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794db2-1721-4798-a720-6682c6c14a7b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:52.410221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:52.413304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:52.413951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:52.414542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:52.424691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:52.426544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:52.437686 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3838/7661] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:53.355510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f111392-1540-47e3-9235-31340326596f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:53.378175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f111392-1540-47e3-9235-31340326596f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:53.397933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:53.398783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:53.399310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:53.399658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:53.401942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:53.583639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:53.589898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41794d95-ae2e-4414-a33b-eed4c216e651 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:53.634324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3824/7662] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:54.442567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:54.444866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:54.693006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5666f-2af7-4c20-968b-793750f038e4 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:54.719712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:54.720431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:54.720764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:54.721181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] PATH_INFO: `/v3/users/282c8f7259f14337ba6e4c1df5de804b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:54.725684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=282c8f7259f14337ba6e4c1df5de804b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:54.727984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:54.813713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282c8f7259f14337ba6e4c1df5de804b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:54.851564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282c8f7259f14337ba6e4c1df5de804b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:54.853029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282c8f7259f14337ba6e4c1df5de804b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:54.887261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282c8f7259f14337ba6e4c1df5de804b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:54.888127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282c8f7259f14337ba6e4c1df5de804b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:54.905567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3839/7663] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:01:54 2022] DELETE /identity/v3/users/282c8f7259f14337ba6e4c1df5de804b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:54.910679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:54.911206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:54.911535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:54.982659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:54.993073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:55.140859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3825/7664] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:55.164767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:55.166451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:55.314109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6f48d-e829-4a54-a48c-bb6982c56433 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:55.324467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf12da5-e38f-4c8c-a7e6-1ee54f8ef084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:55.325229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12da5-e38f-4c8c-a7e6-1ee54f8ef084 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:55.325511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12da5-e38f-4c8c-a7e6-1ee54f8ef084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:55.325787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf12da5-e38f-4c8c-a7e6-1ee54f8ef084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:55.352267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:55.352267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12da5-e38f-4c8c-a7e6-1ee54f8ef084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:55.359399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf12da5-e38f-4c8c-a7e6-1ee54f8ef084 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:55.389383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3840/7665] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:55.985594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:55.986896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:56.024717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988bbd-b5f4-41a0-a75a-a6806c141fba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:56.035256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:56.036506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:56.036978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:56.037421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] PATH_INFO: `/v3/projects/8605431775ed4440b135b316bfce4ab1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:56.038807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8605431775ed4440b135b316bfce4ab1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:56.040746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:56.173087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8605431775ed4440b135b316bfce4ab1', 'request_id': 'req-2c10e3a2-b1b5-438f-801d-bab2c46b8309'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:56.196779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8605431775ed4440b135b316bfce4ab1', 'request_id': 'req-2c10e3a2-b1b5-438f-801d-bab2c46b8309'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:56.214402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8605431775ed4440b135b316bfce4ab1', 'request_id': 'req-2c10e3a2-b1b5-438f-801d-bab2c46b8309'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:56.249468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] The token cache is being invalidate because project 8605431775ed4440b135b316bfce4ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:01:56.250539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:56.254291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c10e3a2-b1b5-438f-801d-bab2c46b8309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:01:56.256502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3826/7666] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:01:55 2022] DELETE /identity/v3/projects/8605431775ed4440b135b316bfce4ab1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:56.262731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:56.263239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:56.263374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:56.312072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:56.313409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:56.528334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3841/7667] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:01:56.536328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:56.536691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:56.537073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:56.553398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:56.592690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:56.596363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:56.627515 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3827/7668] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:56.633703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:56.659239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3b83-d779-4d73-85a2-70b4fc232726 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:56.682136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:56.683991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:56.684463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:56.684922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:56.686383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:01:56.693467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:56.696143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:56.715871 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3842/7669] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:01:56.717106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:56.736481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5c6c-48d8-4cdc-af92-fb42d2ba2fa0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:56.748380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:56.749369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:56.749788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:56.750182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:56.751049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:56.754156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:56.805295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:56.806083 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3828/7670] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:01:56 2022] POST /identity/v3/projects => generated 355 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:56.830781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f5ce0-7a4e-4468-b12d-61f474134dc1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:57.051272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:57.051947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.052231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.056161 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.058056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:57.060193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:57.108314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:57.109663 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3843/7671] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:01:56 2022] POST /identity/v3/users => generated 278 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:01:57.122949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2c2c-180d-4e11-814e-1c7910d68b27 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:57.128335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:57.129092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.129434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.129936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.130794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:57.140666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:57.164032 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3829/7672] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:57.168437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:57.185466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9ea25-2d7c-40cd-b159-fe52e51dd4cd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:57.198099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd201ad-bd6d-45e0-8cea-c8b2ba290015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:57.199265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd201ad-bd6d-45e0-8cea-c8b2ba290015 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.199550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd201ad-bd6d-45e0-8cea-c8b2ba290015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.199824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd201ad-bd6d-45e0-8cea-c8b2ba290015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.200502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd201ad-bd6d-45e0-8cea-c8b2ba290015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:57.202176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd201ad-bd6d-45e0-8cea-c8b2ba290015 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:57.234856 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3844/7673] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:01:57.236103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:57.282152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c42b1f-9f65-49fe-875e-c8e83abca425 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:57.305895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:57.306753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.307110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.307455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] PATH_INFO: `/v3/projects/ff2c7092e2b74bcfb8109c3e264f517b/users/b18d452b2ab148f8b270cd90f678f211/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.350246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2c7092e2b74bcfb8109c3e264f517b, user_id=b18d452b2ab148f8b270cd90f678f211, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:57.353246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:57.384835 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3830/7674] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:01:57 2022] PUT /identity/v3/projects/ff2c7092e2b74bcfb8109c3e264f517b/users/b18d452b2ab148f8b270cd90f678f211/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:01:57.397177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98a068-5d86-49bb-8226-e7cfd8e8fe5d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.397717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98a068-5d86-49bb-8226-e7cfd8e8fe5d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.397892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98a068-5d86-49bb-8226-e7cfd8e8fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.482928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ee98a068-5d86-49bb-8226-e7cfd8e8fe5d None None] MFA Rules not processed for user `b18d452b2ab148f8b270cd90f678f211`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:57.484699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ee98a068-5d86-49bb-8226-e7cfd8e8fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:57.614859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:01:57.665948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3845/7675] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:01:57.674422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:01:57.676202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:57.844750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348d9c3-23a8-4b93-a3b9-1786584b4a99 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:01:57.855886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:01:57.856603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.857069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.857448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.879288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:01:57.880952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:01:57.909528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3831/7676] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:01:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:01:57.913958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:01:57.914246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:01:57.914529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:01:57.949937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:01:57.951171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:01:58.113221 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3846/7677] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:01:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:00.922794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:00.925306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:01.042542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d7a5a-a51a-4740-b831-f69303a5719a service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:01.054715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:01.055569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:01.055864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:01.056593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:01.063327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:01.178787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:01.198490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:01.201358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b655-eee1-4098-bcd7-dad8e4af45e0 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:01.226601 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3832/7678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:08.076688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=29 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:11.216349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:11.769773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:11.878684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c03fe-f238-45d5-afd5-9d5a1e642710 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:11.884735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:11.885710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:11.886746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:11.887201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] PATH_INFO: `/v3/users/b18d452b2ab148f8b270cd90f678f211` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:11.889404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18d452b2ab148f8b270cd90f678f211)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:11.892267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:11.971790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18d452b2ab148f8b270cd90f678f211'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:11.996000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18d452b2ab148f8b270cd90f678f211'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:11.997517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18d452b2ab148f8b270cd90f678f211'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:12.014287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18d452b2ab148f8b270cd90f678f211'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:12.016648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18d452b2ab148f8b270cd90f678f211'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:12.041399 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3847/7679] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:11 2022] DELETE /identity/v3/users/b18d452b2ab148f8b270cd90f678f211 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:12.042970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:12.043261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:12.043542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:12.069014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:12.070438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:12.216553 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3833/7680] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:12.227681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:12.229733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:12.362571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5261c0-b681-45a2-a465-64b942f6e5a7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:12.377428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e4130-d8bf-4fa2-8645-a700fc6bf26a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:12.378130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4130-d8bf-4fa2-8645-a700fc6bf26a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:12.378473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4130-d8bf-4fa2-8645-a700fc6bf26a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:12.378815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e4130-d8bf-4fa2-8645-a700fc6bf26a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:12.405740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e4130-d8bf-4fa2-8645-a700fc6bf26a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:12.408372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e4130-d8bf-4fa2-8645-a700fc6bf26a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:12.433845 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3848/7681] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:12.878779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:12.880379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:12.918578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0ccdc-0d7d-42d8-896e-c45a04e7e141 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:12.952399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:12.953759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:12.955167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:12.957266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] PATH_INFO: `/v3/projects/ff2c7092e2b74bcfb8109c3e264f517b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:12.964362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2c7092e2b74bcfb8109c3e264f517b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:12.978886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.103715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2c7092e2b74bcfb8109c3e264f517b', 'request_id': 'req-234bf0f7-4849-44f6-904e-b2dc60a836b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:13.126224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2c7092e2b74bcfb8109c3e264f517b', 'request_id': 'req-234bf0f7-4849-44f6-904e-b2dc60a836b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:13.134622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2c7092e2b74bcfb8109c3e264f517b', 'request_id': 'req-234bf0f7-4849-44f6-904e-b2dc60a836b6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:13.163321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] The token cache is being invalidate because project ff2c7092e2b74bcfb8109c3e264f517b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:13.163887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:13.165277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-234bf0f7-4849-44f6-904e-b2dc60a836b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:13.168338 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3834/7682] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:12 2022] DELETE /identity/v3/projects/ff2c7092e2b74bcfb8109c3e264f517b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:13.173637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.175279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.175735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.236875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:13.238384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:13.262794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:13.329060 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3849/7683] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:13.336785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.337899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.339276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.427283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:13.427765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:13.441013 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3835/7684] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:13.442053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:13.468562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585a593-11e0-454c-9bbf-21476eb84c9e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:13.474149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:13.474855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.475424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.475925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.476605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:13.476922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:13.482349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.509475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3850/7685] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:02:13.514409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:13.524928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee286c6-f3ad-427e-8f3f-d9e9b629b853 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:13.531218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:13.532158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.532629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.533111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.533962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:13.536303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.586115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3836/7686] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:13 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:13.587480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:13.600862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907b6ea-74fe-47c9-bf28-6c1efb65b79a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:13.702390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:13.704063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.704534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.705012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.705857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:13.708001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.737841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3851/7687] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:13 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:02:13.743834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:13.766978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5572-1042-4cf5-a668-c9c5e7226a28 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:13.772773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:13.773596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.773892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.774162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.774813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:13.777013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.788254 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3837/7688] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:02:13.793944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:13.804478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8a58-5e56-40f2-b615-8790b9ebd8a1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:13.811059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc430-ca39-4035-9775-a802aafb99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:13.812529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc430-ca39-4035-9775-a802aafb99ff admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.813077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc430-ca39-4035-9775-a802aafb99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.813415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc430-ca39-4035-9775-a802aafb99ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.814307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbc430-ca39-4035-9775-a802aafb99ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:13.815954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbc430-ca39-4035-9775-a802aafb99ff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.828981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3852/7689] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:13.833363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:13.844147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c5a14-1339-4f46-9fce-2fd5d770b2f5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:13.849226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:13.849886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.850226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.850508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] PATH_INFO: `/v3/projects/069ff498b9274d7083d3fd77fed60744/users/f0e122d2318d40ac98e1aba341ff93f1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.869386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=069ff498b9274d7083d3fd77fed60744, user_id=f0e122d2318d40ac98e1aba341ff93f1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:13.873034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:13.900457 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3838/7690] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:13 2022] PUT /identity/v3/projects/069ff498b9274d7083d3fd77fed60744/users/f0e122d2318d40ac98e1aba341ff93f1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:13.917568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:13.917882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:13.918159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:13.947283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] MFA Rules not processed for user `f0e122d2318d40ac98e1aba341ff93f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:13.948486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:14.029842 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3853/7691] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:14.034118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.058893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:14.117860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b593ef1-0107-4868-ba2b-7e36e32e70bc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:14.124454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:14.126091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.126605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.127046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.127866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:14.130322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:14.172828 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3839/7692] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:14 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:14.176575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.194297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8942a3-aa73-48f5-851a-93701a686dde None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:14.214302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:14.269912 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:14.271947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.272518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.273225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.274680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:14.277031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:14.317118 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3854/7693] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:14 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:14.319016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.334884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b5b05-9c33-4948-b6d7-687b9acd83c6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:14.342427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:14.343242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.343620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.344121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.344875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:14.346639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:14.373567 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3840/7694] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:14.377509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.394046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d286b-4833-46cf-bf76-b9aec08f46ea admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:14.399510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:14.400394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.400728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.401391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] PATH_INFO: `/v3/projects/4ddf2919a4f24385b7d654b7bdfbd28a/users/ce1e15a877de4cf99aa901c5f67bbcec/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.421975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddf2919a4f24385b7d654b7bdfbd28a, user_id=ce1e15a877de4cf99aa901c5f67bbcec, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:14.424833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:14.450292 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3855/7695] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:14 2022] PUT /identity/v3/projects/4ddf2919a4f24385b7d654b7bdfbd28a/users/ce1e15a877de4cf99aa901c5f67bbcec/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:14.453881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.464784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da468ebd-11ab-41ab-9bd0-aa7c6b0de766 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:14.549914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf8dae-72dc-4ba4-8980-960505ec1053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:14.550639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8dae-72dc-4ba4-8980-960505ec1053 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.551037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8dae-72dc-4ba4-8980-960505ec1053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.551388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf8dae-72dc-4ba4-8980-960505ec1053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.552155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf8dae-72dc-4ba4-8980-960505ec1053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:14.553909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf8dae-72dc-4ba4-8980-960505ec1053 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:14.574551 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3841/7696] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:14.575971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.597138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773935-5643-440b-a059-bf6b8015fb79 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:14.602689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:14.603460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.603822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.604704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] PATH_INFO: `/v3/projects/4ddf2919a4f24385b7d654b7bdfbd28a/users/ce1e15a877de4cf99aa901c5f67bbcec/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.608244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddf2919a4f24385b7d654b7bdfbd28a, user_id=ce1e15a877de4cf99aa901c5f67bbcec, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:14.613391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:14.635971 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3856/7697] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:14 2022] PUT /identity/v3/projects/4ddf2919a4f24385b7d654b7bdfbd28a/users/ce1e15a877de4cf99aa901c5f67bbcec/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:14.649579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:14.649579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:14.661187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:14.712796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] MFA Rules not processed for user `ce1e15a877de4cf99aa901c5f67bbcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:14.715648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:14.856649 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3842/7698] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:14.877278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:14.881641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:15.019366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5564adb-c2cd-4c33-90b6-97832fefec78 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:15.025806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45c27d-7c09-4ab0-87d9-b35084b2f7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:15.027481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c27d-7c09-4ab0-87d9-b35084b2f7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:15.028006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c27d-7c09-4ab0-87d9-b35084b2f7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:15.028434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c27d-7c09-4ab0-87d9-b35084b2f7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:15.053155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45c27d-7c09-4ab0-87d9-b35084b2f7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:15.055035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45c27d-7c09-4ab0-87d9-b35084b2f7b3 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:15.084961 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3857/7699] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:17.548273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:17.609301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:17.706232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef185d96-8137-4632-9698-2e271ca51a8c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:17.726479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:17.727970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:17.729986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:17.731053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] PATH_INFO: `/v3/users/f0e122d2318d40ac98e1aba341ff93f1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:17.733692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e122d2318d40ac98e1aba341ff93f1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:17.736110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:17.859893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e122d2318d40ac98e1aba341ff93f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:17.908997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e122d2318d40ac98e1aba341ff93f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:17.909763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e122d2318d40ac98e1aba341ff93f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:17.928875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e122d2318d40ac98e1aba341ff93f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:17.929878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e122d2318d40ac98e1aba341ff93f1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:17.958945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3843/7700] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:17 2022] DELETE /identity/v3/users/f0e122d2318d40ac98e1aba341ff93f1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:17.964280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:17.964827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:17.964827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:17.999949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:18.001242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:18.137583 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3858/7701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:18.138257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:18.144878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:18.239262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ed69e-c927-4b12-b5e6-27dacd501f94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:18.242083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:18.242831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:18.243118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:18.243393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:18.254867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:18.256532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:18.277331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3844/7702] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:18.911331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:18.913213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:18.954396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33fc20-a895-4f63-8f1b-01191a59acbe None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:18.985457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:18.986127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:18.986450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:18.986735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] PATH_INFO: `/v3/projects/069ff498b9274d7083d3fd77fed60744` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:18.987931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069ff498b9274d7083d3fd77fed60744)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:18.989953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:19.017277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:19.146978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069ff498b9274d7083d3fd77fed60744', 'request_id': 'req-2590dec5-4907-434d-96c8-dab65625b1e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.165854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069ff498b9274d7083d3fd77fed60744', 'request_id': 'req-2590dec5-4907-434d-96c8-dab65625b1e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.177217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069ff498b9274d7083d3fd77fed60744', 'request_id': 'req-2590dec5-4907-434d-96c8-dab65625b1e3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.204984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] The token cache is being invalidate because project 069ff498b9274d7083d3fd77fed60744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:19.205290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.207205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.212939 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3859/7703] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:18 2022] DELETE /identity/v3/projects/069ff498b9274d7083d3fd77fed60744 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:19.214346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:19.227924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019a3a-a16f-49d1-8366-d511f719315b service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:19.332855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:19.445724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:19.449056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:19.449341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:19.449618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] PATH_INFO: `/v3/users/ce1e15a877de4cf99aa901c5f67bbcec` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:19.452710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1e15a877de4cf99aa901c5f67bbcec)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:19.462056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:19.562989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1e15a877de4cf99aa901c5f67bbcec'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.621192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1e15a877de4cf99aa901c5f67bbcec'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.627040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1e15a877de4cf99aa901c5f67bbcec'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.673460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1e15a877de4cf99aa901c5f67bbcec'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.674141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-008cc10c-bdc4-45d0-b363-92920f4d00f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1e15a877de4cf99aa901c5f67bbcec'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:19.714555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3845/7704] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:19 2022] DELETE /identity/v3/users/ce1e15a877de4cf99aa901c5f67bbcec => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:20.864082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:20.867489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:20.945494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590dec5-4907-434d-96c8-dab65625b1e3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:21.087138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:21.087690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.087977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.088443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] PATH_INFO: `/v3/projects/4ddf2919a4f24385b7d654b7bdfbd28a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.090477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddf2919a4f24385b7d654b7bdfbd28a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:21.092604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:21.171452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddf2919a4f24385b7d654b7bdfbd28a', 'request_id': 'req-b48484de-7b57-446a-a749-55f0fe3f2982'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:21.180786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddf2919a4f24385b7d654b7bdfbd28a', 'request_id': 'req-b48484de-7b57-446a-a749-55f0fe3f2982'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:21.219654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddf2919a4f24385b7d654b7bdfbd28a', 'request_id': 'req-b48484de-7b57-446a-a749-55f0fe3f2982'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:21.265744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] The token cache is being invalidate because project 4ddf2919a4f24385b7d654b7bdfbd28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:21.266072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:21.268962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b48484de-7b57-446a-a749-55f0fe3f2982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:21.270936 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3860/7705] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:20 2022] DELETE /identity/v3/projects/4ddf2919a4f24385b7d654b7bdfbd28a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:21.278577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.279655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.280225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.305078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:21.309602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:21.445627 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3846/7706] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:21.453776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.454522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.454816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.482518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:21.484364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:21.535508 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3861/7707] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:21.539977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:21.571611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8eabb-d9c9-4c73-af76-d0f415ff4aba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:21.585678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:21.586727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.587389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.587917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.589464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:21.590196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:21.592153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:21.613755 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3847/7708] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:02:21.618748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:21.634785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67dec6-08e2-4a9f-911f-7b7337ee3ae5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:21.652850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcbc52-66db-4ee2-96a4-c8f8a4b98eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:21.658123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcbc52-66db-4ee2-96a4-c8f8a4b98eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.660009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcbc52-66db-4ee2-96a4-c8f8a4b98eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.661265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcbc52-66db-4ee2-96a4-c8f8a4b98eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.661973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcbc52-66db-4ee2-96a4-c8f8a4b98eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:21.665513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcbc52-66db-4ee2-96a4-c8f8a4b98eb4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:21.704131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:21.721116 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3862/7709] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:21 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:21.736403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:21.739552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.741128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.741474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.747994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60897f2-f9c9-4f32-a12d-caab7da942db admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:21.775968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] MFA Rules not processed for user `12d0128e850f4f22a2172800c44074a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:21.777612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:21.819383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:21.848231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:21.850031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.851734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.852251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.853159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:21.857072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:21.907769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3848/7710] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:21 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:21.910267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:21.910639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3863/7711] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:21.949431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2195ab-97e3-4659-8420-13332cb8197b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:21.956517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:21.957743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:21.958219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:21.958663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:21.960230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:21.965618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:21.982683 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3849/7712] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:21.984308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:21.999469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d47dd-0138-4164-a587-a3ff5b2a62fe None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.005781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05711bf-20af-4f0f-8413-82d36f68a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.006600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05711bf-20af-4f0f-8413-82d36f68a67d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.007977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05711bf-20af-4f0f-8413-82d36f68a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.008432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05711bf-20af-4f0f-8413-82d36f68a67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.009360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05711bf-20af-4f0f-8413-82d36f68a67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.011779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05711bf-20af-4f0f-8413-82d36f68a67d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.026685 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3864/7713] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:02:22.030991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:22.063076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75fdef-a45b-41ef-9a27-83095712fad0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.075801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.076762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.077967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.078453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] PATH_INFO: `/v3/projects/475efdd5c0ed4ca086e2027eabc46bf4/users/66f30c68823a476aab89d65b1e21ca12/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.106914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475efdd5c0ed4ca086e2027eabc46bf4, user_id=66f30c68823a476aab89d65b1e21ca12, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.109864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.148635 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3850/7714] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:22 2022] PUT /identity/v3/projects/475efdd5c0ed4ca086e2027eabc46bf4/users/66f30c68823a476aab89d65b1e21ca12/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:02:22.161534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.161842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.162135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.204407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] MFA Rules not processed for user `66f30c68823a476aab89d65b1e21ca12`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:22.206517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:22.302451 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3865/7715] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:22.308588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:22.386271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1ce03-d3a8-4fe8-97e0-4584a83a95a3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.393158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.394960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.395254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.395536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.397641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.400168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.466566 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3851/7716] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:22 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:22.468189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:22.486722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67da7-40e4-4939-9b09-a1d7c0b1f392 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.636359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.637013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.637301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.637581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.638234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.640404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.686151 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3866/7717] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:22 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:22.690388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:22.707653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9459e-3c5e-439c-9237-bf67fc1b4ba4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.716111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.717228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.717847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.718343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.719294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.721347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.739981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3852/7718] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:02:22.743796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:22.764922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1bfb9-c71b-4e87-8397-a3608abaf3cd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.774903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2e003-5b0b-48fd-bb2c-b67a9c2e9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.776478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e003-5b0b-48fd-bb2c-b67a9c2e9e6e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.777130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e003-5b0b-48fd-bb2c-b67a9c2e9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.777643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2e003-5b0b-48fd-bb2c-b67a9c2e9e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.778674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e003-5b0b-48fd-bb2c-b67a9c2e9e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.782206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2e003-5b0b-48fd-bb2c-b67a9c2e9e6e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.801318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:22.817792 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3867/7719] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:22.821563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:22.833725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c34b3-d365-43fc-a1c8-4ce12b0abc06 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:22.840810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:22.841957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.842516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.842969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] PATH_INFO: `/v3/projects/2b3899f202ec4be6996afb02bae4379b/users/5cf9db38a95f463da383ad23c0d749de/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.867715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3899f202ec4be6996afb02bae4379b, user_id=5cf9db38a95f463da383ad23c0d749de, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:22.888347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:22.909005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3853/7720] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:22 2022] PUT /identity/v3/projects/2b3899f202ec4be6996afb02bae4379b/users/5cf9db38a95f463da383ad23c0d749de/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:02:22.920593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:22.921150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:22.921150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:22.981652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] MFA Rules not processed for user `5cf9db38a95f463da383ad23c0d749de`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:22.983017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:23.143319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3868/7721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:23.147594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:23.256481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:23.285387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084028e-f6b8-4827-ab40-ecc8cf19da1b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:23.292077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:23.296269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:23.296384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:23.296730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:23.297595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:23.301067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:23.353921 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3854/7722] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:23 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:23.356683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:23.373473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137acbcf-e07c-4ece-9929-7c59062f236e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:23.514657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:23.515581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:23.515977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:23.516412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:23.517205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:23.519722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:23.559564 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3869/7723] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:23 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:23.565574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:23.615982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84121eb-6f6e-439f-9873-bb7bd7552384 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:23.637089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:23.637089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:23.637089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:23.637502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:23.638056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:23.639610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:23.662280 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3855/7724] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:23.663006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:23.880022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00497f-97bf-431f-9b2c-8c39fd395b6b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:23.880022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:23.880022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:23.880022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:23.883958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] PATH_INFO: `/v3/projects/9765c87375a14e51a996c8c5a5cee93d/users/8bb2cc60357e4fa78e78c4aaeec000e1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:23.883958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9765c87375a14e51a996c8c5a5cee93d, user_id=8bb2cc60357e4fa78e78c4aaeec000e1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:23.883958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:23.883958 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3870/7725] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:23 2022] PUT /identity/v3/projects/9765c87375a14e51a996c8c5a5cee93d/users/8bb2cc60357e4fa78e78c4aaeec000e1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:02:23.884806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:23.901335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3d4c-d96d-47b2-a9c3-e77b439c439a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:24.022837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876ff26-f65b-4871-b2f6-f56d1e4bd3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:24.024117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876ff26-f65b-4871-b2f6-f56d1e4bd3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:24.024421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876ff26-f65b-4871-b2f6-f56d1e4bd3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:24.024678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876ff26-f65b-4871-b2f6-f56d1e4bd3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:24.025417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876ff26-f65b-4871-b2f6-f56d1e4bd3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:24.039313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876ff26-f65b-4871-b2f6-f56d1e4bd3ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:24.060212 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3856/7726] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:24.064837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:24.091134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e8ff-f400-47ea-9194-9dddcef5b33a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:24.097119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:24.098081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:24.098602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:24.099106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] PATH_INFO: `/v3/projects/9765c87375a14e51a996c8c5a5cee93d/users/8bb2cc60357e4fa78e78c4aaeec000e1/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:24.101823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9765c87375a14e51a996c8c5a5cee93d, user_id=8bb2cc60357e4fa78e78c4aaeec000e1, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:24.106461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:24.131055 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3871/7727] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:24 2022] PUT /identity/v3/projects/9765c87375a14e51a996c8c5a5cee93d/users/8bb2cc60357e4fa78e78c4aaeec000e1/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:24.132051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:24.132205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:24.132479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:24.252245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] MFA Rules not processed for user `8bb2cc60357e4fa78e78c4aaeec000e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:24.253948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:24.421811 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3857/7728] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:24.433734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:24.435458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:24.523118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:24.550337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af4e4-643d-47e0-903c-1002690a275c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:24.567577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:24.585277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:24.585884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:24.589060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:24.622327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:24.624008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:24.651392 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3872/7729] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:24.708842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:24.718853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:24.756323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27966e-36c3-4f2a-b479-3ff921cc9c3b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:24.779531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:24.780986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:24.782597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:24.783415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:24.881445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:24.938072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:24.939568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:24.951691 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3858/7730] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:30.702455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:30.703989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:30.798688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02807-aa6a-46fd-b3ba-870b72759e3a service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:30.802671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:30.803526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:30.803914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:30.804293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:30.809583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:30.824359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:30.825969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594af916-58ed-47ec-9a99-fea1e5fe7250 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:30.851583 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3873/7731] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:02:32.131489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:32.275268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24b595-5b84-421b-a99a-9d0ba78d956c service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:32.280533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:32.281607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:32.281856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:32.282113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] PATH_INFO: `/v3/users/66f30c68823a476aab89d65b1e21ca12` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:32.283285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f30c68823a476aab89d65b1e21ca12)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:32.285559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:32.434669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f30c68823a476aab89d65b1e21ca12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:32.459323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f30c68823a476aab89d65b1e21ca12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:32.460290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f30c68823a476aab89d65b1e21ca12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:32.481130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f30c68823a476aab89d65b1e21ca12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:32.482061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f30c68823a476aab89d65b1e21ca12'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:32.524249 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3859/7732] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:32 2022] DELETE /identity/v3/users/66f30c68823a476aab89d65b1e21ca12 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:32.529716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:32.530687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:32.531222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:32.576298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:32.577718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:32.753376 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3874/7733] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:32.760211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:32.762288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:32.936949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6ca4a-0088-49a5-a4c9-fe9c89e441e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:32.956791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:32.957421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:32.957707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:32.957988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:32.990470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:32.992160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:33.004558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3860/7734] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:33.215039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:33.229254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc3b87-84ca-45af-8fb8-e4dda0b832fb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:33.234871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:33.235885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:33.236423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:33.237019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:33.239515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:33.277443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:33.280799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:33.319090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3875/7735] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:33.887126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:33.888582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:33.902522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:33.915041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c2bb8-f030-4be0-8ef9-29acc8e7d2c6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:33.928748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:33.929511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:33.929822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:33.930112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] PATH_INFO: `/v3/projects/475efdd5c0ed4ca086e2027eabc46bf4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:33.936733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475efdd5c0ed4ca086e2027eabc46bf4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:33.957137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:34.066994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475efdd5c0ed4ca086e2027eabc46bf4', 'request_id': 'req-7a1f8b72-877c-477d-ad6a-48e786ccc711'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.093047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475efdd5c0ed4ca086e2027eabc46bf4', 'request_id': 'req-7a1f8b72-877c-477d-ad6a-48e786ccc711'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.146372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475efdd5c0ed4ca086e2027eabc46bf4', 'request_id': 'req-7a1f8b72-877c-477d-ad6a-48e786ccc711'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.179914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] The token cache is being invalidate because project 475efdd5c0ed4ca086e2027eabc46bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:34.180256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.180895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.183556 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3861/7736] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:33 2022] DELETE /identity/v3/projects/475efdd5c0ed4ca086e2027eabc46bf4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:34.187587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:34.207387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36c470-a5ca-4507-8f3c-0c5166f9b057 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:34.393668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:34.394336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:34.395247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:34.395530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] PATH_INFO: `/v3/users/5cf9db38a95f463da383ad23c0d749de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:34.396877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf9db38a95f463da383ad23c0d749de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:34.399031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:34.425694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:34.494078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf9db38a95f463da383ad23c0d749de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.509761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf9db38a95f463da383ad23c0d749de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.511802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf9db38a95f463da383ad23c0d749de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.527298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf9db38a95f463da383ad23c0d749de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.528147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf9db38a95f463da383ad23c0d749de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:34.565407 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3876/7737] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:34 2022] DELETE /identity/v3/users/5cf9db38a95f463da383ad23c0d749de => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:35.249764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:35.251341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:35.294388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f8b72-877c-477d-ad6a-48e786ccc711 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:35.392440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:35.393685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:35.395441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:35.395901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] PATH_INFO: `/v3/projects/2b3899f202ec4be6996afb02bae4379b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:35.398162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3899f202ec4be6996afb02bae4379b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:35.400241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:35.478291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3899f202ec4be6996afb02bae4379b', 'request_id': 'req-9a43d4fa-df51-408f-85a7-3117e08fdf96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.504298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3899f202ec4be6996afb02bae4379b', 'request_id': 'req-9a43d4fa-df51-408f-85a7-3117e08fdf96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.520207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3899f202ec4be6996afb02bae4379b', 'request_id': 'req-9a43d4fa-df51-408f-85a7-3117e08fdf96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.536408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] The token cache is being invalidate because project 2b3899f202ec4be6996afb02bae4379b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:35.537104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.538251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.540654 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3862/7738] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:35 2022] DELETE /identity/v3/projects/2b3899f202ec4be6996afb02bae4379b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:35.545978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:35.547648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:35.563583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6b83-d028-4984-a2e7-c06da6818685 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:35.634843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:35.636186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:35.636697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:35.637221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] PATH_INFO: `/v3/users/8bb2cc60357e4fa78e78c4aaeec000e1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:35.639071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb2cc60357e4fa78e78c4aaeec000e1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:35.641390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:35.727437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb2cc60357e4fa78e78c4aaeec000e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.744768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb2cc60357e4fa78e78c4aaeec000e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.745635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb2cc60357e4fa78e78c4aaeec000e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.763004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb2cc60357e4fa78e78c4aaeec000e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.763641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0dc8c965-0809-47f6-986d-496168d85a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb2cc60357e4fa78e78c4aaeec000e1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:35.785726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3877/7739] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:35 2022] DELETE /identity/v3/users/8bb2cc60357e4fa78e78c4aaeec000e1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:36.305972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:36.308072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:36.328137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43d4fa-df51-408f-85a7-3117e08fdf96 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:36.388605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:36.466765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:36.467639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:36.468094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:36.468543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] PATH_INFO: `/v3/projects/9765c87375a14e51a996c8c5a5cee93d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:36.470492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9765c87375a14e51a996c8c5a5cee93d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:36.472668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:36.584018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9765c87375a14e51a996c8c5a5cee93d', 'request_id': 'req-ad7daa01-2cd0-4ed9-a527-4a195a07f326'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:36.600647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9765c87375a14e51a996c8c5a5cee93d', 'request_id': 'req-ad7daa01-2cd0-4ed9-a527-4a195a07f326'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:36.609008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9765c87375a14e51a996c8c5a5cee93d', 'request_id': 'req-ad7daa01-2cd0-4ed9-a527-4a195a07f326'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:36.633534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] The token cache is being invalidate because project 9765c87375a14e51a996c8c5a5cee93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:36.633908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:36.635599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ad7daa01-2cd0-4ed9-a527-4a195a07f326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:36.637765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3863/7740] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:36 2022] DELETE /identity/v3/projects/9765c87375a14e51a996c8c5a5cee93d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:36.644084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:36.644593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:36.644695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:36.669217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:36.674793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:36.686783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:36.773763 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3878/7741] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:36.783877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:36.784165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:36.784443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:36.822520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:36.825238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:36.835532 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3864/7742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:36.840743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:36.860741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92509861-4d12-4d87-a9f3-909620d402d0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:36.875144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df263-0224-4822-a12e-408efa931739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:36.876882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df263-0224-4822-a12e-408efa931739 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:36.877416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df263-0224-4822-a12e-408efa931739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:36.877854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df263-0224-4822-a12e-408efa931739 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:36.878992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df263-0224-4822-a12e-408efa931739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:36.879314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df263-0224-4822-a12e-408efa931739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:36.882262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df263-0224-4822-a12e-408efa931739 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:36.899410 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3879/7743] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:02:36.904173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:36.915230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e26d1-300c-4398-86b2-f7fdd804bc6d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:36.922033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:36.923320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:36.924723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:36.924937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:36.925615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:36.927712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:37.008005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3865/7744] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:36 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:37.012399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df263-0224-4822-a12e-408efa931739 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:37.037939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df263-0224-4822-a12e-408efa931739 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:37.165330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:37.165975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:37.170295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:37.170581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:37.172975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:37.177982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:37.253540 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3880/7745] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:37 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:02:37.257872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:37.276787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04300583-c414-4597-9db3-1d84053d83f3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:37.295603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:37.296377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:37.296766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:37.297283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:37.298075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:37.299792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:37.347516 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3866/7746] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:37.351299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:37.364180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75888-5129-44bf-9cf4-9a10b938e6f7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:37.406505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6ae3-e1d0-4310-bbab-6feaa82abb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:37.419163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6ae3-e1d0-4310-bbab-6feaa82abb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:37.419572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6ae3-e1d0-4310-bbab-6feaa82abb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:37.419751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6ae3-e1d0-4310-bbab-6feaa82abb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:37.420447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6ae3-e1d0-4310-bbab-6feaa82abb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:37.422887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6ae3-e1d0-4310-bbab-6feaa82abb89 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:37.472561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3881/7747] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:37.474444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:37.501646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2630d1-ccca-4842-8c63-856440d592e9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:37.518602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:37.519865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:37.520430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:37.520951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] PATH_INFO: `/v3/projects/7997c3057b00437d9ba18a08405aba8b/users/5297f5c6b03d4f1bbcbf7738d6318cb1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:37.540284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7997c3057b00437d9ba18a08405aba8b, user_id=5297f5c6b03d4f1bbcbf7738d6318cb1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:37.544518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:37.587580 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3867/7748] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:37 2022] PUT /identity/v3/projects/7997c3057b00437d9ba18a08405aba8b/users/5297f5c6b03d4f1bbcbf7738d6318cb1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:37.591976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:37.592527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:37.592855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:37.668026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] MFA Rules not processed for user `5297f5c6b03d4f1bbcbf7738d6318cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:37.689731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:37.850341 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3882/7749] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:37.858637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:37.860351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:37.945895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:37.964253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffba8d-281c-4859-9ee7-c179ccb7802e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:37.970295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5a880-deb8-4ae3-b80d-9ae033ebbf41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:37.970913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a880-deb8-4ae3-b80d-9ae033ebbf41 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:37.971283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a880-deb8-4ae3-b80d-9ae033ebbf41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:37.971554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a880-deb8-4ae3-b80d-9ae033ebbf41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:37.987412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a880-deb8-4ae3-b80d-9ae033ebbf41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:37.989028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a880-deb8-4ae3-b80d-9ae033ebbf41 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:38.000502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3868/7750] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:38.025315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:38.035740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:38.149745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5db4db-c1d6-431d-b13f-ae4e9afb1d6e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:38.155975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:38.157324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:38.157833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:38.158324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] PATH_INFO: `/v3/users/5297f5c6b03d4f1bbcbf7738d6318cb1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:38.160847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5297f5c6b03d4f1bbcbf7738d6318cb1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:38.163335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:38.243148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5297f5c6b03d4f1bbcbf7738d6318cb1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:38.257326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5297f5c6b03d4f1bbcbf7738d6318cb1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:38.258184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5297f5c6b03d4f1bbcbf7738d6318cb1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:38.272631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5297f5c6b03d4f1bbcbf7738d6318cb1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:38.273632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5297f5c6b03d4f1bbcbf7738d6318cb1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:38.295684 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3883/7751] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:38 2022] DELETE /identity/v3/users/5297f5c6b03d4f1bbcbf7738d6318cb1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:38.300060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:38.300704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:38.301166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:38.323161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:38.324796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:38.454015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3869/7752] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:38.464073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:38.466843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:38.582724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb900a-5823-4b6b-86f1-4e78b12fd885 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:38.590393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf75270-0f87-4a71-b3b0-de11b3fe46ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:38.591174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75270-0f87-4a71-b3b0-de11b3fe46ff service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:38.591706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75270-0f87-4a71-b3b0-de11b3fe46ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:38.592175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf75270-0f87-4a71-b3b0-de11b3fe46ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:38.607150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75270-0f87-4a71-b3b0-de11b3fe46ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:38.608677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf75270-0f87-4a71-b3b0-de11b3fe46ff service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:38.635158 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3884/7753] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:39.209914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:39.212705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:39.247797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b0f24-dc49-492b-a978-1ec5dc22cfe3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:39.289502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:39.292486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.292807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.293122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] PATH_INFO: `/v3/projects/7997c3057b00437d9ba18a08405aba8b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.297550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7997c3057b00437d9ba18a08405aba8b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:39.302558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:39.434970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7997c3057b00437d9ba18a08405aba8b', 'request_id': 'req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.455690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7997c3057b00437d9ba18a08405aba8b', 'request_id': 'req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.465237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7997c3057b00437d9ba18a08405aba8b', 'request_id': 'req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.487358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] The token cache is being invalidate because project 7997c3057b00437d9ba18a08405aba8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:39.487826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.488735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.490865 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3870/7754] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:39 2022] DELETE /identity/v3/projects/7997c3057b00437d9ba18a08405aba8b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:39.495967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3acc86-181e-4a94-bb91-49f906318a2b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.496422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3acc86-181e-4a94-bb91-49f906318a2b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.496533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3acc86-181e-4a94-bb91-49f906318a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.522619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9e3acc86-181e-4a94-bb91-49f906318a2b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:39.524483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e3acc86-181e-4a94-bb91-49f906318a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:39.576028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:39.609572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:39.612210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:39.673554 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3885/7755] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:39.675780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.676080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.676529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.715790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:39.717355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:39.728729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3886/7756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:39.734126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:39.746408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d64bb-0455-46d3-bf91-c608a35124d9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:39.752722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:39.753498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.753907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.754294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.755680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:39.756097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:39.758829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:39.778063 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3887/7757] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:02:39.790556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:39.815111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d2b69-2a15-422e-85ed-cd9dab6d50cf admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:39.818527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fcbdb-eac2-4eab-8d31-d89a25fafc05 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:39.825005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:39.826182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.826803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.827395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] PATH_INFO: `/v3/users/99484ade555448d68756f81a9c8475d3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.829424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:39.830128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.830383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.830662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.831219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:39.831929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99484ade555448d68756f81a9c8475d3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:39.833148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:39.834936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:39.852085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:39.885600 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3888/7758] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:39 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:39.890436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:39.933473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99484ade555448d68756f81a9c8475d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.959398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99484ade555448d68756f81a9c8475d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.964402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99484ade555448d68756f81a9c8475d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.969474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaed00f-7a60-46c0-8d1f-a4728fccf21f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:39.976324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:39.977225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:39.977516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:39.977802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:39.978442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:39.980670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99484ade555448d68756f81a9c8475d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.981565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-08fe8975-e0ca-4e5c-803b-5a8a0dff077c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99484ade555448d68756f81a9c8475d3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:39.981925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:40.008326 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3871/7759] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:39 2022] DELETE /identity/v3/users/99484ade555448d68756f81a9c8475d3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:40.014674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.015230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.015333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3889/7760] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:39 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:02:40.015754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.016231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:40.019281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:40.032368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f62c87-78dd-4cdd-9775-caa42a3c85d2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:40.068377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:40.070720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:40.110490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:40.111532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.111960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.112439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.113878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:40.116112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:40.133107 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3890/7761] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:40.134276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:40.159135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515b86b-ae8c-4bc4-aad5-7bff335386ae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:40.172523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:40.173370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.173634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.173982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.174735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:40.180656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:40.188377 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3872/7762] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:40.198848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:40.202417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:40.216278 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3891/7763] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:40.224341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:40.281071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:40.287453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be7e05-db86-4348-9550-80e603f39da0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:40.304358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:40.305204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.305484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.305768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] PATH_INFO: `/v3/projects/b5d030cdecb447139fdb17cbce9f4712/users/ef6db24e596a467c9ce35dc0bb7702c7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.306630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a33c32-7537-4cf2-94e9-ecd4eebf7d65 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:40.311770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe731a-7664-45ab-a3c5-711a41d6adc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:40.312516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe731a-7664-45ab-a3c5-711a41d6adc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.312909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe731a-7664-45ab-a3c5-711a41d6adc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.313319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe731a-7664-45ab-a3c5-711a41d6adc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.335296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d030cdecb447139fdb17cbce9f4712, user_id=ef6db24e596a467c9ce35dc0bb7702c7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:40.339284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:40.339436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe731a-7664-45ab-a3c5-711a41d6adc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:40.340935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe731a-7664-45ab-a3c5-711a41d6adc1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:40.355461 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3873/7764] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:02:40.400359 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3892/7765] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:40 2022] PUT /identity/v3/projects/b5d030cdecb447139fdb17cbce9f4712/users/ef6db24e596a467c9ce35dc0bb7702c7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:40.411656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.411972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.412237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.464770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] MFA Rules not processed for user `ef6db24e596a467c9ce35dc0bb7702c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:40.468093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:40.529138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:40.657942 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3874/7766] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:40.678938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:40.681881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:40.792575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:40.795518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:40.848042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d76d2-5af0-45f2-ab1c-4a416098f9ed admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:40.853298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4ddc0-f3e2-4d10-afe2-1d0cdb9496b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:40.862965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4ddc0-f3e2-4d10-afe2-1d0cdb9496b5 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.862965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4ddc0-f3e2-4d10-afe2-1d0cdb9496b5 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.862965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4ddc0-f3e2-4d10-afe2-1d0cdb9496b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.877713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4ddc0-f3e2-4d10-afe2-1d0cdb9496b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:40.879425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4ddc0-f3e2-4d10-afe2-1d0cdb9496b5 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:40.899512 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3893/7767] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:40.937172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba05af8-bb11-4992-a968-c393428f96f6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:40.942935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:40.943626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:40.943889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:40.944172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] PATH_INFO: `/v3/projects/573d47b68fcf4a34ad72fe3f25765b8c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:40.945531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573d47b68fcf4a34ad72fe3f25765b8c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:40.948169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.075854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573d47b68fcf4a34ad72fe3f25765b8c', 'request_id': 'req-3f3b95d9-4b15-46c4-b1f2-cac424df6763'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:41.104664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573d47b68fcf4a34ad72fe3f25765b8c', 'request_id': 'req-3f3b95d9-4b15-46c4-b1f2-cac424df6763'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:41.112733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573d47b68fcf4a34ad72fe3f25765b8c', 'request_id': 'req-3f3b95d9-4b15-46c4-b1f2-cac424df6763'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:41.137856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] The token cache is being invalidate because project 573d47b68fcf4a34ad72fe3f25765b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:41.138151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:41.138829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3f3b95d9-4b15-46c4-b1f2-cac424df6763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:41.140699 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3875/7768] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:40 2022] DELETE /identity/v3/projects/573d47b68fcf4a34ad72fe3f25765b8c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:41.145888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.146457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.147095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.181431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:41.183431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:41.306017 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3894/7769] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:41.314668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.315394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.315681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.346821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:41.349257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:41.366598 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3876/7770] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:41.368126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:41.395816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b51f7f-f4f1-4070-92c7-32f1a1588565 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:41.402790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:41.403817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.404895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.405215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.406245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:41.406245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:41.408087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.428633 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3895/7771] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:02:41.429888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:41.444411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6d1d-4210-4876-966e-ecad6b6b26a9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:41.452484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:41.454042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.454325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.454651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.455380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:41.457714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.537683 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3877/7772] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:41 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:41.541916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:41.552578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9972b37-92eb-4c5e-936e-ec8cda15bd57 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:41.709270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:41.709966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.710327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.710679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.711393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:41.714104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.723773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:41.740408 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3896/7773] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:41 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:41.745123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:41.756426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2ee7-5234-4601-9e72-1feca8c3f605 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:41.763087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:41.763087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.763488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.763840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.764655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:41.766513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.779146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3878/7774] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:41.783212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:41.807363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f861424-0c28-479a-9fae-1f425c3210c1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:41.844496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c074a-a371-4c32-b0ce-452ef15f9549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:41.845292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c074a-a371-4c32-b0ce-452ef15f9549 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.845665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c074a-a371-4c32-b0ce-452ef15f9549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.846041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c074a-a371-4c32-b0ce-452ef15f9549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.846878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c074a-a371-4c32-b0ce-452ef15f9549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:41.848611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c074a-a371-4c32-b0ce-452ef15f9549 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.864696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3897/7775] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:41.868489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:41.885212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443430f-303b-4e6e-aa62-dbf6432b519a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:41.890881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:41.891795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:41.892224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:41.892644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] PATH_INFO: `/v3/projects/d18ea060efe4478d80523ecc5fce6a55/users/24984af8f467496c8ef9c5a8d5508f50/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:41.948652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:41.957159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18ea060efe4478d80523ecc5fce6a55, user_id=24984af8f467496c8ef9c5a8d5508f50, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:41.968509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:41.999123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3879/7776] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:41 2022] PUT /identity/v3/projects/d18ea060efe4478d80523ecc5fce6a55/users/24984af8f467496c8ef9c5a8d5508f50/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:42.009231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:42.009529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:42.010767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:42.077623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] MFA Rules not processed for user `24984af8f467496c8ef9c5a8d5508f50`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:42.078856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:42.278157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3898/7777] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:42.290082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:42.293128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:42.403201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2d40-1cec-4fea-9585-176d8a418829 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:42.411194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b486c-6bbe-49bf-a485-2173515af132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:42.411786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b486c-6bbe-49bf-a485-2173515af132 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:42.412339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b486c-6bbe-49bf-a485-2173515af132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:42.412339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b486c-6bbe-49bf-a485-2173515af132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:42.427209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b486c-6bbe-49bf-a485-2173515af132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:42.428751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b486c-6bbe-49bf-a485-2173515af132 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:42.448008 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3880/7778] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:42.948575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:43.039724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d08fe4-798d-4266-8f63-02c1982ede30 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:43.049246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:43.050038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:43.050329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:43.050614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] PATH_INFO: `/v3/users/24984af8f467496c8ef9c5a8d5508f50` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:43.052001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24984af8f467496c8ef9c5a8d5508f50)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:43.054212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:43.132841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24984af8f467496c8ef9c5a8d5508f50'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.153034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24984af8f467496c8ef9c5a8d5508f50'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.154101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24984af8f467496c8ef9c5a8d5508f50'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.164220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24984af8f467496c8ef9c5a8d5508f50'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.164891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24984af8f467496c8ef9c5a8d5508f50'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.167219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:43.185252 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3899/7779] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:42 2022] DELETE /identity/v3/users/24984af8f467496c8ef9c5a8d5508f50 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:43.188403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:43.189426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:43.189929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:43.219135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:43.220961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:43.296327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3881/7780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:43.316694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:43.318414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:43.423524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5364f4-8faa-4dda-8d7c-d001e1c9a11e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:43.438832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc7ce5-60b0-47cf-a825-4c3e7519a4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:43.440251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc7ce5-60b0-47cf-a825-4c3e7519a4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:43.441546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc7ce5-60b0-47cf-a825-4c3e7519a4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:43.441916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc7ce5-60b0-47cf-a825-4c3e7519a4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:43.491794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc7ce5-60b0-47cf-a825-4c3e7519a4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:43.493430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc7ce5-60b0-47cf-a825-4c3e7519a4f7 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:43.506532 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3900/7781] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:43.855510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:43.858005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:43.884195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db71bf-5fdd-4a98-87a6-50a58293bfdd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:43.890050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:43.890857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:43.891340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:43.891938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] PATH_INFO: `/v3/projects/d18ea060efe4478d80523ecc5fce6a55` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:43.893795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18ea060efe4478d80523ecc5fce6a55)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:43.895836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:43.952046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18ea060efe4478d80523ecc5fce6a55', 'request_id': 'req-a9206720-b4a9-480b-b1eb-153c45464352'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.965717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18ea060efe4478d80523ecc5fce6a55', 'request_id': 'req-a9206720-b4a9-480b-b1eb-153c45464352'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.973369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18ea060efe4478d80523ecc5fce6a55', 'request_id': 'req-a9206720-b4a9-480b-b1eb-153c45464352'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.988953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] The token cache is being invalidate because project d18ea060efe4478d80523ecc5fce6a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:43.989429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.990852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a9206720-b4a9-480b-b1eb-153c45464352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:43.993514 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3882/7782] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:43 2022] DELETE /identity/v3/projects/d18ea060efe4478d80523ecc5fce6a55 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:43.998641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:43.999165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:43.999240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.027343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:44.028565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:44.122885 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3901/7783] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:44.130415 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.130711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.130992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.153374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:44.154980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:44.168641 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3883/7784] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:44.169174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.179691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f085-6fa3-4ad1-a71a-7e64485ae90b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:44.192444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:44.192444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.192444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.192444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.193934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:44.193934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:44.193934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:44.210018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3902/7785] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:02:44.214839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.224365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a5722-7aae-4566-921c-f78bd706c376 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:44.230154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:44.230770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.231045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.231380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.231978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:44.233948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:44.242764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:44.271656 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3884/7786] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:44 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:02:44.276080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.287273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9aae-9b80-4319-b5cf-87e8bbf5d27c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:44.371062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:44.371701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.371992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.372301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.372987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:44.374923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:44.406214 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3903/7787] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:44 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:44.411892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.428884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fee06-552b-4b88-9e1b-b3767fd72a94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:44.434507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:44.435210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.435759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.436043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.437143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:44.446291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:44.461891 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3885/7788] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:44.466170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.479000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc00dd4-1e83-46e7-b6d1-3f6b1d21d077 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:44.493453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436b3d-1c39-47f2-8348-7918d138afad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:44.495417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436b3d-1c39-47f2-8348-7918d138afad admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.496437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436b3d-1c39-47f2-8348-7918d138afad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.496871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436b3d-1c39-47f2-8348-7918d138afad admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.498334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436b3d-1c39-47f2-8348-7918d138afad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:44.500582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436b3d-1c39-47f2-8348-7918d138afad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:44.506555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:44.525100 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3904/7789] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:02:44.536456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.551098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931af2-04c7-4331-82c2-76d640409547 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:44.556885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:44.557780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.558179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.558534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] PATH_INFO: `/v3/projects/f693260232344a848d106cef1f283b46/users/8f74e642c455431b9a78e201b722f390/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.578974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f693260232344a848d106cef1f283b46, user_id=8f74e642c455431b9a78e201b722f390, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:44.582172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:44.617116 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3886/7790] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:44 2022] PUT /identity/v3/projects/f693260232344a848d106cef1f283b46/users/8f74e642c455431b9a78e201b722f390/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:44.622184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:44.623121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:44.623539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:44.692146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] MFA Rules not processed for user `8f74e642c455431b9a78e201b722f390`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:44.693535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:44.817476 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3905/7791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:44.830389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.845837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:44.899229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:44.900702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:45.009265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3fb78-dc65-468e-9c3e-d9cd30fa8d51 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:45.014738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:45.016801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:45.017239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:45.017527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:45.054363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:45.061213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:45.067606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739a26a-b47d-4158-9d53-5b08cc548401 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:45.075347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:45.076346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:45.076944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:45.077538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:45.079648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:45.086164 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3887/7792] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:45.105747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:45.223173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c8a7-348d-4c2c-b78c-feda1e294b3d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:45.231458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:45.232464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:45.232787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:45.233103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] PATH_INFO: `/v3/users/8f74e642c455431b9a78e201b722f390` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:45.234535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f74e642c455431b9a78e201b722f390)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:45.235598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:45.236585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:45.239196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce5787-b29b-4867-91a6-142cc8c8c4d4 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:45.268135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3906/7793] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:02:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:02:45.320725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f74e642c455431b9a78e201b722f390'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:45.329475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:45.336682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f74e642c455431b9a78e201b722f390'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:45.337619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f74e642c455431b9a78e201b722f390'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:45.353018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f74e642c455431b9a78e201b722f390'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:45.354405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f74e642c455431b9a78e201b722f390'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:45.372793 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3888/7794] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:02:45 2022] DELETE /identity/v3/users/8f74e642c455431b9a78e201b722f390 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:02:45.375011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:45.375555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:45.375996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:45.404725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:45.406848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:45.423134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:45.533123 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3907/7795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:45.552128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:45.554096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:45.706435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908d33-faa4-4251-88ee-6efb5b39ab30 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:45.710539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82949f76-ee12-48d7-8fe1-720c70daa7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:45.711502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82949f76-ee12-48d7-8fe1-720c70daa7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:45.712135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82949f76-ee12-48d7-8fe1-720c70daa7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:45.713323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82949f76-ee12-48d7-8fe1-720c70daa7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:45.725225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82949f76-ee12-48d7-8fe1-720c70daa7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:45.727088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82949f76-ee12-48d7-8fe1-720c70daa7f5 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:45.741976 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3889/7796] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:46.290374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:46.303880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:46.334944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c060d3-5e6e-40e5-bb35-ecc2db90b11d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:46.366753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:46.367507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:46.367775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:46.368003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] PATH_INFO: `/v3/projects/f693260232344a848d106cef1f283b46` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:46.372411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f693260232344a848d106cef1f283b46)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:46.376125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:46.478575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f693260232344a848d106cef1f283b46', 'request_id': 'req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:46.492289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f693260232344a848d106cef1f283b46', 'request_id': 'req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:46.501983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f693260232344a848d106cef1f283b46', 'request_id': 'req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:46.524526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] The token cache is being invalidate because project f693260232344a848d106cef1f283b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:02:46.524919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:46.526509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-cb74dcbc-525c-4b79-b31b-b1a40f72e2ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:02:46.528478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3908/7797] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:02:46 2022] DELETE /identity/v3/projects/f693260232344a848d106cef1f283b46 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:46.533537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:46.533996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:46.534069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:46.565872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:46.568079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:46.680834 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3890/7798] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:46.689707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:46.690153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:46.690433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:46.733813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:46.735387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:46.745337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3909/7799] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:02:46.749165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:46.761481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f06f5-b6a4-4725-a233-ad548ab990b0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:46.766678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:46.768531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:46.768628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:46.768835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:46.769595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:02:46.770368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:46.776064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:46.807196 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3891/7800] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:02:46.811504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:46.823013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f1b68-0839-4a73-8914-cf88b36301b9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:46.831522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:46.835145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:46.835931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:46.836513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:46.837527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:46.840954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:46.893081 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3910/7801] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:46 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:46.895092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:46.908527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f70ee7-edb1-4e28-8aeb-0c1a689870d7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:47.124798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:47.125498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:47.125837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:47.126050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:47.126708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:47.128643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:47.147476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:47.180495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3892/7802] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:46 2022] POST /identity/v3/users => generated 285 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:47.185226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:47.203623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693809f-2750-4710-a19a-038ae9e142ad admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:47.221628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:47.225088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:47.225448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:47.225769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:47.226504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:47.228453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:47.246702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:47.248143 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3911/7803] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:47.264880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e53db4-8a06-499c-86e3-e604945695ca admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:47.276759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f5db1-fdc3-451b-963d-95e5564468d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:47.277376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f5db1-fdc3-451b-963d-95e5564468d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:47.277730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f5db1-fdc3-451b-963d-95e5564468d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:47.278082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f5db1-fdc3-451b-963d-95e5564468d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:47.278806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f5db1-fdc3-451b-963d-95e5564468d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:47.280502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f5db1-fdc3-451b-963d-95e5564468d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:47.299065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3893/7804] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:47.299878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:47.313553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bb68f-a609-4cd5-b58a-c1996f9eefcd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:47.319835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:47.320803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:47.321416 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:47.321905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] PATH_INFO: `/v3/projects/39f74a8793534ac2ad971add33935677/users/934bc07f41754aeabb89c32907a2ca44/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:47.344068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f74a8793534ac2ad971add33935677, user_id=934bc07f41754aeabb89c32907a2ca44, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:47.347871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:47.378770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:47.379059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:47.379338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:47.379629 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3912/7805] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:47 2022] PUT /identity/v3/projects/39f74a8793534ac2ad971add33935677/users/934bc07f41754aeabb89c32907a2ca44/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:02:47.451949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] MFA Rules not processed for user `934bc07f41754aeabb89c32907a2ca44`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:47.456244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:47.688980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3894/7806] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:47.691724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:47.767788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:47.816963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308f737-07c0-4911-88db-c8b91e1f8eb2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:47.825130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:47.825968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:47.826512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:47.826978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:47.829115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:47.832234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:47.874979 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3913/7807] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:02:47 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:47.880635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:47.894831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f35a7-05f7-4766-871a-fb26c42a0a22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:48.030118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:48.033817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.034110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.034391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.035056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:48.065624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:48.118456 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3895/7808] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:02:47 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:02:48.124812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:48.144635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ed55-4f79-4ecd-a355-076026f4e651 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:48.156016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:48.159498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.160236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.161088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.162700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:48.168038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:48.192958 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3914/7809] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:02:48.196795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:48.215823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c6e55-46fe-4a87-b2cb-f8884e6c7119 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:48.224507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:48.225398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.225784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.226164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] PATH_INFO: `/v3/projects/8bbdea89f41c4c58b67daa26ab882829/users/3b6c3a5b1eb04900951dc1b218bbf1eb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.258585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbdea89f41c4c58b67daa26ab882829, user_id=3b6c3a5b1eb04900951dc1b218bbf1eb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:48.263387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:48.292824 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3896/7810] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:48 2022] PUT /identity/v3/projects/8bbdea89f41c4c58b67daa26ab882829/users/3b6c3a5b1eb04900951dc1b218bbf1eb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:48.297429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:48.313565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27319100-3d4a-41ae-8a78-931407e4bc53 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:48.428430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b1f3e-10bf-42f8-9770-56f29bea870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:48.429749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1f3e-10bf-42f8-9770-56f29bea870c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.430808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1f3e-10bf-42f8-9770-56f29bea870c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.432426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1f3e-10bf-42f8-9770-56f29bea870c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.433383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b1f3e-10bf-42f8-9770-56f29bea870c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:48.437977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b1f3e-10bf-42f8-9770-56f29bea870c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:48.462300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:48.463735 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3915/7811] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:02:48.479051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc673-4ec2-4d97-a6d3-4ac2780b9066 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:48.500949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:48.501329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.501690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.501984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] PATH_INFO: `/v3/projects/8bbdea89f41c4c58b67daa26ab882829/users/3b6c3a5b1eb04900951dc1b218bbf1eb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.504442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbdea89f41c4c58b67daa26ab882829, user_id=3b6c3a5b1eb04900951dc1b218bbf1eb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:48.507447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:48.528437 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3897/7812] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:02:48 2022] PUT /identity/v3/projects/8bbdea89f41c4c58b67daa26ab882829/users/3b6c3a5b1eb04900951dc1b218bbf1eb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:02:48.537452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.538137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.538592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.592234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] MFA Rules not processed for user `3b6c3a5b1eb04900951dc1b218bbf1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:48.593573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:48.749445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3916/7813] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:48.761966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:48.766137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:48.825732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:48.928936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed458ee1-30a1-4606-853a-e68fb4ab5665 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:48.940919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeca04d-2202-4378-a803-d9058c607254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:48.941755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeca04d-2202-4378-a803-d9058c607254 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:48.942112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeca04d-2202-4378-a803-d9058c607254 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:48.942904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeca04d-2202-4378-a803-d9058c607254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:48.972163 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeca04d-2202-4378-a803-d9058c607254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:48.975296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeca04d-2202-4378-a803-d9058c607254 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:48.994961 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3898/7814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:49.179609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:49.199955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252a05-c813-4e90-8fd2-e2d510cf8e9d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:49.211731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:49.212475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:49.213575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:49.213920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:49.320073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:02:49.360114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:49.362066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:49.389004 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3917/7815] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:02:54.975477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63eac-3a34-4185-9130-61167e70ca87 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:54.977134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63eac-3a34-4185-9130-61167e70ca87 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:54.977284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f63eac-3a34-4185-9130-61167e70ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:55.010838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-95f63eac-3a34-4185-9130-61167e70ca87 None None] MFA Rules not processed for user `329523b6f089401face7b477d08ca7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:02:55.013036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-95f63eac-3a34-4185-9130-61167e70ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:55.143195 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3899/7816] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:02:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:02:56.103993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:02:56.106337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:56.201036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323289b-5e32-48b0-ad5e-17cc13f09568 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:02:56.215946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:02:56.218874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:02:56.219365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:02:56.222303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:02:56.230602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:02:56.255393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:02:56.258172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:02:56.280571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3918/7817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:02:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:00.390339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:00.390835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:00.391141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:00.438144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] MFA Rules not processed for user `67c2b26730184ce58b866e37ebe43794`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:00.439490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:00.713765 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3900/7818] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:06.269005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=40 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:10.361313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:10.364285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:10.581139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f73dd1-e5de-422b-b9a7-1ffb435d9323 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:10.594459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:10.598447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:10.598870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:10.600001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:10.607566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:10.640250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:10.642114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3c555-801d-40ec-8156-00250e4dea0b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:10.677532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=69 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:10.725265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3919/7819] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:17.818057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:17.820319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:18.003819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119c0ec-57c6-42cc-8c9b-441da774a0b2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:18.027242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:18.028727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:18.029918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:18.032454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] PATH_INFO: `/v3/users/ef6db24e596a467c9ce35dc0bb7702c7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:18.036737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6db24e596a467c9ce35dc0bb7702c7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:18.044515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:18.158006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6db24e596a467c9ce35dc0bb7702c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:18.178217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6db24e596a467c9ce35dc0bb7702c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:18.178977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6db24e596a467c9ce35dc0bb7702c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:18.190058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6db24e596a467c9ce35dc0bb7702c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:18.190769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6db24e596a467c9ce35dc0bb7702c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:18.208788 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3901/7820] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:03:17 2022] DELETE /identity/v3/users/ef6db24e596a467c9ce35dc0bb7702c7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:18.216329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:18.216782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:18.216870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:18.255098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:18.256454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:18.427244 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3920/7821] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:18.438175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:18.439642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:18.576446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7ca9c-fdff-42ab-85ca-82f95b8f749c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:18.585468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0b780-cd8c-47be-8170-24f04cfc2c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:18.586106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0b780-cd8c-47be-8170-24f04cfc2c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:18.586396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0b780-cd8c-47be-8170-24f04cfc2c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:18.586671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0b780-cd8c-47be-8170-24f04cfc2c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:18.615807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0b780-cd8c-47be-8170-24f04cfc2c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:18.617375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0b780-cd8c-47be-8170-24f04cfc2c50 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:18.645552 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3902/7822] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:19.121434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:19.122997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:19.148332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84f2e2-b833-49e9-8463-9ac65d1f397d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:19.163918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:19.165085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.167264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.167790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] PATH_INFO: `/v3/projects/b5d030cdecb447139fdb17cbce9f4712` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.169253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d030cdecb447139fdb17cbce9f4712)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:19.184027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:19.295556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d030cdecb447139fdb17cbce9f4712', 'request_id': 'req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:19.315460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d030cdecb447139fdb17cbce9f4712', 'request_id': 'req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:19.327439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d030cdecb447139fdb17cbce9f4712', 'request_id': 'req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:19.352307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] The token cache is being invalidate because project b5d030cdecb447139fdb17cbce9f4712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:03:19.353644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:19.357041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0deb0298-5aca-48ce-963c-3cc12bbfa2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:19.360746 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3921/7823] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:03:19 2022] DELETE /identity/v3/projects/b5d030cdecb447139fdb17cbce9f4712 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:19.365400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.366829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.367318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.408636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:19.410231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:19.451711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:19.547985 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3903/7824] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:19.563573 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.563971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.564349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.596429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:19.597695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:19.610813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3922/7825] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:19.611943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:19.623453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be310d-8b91-410c-b91c-da5ab28d9ddf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:19.630984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:19.631759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.632141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.632514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.633339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:03:19.633785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:19.637012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:19.666011 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3904/7826] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:03:19.670352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:19.674898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:19.682073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5d5a-e2ee-46c6-b40f-96fc287ae31f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:19.689904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:19.690796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.691297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.691797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.692988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:19.695598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:19.740773 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3923/7827] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:03:19 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:19.744850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:19.756696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36c515-bde6-489f-a2fa-99816e5728ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:19.847150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:19.847860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.848208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.848505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.849771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:19.852456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:19.899505 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3905/7828] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:03:19 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:19.900628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:19.914607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5548ce6-3c20-4c82-90b7-27a658e59ba7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:19.927710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:19.930263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.932239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.933207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.937028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:19.941162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:19.967651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3924/7829] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:03:19.968926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:19.980742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaae9c-4210-445a-9662-4cf003b1c0ea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:19.986258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00cf0c-5883-4312-9ce3-2b75de42206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:19.986876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00cf0c-5883-4312-9ce3-2b75de42206d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:19.987158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00cf0c-5883-4312-9ce3-2b75de42206d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:19.987434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00cf0c-5883-4312-9ce3-2b75de42206d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:19.988085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00cf0c-5883-4312-9ce3-2b75de42206d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:19.990140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00cf0c-5883-4312-9ce3-2b75de42206d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.005704 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3906/7830] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:20.010227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:20.028347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f235-8286-4ea2-8ab4-9dbc2bc95b5e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:20.041602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:20.042302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.042587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.042867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] PATH_INFO: `/v3/projects/7e5fb040fd484396b0d52e130dd39459/users/493e478631494374bb29c459eaf4e286/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.060954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5fb040fd484396b0d52e130dd39459, user_id=493e478631494374bb29c459eaf4e286, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:20.063482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.096403 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3925/7831] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:20 2022] PUT /identity/v3/projects/7e5fb040fd484396b0d52e130dd39459/users/493e478631494374bb29c459eaf4e286/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:03:20.109004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.109004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.109004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.194356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] MFA Rules not processed for user `493e478631494374bb29c459eaf4e286`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:20.195888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:20.328102 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3907/7832] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:03:20.330702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:20.562436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf3f6-bf70-4981-b25c-63307e671089 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:20.577839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:20.578837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.579330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.579769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.580428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:20.583325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.623144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3926/7833] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:03:20 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:20.626258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:20.638455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8bd03-3edc-41e6-95c7-9c0738043143 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:20.654256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:20.727733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:20.729115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.730060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.730424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.731333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:20.733964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.769220 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3908/7834] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:03:20 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:20.770553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:20.783934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e372d5-a739-4b72-ab42-870729235629 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:20.789411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:20.790181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.791162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.791439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.792099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:20.794662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.813487 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3927/7835] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:20.815816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:20.832608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3174-74f2-449b-82e8-916bd490bc8f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:20.842880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760f998-ecbb-4263-ba0e-c25e9275145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:20.843610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760f998-ecbb-4263-ba0e-c25e9275145a admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.844045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760f998-ecbb-4263-ba0e-c25e9275145a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.844332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760f998-ecbb-4263-ba0e-c25e9275145a admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.845145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760f998-ecbb-4263-ba0e-c25e9275145a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:20.846916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760f998-ecbb-4263-ba0e-c25e9275145a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.859999 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3909/7836] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:20.863740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:20.878736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570a989-be0a-44d7-ba1e-2f6f3da9ab0d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:20.886106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:20.887744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.888241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.888447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] PATH_INFO: `/v3/projects/e78801b0c46a4e1da7301a8c4a150e1c/users/f2ab4426b34944f6a758e04d42443ca1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.920928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78801b0c46a4e1da7301a8c4a150e1c, user_id=f2ab4426b34944f6a758e04d42443ca1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:20.925701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:20.943325 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3928/7837] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:20 2022] PUT /identity/v3/projects/e78801b0c46a4e1da7301a8c4a150e1c/users/f2ab4426b34944f6a758e04d42443ca1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:03:20.953782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:20.954073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:20.954357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:20.987235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] MFA Rules not processed for user `f2ab4426b34944f6a758e04d42443ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:20.988648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:21.094579 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3910/7838] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:21.099024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:21.228231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:21.237921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa196d-7fe0-4244-9fa3-ad49911e1a48 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:21.243703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:21.244568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:21.244861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:21.245163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:21.246211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:21.248429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:21.317111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:21.317875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3929/7839] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:03:21 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:21.339365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a638ca-90de-4c19-bc76-82776c4d0ab2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:21.443523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:21.444549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:21.444856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:21.445282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:21.445924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:21.448664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:21.489440 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3911/7840] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:03:21 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:21.493528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:21.504664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a0551-4c34-4aaf-8aab-04ead83d6d89 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:21.531600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:21.532236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:21.532521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:21.538003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:21.541172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:21.543184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:21.575078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:21.581075 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3930/7841] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:21.601963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21866f-db3f-4c63-9944-d34962f1c45d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:21.611261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:21.611973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:21.612260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:21.612544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] PATH_INFO: `/v3/projects/2aabfc9c0cf04163b30272077fef5c1b/users/6a0239350b5b42e4be11e2487e4b9358/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:21.657515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:21.670480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aabfc9c0cf04163b30272077fef5c1b, user_id=6a0239350b5b42e4be11e2487e4b9358, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:21.672588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:21.713572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:21.714463 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3912/7842] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:21 2022] PUT /identity/v3/projects/2aabfc9c0cf04163b30272077fef5c1b/users/6a0239350b5b42e4be11e2487e4b9358/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:21.730941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2d693-39b1-49d6-b3d1-bad351c3f93e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:21.927990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7de66-a3a4-429a-9dc9-c63d24dcfa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:21.928768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7de66-a3a4-429a-9dc9-c63d24dcfa46 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:21.929083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7de66-a3a4-429a-9dc9-c63d24dcfa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:21.929361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7de66-a3a4-429a-9dc9-c63d24dcfa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:21.930039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7de66-a3a4-429a-9dc9-c63d24dcfa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:21.931754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7de66-a3a4-429a-9dc9-c63d24dcfa46 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:21.967589 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3931/7843] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:21.974247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:21.988639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269bf7b-13d0-45f0-bd2d-c1e331563b2f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:21.995739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:21.996791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:21.997011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:21.997314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] PATH_INFO: `/v3/projects/2aabfc9c0cf04163b30272077fef5c1b/users/6a0239350b5b42e4be11e2487e4b9358/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:21.999497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aabfc9c0cf04163b30272077fef5c1b, user_id=6a0239350b5b42e4be11e2487e4b9358, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:22.002848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:22.036256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:22.036256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:22.036536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:22.039768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3913/7844] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:21 2022] PUT /identity/v3/projects/2aabfc9c0cf04163b30272077fef5c1b/users/6a0239350b5b42e4be11e2487e4b9358/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:22.071254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] MFA Rules not processed for user `6a0239350b5b42e4be11e2487e4b9358`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:22.073459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:22.189431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3932/7845] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:22.203335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:22.206427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:22.320848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf19ffd-90fa-48c4-a200-c495c20026da admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:22.326908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:22.327537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:22.327864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:22.328089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:22.445553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:22.447139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:22.458168 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3914/7846] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:24.996108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:24.997617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:25.097197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:25.121987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba57eb4-8a05-4d79-9c75-087c72e94301 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:25.128562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:25.129386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:25.129783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:25.130183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] PATH_INFO: `/v3/users/12d0128e850f4f22a2172800c44074a4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:25.131625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d0128e850f4f22a2172800c44074a4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:25.133661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:25.198997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d0128e850f4f22a2172800c44074a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:25.217234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d0128e850f4f22a2172800c44074a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:25.219021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d0128e850f4f22a2172800c44074a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:25.254977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d0128e850f4f22a2172800c44074a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:25.257535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d0128e850f4f22a2172800c44074a4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:25.282760 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3933/7847] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:03:24 2022] DELETE /identity/v3/users/12d0128e850f4f22a2172800c44074a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:25.388660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:25.390483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:25.510883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b327c86-7c1b-449e-bc6d-5434e000361f service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:25.520196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:25.522248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:25.579717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:25.584750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:25.585809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:25.586284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:25.586907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:25.589148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:25.626802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebcd2e-40bb-4c54-864e-c34e298947be admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:25.637736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:25.640747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:25.641068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:25.642848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:25.649678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:25.730868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:25.731727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:25.745192 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3915/7848] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:25.745847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:25.749122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:25.762363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:25.765884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdddd0-a4d2-4bb1-a20c-2920210e2d68 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:25.781308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3934/7849] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:03:25.879451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54354d7b-966d-48b6-b494-2c1ac26e130c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:25.888470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:25.889374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:25.889745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:25.890023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] PATH_INFO: `/v3/projects/f477959bd24b4db881b62dab54861aa5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:25.893038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f477959bd24b4db881b62dab54861aa5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:25.895771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:25.978989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f477959bd24b4db881b62dab54861aa5', 'request_id': 'req-29a7baaf-e325-4b88-84a5-317a464240d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:25.991785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f477959bd24b4db881b62dab54861aa5', 'request_id': 'req-29a7baaf-e325-4b88-84a5-317a464240d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:26.009892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f477959bd24b4db881b62dab54861aa5', 'request_id': 'req-29a7baaf-e325-4b88-84a5-317a464240d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:26.042038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] The token cache is being invalidate because project f477959bd24b4db881b62dab54861aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:03:26.042466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:26.043861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29a7baaf-e325-4b88-84a5-317a464240d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:26.049299 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3916/7850] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:03:25 2022] DELETE /identity/v3/projects/f477959bd24b4db881b62dab54861aa5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:26.054074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.054549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.054704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.104731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:26.106252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:26.163257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:26.312649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3935/7851] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:26.320267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.320587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.321034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.343866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:26.345376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:26.354458 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3917/7852] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:26.361698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:26.389329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d792ae7-a07c-46d9-9b33-9fa1666ede78 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:26.404123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:26.404788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.405137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.405415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.409334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:03:26.409913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:26.415028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:26.432965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3936/7853] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:03:26.438054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:26.454439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892e10-d5a0-4fb5-995c-2c6ff71b6d4a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:26.468579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:26.469607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.470101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.470527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.472468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:26.475275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:26.521005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:26.546845 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3918/7854] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:03:26 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:26.551696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:26.568590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dd6dd-ce07-4038-8ad4-9e85149ba34a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:26.802023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:26.803824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:26.827208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:26.839313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.839615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.839899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.840588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:26.842617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:26.888476 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3937/7855] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:03:26 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:03:26.891306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:26.912367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb839b1-f35b-4773-98a6-707c998b8e2a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:26.923620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:26.924290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.925404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.925695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.926368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:26.929601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:26.952934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c4b1-1e4a-4e20-a813-f4f02ac01c13 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:26.957755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:26.958509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:26.958798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:26.959128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:26.961511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:26.972209 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3938/7856] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:26.973421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:27.008341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc316-4fbe-46f5-8434-6dfbcb591300 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:27.021656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:27.027228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:27.027383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:27.027687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:27.028432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:27.030355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:27.055211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:27.058190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560853b-9fa0-4f6a-9d39-81a65323e64a service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:27.076035 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3939/7857] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:27.076035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:27.077296 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3919/7858] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:03:27.089069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462c39-396f-4dbe-a99f-d01e0eb3497c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:27.108738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:27.109455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:27.109733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:27.110008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] PATH_INFO: `/v3/projects/7b99b6a5b1764f64a68793f37d4f9b96/users/881baf1ede7e4fb5acf65268a81241ad/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:27.152671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b99b6a5b1764f64a68793f37d4f9b96, user_id=881baf1ede7e4fb5acf65268a81241ad, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:27.156779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:27.200220 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3940/7859] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:27 2022] PUT /identity/v3/projects/7b99b6a5b1764f64a68793f37d4f9b96/users/881baf1ede7e4fb5acf65268a81241ad/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:27.204186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:27.204280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:27.204587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:27.283713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:27.284995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:27.411331 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3920/7860] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:27.431811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:27.437690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:27.640275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98b339-adc4-4ec0-b1a3-1d3b2bc7057f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:27.648751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39207491-c7b2-4a46-917f-0066a4947bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:27.652411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207491-c7b2-4a46-917f-0066a4947bfe service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:27.653079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207491-c7b2-4a46-917f-0066a4947bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:27.653665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207491-c7b2-4a46-917f-0066a4947bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:27.668275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39207491-c7b2-4a46-917f-0066a4947bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:27.671249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39207491-c7b2-4a46-917f-0066a4947bfe service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:27.676605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:27.694893 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3941/7861] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:37.402962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=77 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:37.696971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:38.621201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:38.622815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:38.643586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79f69a-ae87-4dbc-8ada-24179d758cee None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:38.685653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:38.686878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:38.687480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:38.688068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] PATH_INFO: `/v3/users/493e478631494374bb29c459eaf4e286` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:38.689792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493e478631494374bb29c459eaf4e286)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:38.691994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:38.802715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493e478631494374bb29c459eaf4e286'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:38.834146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493e478631494374bb29c459eaf4e286'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:38.837682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493e478631494374bb29c459eaf4e286'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:38.858051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493e478631494374bb29c459eaf4e286'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:38.858935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-27ebef79-dd2a-42c7-acee-abd6ec967978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493e478631494374bb29c459eaf4e286'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:38.907974 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3921/7862] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:03:38 2022] DELETE /identity/v3/users/493e478631494374bb29c459eaf4e286 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:38.909278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:38.910061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:38.910484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:38.998658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:39.028032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:39.070733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:39.071174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:39.071568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:39.194099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] MFA Rules not processed for user `881baf1ede7e4fb5acf65268a81241ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:39.195532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:39.224357 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3942/7863] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:39.246209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:39.247498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:39.426754 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3922/7864] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:39.429028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:39.433850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:39.525486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c58d2-29a1-4cbf-a7e8-3ce5c636b840 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:39.542684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:39.543670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:39.544067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:39.544457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:39.567607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:39.569321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:39.588869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:39.598593 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3943/7865] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:39.625930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513a74c-8d7f-48b1-b26e-07ad5d61b530 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:39.633027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:39.634996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:39.635392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:39.635777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:39.658852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:39.660868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:39.685930 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3923/7866] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:40.208080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:40.210157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:40.226998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50fe04-8142-4eeb-8956-55c25b8e78a2 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:40.247599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:40.248312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:40.248594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:40.249045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] PATH_INFO: `/v3/projects/7e5fb040fd484396b0d52e130dd39459` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:40.250207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5fb040fd484396b0d52e130dd39459)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:40.255387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:40.349646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5fb040fd484396b0d52e130dd39459', 'request_id': 'req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.358044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5fb040fd484396b0d52e130dd39459', 'request_id': 'req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.366500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5fb040fd484396b0d52e130dd39459', 'request_id': 'req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.394213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] The token cache is being invalidate because project 7e5fb040fd484396b0d52e130dd39459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:03:40.394525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.399031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.401502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3944/7867] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:03:40 2022] DELETE /identity/v3/projects/7e5fb040fd484396b0d52e130dd39459 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:40.405542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:40.435739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf82172-98ba-4255-9f23-8ec3305a6cbd service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:40.598814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:40.601154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:40.601561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:40.603400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] PATH_INFO: `/v3/users/f2ab4426b34944f6a758e04d42443ca1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:40.606041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ab4426b34944f6a758e04d42443ca1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:40.610745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:40.736706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ab4426b34944f6a758e04d42443ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.776452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ab4426b34944f6a758e04d42443ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.777537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ab4426b34944f6a758e04d42443ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.794857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ab4426b34944f6a758e04d42443ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.799863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ab4426b34944f6a758e04d42443ca1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:40.866133 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3924/7868] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:03:40 2022] DELETE /identity/v3/users/f2ab4426b34944f6a758e04d42443ca1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:41.634516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:41.636122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:41.660054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882f884-e3d9-481e-94bc-e4f3ee9db7e2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:41.711703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:41.799813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:41.806876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:41.813703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:41.814551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] PATH_INFO: `/v3/projects/e78801b0c46a4e1da7301a8c4a150e1c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:41.825090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78801b0c46a4e1da7301a8c4a150e1c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:41.827061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:41.903786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78801b0c46a4e1da7301a8c4a150e1c', 'request_id': 'req-aa635669-f548-4bce-8db4-5b9a0f647875'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:41.913223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78801b0c46a4e1da7301a8c4a150e1c', 'request_id': 'req-aa635669-f548-4bce-8db4-5b9a0f647875'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:41.921987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78801b0c46a4e1da7301a8c4a150e1c', 'request_id': 'req-aa635669-f548-4bce-8db4-5b9a0f647875'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:41.957464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] The token cache is being invalidate because project e78801b0c46a4e1da7301a8c4a150e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:03:41.958402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:41.959890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:41.967547 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3945/7869] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:03:41 2022] DELETE /identity/v3/projects/e78801b0c46a4e1da7301a8c4a150e1c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:41.971582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:41.973117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:41.998154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca71507-58cd-4e8a-b4d1-c54a090542d2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:42.141485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:42.142165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:42.142454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:42.142731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] PATH_INFO: `/v3/users/6a0239350b5b42e4be11e2487e4b9358` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:42.143896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0239350b5b42e4be11e2487e4b9358)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:42.145856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:42.160345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:42.261501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0239350b5b42e4be11e2487e4b9358'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:42.290923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0239350b5b42e4be11e2487e4b9358'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:42.292139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0239350b5b42e4be11e2487e4b9358'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:42.311292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0239350b5b42e4be11e2487e4b9358'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:42.312191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-45f9aa41-d152-4647-9f65-536bf4c917fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0239350b5b42e4be11e2487e4b9358'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:42.345825 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3925/7870] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:03:41 2022] DELETE /identity/v3/users/6a0239350b5b42e4be11e2487e4b9358 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:03:42.880351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:42.881844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:42.903318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa635669-f548-4bce-8db4-5b9a0f647875 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:43.028608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38a7b7-995e-4c53-8ce8-e8047528dd18 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.029179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38a7b7-995e-4c53-8ce8-e8047528dd18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.029179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38a7b7-995e-4c53-8ce8-e8047528dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.059528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:43.065531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.066445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.066947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] PATH_INFO: `/v3/projects/2aabfc9c0cf04163b30272077fef5c1b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.068627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aabfc9c0cf04163b30272077fef5c1b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:43.070045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cb38a7b7-995e-4c53-8ce8-e8047528dd18 None None] MFA Rules not processed for user `881baf1ede7e4fb5acf65268a81241ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:43.071108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:43.071692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cb38a7b7-995e-4c53-8ce8-e8047528dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:43.168283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aabfc9c0cf04163b30272077fef5c1b', 'request_id': 'req-5cefb515-3f3d-48a1-9717-bbac38bf3df0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:43.175965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aabfc9c0cf04163b30272077fef5c1b', 'request_id': 'req-5cefb515-3f3d-48a1-9717-bbac38bf3df0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:43.177987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:43.197490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aabfc9c0cf04163b30272077fef5c1b', 'request_id': 'req-5cefb515-3f3d-48a1-9717-bbac38bf3df0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:43.211534 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3926/7871] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:03:43.238632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] The token cache is being invalidate because project 2aabfc9c0cf04163b30272077fef5c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:03:43.239898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:43.241682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5cefb515-3f3d-48a1-9717-bbac38bf3df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:03:43.246263 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3946/7872] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:03:42 2022] DELETE /identity/v3/projects/2aabfc9c0cf04163b30272077fef5c1b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:43.252156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.252429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.252765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.295678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:43.297191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:43.493130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3927/7873] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:43.500809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.501791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.502247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.532574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:43.534168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:43.546955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3947/7874] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:43.551804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:43.567487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227197e-2016-45e8-aa35-7b3c875fb2e8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:43.575711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:43.576535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.577016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.578085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.578945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:03:43.579875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:43.582045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:43.599797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3928/7875] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:03:43.605060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:43.619451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f55d2b-aa9d-444b-a5ed-8318d57348dd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:43.626415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:43.627373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.627831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.628249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.629215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:43.631473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:43.678492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3948/7876] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:03:43 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:43.682448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:43.698412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc17c-6b6c-4943-bcb1-acd4eaa5fe13 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:43.731500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:43.845488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:43.848148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.848682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.849158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.849940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:43.864414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:43.907105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3929/7877] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:03:43 2022] POST /identity/v3/users => generated 296 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:43.911669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:43.928453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab889e-8d08-484a-92e7-92a6fda11fab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:43.935525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:43.936802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:43.937209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:43.938074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:43.939654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:43.940243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:43.963213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3949/7878] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:43.968864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:43.994302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9429-d6b9-4b0b-8da7-eb847592613b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.021301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861d07b-99f1-4b9c-8a90-75877cf1c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.021959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d07b-99f1-4b9c-8a90-75877cf1c753 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.022246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d07b-99f1-4b9c-8a90-75877cf1c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.022888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861d07b-99f1-4b9c-8a90-75877cf1c753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.023187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861d07b-99f1-4b9c-8a90-75877cf1c753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.025649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861d07b-99f1-4b9c-8a90-75877cf1c753 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.043425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3930/7879] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:44.045235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:44.065951 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6995d-4a4a-4c42-a163-bdc8049f7dc2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.071827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.071827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.072240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.072496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] PATH_INFO: `/v3/projects/a86e3137c6764eeb948b9c7dab895c34/users/ad3a53da0c764f0a893966aea6505fa7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.090259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86e3137c6764eeb948b9c7dab895c34, user_id=ad3a53da0c764f0a893966aea6505fa7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.106290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.132250 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3950/7880] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:44 2022] PUT /identity/v3/projects/a86e3137c6764eeb948b9c7dab895c34/users/ad3a53da0c764f0a893966aea6505fa7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:44.148861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.150477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.151280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.216037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] MFA Rules not processed for user `ad3a53da0c764f0a893966aea6505fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:44.217700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:44.377944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3931/7881] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:44.382079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:44.527698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:44.529297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:44.531330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e59432-a6c3-4983-8d3b-fefe01fb4927 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.545596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.546378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.546756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.547099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.547805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.553515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.614846 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3951/7882] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:03:44 2022] POST /identity/v3/projects => generated 393 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:44.618976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:44.706744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9f58b-64e9-491d-992c-b186781ce2de None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.729976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:44.746152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c304a-6f43-49c8-ad99-219b2c6031e9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.757409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.758619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.760034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.760504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.763015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.765645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.801813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:44.816799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.817922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.818258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.818694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.820577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:44.824064 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3952/7883] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:03:44 2022] POST /identity/v3/users => generated 303 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:03:44.830255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:44.850087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0fe3a-cc8f-404d-9674-749c4a085bea admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.863078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.863947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.864162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.864410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.865442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.865887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.866717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.868846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.889488 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3953/7884] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:44.892041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:44.894005 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3932/7885] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:03:44.906729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680815f4-e105-40f1-a078-8771e25f3429 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:44.913317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:44.914049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:44.914273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:44.914555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] PATH_INFO: `/v3/projects/519c294387a04ca5bcdeab3e4e574eb5/users/0589f01c6bb44698b9e060a659c8679b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:44.956079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=519c294387a04ca5bcdeab3e4e574eb5, user_id=0589f01c6bb44698b9e060a659c8679b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:44.961307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:44.983988 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3954/7886] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:44 2022] PUT /identity/v3/projects/519c294387a04ca5bcdeab3e4e574eb5/users/0589f01c6bb44698b9e060a659c8679b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:44.988028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:45.002444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38eb4-2666-48c0-83d8-03adaa8ea48c service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:45.113748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f501c-3f31-4827-874d-f5cb2a675912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:45.114592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f501c-3f31-4827-874d-f5cb2a675912 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:45.114969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f501c-3f31-4827-874d-f5cb2a675912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:45.115336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f501c-3f31-4827-874d-f5cb2a675912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:45.116086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f501c-3f31-4827-874d-f5cb2a675912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:45.117833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f501c-3f31-4827-874d-f5cb2a675912 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:45.148703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:45.149008 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3933/7887] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:03:45.161138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5284d-e31f-48df-9742-db0149f5c9da admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:45.167276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:45.168067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:45.168389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:45.168668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] PATH_INFO: `/v3/projects/519c294387a04ca5bcdeab3e4e574eb5/users/0589f01c6bb44698b9e060a659c8679b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:45.170684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519c294387a04ca5bcdeab3e4e574eb5, user_id=0589f01c6bb44698b9e060a659c8679b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:45.173782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:45.216315 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3955/7888] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:03:45 2022] PUT /identity/v3/projects/519c294387a04ca5bcdeab3e4e574eb5/users/0589f01c6bb44698b9e060a659c8679b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:03:45.218616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:45.219531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:45.220122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:45.254756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] MFA Rules not processed for user `0589f01c6bb44698b9e060a659c8679b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:45.256506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:45.429171 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3934/7889] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:45.448006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:45.450394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:45.639477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d968aa-5fd1-41fb-b9eb-554e6860e648 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:45.675362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b7a2d-8fc4-4cfa-a501-d169d6b621b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:45.676222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b7a2d-8fc4-4cfa-a501-d169d6b621b8 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:45.677036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b7a2d-8fc4-4cfa-a501-d169d6b621b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:45.677325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b7a2d-8fc4-4cfa-a501-d169d6b621b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:45.799632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b7a2d-8fc4-4cfa-a501-d169d6b621b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:45.803442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b7a2d-8fc4-4cfa-a501-d169d6b621b8 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:45.821882 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3956/7890] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:51.354620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:51.357633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:51.411121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:03:51.453337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016cea3-f711-4e36-972d-5e6687d5b155 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:51.458018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:51.458812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:51.459245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:51.459632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:51.480987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:51.484301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:51.504752 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3935/7891] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:03:55.724081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:55.724514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:55.724642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:55.796021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] MFA Rules not processed for user `ad3a53da0c764f0a893966aea6505fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:03:55.798896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:55.817501 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3957/7892] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:03:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:03:56.242568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:56.244542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:56.261994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948f3c-249c-4e8e-bd77-09e6fbbdc8ea service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:56.283871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:56.285443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:56.285851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:56.286392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:56.288376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:56.311303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:56.312815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:56.351644 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3936/7893] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:03:57.813007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:03:57.815571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:57.847180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bba7d-b0e5-45b1-b155-ffa6a8ecdb41 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:03:57.866715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:03:57.869414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:03:57.870053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:03:57.870636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:03:57.873299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:03:57.899969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:03:57.901971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c515ca-3d59-4511-96f1-43112869922a service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:03:57.918345 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3958/7894] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:03:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:06.332658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=18 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:07.910526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:08.158292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:08.160022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:08.313440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55451-52ad-48f4-9bd6-5626d4933439 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:08.325683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:08.326343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:08.326626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:08.326901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] PATH_INFO: `/v3/users/934bc07f41754aeabb89c32907a2ca44` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:08.328665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934bc07f41754aeabb89c32907a2ca44)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:08.332497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:08.445352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934bc07f41754aeabb89c32907a2ca44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:08.475354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934bc07f41754aeabb89c32907a2ca44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:08.476665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934bc07f41754aeabb89c32907a2ca44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:08.489698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934bc07f41754aeabb89c32907a2ca44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:08.497866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934bc07f41754aeabb89c32907a2ca44'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:08.534801 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3937/7895] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:08 2022] DELETE /identity/v3/users/934bc07f41754aeabb89c32907a2ca44 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:08.539293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:08.539867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:08.540378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:08.606437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:08.615258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:08.734566 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3959/7896] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:08.747285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:08.749893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:08.855835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3c877-b857-4ecb-8ee4-dc1391dec4f6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:08.861223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:08.862271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:08.863027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:08.863432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:08.878763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:08.881041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:08.906287 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3938/7897] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:09.743348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:09.745236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:09.769526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4bf3-6740-473c-99a9-bb18dd5e41ca None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:09.776885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:09.777916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:09.778351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:09.778784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] PATH_INFO: `/v3/projects/39f74a8793534ac2ad971add33935677` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:09.780574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f74a8793534ac2ad971add33935677)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:09.782930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:09.847315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f74a8793534ac2ad971add33935677', 'request_id': 'req-df803df8-9e0b-41f5-b205-8bc7279921b8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:09.858349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f74a8793534ac2ad971add33935677', 'request_id': 'req-df803df8-9e0b-41f5-b205-8bc7279921b8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:09.880491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f74a8793534ac2ad971add33935677', 'request_id': 'req-df803df8-9e0b-41f5-b205-8bc7279921b8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:09.902680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] The token cache is being invalidate because project 39f74a8793534ac2ad971add33935677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:09.903220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:09.904099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:09.912405 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3960/7898] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:09 2022] DELETE /identity/v3/projects/39f74a8793534ac2ad971add33935677 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:09.913056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:09.925064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404bb8d-6966-4948-8128-31457fe000d8 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:09.979284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:10.065516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:10.067197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:10.067634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:10.068088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] PATH_INFO: `/v3/users/3b6c3a5b1eb04900951dc1b218bbf1eb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:10.070063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6c3a5b1eb04900951dc1b218bbf1eb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:10.072986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:10.153882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6c3a5b1eb04900951dc1b218bbf1eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:10.180754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6c3a5b1eb04900951dc1b218bbf1eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:10.181954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6c3a5b1eb04900951dc1b218bbf1eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:10.194817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6c3a5b1eb04900951dc1b218bbf1eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:10.196955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6c3a5b1eb04900951dc1b218bbf1eb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:10.227414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3939/7899] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:09 2022] DELETE /identity/v3/users/3b6c3a5b1eb04900951dc1b218bbf1eb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:04:10.682903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:10.685406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:10.862255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df803df8-9e0b-41f5-b205-8bc7279921b8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:10.913956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:10.979529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:10.980609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:10.981274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:10.981890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:10.984340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:11.003996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:11.006021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b7b6c-e9ec-4b98-968a-72b39b7304d2 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:11.024445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3961/7900] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:11.841168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:11.842955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:11.968651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ee08a-4432-4366-8e6c-e126b48891a0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:11.974114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:11.975023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:11.975532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:11.975962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] PATH_INFO: `/v3/projects/8bbdea89f41c4c58b67daa26ab882829` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:11.977577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbdea89f41c4c58b67daa26ab882829)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:11.979876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.103971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:12.108788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbdea89f41c4c58b67daa26ab882829', 'request_id': 'req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:12.129509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbdea89f41c4c58b67daa26ab882829', 'request_id': 'req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:12.144531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbdea89f41c4c58b67daa26ab882829', 'request_id': 'req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:12.158904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] The token cache is being invalidate because project 8bbdea89f41c4c58b67daa26ab882829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:12.159216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:12.159901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3cc85a7-f370-4faf-89a4-72a39bcc07a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:12.164666 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3940/7901] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:11 2022] DELETE /identity/v3/projects/8bbdea89f41c4c58b67daa26ab882829 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:12.166833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.167327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.167424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.199634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:12.201601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:12.295603 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3962/7902] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:12.297289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.297627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.297914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.324332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:12.326321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:12.342769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:12.349730 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3941/7903] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:12.359312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa588f-2f61-4cf9-97f3-93114fe71527 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:12.364567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:12.365297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.365695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.366119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.367097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:12.368043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:12.369966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.389388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:12.396259 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3963/7904] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:12.401953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185b991-aecc-42fa-a3ce-4c2749666671 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:12.408396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:12.409128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.410273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.410630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.411349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:12.413450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.459413 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3942/7905] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:12 2022] POST /identity/v3/projects => generated 363 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:12.463839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:12.477478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d2648-710a-428c-a9c9-2fdb0ab26b4b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:12.552181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:12.552803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.553126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.553401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.554043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:12.557274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.583572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3964/7906] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:12 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:12.588695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:12.606225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adb727-6bb7-4126-baec-c8dc19025dc2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:12.615290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:12.617082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.618306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.619242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.620121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:12.623532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.639297 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3943/7907] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:04:12.643723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:12.667859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af72a1-125d-4bd0-8064-21f82279a741 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:12.673092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee141db3-47e5-4599-8be0-c43e727afdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:12.673988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141db3-47e5-4599-8be0-c43e727afdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.674484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141db3-47e5-4599-8be0-c43e727afdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.674964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141db3-47e5-4599-8be0-c43e727afdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.675824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee141db3-47e5-4599-8be0-c43e727afdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:12.678419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee141db3-47e5-4599-8be0-c43e727afdbb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.696942 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3965/7908] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:12.699237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:12.710553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a551-ef25-41e0-8317-23c16948579e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:12.716551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:12.717372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.717754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.718591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] PATH_INFO: `/v3/projects/2f9c8aefd76b499ab86f66cc1ad73d14/users/3222838558fa405d98b69da72e970ef7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.736831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9c8aefd76b499ab86f66cc1ad73d14, user_id=3222838558fa405d98b69da72e970ef7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:12.740166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:12.773372 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3944/7909] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:12 2022] PUT /identity/v3/projects/2f9c8aefd76b499ab86f66cc1ad73d14/users/3222838558fa405d98b69da72e970ef7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:12.774091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:12.774757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:12.774757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:12.807483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] MFA Rules not processed for user `3222838558fa405d98b69da72e970ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:12.809116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:12.823370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:13.005697 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3966/7910] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:13.013046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:13.182888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1d46-8a5a-48d7-b22f-8ee29296a268 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:13.191072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:13.192014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.192372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.192726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.193535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:13.196638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:13.251734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:13.262115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3945/7911] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:13 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:13.269942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e25fe-66ea-4a15-a663-51e021e7e320 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:13.405676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:13.406341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.406634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.406897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.407547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:13.409523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:13.469320 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3967/7912] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:13 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:13.471783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:13.486328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f534e-ac7f-4c3b-9d58-3bc5f35782de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:13.493697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:13.494374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.494709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.494988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.496020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:13.497910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:13.517046 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3946/7913] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:13.518460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:13.534943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d066080-f73b-418d-ba6b-608899355dfc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:13.546298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:13.547033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.547317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.547868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] PATH_INFO: `/v3/projects/8734e8ffe06345daa4b5d80fc6fa924e/users/a0c575978e0d400bb64ab55c4ea25bcb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.575538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8734e8ffe06345daa4b5d80fc6fa924e, user_id=a0c575978e0d400bb64ab55c4ea25bcb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:13.592956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:13.619272 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3968/7914] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:13 2022] PUT /identity/v3/projects/8734e8ffe06345daa4b5d80fc6fa924e/users/a0c575978e0d400bb64ab55c4ea25bcb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:13.620184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:13.635129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8440b-7f50-48d9-bffb-2f0a9c011dbe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:13.740962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:13.764213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d172e09-6c15-4cff-858c-ca3210ed3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:13.765581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d172e09-6c15-4cff-858c-ca3210ed3552 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.765994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d172e09-6c15-4cff-858c-ca3210ed3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.766367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d172e09-6c15-4cff-858c-ca3210ed3552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.767264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d172e09-6c15-4cff-858c-ca3210ed3552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:13.769156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d172e09-6c15-4cff-858c-ca3210ed3552 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:13.784605 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3947/7915] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:04:13.786204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:13.808395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b36121-bbaf-4f36-895f-02a5e7ac4341 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:13.819590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:13.820531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.821894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.822193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] PATH_INFO: `/v3/projects/8734e8ffe06345daa4b5d80fc6fa924e/users/a0c575978e0d400bb64ab55c4ea25bcb/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.825712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8734e8ffe06345daa4b5d80fc6fa924e, user_id=a0c575978e0d400bb64ab55c4ea25bcb, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:13.829764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:13.868235 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3969/7916] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:13 2022] PUT /identity/v3/projects/8734e8ffe06345daa4b5d80fc6fa924e/users/a0c575978e0d400bb64ab55c4ea25bcb/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:13.879913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:13.880337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:13.880708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:13.950617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] MFA Rules not processed for user `a0c575978e0d400bb64ab55c4ea25bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:13.952896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:14.110170 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3948/7917] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:14.121374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:14.123632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:14.216341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00fa2-3ce7-49fd-afde-8f8e96028172 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:14.228173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:14.228893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:14.229257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:14.229602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:14.251868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:14.253543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:14.278268 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3970/7918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:14.496513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:14.517230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26dd0-0401-4770-8005-04cf3b8fc30d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:14.523293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c219d-40b2-48fb-885c-11e7d9d1794f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:14.525289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c219d-40b2-48fb-885c-11e7d9d1794f service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:14.525894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c219d-40b2-48fb-885c-11e7d9d1794f service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:14.526483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c219d-40b2-48fb-885c-11e7d9d1794f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:14.649339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c219d-40b2-48fb-885c-11e7d9d1794f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:14.651290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c219d-40b2-48fb-885c-11e7d9d1794f service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:14.681896 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3949/7919] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:15.485285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:15.487507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:15.498534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:15.584634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dcae9-b200-43e5-87e0-5ec69b72b35b service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:15.594674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:15.596404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:15.597125 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:15.598455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] PATH_INFO: `/v3/users/827d56f08105400f9667bb1131ba8ceb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:15.600735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827d56f08105400f9667bb1131ba8ceb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:15.604142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:15.698567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827d56f08105400f9667bb1131ba8ceb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:15.726177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827d56f08105400f9667bb1131ba8ceb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:15.727261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827d56f08105400f9667bb1131ba8ceb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:15.741433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827d56f08105400f9667bb1131ba8ceb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:15.742925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827d56f08105400f9667bb1131ba8ceb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:15.765431 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3971/7920] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:15 2022] DELETE /identity/v3/users/827d56f08105400f9667bb1131ba8ceb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:15.769959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:15.770507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:15.770507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:15.825018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:15.828211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:15.954129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3950/7921] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:15.966732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:15.968130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:16.073697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223bcb-89df-44e0-9fec-c6faa283b276 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:16.080175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:16.080804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:16.081118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:16.081389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:16.122186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:16.124002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:16.172290 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3972/7922] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:17.025141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:17.026860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:17.035052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:17.046784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12df719-f941-4c9c-b6fb-bb972a3c57c0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:17.058984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:17.067511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:17.068040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:17.068547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] PATH_INFO: `/v3/projects/a578b6bb49b24996b84664862e6b3d3a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:17.070187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a578b6bb49b24996b84664862e6b3d3a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:17.073561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:17.148189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a578b6bb49b24996b84664862e6b3d3a', 'request_id': 'req-4802cdef-98bd-4e25-9b8f-20286cb3c194'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.163202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a578b6bb49b24996b84664862e6b3d3a', 'request_id': 'req-4802cdef-98bd-4e25-9b8f-20286cb3c194'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.171716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a578b6bb49b24996b84664862e6b3d3a', 'request_id': 'req-4802cdef-98bd-4e25-9b8f-20286cb3c194'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.185851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] The token cache is being invalidate because project a578b6bb49b24996b84664862e6b3d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:17.186468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.187291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.189342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3951/7923] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:17 2022] DELETE /identity/v3/projects/a578b6bb49b24996b84664862e6b3d3a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:17.193387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:17.204591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622f46-9a74-491e-8943-a7b06a15f948 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:17.234041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:17.271101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:17.271984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:17.272532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:17.273333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] PATH_INFO: `/v3/users/3b009f6e5dba473d9893b6862683a282` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:17.276055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b009f6e5dba473d9893b6862683a282)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:17.278233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:17.346942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b009f6e5dba473d9893b6862683a282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.362670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b009f6e5dba473d9893b6862683a282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.363418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b009f6e5dba473d9893b6862683a282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.379855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b009f6e5dba473d9893b6862683a282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.381661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-75f209d4-c13e-406e-aca3-ca1afa5ddbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b009f6e5dba473d9893b6862683a282'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:17.415027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3973/7924] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:17 2022] DELETE /identity/v3/users/3b009f6e5dba473d9893b6862683a282 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:18.160652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:18.167245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:18.221205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802cdef-98bd-4e25-9b8f-20286cb3c194 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:18.338563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:18.339391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:18.339679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:18.340008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] PATH_INFO: `/v3/projects/39f92feb17d04a78a8c2e6e1534801f7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:18.341286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f92feb17d04a78a8c2e6e1534801f7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:18.344000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:18.438479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f92feb17d04a78a8c2e6e1534801f7', 'request_id': 'req-631a5ab0-78fa-49e9-92a6-01c28855fc96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:18.459631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f92feb17d04a78a8c2e6e1534801f7', 'request_id': 'req-631a5ab0-78fa-49e9-92a6-01c28855fc96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:18.468182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f92feb17d04a78a8c2e6e1534801f7', 'request_id': 'req-631a5ab0-78fa-49e9-92a6-01c28855fc96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:18.483659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] The token cache is being invalidate because project 39f92feb17d04a78a8c2e6e1534801f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:18.484102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:18.484864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-631a5ab0-78fa-49e9-92a6-01c28855fc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:18.488371 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3952/7925] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:18 2022] DELETE /identity/v3/projects/39f92feb17d04a78a8c2e6e1534801f7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:18.494224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:18.495485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:18.495777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:18.523311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:18.525408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:18.647095 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3974/7926] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:18.654909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:18.655174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:18.656633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:18.712786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:18.717007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:18.731893 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3953/7927] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:18.733202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:18.745318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a04d77-a272-42d7-bdbb-882cc05ad135 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:18.761729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:18.764661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:18.764999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:18.765290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:18.765980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:18.766290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:18.767965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:18.789005 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3975/7928] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:18.791652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:18.800012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:18.807518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:18.809516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b2591-cbfe-4ab4-8edf-e08ac711b699 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:18.819165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:18.820946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:18.821300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:18.821747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:18.822562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:18.828836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:18.848011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:18.876241 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3954/7929] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:18 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:18.876438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:18.877792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:18.929177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03857a76-5b1a-4ed1-9a58-d4809e730807 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:18.987685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c7cca-a9f9-446b-9c01-fff7aa4620e6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:18.994501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:18.995504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:18.995784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:18.996194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:18.996843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:18.998986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.020884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.021615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.021904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.022191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.025972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:19.031325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3955/7930] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:18 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:04:19.035755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.055567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf5b9-d43d-40a3-9174-dea27be9729a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.064588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.065340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.065624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.065898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.066692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.069136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.086722 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3956/7931] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:04:19.102996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.126186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.127998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.142319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3976/7932] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:19.155496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f1280-f3cb-40da-883d-0882f6443b69 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.169678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb57034-5fe1-4b48-88ab-f9b1f5e0c850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.171860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb57034-5fe1-4b48-88ab-f9b1f5e0c850 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.177032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb57034-5fe1-4b48-88ab-f9b1f5e0c850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.177627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb57034-5fe1-4b48-88ab-f9b1f5e0c850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.179409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb57034-5fe1-4b48-88ab-f9b1f5e0c850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.181510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb57034-5fe1-4b48-88ab-f9b1f5e0c850 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.205440 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3957/7933] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:19.209863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.239535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47ad20-ff9b-4e05-83bd-b2165a0a8e49 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.249741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.251054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.252104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.252481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] PATH_INFO: `/v3/projects/1552f50cbb8746cdba151da933431d37/users/25f8299e6b0a4d5380bf1dbec48cc9da/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.296261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1552f50cbb8746cdba151da933431d37, user_id=25f8299e6b0a4d5380bf1dbec48cc9da, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.301281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.341104 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3977/7934] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:19 2022] PUT /identity/v3/projects/1552f50cbb8746cdba151da933431d37/users/25f8299e6b0a4d5380bf1dbec48cc9da/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:19.351271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.351718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.352522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.392495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] MFA Rules not processed for user `25f8299e6b0a4d5380bf1dbec48cc9da`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:19.393748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:19.473740 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3958/7935] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:19.478419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.560606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:19.581163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64cd2-c9ac-4280-9755-317940f702d7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.587433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.588040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.588319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.588596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.589567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.591583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.624343 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3978/7936] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:19 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:19.627982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.642634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55648722-de4d-42dc-b824-fbee372b57f6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.717574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:19.739289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.740067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.740402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.740738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.741530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.745263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.781414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3959/7937] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:19 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:19.785360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.803499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad871-2e8a-4d99-8057-4ba77d59f55a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.810710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.812056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.812056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.812283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.813103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.814883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.833781 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3979/7938] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:19.838688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.854369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacde42f-e4c3-4c07-9868-e6c5c7460e68 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:19.871906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:19.875093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:19.875544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:19.875846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] PATH_INFO: `/v3/projects/39656840076c41ef9174a9d67f33ab69/users/3492499bb4df44c68d1bd8a3708f1159/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:19.903642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39656840076c41ef9174a9d67f33ab69, user_id=3492499bb4df44c68d1bd8a3708f1159, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:19.907103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:19.937292 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3960/7939] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:19 2022] PUT /identity/v3/projects/39656840076c41ef9174a9d67f33ab69/users/3492499bb4df44c68d1bd8a3708f1159/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:19.941122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:19.967388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe73e-cd62-464e-a416-c9564a49216d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:20.072929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a467e-d7e9-4434-9797-9ac410b6df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:20.073802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a467e-d7e9-4434-9797-9ac410b6df8e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:20.074149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a467e-d7e9-4434-9797-9ac410b6df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:20.074604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a467e-d7e9-4434-9797-9ac410b6df8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:20.075322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a467e-d7e9-4434-9797-9ac410b6df8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:20.077746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a467e-d7e9-4434-9797-9ac410b6df8e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:20.089948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3980/7940] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:20.094124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:20.106534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb700831-149e-4898-a377-eacfb33e1a89 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:20.111367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:20.112037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:20.112345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:20.112625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] PATH_INFO: `/v3/projects/39656840076c41ef9174a9d67f33ab69/users/3492499bb4df44c68d1bd8a3708f1159/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:20.114592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39656840076c41ef9174a9d67f33ab69, user_id=3492499bb4df44c68d1bd8a3708f1159, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:20.117784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:20.128931 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3961/7941] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:20 2022] PUT /identity/v3/projects/39656840076c41ef9174a9d67f33ab69/users/3492499bb4df44c68d1bd8a3708f1159/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:20.140466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:20.140763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:20.141060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:20.169821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] MFA Rules not processed for user `3492499bb4df44c68d1bd8a3708f1159`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:20.171040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:20.246707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3981/7942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:20.257781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:20.260361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:20.333563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54726c-41f2-439a-b7f8-5058d706182d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:20.338150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:20.338991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:20.339342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:20.339687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:20.416582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:20.418300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:20.433067 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3962/7943] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:22.935954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:22.938820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:23.101090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:23.194386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c86ad4-8c43-424b-bd51-ac1e45b5f068 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:23.208007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:23.209584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:23.213243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:23.215072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:23.218901 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:23.264849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:23.266856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe727-4cc3-4fed-9f96-7c22d19bf668 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:23.285800 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3982/7944] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:28.114310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:28.276866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:28.334296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d629282-328b-45c7-ac7d-734e8167a6c2 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:28.338996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:28.339883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:28.340272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:28.340634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] PATH_INFO: `/v3/users/25f8299e6b0a4d5380bf1dbec48cc9da` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:28.345753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f8299e6b0a4d5380bf1dbec48cc9da)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:28.347822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:28.459723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f8299e6b0a4d5380bf1dbec48cc9da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:28.484823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f8299e6b0a4d5380bf1dbec48cc9da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:28.487946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f8299e6b0a4d5380bf1dbec48cc9da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:28.507194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f8299e6b0a4d5380bf1dbec48cc9da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:28.508718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f8299e6b0a4d5380bf1dbec48cc9da'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:28.537542 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3963/7945] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:28 2022] DELETE /identity/v3/users/25f8299e6b0a4d5380bf1dbec48cc9da => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:28.539624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:28.540286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:28.540286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:28.586374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:28.587684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:28.795234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3983/7946] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:04:28.807641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:28.808711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:29.008658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128edf57-bde0-47b9-8a36-ba6d37e09f71 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:29.023574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:29.029776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:29.030195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:29.033268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:29.069284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:29.075017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:29.111986 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3964/7947] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:29.777696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:29.798688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ed6da-fa75-423c-bef0-a0f46b47d4a4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:29.810102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:29.810940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:29.811295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:29.811679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:29.818096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:29.846223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:29.848112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:29.878038 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3984/7948] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:30.209863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:30.211902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:30.234915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae56535-dd0c-4d41-bd52-7827ddfe9fb9 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:30.256198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:30.256559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:30.256847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:30.257156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] PATH_INFO: `/v3/projects/1552f50cbb8746cdba151da933431d37` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:30.266955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1552f50cbb8746cdba151da933431d37)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:30.271756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:30.436402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1552f50cbb8746cdba151da933431d37', 'request_id': 'req-41afe405-5399-4aa2-a826-6533d2237c14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:30.479947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1552f50cbb8746cdba151da933431d37', 'request_id': 'req-41afe405-5399-4aa2-a826-6533d2237c14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:30.513924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1552f50cbb8746cdba151da933431d37', 'request_id': 'req-41afe405-5399-4aa2-a826-6533d2237c14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:30.532314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:30.636442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] The token cache is being invalidate because project 1552f50cbb8746cdba151da933431d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:30.638506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:30.640890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:30.646241 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3965/7949] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:30 2022] DELETE /identity/v3/projects/1552f50cbb8746cdba151da933431d37 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:30.650443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:30.678758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac832b-149f-420e-afd2-3a1ca3681d7b service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:30.856048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:30.857836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:30.858949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:30.859391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] PATH_INFO: `/v3/users/3492499bb4df44c68d1bd8a3708f1159` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:30.863196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3492499bb4df44c68d1bd8a3708f1159)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:30.867073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:31.066168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3492499bb4df44c68d1bd8a3708f1159'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:31.118341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:31.131923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3492499bb4df44c68d1bd8a3708f1159'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:31.139334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3492499bb4df44c68d1bd8a3708f1159'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:31.158706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3492499bb4df44c68d1bd8a3708f1159'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:31.160176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4adfca37-961a-4964-9e28-939a5829da90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3492499bb4df44c68d1bd8a3708f1159'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:31.206746 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3985/7950] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:30 2022] DELETE /identity/v3/users/3492499bb4df44c68d1bd8a3708f1159 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:32.557765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:32.559261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:32.579577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afe405-5399-4aa2-a826-6533d2237c14 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:32.798241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:32.799286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:32.799793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:32.800397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] PATH_INFO: `/v3/projects/39656840076c41ef9174a9d67f33ab69` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:32.804431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39656840076c41ef9174a9d67f33ab69)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:32.813680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:32.992642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39656840076c41ef9174a9d67f33ab69', 'request_id': 'req-9fda1e74-67e9-4be3-b27d-d6e65238a956'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:33.011471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39656840076c41ef9174a9d67f33ab69', 'request_id': 'req-9fda1e74-67e9-4be3-b27d-d6e65238a956'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:33.042439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39656840076c41ef9174a9d67f33ab69', 'request_id': 'req-9fda1e74-67e9-4be3-b27d-d6e65238a956'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:33.085708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] The token cache is being invalidate because project 39656840076c41ef9174a9d67f33ab69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:33.090791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:33.091798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9fda1e74-67e9-4be3-b27d-d6e65238a956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:33.103596 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3966/7951] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:32 2022] DELETE /identity/v3/projects/39656840076c41ef9174a9d67f33ab69 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:33.108731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:33.109261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:33.109756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:33.166044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:33.170895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:33.401045 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3986/7952] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:33.408518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:33.409121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:33.409613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:33.471454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:33.472783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:33.521249 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3967/7953] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:33.533004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:33.550559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3a254-cf9a-4f1e-aef7-5556665c6def None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:33.574659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:33.582529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:33.582529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:33.582529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:33.582529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:33.582529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:33.586531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:33.659307 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3987/7954] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:33.660448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:33.682475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c3335-0e63-4141-91cb-765701526b80 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:33.696921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:33.697998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:33.703812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:33.703812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:33.703812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:33.713407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:33.830574 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3968/7955] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:33 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:04:33.832165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:33.848849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2c284-c49f-406b-8ea4-7a444d856fe1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:33.976176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:33.977333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:33.977723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:33.978287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:33.980825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:33.998124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:34.087448 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3988/7956] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:33 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:34.088708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:34.103634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857abb2-8703-463c-aa51-8c7e83638d82 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:34.123258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:34.124034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:34.128144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:34.128641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:34.129485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:34.135992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:34.183895 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3969/7957] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:34.186697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:34.212461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df7074-9825-4bd7-b169-3901cef89eaa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:34.235702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994558-ec0c-4a2f-b15d-c9bbaa19f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:34.240122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994558-ec0c-4a2f-b15d-c9bbaa19f77b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:34.241207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994558-ec0c-4a2f-b15d-c9bbaa19f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:34.242437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994558-ec0c-4a2f-b15d-c9bbaa19f77b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:34.247441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994558-ec0c-4a2f-b15d-c9bbaa19f77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:34.249328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994558-ec0c-4a2f-b15d-c9bbaa19f77b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:34.297702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3989/7958] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:34.298999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:34.330959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fe1f1-c69c-4e49-91cd-7639d842d855 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:34.349620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:34.350482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:34.355138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:34.355659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] PATH_INFO: `/v3/projects/ec96e148fb584e47aea344938b4eac8f/users/b7c84d1eac77481b97d45dfbfdef32ab/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:34.418058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec96e148fb584e47aea344938b4eac8f, user_id=b7c84d1eac77481b97d45dfbfdef32ab, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:34.426599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:34.494346 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3970/7959] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:34 2022] PUT /identity/v3/projects/ec96e148fb584e47aea344938b4eac8f/users/b7c84d1eac77481b97d45dfbfdef32ab/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:34.495479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:34.495992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:34.496345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:34.559044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] MFA Rules not processed for user `b7c84d1eac77481b97d45dfbfdef32ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:34.562853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:34.685220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:34.793180 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3990/7960] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:34.798937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:34.883903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:35.001604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cb642-e5b8-4ccc-a18d-81a4f0044bb1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:35.010628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:35.011656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:35.012269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:35.012859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:35.014275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:35.016646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:35.146484 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3971/7961] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:34 2022] POST /identity/v3/projects => generated 383 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:35.151795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:35.167452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b8e75-dcb0-41c0-b967-f0d9096f643f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:35.351622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:35.352567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:35.352858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:35.358571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:35.362422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:35.371828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:35.432724 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3991/7962] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:35 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:04:35.436958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:35.458702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875eff3-4f8f-4a9a-ba2f-ed56b69beecb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:35.484282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:35.484942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:35.485878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:35.486169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:35.486833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:35.501296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:35.523955 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3972/7963] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:35.528743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:35.551719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac03de5-0261-4c78-8b87-d07bb1358405 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:35.561072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e99ef-9b05-4393-bbd0-6c82c164d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:35.561705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e99ef-9b05-4393-bbd0-6c82c164d727 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:35.561985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e99ef-9b05-4393-bbd0-6c82c164d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:35.562285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e99ef-9b05-4393-bbd0-6c82c164d727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:35.563044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e99ef-9b05-4393-bbd0-6c82c164d727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:35.564727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e99ef-9b05-4393-bbd0-6c82c164d727 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:35.595329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:35.595529 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3992/7964] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:35.606521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef6dcd-1cd0-4126-b962-508073cf5aa6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:35.619290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:35.620004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:35.620295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:35.620607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] PATH_INFO: `/v3/projects/2bb063072f83411cbc9ec63c8dd68ab9/users/12022b125cdb43c2a52b98d4991862ba/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:35.694514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb063072f83411cbc9ec63c8dd68ab9, user_id=12022b125cdb43c2a52b98d4991862ba, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:35.702102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:35.733188 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3973/7965] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:35 2022] PUT /identity/v3/projects/2bb063072f83411cbc9ec63c8dd68ab9/users/12022b125cdb43c2a52b98d4991862ba/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:04:35.747669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:35.748021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:35.748251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:35.806201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] MFA Rules not processed for user `12022b125cdb43c2a52b98d4991862ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:35.807305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:35.954135 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3993/7966] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:04:35.955839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.077367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5afe2-9f0f-43ce-9b48-a4f2aed7136c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:36.084337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:36.086375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.086889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.087330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.088206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:36.091574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:36.147149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.147383 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3974/7967] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:35 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:36.183765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5098a9-e664-43bc-be9e-e883005521cd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:36.257364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:36.306251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:36.306905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.307233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.307466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.308134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:36.310300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:36.361705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3994/7968] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:36 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:04:36.365502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.380303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011105a-6514-41ad-bfae-1f62b5b5a108 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:36.393273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:36.393895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.394349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.394785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.395608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:36.399373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:36.433421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.433635 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3975/7969] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:36.450964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb620-715a-416b-a071-7ab138eff51b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:36.465273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:36.466235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.466700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.466983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] PATH_INFO: `/v3/projects/2b3ee9bacf82491293982ae2fcd58100/users/99d26adc78f040e0878faab5487e57b0/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.503251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3ee9bacf82491293982ae2fcd58100, user_id=99d26adc78f040e0878faab5487e57b0, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:36.506155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:36.546478 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3995/7970] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:36 2022] PUT /identity/v3/projects/2b3ee9bacf82491293982ae2fcd58100/users/99d26adc78f040e0878faab5487e57b0/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:36.548811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.574443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d89891-1da1-4aab-976a-61a4608d18f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:36.684858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:36.705621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67d4c-63b2-4af2-9b3e-117d30d13e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:36.707185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67d4c-63b2-4af2-9b3e-117d30d13e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.707477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67d4c-63b2-4af2-9b3e-117d30d13e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.707810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67d4c-63b2-4af2-9b3e-117d30d13e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.708537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67d4c-63b2-4af2-9b3e-117d30d13e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:36.713625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a67d4c-63b2-4af2-9b3e-117d30d13e6f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:36.727272 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3976/7971] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:36.731050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.744827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179e69-319f-427a-b3c9-8b59ca444ccc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:36.751457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:36.752195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.752524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.753703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] PATH_INFO: `/v3/projects/2b3ee9bacf82491293982ae2fcd58100/users/99d26adc78f040e0878faab5487e57b0/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.758751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3ee9bacf82491293982ae2fcd58100, user_id=99d26adc78f040e0878faab5487e57b0, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:36.767582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:36.801420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba7f6-3a20-4629-9fef-91773302f61d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:36.801717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba7f6-3a20-4629-9fef-91773302f61d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:36.802038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba7f6-3a20-4629-9fef-91773302f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:36.815005 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3996/7972] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:36 2022] PUT /identity/v3/projects/2b3ee9bacf82491293982ae2fcd58100/users/99d26adc78f040e0878faab5487e57b0/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:36.843929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-836ba7f6-3a20-4629-9fef-91773302f61d None None] MFA Rules not processed for user `99d26adc78f040e0878faab5487e57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:36.845159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-836ba7f6-3a20-4629-9fef-91773302f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:36.966327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3977/7973] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:04:36.983660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:36.985488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:37.148805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689b0c0-3615-4738-b80b-b25fed0757eb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:37.178144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:37.178784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:37.179217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:37.179359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:37.356872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:37.359024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:37.380607 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3997/7974] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:37.627371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:37.627755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:37.628595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:37.670146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] MFA Rules not processed for user `67c2b26730184ce58b866e37ebe43794`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:37.672829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:37.844015 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3978/7975] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:40.379760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:40.381736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:40.414614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d61ca2-003a-4e25-9673-9d7731ebb089 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:40.434123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:40.434756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:40.435036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:40.435311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:40.539275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:40.568406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:40.572494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:40.599935 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3998/7976] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:41.652972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:41.675901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a2e8c-6d62-4bdd-aa77-e162174321fd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:41.682731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:41.684016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:41.684635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:41.685272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:41.697640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:41.703606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:41.799874 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3979/7977] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:43.164044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:43.165964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:43.307572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8323d0-2fb9-4d9b-977b-04f9f8347d07 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:43.313364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:43.314442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:43.314875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:43.315337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] PATH_INFO: `/v3/users/329523b6f089401face7b477d08ca7d6` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:43.317036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=329523b6f089401face7b477d08ca7d6)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:43.319411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:43.459234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '329523b6f089401face7b477d08ca7d6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:43.501067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '329523b6f089401face7b477d08ca7d6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:43.501926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '329523b6f089401face7b477d08ca7d6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:43.529601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '329523b6f089401face7b477d08ca7d6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:43.533761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '329523b6f089401face7b477d08ca7d6'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:43.583454 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 3999/7978] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:43 2022] DELETE /identity/v3/users/329523b6f089401face7b477d08ca7d6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:43.847776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:43.900656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3a2c-a4fe-45d0-b09e-2e7f320733e3 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:44.023743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:44.024712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:44.025033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:44.025314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] PATH_INFO: `/v3/projects/feef1976405a442eb7ee441d12c9a1d9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:44.026508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=feef1976405a442eb7ee441d12c9a1d9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:44.028587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:44.031963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:44.089495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feef1976405a442eb7ee441d12c9a1d9', 'request_id': 'req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.104994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feef1976405a442eb7ee441d12c9a1d9', 'request_id': 'req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.124082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feef1976405a442eb7ee441d12c9a1d9', 'request_id': 'req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.149572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] The token cache is being invalidate because project feef1976405a442eb7ee441d12c9a1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:44.149868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.150553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.155004 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3980/7979] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:43 2022] DELETE /identity/v3/projects/feef1976405a442eb7ee441d12c9a1d9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:44.156803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:44.158457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:44.178973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc1cd-f0b7-483c-8633-753a26771f61 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:44.298592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:44.299679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:44.300072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:44.300456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] PATH_INFO: `/v3/users/7f14ba0f38324bc4bf89f4c4f64364b5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:44.302774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f14ba0f38324bc4bf89f4c4f64364b5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:44.305638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:44.313856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:44.397170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f14ba0f38324bc4bf89f4c4f64364b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.418408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f14ba0f38324bc4bf89f4c4f64364b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.420407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f14ba0f38324bc4bf89f4c4f64364b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.442463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f14ba0f38324bc4bf89f4c4f64364b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.443141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f14ba0f38324bc4bf89f4c4f64364b5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:44.460979 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4000/7980] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:44 2022] DELETE /identity/v3/users/7f14ba0f38324bc4bf89f4c4f64364b5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:44.684435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:44.685987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:44.734167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c99e2-4015-4774-bf1e-f6be3099d1ef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:44.850361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:44.852419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:44.852940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:44.853430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] PATH_INFO: `/v3/projects/e6dcde85b18e4b409653b874d3d914d2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:44.855340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6dcde85b18e4b409653b874d3d914d2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:44.857742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:45.000344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6dcde85b18e4b409653b874d3d914d2', 'request_id': 'req-339b950d-75c5-46b4-88d2-f3335ae7131f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:45.014885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6dcde85b18e4b409653b874d3d914d2', 'request_id': 'req-339b950d-75c5-46b4-88d2-f3335ae7131f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:45.025022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6dcde85b18e4b409653b874d3d914d2', 'request_id': 'req-339b950d-75c5-46b4-88d2-f3335ae7131f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:45.041196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] The token cache is being invalidate because project e6dcde85b18e4b409653b874d3d914d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:45.041511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:45.042430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-339b950d-75c5-46b4-88d2-f3335ae7131f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:45.045255 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3981/7981] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:44 2022] DELETE /identity/v3/projects/e6dcde85b18e4b409653b874d3d914d2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:46.061279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:46.062828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:46.077454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e539b2d-d944-4e51-9b5b-4dce31841dc8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:46.144438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:46.145195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:46.145482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:46.145759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] PATH_INFO: `/v3/users/3222838558fa405d98b69da72e970ef7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:46.146937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3222838558fa405d98b69da72e970ef7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:46.149126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:46.204997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3222838558fa405d98b69da72e970ef7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:46.219654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3222838558fa405d98b69da72e970ef7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:46.219891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3222838558fa405d98b69da72e970ef7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:46.227713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3222838558fa405d98b69da72e970ef7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:46.228679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3222838558fa405d98b69da72e970ef7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:46.245718 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4001/7982] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:46 2022] DELETE /identity/v3/users/3222838558fa405d98b69da72e970ef7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:46.250190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:46.250640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:46.250738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:46.272382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:46.275421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:46.291046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:46.347419 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3982/7983] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:04:46.359849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:46.361386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:46.378363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:46.467483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c38759-72cb-4331-95df-7280d5a752b1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:46.471941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:46.472886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:46.473393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:46.473869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:46.486334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:46.488434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:46.515488 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4002/7984] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:46.881320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:46.890028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:46.915603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af9f8-37fd-4276-8086-ca924c645bc9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:46.926708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:46.927318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:46.927643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:46.927854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] PATH_INFO: `/v3/projects/2f9c8aefd76b499ab86f66cc1ad73d14` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:46.933909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9c8aefd76b499ab86f66cc1ad73d14)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:46.936458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:46.987787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9c8aefd76b499ab86f66cc1ad73d14', 'request_id': 'req-26048de7-fc65-4fef-aa27-9d167dffd08d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:46.998711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9c8aefd76b499ab86f66cc1ad73d14', 'request_id': 'req-26048de7-fc65-4fef-aa27-9d167dffd08d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.006587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9c8aefd76b499ab86f66cc1ad73d14', 'request_id': 'req-26048de7-fc65-4fef-aa27-9d167dffd08d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.020890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] The token cache is being invalidate because project 2f9c8aefd76b499ab86f66cc1ad73d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:47.021238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.021992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.024654 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3983/7985] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:46 2022] DELETE /identity/v3/projects/2f9c8aefd76b499ab86f66cc1ad73d14 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:47.028884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:47.040259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c0786-3be3-4eff-8d8c-94d0a39d6e28 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:47.134647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:47.135381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:47.135729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:47.136093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] PATH_INFO: `/v3/users/a0c575978e0d400bb64ab55c4ea25bcb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:47.137377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c575978e0d400bb64ab55c4ea25bcb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:47.139632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:47.188928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c575978e0d400bb64ab55c4ea25bcb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.202259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c575978e0d400bb64ab55c4ea25bcb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.202968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c575978e0d400bb64ab55c4ea25bcb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.211899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c575978e0d400bb64ab55c4ea25bcb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.212530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79cb27a0-6cd8-4225-8154-f1edc0d9499d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c575978e0d400bb64ab55c4ea25bcb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.230417 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4003/7986] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:47 2022] DELETE /identity/v3/users/a0c575978e0d400bb64ab55c4ea25bcb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:47.531298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:47.533708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:47.562199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048de7-fc65-4fef-aa27-9d167dffd08d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:47.635653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:47.636306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:47.636598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:47.636886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] PATH_INFO: `/v3/projects/8734e8ffe06345daa4b5d80fc6fa924e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:47.638583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8734e8ffe06345daa4b5d80fc6fa924e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:47.644609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:47.724496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:47.736055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8734e8ffe06345daa4b5d80fc6fa924e', 'request_id': 'req-3aafdfd0-0e72-46f3-9284-ed77a435c356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.747397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8734e8ffe06345daa4b5d80fc6fa924e', 'request_id': 'req-3aafdfd0-0e72-46f3-9284-ed77a435c356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.755077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8734e8ffe06345daa4b5d80fc6fa924e', 'request_id': 'req-3aafdfd0-0e72-46f3-9284-ed77a435c356'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.769147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] The token cache is being invalidate because project 8734e8ffe06345daa4b5d80fc6fa924e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:47.769573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.774481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3aafdfd0-0e72-46f3-9284-ed77a435c356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:47.776335 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3984/7987] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:47 2022] DELETE /identity/v3/projects/8734e8ffe06345daa4b5d80fc6fa924e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:47.785235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:47.785235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:47.785235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:47.804609 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:47.806031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:47.828730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:47.872451 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4004/7988] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:47.880337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:47.880627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:47.880924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:47.902800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:47.904437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:47.912068 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3985/7989] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:47.916754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:47.926435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6549d-960c-4d25-bf06-1ab005eeff1f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:47.931386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:47.932002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:47.932287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:47.932567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:47.933264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:47.933603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:47.935589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:47.948350 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4005/7990] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:47.952732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:47.962784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002fe68-2912-4811-bc0d-fd26797502c0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:47.967430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:47.968046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:47.968327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:47.968599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:47.969422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:47.971942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.005037 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3986/7991] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:47 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:48.006224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.022955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f08c2-dfbf-46ed-9401-c18b86790a09 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.097431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.098150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.098329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.098612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.099255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.101285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.126901 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4006/7992] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:48 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:48.128085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.140105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac692b29-921f-4eca-9370-1996dc47d87f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.144770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.145396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.145685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.145959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.146602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.149523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.161819 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3987/7993] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:48.165412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.176484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b6a7-7702-4c16-b92c-b013ce2daab2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.182083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5eff-d45f-4dec-a98e-dddc7d505882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.182727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5eff-d45f-4dec-a98e-dddc7d505882 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.183151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5eff-d45f-4dec-a98e-dddc7d505882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.183434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5eff-d45f-4dec-a98e-dddc7d505882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.184088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce5eff-d45f-4dec-a98e-dddc7d505882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.185743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce5eff-d45f-4dec-a98e-dddc7d505882 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.198627 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4007/7994] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:48.202807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.220760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2476fa-6af7-43f2-ace7-3654803b3b10 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.225868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.227455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.227741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.228020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] PATH_INFO: `/v3/projects/73bda0cb3caf4cf48686b70f44ee7291/users/78938da0c3274951a1cdfbcaa60a2069/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.244086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bda0cb3caf4cf48686b70f44ee7291, user_id=78938da0c3274951a1cdfbcaa60a2069, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.246784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.269673 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3988/7995] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:48 2022] PUT /identity/v3/projects/73bda0cb3caf4cf48686b70f44ee7291/users/78938da0c3274951a1cdfbcaa60a2069/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:48.281847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.282695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.283059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.321366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] MFA Rules not processed for user `78938da0c3274951a1cdfbcaa60a2069`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:48.324817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:48.412953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4008/7996] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:48.415811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.486335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e40347-45e5-4b6e-81aa-48ec5bcbeb4a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.491617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.492922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.493205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.493483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.494595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.496774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.526652 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3989/7997] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:48 2022] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:48.530423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.542310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d462543-3f03-4812-8f35-41dcc5b0c0d5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.566767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:48.615148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.615778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.616063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.616343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.617552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.619778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.647106 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4009/7998] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:48 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:04:48.651456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.668798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d0304-b390-4cf6-9e1f-6bd408bff4f3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.676522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.677406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.677838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.678260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.679982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.682354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.723172 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3990/7999] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:04:48.727742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.738870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051a7c-849f-4883-beb0-3d7ea27fd12f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.744437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.745135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.745417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.745693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] PATH_INFO: `/v3/projects/024a5f1479a446e4ad9df75e5e1baadd/users/7423f5a79f2e446693567a629f8feed3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.763290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024a5f1479a446e4ad9df75e5e1baadd, user_id=7423f5a79f2e446693567a629f8feed3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.767833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.812379 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4010/8000] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:48 2022] PUT /identity/v3/projects/024a5f1479a446e4ad9df75e5e1baadd/users/7423f5a79f2e446693567a629f8feed3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:48.816734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.834466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9095d5b-6b38-4b96-8f61-22342a383230 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.922519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:48.942400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb464a-782c-4a8d-8681-3ade52903c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.943046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb464a-782c-4a8d-8681-3ade52903c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.943330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb464a-782c-4a8d-8681-3ade52903c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.943604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb464a-782c-4a8d-8681-3ade52903c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:48.944265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb464a-782c-4a8d-8681-3ade52903c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:48.946838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb464a-782c-4a8d-8681-3ade52903c0e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:48.965402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3991/8001] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:48.969446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:48.989741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef56ae5-713e-4696-ab8f-5b2ca7f03967 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:48.996763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:48.997865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:48.998319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:48.998597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] PATH_INFO: `/v3/projects/024a5f1479a446e4ad9df75e5e1baadd/users/7423f5a79f2e446693567a629f8feed3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:49.000629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024a5f1479a446e4ad9df75e5e1baadd, user_id=7423f5a79f2e446693567a629f8feed3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:49.003494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:49.024950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4011/8002] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:48 2022] PUT /identity/v3/projects/024a5f1479a446e4ad9df75e5e1baadd/users/7423f5a79f2e446693567a629f8feed3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:04:49.035251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:49.035529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:49.035807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:49.083360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] MFA Rules not processed for user `7423f5a79f2e446693567a629f8feed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:49.085014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:49.158422 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3992/8003] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:49.169877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:49.171576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:49.244931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b832d-dfee-43b4-b058-d331f3859285 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:49.248665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:49.249124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:49.249406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:49.249682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:49.259717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:49.261354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:49.271527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4012/8004] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:49.318843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:49.320655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:49.344976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cb5b7-a492-4088-a560-baa18984a668 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:49.348695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff93e2-c8be-4bad-bfbf-c90edc89a0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:49.349344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff93e2-c8be-4bad-bfbf-c90edc89a0cb service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:49.349630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff93e2-c8be-4bad-bfbf-c90edc89a0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:49.349907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff93e2-c8be-4bad-bfbf-c90edc89a0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:49.416975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff93e2-c8be-4bad-bfbf-c90edc89a0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:49.418655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff93e2-c8be-4bad-bfbf-c90edc89a0cb service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:49.431070 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3993/8005] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:50.555087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:50.558493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:50.656796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10416-6aaf-45a4-92d2-30916ad48649 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:50.661832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:50.662988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:50.663688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:50.664184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] PATH_INFO: `/v3/users/b7c84d1eac77481b97d45dfbfdef32ab` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:50.665506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c84d1eac77481b97d45dfbfdef32ab)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:50.667833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:50.675886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:50.745453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c84d1eac77481b97d45dfbfdef32ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:50.767860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c84d1eac77481b97d45dfbfdef32ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:50.768745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c84d1eac77481b97d45dfbfdef32ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:50.781317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c84d1eac77481b97d45dfbfdef32ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:50.782238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c84d1eac77481b97d45dfbfdef32ab'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:50.805716 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4013/8006] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:50 2022] DELETE /identity/v3/users/b7c84d1eac77481b97d45dfbfdef32ab => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:50.819280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:50.819280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:50.819280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:50.848066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:50.849343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:50.913614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3994/8007] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:50.924372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:50.926016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:50.991198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79007c7d-4c3d-437c-a17a-fcaf48a1d742 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:50.995875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:50.996626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:50.997099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:50.997461 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:51.007885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:51.009480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:51.021927 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4014/8008] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:51.414728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:51.418011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:51.449909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5969b-9574-4e5f-ad64-a3bc29e8c51a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:51.451608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:51.458195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:51.460966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:51.463658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:51.464836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] PATH_INFO: `/v3/projects/ec96e148fb584e47aea344938b4eac8f` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:51.469580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec96e148fb584e47aea344938b4eac8f)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:51.473489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:51.560320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec96e148fb584e47aea344938b4eac8f', 'request_id': 'req-338562c4-3312-4beb-8972-943d0cb27733'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.573404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec96e148fb584e47aea344938b4eac8f', 'request_id': 'req-338562c4-3312-4beb-8972-943d0cb27733'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.582700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec96e148fb584e47aea344938b4eac8f', 'request_id': 'req-338562c4-3312-4beb-8972-943d0cb27733'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.605529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] The token cache is being invalidate because project ec96e148fb584e47aea344938b4eac8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:51.605992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.611731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.614521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3995/8009] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:51 2022] DELETE /identity/v3/projects/ec96e148fb584e47aea344938b4eac8f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:51.619940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:51.636756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da6689-e217-4aa5-be32-c90893276cbc service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:51.712872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:51.712872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:51.712872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:51.712872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] PATH_INFO: `/v3/users/12022b125cdb43c2a52b98d4991862ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:51.713499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12022b125cdb43c2a52b98d4991862ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:51.715657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:51.768716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:51.795491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12022b125cdb43c2a52b98d4991862ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.819348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12022b125cdb43c2a52b98d4991862ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.819809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12022b125cdb43c2a52b98d4991862ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.829142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12022b125cdb43c2a52b98d4991862ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.832734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12022b125cdb43c2a52b98d4991862ba'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:51.855162 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4015/8010] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:51 2022] DELETE /identity/v3/users/12022b125cdb43c2a52b98d4991862ba => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:52.238546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:52.240407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:52.273620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338562c4-3312-4beb-8972-943d0cb27733 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:52.339906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:52.340564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:52.340844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:52.341160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] PATH_INFO: `/v3/projects/2bb063072f83411cbc9ec63c8dd68ab9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:52.342312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb063072f83411cbc9ec63c8dd68ab9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:52.344369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:52.401057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb063072f83411cbc9ec63c8dd68ab9', 'request_id': 'req-25f2d934-0ef8-4307-a723-15a69aa0b718'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.411436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb063072f83411cbc9ec63c8dd68ab9', 'request_id': 'req-25f2d934-0ef8-4307-a723-15a69aa0b718'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.419230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb063072f83411cbc9ec63c8dd68ab9', 'request_id': 'req-25f2d934-0ef8-4307-a723-15a69aa0b718'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.431595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] The token cache is being invalidate because project 2bb063072f83411cbc9ec63c8dd68ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:52.431893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.432662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.434389 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3996/8011] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:52 2022] DELETE /identity/v3/projects/2bb063072f83411cbc9ec63c8dd68ab9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:52.438197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:52.439618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:52.452586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346febe-71ca-4abe-8d1e-c671ad567356 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:52.515323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:52.515974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:52.516259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:52.516540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] PATH_INFO: `/v3/users/99d26adc78f040e0878faab5487e57b0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:52.517721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d26adc78f040e0878faab5487e57b0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:52.519696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:52.567547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d26adc78f040e0878faab5487e57b0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.580931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d26adc78f040e0878faab5487e57b0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.581748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d26adc78f040e0878faab5487e57b0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.590511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d26adc78f040e0878faab5487e57b0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.591224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bdfac170-a502-4287-bbaf-94364cbb98b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d26adc78f040e0878faab5487e57b0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:52.606605 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4016/8012] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:52 2022] DELETE /identity/v3/users/99d26adc78f040e0878faab5487e57b0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:53.006095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.010400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:53.043356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d934-0ef8-4307-a723-15a69aa0b718 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.060756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:53.121628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.124042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.124440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.124937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] PATH_INFO: `/v3/projects/2b3ee9bacf82491293982ae2fcd58100` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.127213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3ee9bacf82491293982ae2fcd58100)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.130196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.193181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3ee9bacf82491293982ae2fcd58100', 'request_id': 'req-2e832e0a-3179-49de-ae1c-c939181a8e7b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:53.202083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3ee9bacf82491293982ae2fcd58100', 'request_id': 'req-2e832e0a-3179-49de-ae1c-c939181a8e7b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:53.209962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3ee9bacf82491293982ae2fcd58100', 'request_id': 'req-2e832e0a-3179-49de-ae1c-c939181a8e7b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:53.222994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] The token cache is being invalidate because project 2b3ee9bacf82491293982ae2fcd58100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:53.223366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:53.224051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2e832e0a-3179-49de-ae1c-c939181a8e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:53.225858 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3997/8013] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:53 2022] DELETE /identity/v3/projects/2b3ee9bacf82491293982ae2fcd58100 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:53.230718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.231251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.231351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.253704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:53.254943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:53.277729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:53.321624 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4017/8014] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:53.330247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.330731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.330895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.351884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:53.353106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:53.361290 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3998/8015] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:53.366030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.376076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da339aa8-7543-4396-90a2-c07d03e2ebfa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.380684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.381324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.381623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.381885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.383152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:53.383456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.385080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.397026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4018/8016] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:53.402341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.411908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19617b2-52ea-4385-8d7b-acb730e861b5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.416853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.417481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.417763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.418043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.418677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.420579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.452415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 3999/8017] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:53 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:53.453705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.464749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eda1b-73d8-4ece-9fa8-226f96c3a9b6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.532032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.532658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.532969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.533249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.533876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.535795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.561886 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4019/8018] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:53 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:53.563136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.574127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e35a8d-0ce1-458e-8c98-e27344090efe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.578767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.579384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.579711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.579940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.580681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.582439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.593192 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4000/8019] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:53.597072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.608652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286083c-1bf0-4aa6-9d32-ee670ff06c45 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.613513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673b5d9-6e29-489b-9c97-4f2fc1f20231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.614117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b5d9-6e29-489b-9c97-4f2fc1f20231 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.614401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b5d9-6e29-489b-9c97-4f2fc1f20231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.614677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b5d9-6e29-489b-9c97-4f2fc1f20231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.615324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673b5d9-6e29-489b-9c97-4f2fc1f20231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.618485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673b5d9-6e29-489b-9c97-4f2fc1f20231 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.629433 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4020/8020] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:53.634061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.644468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6d869-08a7-4c72-86da-00516fbccab7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.650076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.650745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.651028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.651306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] PATH_INFO: `/v3/projects/ab1edf3cfeff48e7a295daa9dcb1877a/users/ea7fccf567094c43aec0de4b4399538e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.667687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab1edf3cfeff48e7a295daa9dcb1877a, user_id=ea7fccf567094c43aec0de4b4399538e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.670574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.685293 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4001/8021] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:53 2022] PUT /identity/v3/projects/ab1edf3cfeff48e7a295daa9dcb1877a/users/ea7fccf567094c43aec0de4b4399538e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:53.696434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.696723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.697032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.724772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] MFA Rules not processed for user `ea7fccf567094c43aec0de4b4399538e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:53.726186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:53.799155 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4021/8022] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:53.811914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:53.813741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:53.868576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:53.888353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592b07-f6e6-4997-b580-630c3b013dfe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:53.896579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77014770-2ca6-4c7b-9200-4508f8ff19fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:53.897787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014770-2ca6-4c7b-9200-4508f8ff19fd service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:53.898510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014770-2ca6-4c7b-9200-4508f8ff19fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:53.899088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77014770-2ca6-4c7b-9200-4508f8ff19fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:53.919263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77014770-2ca6-4c7b-9200-4508f8ff19fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:53.921399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77014770-2ca6-4c7b-9200-4508f8ff19fd service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:53.941087 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4002/8023] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:54.389479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:54.391653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:54.426989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:54.482829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0bc54-d2df-4f5c-8047-c7805e93f1c3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:54.490017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:54.490913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:54.491297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:54.491780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] PATH_INFO: `/v3/users/78938da0c3274951a1cdfbcaa60a2069` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:54.493678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78938da0c3274951a1cdfbcaa60a2069)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:54.497003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:54.587538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78938da0c3274951a1cdfbcaa60a2069'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:54.603402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78938da0c3274951a1cdfbcaa60a2069'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:54.604190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78938da0c3274951a1cdfbcaa60a2069'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:54.614090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78938da0c3274951a1cdfbcaa60a2069'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:54.614821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78938da0c3274951a1cdfbcaa60a2069'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:54.630189 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4022/8024] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:54 2022] DELETE /identity/v3/users/78938da0c3274951a1cdfbcaa60a2069 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:54.635379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:54.636210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:54.636548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:54.666279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:54.668158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:54.748472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4003/8025] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:04:54.759704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:54.761727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:54.856339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681c58-6d48-4e88-ac86-31048295ac8e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:54.862811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:54.863369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:54.863653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:54.864682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:54.884343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:54.886488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:54.900502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4023/8026] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:55.260805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:55.262634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:55.307897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8940-be12-44d3-a717-ffbd2795abc0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:55.337933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:55.338566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:55.338854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:55.339132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] PATH_INFO: `/v3/projects/73bda0cb3caf4cf48686b70f44ee7291` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:55.340529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bda0cb3caf4cf48686b70f44ee7291)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:55.342678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:55.412711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bda0cb3caf4cf48686b70f44ee7291', 'request_id': 'req-2b106a2a-f61d-43b1-b5db-56292f03d186'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.428289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bda0cb3caf4cf48686b70f44ee7291', 'request_id': 'req-2b106a2a-f61d-43b1-b5db-56292f03d186'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.441747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bda0cb3caf4cf48686b70f44ee7291', 'request_id': 'req-2b106a2a-f61d-43b1-b5db-56292f03d186'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.458444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] The token cache is being invalidate because project 73bda0cb3caf4cf48686b70f44ee7291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:55.458684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.459334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.461659 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4004/8027] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:55 2022] DELETE /identity/v3/projects/73bda0cb3caf4cf48686b70f44ee7291 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:04:55.478249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:55.490873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914503-89ad-4e8d-b8eb-e2904c8f496a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:55.543699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:55.564674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:55.565446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:55.565728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:55.566002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] PATH_INFO: `/v3/users/7423f5a79f2e446693567a629f8feed3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:55.567144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7423f5a79f2e446693567a629f8feed3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:55.569362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:55.618251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7423f5a79f2e446693567a629f8feed3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.631309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7423f5a79f2e446693567a629f8feed3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.632030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7423f5a79f2e446693567a629f8feed3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.640281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7423f5a79f2e446693567a629f8feed3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.641358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6919a0d8-4dd5-4d40-ace2-584f95208c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7423f5a79f2e446693567a629f8feed3'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:55.665993 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4024/8028] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:55 2022] DELETE /identity/v3/users/7423f5a79f2e446693567a629f8feed3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:55.965308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:55.967133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:55.984250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b106a2a-f61d-43b1-b5db-56292f03d186 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.050610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.051251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.051531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.051940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] PATH_INFO: `/v3/projects/024a5f1479a446e4ad9df75e5e1baadd` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.053136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=024a5f1479a446e4ad9df75e5e1baadd)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.055261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.067450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:56.107941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024a5f1479a446e4ad9df75e5e1baadd', 'request_id': 'req-283dd722-fb04-43ad-a34d-b61e12b0b3ca'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:56.116081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024a5f1479a446e4ad9df75e5e1baadd', 'request_id': 'req-283dd722-fb04-43ad-a34d-b61e12b0b3ca'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:56.122662 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024a5f1479a446e4ad9df75e5e1baadd', 'request_id': 'req-283dd722-fb04-43ad-a34d-b61e12b0b3ca'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:56.133946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] The token cache is being invalidate because project 024a5f1479a446e4ad9df75e5e1baadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:56.134246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:56.134925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-283dd722-fb04-43ad-a34d-b61e12b0b3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:56.136537 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4005/8029] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:55 2022] DELETE /identity/v3/projects/024a5f1479a446e4ad9df75e5e1baadd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:56.141644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.141928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.142207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.164441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:56.165694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:56.227090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4025/8030] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:56.235642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.235926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.236203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.259081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:56.260486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:56.268806 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4006/8031] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:56.273303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.283062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa56c4-ff28-465b-bd50-b3e6d4d2121b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.287602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.288209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.289202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.289483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.290133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:56.290434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.292030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.303606 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4026/8032] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:56.308454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.318165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a84274-6eb0-4148-b036-c9f251c792cc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.323289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.323984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.324331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.324670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.325410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.327380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.356652 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4007/8033] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:56 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:56.360725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.371190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e9100-908d-4dc6-870c-2f0eb703d024 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.418004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:56.430953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.431747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.432151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.432664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.433411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.435707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.459339 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4027/8034] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:56 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:56.463221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.474449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba5f6-997a-4cf7-aec4-1c5005b3b126 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.481992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.482848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.483152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.483395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.484186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.485811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.499424 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4008/8035] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:56.502167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.515349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974348f2-d1fb-4ceb-bfd5-db460901f4ac admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.521898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22128cc7-ca59-4995-b5b0-8f1aec145b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.522519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128cc7-ca59-4995-b5b0-8f1aec145b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.522869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128cc7-ca59-4995-b5b0-8f1aec145b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.523147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128cc7-ca59-4995-b5b0-8f1aec145b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.524054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22128cc7-ca59-4995-b5b0-8f1aec145b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.525980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22128cc7-ca59-4995-b5b0-8f1aec145b89 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.540738 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4028/8036] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:04:56.561065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.562956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acddb9-acad-4843-908d-a943320a76fe None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.563242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acddb9-acad-4843-908d-a943320a76fe None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.563518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acddb9-acad-4843-908d-a943320a76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.582488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d41cc7-db0c-42ed-aba0-157e7f8abe46 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.596558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-13acddb9-acad-4843-908d-a943320a76fe None None] MFA Rules not processed for user `ea7fccf567094c43aec0de4b4399538e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:56.597040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b357955-c7d3-48e2-8442-7f81df04dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.597625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b357955-c7d3-48e2-8442-7f81df04dc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.597907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b357955-c7d3-48e2-8442-7f81df04dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.598186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b357955-c7d3-48e2-8442-7f81df04dc06 admin admin] PATH_INFO: `/v3/projects/b9b8264ce42e43fa955bcbc9e8fb9974/users/a8d10843665444318dd738e545d69fd0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.603226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13acddb9-acad-4843-908d-a943320a76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:56.623509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b357955-c7d3-48e2-8442-7f81df04dc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b8264ce42e43fa955bcbc9e8fb9974, user_id=a8d10843665444318dd738e545d69fd0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.627768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b357955-c7d3-48e2-8442-7f81df04dc06 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.682587 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4009/8037] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:56 2022] PUT /identity/v3/projects/b9b8264ce42e43fa955bcbc9e8fb9974/users/a8d10843665444318dd738e545d69fd0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:56.683694 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4029/8038] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:56.684092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.684386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.684665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.721167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] MFA Rules not processed for user `a8d10843665444318dd738e545d69fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:56.723000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:56.810199 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4010/8039] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:56.817652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acddb9-acad-4843-908d-a943320a76fe None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:56.820419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13acddb9-acad-4843-908d-a943320a76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:56.892269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acddb9-acad-4843-908d-a943320a76fe None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:56.948738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1dd03-dcae-4d0d-a119-a79f18aac2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:56.949473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1dd03-dcae-4d0d-a119-a79f18aac2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:56.950325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1dd03-dcae-4d0d-a119-a79f18aac2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:56.950325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1dd03-dcae-4d0d-a119-a79f18aac2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:56.960253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1dd03-dcae-4d0d-a119-a79f18aac2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:56.961962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1dd03-dcae-4d0d-a119-a79f18aac2b9 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:56.972254 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4030/8040] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:56.995479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:57.030897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:57.071667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae811-c309-46ce-98e0-ffb9b354824d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:57.076401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:57.077076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:57.077363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:57.077641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] PATH_INFO: `/v3/users/a8d10843665444318dd738e545d69fd0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:57.078789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d10843665444318dd738e545d69fd0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:57.080730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:57.138905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d10843665444318dd738e545d69fd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.156545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d10843665444318dd738e545d69fd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.157334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d10843665444318dd738e545d69fd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.169680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d10843665444318dd738e545d69fd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.171167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d10843665444318dd738e545d69fd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.186648 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4011/8041] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:56 2022] DELETE /identity/v3/users/a8d10843665444318dd738e545d69fd0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:57.191073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:57.191370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:57.191652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:57.217563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:57.218782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:57.254993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:57.311403 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4031/8042] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:04:57.321347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:57.322889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:57.419440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b02e-dfab-4521-8128-5985d5552146 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:57.424341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32921d-245f-4a87-b2af-c6f295f72a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:57.425066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32921d-245f-4a87-b2af-c6f295f72a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:57.425414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32921d-245f-4a87-b2af-c6f295f72a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:57.425752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32921d-245f-4a87-b2af-c6f295f72a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:57.441200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32921d-245f-4a87-b2af-c6f295f72a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:57.442736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32921d-245f-4a87-b2af-c6f295f72a79 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:57.458894 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4012/8043] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:57.861714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:57.863763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:57.890674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f8ce9-8337-4dd4-abc0-d518d0381892 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:57.895823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:57.896542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:57.897048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:57.898027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] PATH_INFO: `/v3/projects/b9b8264ce42e43fa955bcbc9e8fb9974` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:57.899261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b8264ce42e43fa955bcbc9e8fb9974)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:57.901587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:57.958173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b8264ce42e43fa955bcbc9e8fb9974', 'request_id': 'req-55ddf10d-e4d9-4387-810d-2842c316e321'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.964204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b8264ce42e43fa955bcbc9e8fb9974', 'request_id': 'req-55ddf10d-e4d9-4387-810d-2842c316e321'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.970834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b8264ce42e43fa955bcbc9e8fb9974', 'request_id': 'req-55ddf10d-e4d9-4387-810d-2842c316e321'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.985882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] The token cache is being invalidate because project b9b8264ce42e43fa955bcbc9e8fb9974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:57.986287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.986938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-55ddf10d-e4d9-4387-810d-2842c316e321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:57.988693 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4032/8044] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:57 2022] DELETE /identity/v3/projects/b9b8264ce42e43fa955bcbc9e8fb9974 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:57.995404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:57.996406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:57.997358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.018527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:58.019897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:58.065191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:58.082449 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4013/8045] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:58.090613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.090864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.091419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.112081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:58.113527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:58.121881 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4033/8046] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:58.126064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.135687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2141-1d2f-4b5d-8677-f64fde0ee1cd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.140599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.141238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.141521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.141793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.142445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:58.142754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.144338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.157263 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4014/8047] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:04:58.162112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.172084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919dd28-c8c2-441c-9131-6d1aa196d40e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.176692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.177323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.177603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.177876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.178503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.181378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.209824 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4034/8048] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:58 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:58.214706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.225142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601a849-6a26-4bd2-8e21-8c1cec1ee2ba admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.284013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.284684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.285393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.285767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.286597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.289575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.310629 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4015/8049] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:58 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:04:58.314738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.324961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f650-063a-4bca-81c5-00ce8a00548d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.329596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.330190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.330468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.330740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.331376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.332965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.343232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4035/8050] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:58.347085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.357491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04698a9-2aea-4163-8519-c3e19ec89d3e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.362026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d729c-405b-4539-aea7-3de7c57d50e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.362616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d729c-405b-4539-aea7-3de7c57d50e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.362897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d729c-405b-4539-aea7-3de7c57d50e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.363169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d729c-405b-4539-aea7-3de7c57d50e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.363798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d729c-405b-4539-aea7-3de7c57d50e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.365407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d729c-405b-4539-aea7-3de7c57d50e7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.376105 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4016/8051] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:58.380047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.390672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4ecc-ce25-40bd-9b51-9978ce93ea0d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.395232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.395866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.396146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.396490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] PATH_INFO: `/v3/projects/62cb71aa782f49538d3dab4377f2e308/users/022ea3dd61a8440da1f8699caa7af2ef/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.411200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62cb71aa782f49538d3dab4377f2e308, user_id=022ea3dd61a8440da1f8699caa7af2ef, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.414474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.426933 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4036/8052] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:58 2022] PUT /identity/v3/projects/62cb71aa782f49538d3dab4377f2e308/users/022ea3dd61a8440da1f8699caa7af2ef/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:58.437953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.438245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.438522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.466597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] MFA Rules not processed for user `022ea3dd61a8440da1f8699caa7af2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:58.467818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:58.535614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4017/8053] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:58.577910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.587261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:58.670556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f42b-1790-4ae5-a836-c363e1322ef9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.674446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0e4f-6a46-41d9-add9-00968f48eda5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.675249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0e4f-6a46-41d9-add9-00968f48eda5 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.675597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0e4f-6a46-41d9-add9-00968f48eda5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.675942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0e4f-6a46-41d9-add9-00968f48eda5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.682758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:58.686892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd0e4f-6a46-41d9-add9-00968f48eda5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.688631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd0e4f-6a46-41d9-add9-00968f48eda5 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.702621 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4037/8054] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:04:58.727490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:58.790046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:58.810516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a16e66-27aa-4016-ba55-bad6a336eb36 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:58.815766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:58.816410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.816695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.817258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] PATH_INFO: `/v3/users/022ea3dd61a8440da1f8699caa7af2ef` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.818445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=022ea3dd61a8440da1f8699caa7af2ef)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:58.821080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:58.869849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022ea3dd61a8440da1f8699caa7af2ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:58.883166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022ea3dd61a8440da1f8699caa7af2ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:58.884020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022ea3dd61a8440da1f8699caa7af2ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:58.892336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022ea3dd61a8440da1f8699caa7af2ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:58.893077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022ea3dd61a8440da1f8699caa7af2ef'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:58.905865 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4018/8055] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:04:58 2022] DELETE /identity/v3/users/022ea3dd61a8440da1f8699caa7af2ef => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:58.910410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:58.910916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:58.911015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:58.931740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:58.932992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:58.996169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4038/8056] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:59.007443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.009783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:59.078748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4cfeb-fe68-4c2e-908a-cbbc24609489 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.082601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352235f-e4ab-49a2-86a4-540ec1ec7166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.083210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352235f-e4ab-49a2-86a4-540ec1ec7166 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.083490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352235f-e4ab-49a2-86a4-540ec1ec7166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.083770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352235f-e4ab-49a2-86a4-540ec1ec7166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.093805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352235f-e4ab-49a2-86a4-540ec1ec7166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.095789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352235f-e4ab-49a2-86a4-540ec1ec7166 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.105892 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4019/8057] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:04:59.384262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.385962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:59.399976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f4e9f-4a8f-47ce-a5df-71e5f5d92480 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.405362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.407454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.407454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.407454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] PATH_INFO: `/v3/projects/62cb71aa782f49538d3dab4377f2e308` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.407753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62cb71aa782f49538d3dab4377f2e308)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.409697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.463642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62cb71aa782f49538d3dab4377f2e308', 'request_id': 'req-717807ec-ee42-4374-9bbe-9a57a37b5da4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:59.470325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62cb71aa782f49538d3dab4377f2e308', 'request_id': 'req-717807ec-ee42-4374-9bbe-9a57a37b5da4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:59.477675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62cb71aa782f49538d3dab4377f2e308', 'request_id': 'req-717807ec-ee42-4374-9bbe-9a57a37b5da4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:59.502872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] The token cache is being invalidate because project 62cb71aa782f49538d3dab4377f2e308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:04:59.503248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:59.503922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-717807ec-ee42-4374-9bbe-9a57a37b5da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:04:59.505735 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4039/8058] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:04:59 2022] DELETE /identity/v3/projects/62cb71aa782f49538d3dab4377f2e308 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:04:59.510589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.510734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.511018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.533561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:59.534815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:59.617169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4020/8059] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:59.621705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.622094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.622440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.644052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:04:59.645409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:04:59.654366 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4040/8060] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:04:59.658509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.672115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bb290-3d15-45ac-ba66-4cc7e0ea8dbf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.677399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.678094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.678797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.678797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.680353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:04:59.680741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.682547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.684430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:04:59.696327 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4021/8061] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:04:59.700878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.711947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd87c7-4092-4017-8c7a-bfff09bf7cd6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.717014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.717629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.717909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.718268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.718935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.720828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.764504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4041/8062] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:04:59 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:59.765167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.777197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f025-64d9-45ef-859d-223d9c2344ad admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.841659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.842178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.842460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.842732 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.843360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.845379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.874499 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4022/8063] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:04:59 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:04:59.876002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.889728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a8ba5-fef2-43ff-b777-6f2e52d9ae93 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.894665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.895342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.895692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.896035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.896791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.898565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.909393 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4042/8064] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:59.913043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.922953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6036-801b-4124-a4e6-a4aa762a1379 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.927571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90db6e-4bde-40ac-ac1a-f21de869edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.928176 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90db6e-4bde-40ac-ac1a-f21de869edfb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.928458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90db6e-4bde-40ac-ac1a-f21de869edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.928739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90db6e-4bde-40ac-ac1a-f21de869edfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.929899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90db6e-4bde-40ac-ac1a-f21de869edfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.931652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90db6e-4bde-40ac-ac1a-f21de869edfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.945923 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4023/8065] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:04:59.947348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:04:59.957593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3856c0c-f7ef-48f4-8655-16335fae4da8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:04:59.962508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:04:59.963239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:04:59.963589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:04:59.963870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] PATH_INFO: `/v3/projects/4826a186c30d440aae7f6bda2a7da4f1/users/26505c60342a4b48877fade62b501c04/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:04:59.979268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4826a186c30d440aae7f6bda2a7da4f1, user_id=26505c60342a4b48877fade62b501c04, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:04:59.982031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:04:59.999853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4043/8066] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:04:59 2022] PUT /identity/v3/projects/4826a186c30d440aae7f6bda2a7da4f1/users/26505c60342a4b48877fade62b501c04/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:00.011217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:00.011753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:00.013091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:00.042776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] MFA Rules not processed for user `26505c60342a4b48877fade62b501c04`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:00.044006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:00.119149 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4024/8067] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:00.130560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:00.132292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:00.151717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:00.196085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02eaf7-f3d8-45bf-b290-5bb31dc3186c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:00.199739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c822c30-ebad-4834-a02a-dca1d665d525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:00.200347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c822c30-ebad-4834-a02a-dca1d665d525 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:00.200626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c822c30-ebad-4834-a02a-dca1d665d525 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:00.200916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c822c30-ebad-4834-a02a-dca1d665d525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:00.209362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c822c30-ebad-4834-a02a-dca1d665d525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:00.210836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c822c30-ebad-4834-a02a-dca1d665d525 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:00.219680 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4044/8068] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:08.426719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:08.490892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:08.521487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7032d5-be42-48ec-9b61-b5693ff98470 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:08.527712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:08.528496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:08.528785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:08.529098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] PATH_INFO: `/v3/users/26505c60342a4b48877fade62b501c04` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:08.530430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26505c60342a4b48877fade62b501c04)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:08.532348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:08.586845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26505c60342a4b48877fade62b501c04'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:08.599254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26505c60342a4b48877fade62b501c04'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:08.599962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26505c60342a4b48877fade62b501c04'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:08.608694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26505c60342a4b48877fade62b501c04'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:08.609453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26505c60342a4b48877fade62b501c04'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:08.624264 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4025/8069] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:05:08 2022] DELETE /identity/v3/users/26505c60342a4b48877fade62b501c04 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:05:08.630377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:08.631118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:08.631681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:08.676219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:08.677448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:08.741857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4045/8070] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:08.751695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:08.753173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:08.840468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79944-a790-4e78-913e-017e1d525eb6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:08.844541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d96e-9d51-4d5e-b4b3-3bdf3e1d5182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:08.845277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d96e-9d51-4d5e-b4b3-3bdf3e1d5182 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:08.845634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d96e-9d51-4d5e-b4b3-3bdf3e1d5182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:08.845984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d96e-9d51-4d5e-b4b3-3bdf3e1d5182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:08.855742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d96e-9d51-4d5e-b4b3-3bdf3e1d5182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:08.857271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d96e-9d51-4d5e-b4b3-3bdf3e1d5182 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:08.868475 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4026/8071] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:05:09.187788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.189448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:09.205100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b77ea-29e4-4102-8b5e-2e541a3c582e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.212843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.213622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.214116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.214476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] PATH_INFO: `/v3/projects/4826a186c30d440aae7f6bda2a7da4f1` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.216384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4826a186c30d440aae7f6bda2a7da4f1)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.218589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.278633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4826a186c30d440aae7f6bda2a7da4f1', 'request_id': 'req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:09.284364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4826a186c30d440aae7f6bda2a7da4f1', 'request_id': 'req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:09.291556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4826a186c30d440aae7f6bda2a7da4f1', 'request_id': 'req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:09.309741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] The token cache is being invalidate because project 4826a186c30d440aae7f6bda2a7da4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:05:09.310192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:09.310983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-df8eebd4-b20d-44ca-84bf-3a2e790aa30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:09.316626 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4046/8072] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:05:09 2022] DELETE /identity/v3/projects/4826a186c30d440aae7f6bda2a7da4f1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:09.318351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4702495-747f-45d8-983a-baa226c8575a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.318650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4702495-747f-45d8-983a-baa226c8575a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.318932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4702495-747f-45d8-983a-baa226c8575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.344232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c4702495-747f-45d8-983a-baa226c8575a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:09.345653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c4702495-747f-45d8-983a-baa226c8575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:09.408952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:09.435143 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4027/8073] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:09.448409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.448696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.449216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.483935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:09.484827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:09.493517 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4047/8074] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:09.497530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4702495-747f-45d8-983a-baa226c8575a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.508149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4702495-747f-45d8-983a-baa226c8575a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.512856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.513539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.514078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.514353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.515005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:05:09.515312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.516929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.530243 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4028/8075] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:05:09.541626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.555441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba242b-f6c5-4546-9605-b10e2bb2c725 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.561108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.562073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.562466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.563446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.564243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.567182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.625924 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4048/8076] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:05:09 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:05:09.626995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.641777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f241b34-c31e-4b88-a6eb-6d3438d027c6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.717517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.718131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.718410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.718683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.719323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.721249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.744341 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4029/8077] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:05:09 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:05:09.748845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.756360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:09.761569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eb16-c8f4-44ba-b83d-3a5ea6be9872 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.768256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.769033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.769403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.769894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.770785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.772590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.787208 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4049/8078] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:05:09.791281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.805380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614de123-f08a-4f04-9a11-cb615da8eb33 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.810779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28877e42-7f7d-4ce0-a4b2-91f6eb7ff4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.811391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877e42-7f7d-4ce0-a4b2-91f6eb7ff4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.811708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877e42-7f7d-4ce0-a4b2-91f6eb7ff4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.811989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877e42-7f7d-4ce0-a4b2-91f6eb7ff4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.812632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28877e42-7f7d-4ce0-a4b2-91f6eb7ff4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.814287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28877e42-7f7d-4ce0-a4b2-91f6eb7ff4f2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.827497 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4030/8079] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:05:09.831539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:09.843271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67cf64-90e4-47e0-b02e-aec97cd35717 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:09.849835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:09.850516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.851550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.851644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] PATH_INFO: `/v3/projects/6c6aa80b8f7e434e904f072e8f7fed14/users/46af9c81141b48e99a1c6212a7c85285/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.869954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6aa80b8f7e434e904f072e8f7fed14, user_id=46af9c81141b48e99a1c6212a7c85285, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:09.873417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:09.893139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4050/8080] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:05:09 2022] PUT /identity/v3/projects/6c6aa80b8f7e434e904f072e8f7fed14/users/46af9c81141b48e99a1c6212a7c85285/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:09.900067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:09.900674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:09.901194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:09.941073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] MFA Rules not processed for user `46af9c81141b48e99a1c6212a7c85285`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:09.942483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:10.025543 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4031/8081] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:05:10.030556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:10.097172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec06acf-60dc-4031-b4b2-713b6a84cea6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:10.102535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:10.103225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:10.103568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:10.104210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:10.104537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:10.106469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:10.143794 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4051/8082] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:05:10 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:05:10.144692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:10.156180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760ed5e-9657-40e9-a6c3-726e24f90dd2 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:10.200417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:10.226562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:10.227203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:10.227491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:10.227754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:10.228492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:10.230580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:10.258364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4032/8083] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:05:10 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:05:10.262345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:10.274092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61a532-e8a3-45be-9733-be80b32dfb15 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:10.279061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9f2a-e374-45b4-9e14-debe8d769024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:10.279639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9f2a-e374-45b4-9e14-debe8d769024 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:10.279933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9f2a-e374-45b4-9e14-debe8d769024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:10.280244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9f2a-e374-45b4-9e14-debe8d769024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:10.280856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9f2a-e374-45b4-9e14-debe8d769024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:10.282502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9f2a-e374-45b4-9e14-debe8d769024 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:10.295875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4052/8084] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:05:10.300053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:10.311617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648c06-ca4d-4181-9f2f-11f690f38171 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:10.317749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:10.317749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:10.317749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:10.318072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] PATH_INFO: `/v3/projects/4f27b2dd730c486a80410e1abaa672f0/users/62b8d5e722054e4a90d3228e2f75542d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:10.334505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f27b2dd730c486a80410e1abaa672f0, user_id=62b8d5e722054e4a90d3228e2f75542d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:10.337889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:10.355103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4033/8085] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:05:10 2022] PUT /identity/v3/projects/4f27b2dd730c486a80410e1abaa672f0/users/62b8d5e722054e4a90d3228e2f75542d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:10.366398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:10.367111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:10.367646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:10.399366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] MFA Rules not processed for user `62b8d5e722054e4a90d3228e2f75542d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:10.400622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:10.477059 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4053/8086] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:10 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:10.514391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:10.516334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:10.593921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd17c-8390-4ddc-9725-d37b673bbbfb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:10.599166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa520af-5f70-4b5b-9b42-24eaeea819cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:10.599845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa520af-5f70-4b5b-9b42-24eaeea819cf service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:10.600199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa520af-5f70-4b5b-9b42-24eaeea819cf service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:10.600539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa520af-5f70-4b5b-9b42-24eaeea819cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:10.609376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa520af-5f70-4b5b-9b42-24eaeea819cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:10.611029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa520af-5f70-4b5b-9b42-24eaeea819cf service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:10.619939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4034/8087] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:05:11.227102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:11.261968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:11.292964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72847212-a876-4ac1-b3e9-9d7bed52aa8f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:11.299130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:11.300048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:11.300335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:11.300618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] PATH_INFO: `/v3/users/46af9c81141b48e99a1c6212a7c85285` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:11.301786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46af9c81141b48e99a1c6212a7c85285)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:11.303752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:11.352348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46af9c81141b48e99a1c6212a7c85285'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.364307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46af9c81141b48e99a1c6212a7c85285'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.365017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46af9c81141b48e99a1c6212a7c85285'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.372744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46af9c81141b48e99a1c6212a7c85285'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.373431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46af9c81141b48e99a1c6212a7c85285'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.386134 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4054/8088] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:05:11 2022] DELETE /identity/v3/users/46af9c81141b48e99a1c6212a7c85285 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:11.391027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:11.391323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:11.391632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:11.412137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:11.414056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:11.475304 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4035/8089] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:05:11.485420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:11.486847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:11.548776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bff99-867e-4a0d-87fe-5b85fde2d5c6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:11.552376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:11.553015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:11.553296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:11.553568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:11.563229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:11.564799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:11.575011 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4055/8090] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:11.857846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:11.859393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:11.875318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c7e5-4a4c-42fe-aa66-acf424c936bd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:11.881328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:11.882720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:11.883341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:11.883341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] PATH_INFO: `/v3/projects/6c6aa80b8f7e434e904f072e8f7fed14` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:11.891040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6aa80b8f7e434e904f072e8f7fed14)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:11.893198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:11.933185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:11.948397 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6aa80b8f7e434e904f072e8f7fed14', 'request_id': 'req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.955705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6aa80b8f7e434e904f072e8f7fed14', 'request_id': 'req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.961860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6aa80b8f7e434e904f072e8f7fed14', 'request_id': 'req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.974032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] The token cache is being invalidate because project 6c6aa80b8f7e434e904f072e8f7fed14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:05:11.974325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.974990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:11.976763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4036/8091] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:05:11 2022] DELETE /identity/v3/projects/6c6aa80b8f7e434e904f072e8f7fed14 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:11.980517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:11.990602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd477-ca3d-4630-9639-5e77e1a3f8aa service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:12.043658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:12.051670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:12.052414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.052711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.053083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] PATH_INFO: `/v3/users/62b8d5e722054e4a90d3228e2f75542d` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.055399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b8d5e722054e4a90d3228e2f75542d)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:12.057843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:12.110849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b8d5e722054e4a90d3228e2f75542d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.123634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b8d5e722054e4a90d3228e2f75542d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.124363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b8d5e722054e4a90d3228e2f75542d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.133361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b8d5e722054e4a90d3228e2f75542d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.134091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c4a7aa7a-8434-482a-b8b7-7fb0a3083e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b8d5e722054e4a90d3228e2f75542d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.147407 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4056/8092] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:05:11 2022] DELETE /identity/v3/users/62b8d5e722054e4a90d3228e2f75542d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:12.440355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:12.442499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:12.464659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee56fe0-1b64-4d60-b1c8-fa503c33eb9f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:12.532018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:12.532656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.532968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.533249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] PATH_INFO: `/v3/projects/4f27b2dd730c486a80410e1abaa672f0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.534371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f27b2dd730c486a80410e1abaa672f0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:12.536293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:12.584320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f27b2dd730c486a80410e1abaa672f0', 'request_id': 'req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.593263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f27b2dd730c486a80410e1abaa672f0', 'request_id': 'req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.598981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f27b2dd730c486a80410e1abaa672f0', 'request_id': 'req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.611991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] The token cache is being invalidate because project 4f27b2dd730c486a80410e1abaa672f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:05:12.612289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.613007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bb35ff73-12c9-4e8e-9fdf-a58de5fb0c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:12.614549 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4037/8093] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:05:12 2022] DELETE /identity/v3/projects/4f27b2dd730c486a80410e1abaa672f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:05:12.619798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.620294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.620397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.641519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:12.642753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:12.717472 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4057/8094] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:12.725332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.725684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.726451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.747605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:12.748865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:12.757438 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4038/8095] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:05:12.761966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:12.772476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7b1f-233f-4325-b4a8-8cd70bd1e110 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:12.777647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:12.778326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.778701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.779049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.779774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:05:12.780150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:12.781851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:12.795853 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4058/8096] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:05:12.800126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:12.810628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e11c6-3f02-475f-b193-9c90e44f333a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:12.815329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:12.816549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.816848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.817175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.817824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:12.819853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:12.852759 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4039/8097] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:05:12 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:05:12.854020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:12.864192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08db41-dbc9-42b4-9d03-93f993c088e1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:12.924430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:12.925068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.925349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.925621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.926274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:12.928164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:12.937694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:12.956097 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4059/8098] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:05:12 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:05:12.957752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:12.972225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1e85c-7a9e-4290-96c7-b0420dcbbdd5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:12.977545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:12.978155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:12.978437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:12.978709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:12.979352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:12.980963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:12.992441 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4040/8099] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:05:12.996228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:13.006232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595d0f4-7931-46c8-a632-c807284e04ff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:13.011353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc8648-fb1f-44e2-abfb-d0d3a5a37370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:13.012136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8648-fb1f-44e2-abfb-d0d3a5a37370 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:13.012451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8648-fb1f-44e2-abfb-d0d3a5a37370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:13.012740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc8648-fb1f-44e2-abfb-d0d3a5a37370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:13.013458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc8648-fb1f-44e2-abfb-d0d3a5a37370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:13.015298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc8648-fb1f-44e2-abfb-d0d3a5a37370 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:13.026370 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4060/8100] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:05:13.030444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:13.041491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2df6a-3310-4c3e-abbb-66820fa23b8b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:13.046131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:13.046777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:13.047061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:13.047334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] PATH_INFO: `/v3/projects/18bfe3689dd14d3788d4195e3ec51269/users/df9a0007368e40bb9214f78d36bedb31/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:13.050528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:13.065660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bfe3689dd14d3788d4195e3ec51269, user_id=df9a0007368e40bb9214f78d36bedb31, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:13.068380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:13.081849 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4041/8101] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:05:13 2022] PUT /identity/v3/projects/18bfe3689dd14d3788d4195e3ec51269/users/df9a0007368e40bb9214f78d36bedb31/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:13.087123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b1d8-2451-4bc0-9766-2cf9075fcdc3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:13.087473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b1d8-2451-4bc0-9766-2cf9075fcdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:13.087814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435b1d8-2451-4bc0-9766-2cf9075fcdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:13.108120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5435b1d8-2451-4bc0-9766-2cf9075fcdc3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:13.109368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5435b1d8-2451-4bc0-9766-2cf9075fcdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:13.172154 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4061/8102] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:13.182360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:13.184133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:13.244743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf25e9b-5bed-42db-a413-2a07e5928d9f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:13.248573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:13.249213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:13.249527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:13.249804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:13.259683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:13.261138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:13.270920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4042/8103] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:18.222002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:18.222561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:18.222561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:18.253409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] MFA Rules not processed for user `df9a0007368e40bb9214f78d36bedb31`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:18.254638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:18.333257 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4062/8104] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:18.339764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:18.350116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2475ce-9cda-43cc-b1e0-7597bf02b17d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:18.358144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:18.358885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:18.359240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:18.359607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:18.360341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:18.362386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:18.390625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4043/8105] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:05:18 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:05:18.391842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:18.403318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5142-1594-4a01-9edc-7ec80b588dd9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:18.407973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03908309-1f73-49d2-8b69-65243c58a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:18.408583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908309-1f73-49d2-8b69-65243c58a965 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:18.408893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908309-1f73-49d2-8b69-65243c58a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:18.409202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03908309-1f73-49d2-8b69-65243c58a965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:18.409849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908309-1f73-49d2-8b69-65243c58a965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:18.411443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03908309-1f73-49d2-8b69-65243c58a965 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:18.422183 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4063/8106] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:05:18.426432 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:18.439860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9027-1c2d-45e3-b2e4-c77495e43b0b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:18.448111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:18.449111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:18.449531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:18.449938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] PATH_INFO: `/v3/system/users/21838124c4724b9db8be93a038974f31/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:18.468097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=21838124c4724b9db8be93a038974f31, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:18.469256 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:05:18.469256 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:05:18.469256 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:05:18.470165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:18.480250 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4044/8107] 10.222.0.16 () {60 vars in 1378 bytes} [Wed Oct 5 03:05:18 2022] PUT /identity/v3/system/users/21838124c4724b9db8be93a038974f31/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:05:18.495241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:18.495771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:18.496716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:18.531516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] MFA Rules not processed for user `21838124c4724b9db8be93a038974f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:18.532852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:18.596683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:18.665249 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4064/8108] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:18 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 05 03:05:18.669187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:18.843402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:18.851827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93c35-16bc-430c-b199-0c97d51a1bfd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:18.895550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21838124c4724b9db8be93a038974f31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:18.896177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:18.896458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:18.896731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:18.897438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:18.899290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:18.907301 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4045/8109] 10.222.0.16 () {58 vars in 1110 bytes} [Wed Oct 5 03:05:18 2022] GET /identity/v3/services => generated 2191 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:05:18.916582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:19.066479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48ae89-dbb9-443f-be0c-424e2174f0b7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:19.111513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21838124c4724b9db8be93a038974f31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:19.112361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:19.112651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:19.113589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] PATH_INFO: `/v3/limits` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:19.113589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:19.114933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 05 03:05:19.161619 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 05 03:05:19.162627 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 03:05:19.165068 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4065/8110] 10.222.0.16 () {60 vars in 1126 bytes} [Wed Oct 5 03:05:18 2022] POST /identity/v3/limits => generated 124 bytes in 252 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 05 03:05:19.168521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:19.287458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20f73-e406-44ea-9f7c-56ff119d4b3d None tempest-ImageQuotaTest-1627715296-system-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:19.329513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21838124c4724b9db8be93a038974f31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:19.330139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:19.330542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:19.330825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:19.331449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:19.332547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:19.339769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4046/8111] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 03:05:19 2022] GET /identity/v3/registered_limits => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:05:19.346228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:19.386350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:19.465261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3550-4173-4e5f-afa4-c21b939e8343 None tempest-ImageQuotaTest-1627715296-system-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:19.505499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21838124c4724b9db8be93a038974f31', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:19.508337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:19.508337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:19.508337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:19.508337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:19.509185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:19.514808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4066/8112] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Oct 5 03:05:19 2022] GET /identity/v3/registered_limits => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:05:19.649215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:19.651553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:19.713436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:19.766199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849a49-22ba-4e67-99a5-690a13b1c7d2 None tempest-ImageQuotaTest-1627715296-system-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:19.771137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:19.771739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:19.772020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:19.772339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:19.774190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:19.790280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:19.791993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:19.805939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4047/8113] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:05:19.961919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:19.963896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:19.979903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440b796-c43b-44c9-97f2-66b6e250ca9c None tempest-ImageQuotaTest-1627715296-system-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:19.984234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:19.984930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:19.985315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:19.985598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:19.987411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:20.004078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:20.005624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:20.017844 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4067/8114] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:05:20.116435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:20.118104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:20.138765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f22fc9-1e88-4aec-befc-25a5ff1771ac service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:20.144449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ee187-7355-4921-9929-240984408019 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:20.145080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ee187-7355-4921-9929-240984408019 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:20.145720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ee187-7355-4921-9929-240984408019 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:20.145720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ee187-7355-4921-9929-240984408019 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:20.147864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-bd2ee187-7355-4921-9929-240984408019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:20.164066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ee187-7355-4921-9929-240984408019 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:20.165424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ee187-7355-4921-9929-240984408019 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:20.178337 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4048/8115] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:20.378664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:20.391590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5305b-79ce-4b78-8d7e-6c1d11cb704a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:20.396171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:20.396775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:20.397109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:20.398036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:20.400173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:20.490843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:20.492258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:20.508927 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4068/8116] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:23.092637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ee187-7355-4921-9929-240984408019 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:23.104743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ee187-7355-4921-9929-240984408019 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:23.111188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:23.112463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:23.112829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:23.113231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] PATH_INFO: `/v3/users/df9a0007368e40bb9214f78d36bedb31` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:23.114806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9a0007368e40bb9214f78d36bedb31)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:23.117276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:23.189331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9a0007368e40bb9214f78d36bedb31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.203486 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9a0007368e40bb9214f78d36bedb31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.204271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9a0007368e40bb9214f78d36bedb31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.213476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9a0007368e40bb9214f78d36bedb31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.214188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9a0007368e40bb9214f78d36bedb31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.231821 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4049/8117] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:05:23 2022] DELETE /identity/v3/users/df9a0007368e40bb9214f78d36bedb31 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:23.437445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:23.457862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361cb63-0699-4c4e-a051-d67ecf817395 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:23.475651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:23.540054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:23.540810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:23.541198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:23.541541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] PATH_INFO: `/v3/projects/18bfe3689dd14d3788d4195e3ec51269` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:23.542761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bfe3689dd14d3788d4195e3ec51269)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:23.544753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:23.597911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bfe3689dd14d3788d4195e3ec51269', 'request_id': 'req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.604101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bfe3689dd14d3788d4195e3ec51269', 'request_id': 'req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.610868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bfe3689dd14d3788d4195e3ec51269', 'request_id': 'req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.627302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] The token cache is being invalidate because project 18bfe3689dd14d3788d4195e3ec51269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:05:23.627603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.628382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-ff64f0bd-1bf0-4d8d-8b31-c439f14340c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.630171 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4069/8118] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:05:23 2022] DELETE /identity/v3/projects/18bfe3689dd14d3788d4195e3ec51269 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:23.634646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:23.636054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:23.657289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d4c33-e0a0-4880-a113-3453ffdaef90 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:23.722881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:23.723608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:23.723927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:23.724214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] PATH_INFO: `/v3/users/21838124c4724b9db8be93a038974f31` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:23.726070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21838124c4724b9db8be93a038974f31)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:23.728633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:23.740301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:23.807718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21838124c4724b9db8be93a038974f31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.834392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21838124c4724b9db8be93a038974f31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.836206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21838124c4724b9db8be93a038974f31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.851337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21838124c4724b9db8be93a038974f31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.852157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21838124c4724b9db8be93a038974f31'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:05:23.884179 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4050/8119] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:05:23 2022] DELETE /identity/v3/users/21838124c4724b9db8be93a038974f31 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:05:24.812168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:24.813280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:24.813675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:24.833506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] MFA Rules not processed for user `881baf1ede7e4fb5acf65268a81241ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:05:24.834776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:24.890622 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4070/8120] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:05:33.879408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=11,keystone:SELECT=26,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:34.883891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:36.540073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:36.541544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:36.616352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcdf19-422f-43e9-a9a8-f38251e558a6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:36.621457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:36.622075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:36.622361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:36.622640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:36.624421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:36.640158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:36.641926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:36.656123 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4051/8121] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:37.944466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:37.945995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:38.037649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1fde-d7de-435c-8a73-eb5fd6a47ef3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:38.044620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:38.045302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:38.045574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:38.045853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:38.047600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:38.065927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:38.067763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:38.085992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4071/8122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:05:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:05:41.312207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:05:41.313841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:41.399582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45ac77-a4df-4d74-a3b8-6bbcb1b354c9 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:05:41.404780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:05:41.405559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:05:41.405846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:05:41.406130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:05:41.407943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:05:41.482097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:05:41.483750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:05:41.493793 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4052/8123] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:05:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:05:48.077470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=37 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:05:51.489350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=86 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:10.742656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:10.745219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:10.823123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb138c25-c583-4379-93b5-f7262bd9e886 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:10.826673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:10.827282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:10.827561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:10.827835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:10.829560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:10.891096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:10.892545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30949-4497-45f4-b59d-b413199deb90 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:10.902145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4072/8124] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:06:19.947487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:19.948983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:20.048154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefc85f-d00e-45a5-be53-d51123a76012 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:20.052970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:20.053677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:20.053977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:20.054244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] PATH_INFO: `/v3/users/67c2b26730184ce58b866e37ebe43794` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:20.055464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c2b26730184ce58b866e37ebe43794)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:20.058624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:20.116490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c2b26730184ce58b866e37ebe43794'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.130041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c2b26730184ce58b866e37ebe43794'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.130762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c2b26730184ce58b866e37ebe43794'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.139112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c2b26730184ce58b866e37ebe43794'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.139851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c2b26730184ce58b866e37ebe43794'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.152504 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4053/8125] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:06:19 2022] DELETE /identity/v3/users/67c2b26730184ce58b866e37ebe43794 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:06:20.157169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:20.157666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:20.157753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:20.186953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:20.188163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:20.253152 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4073/8126] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:06:20.263209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:20.264601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:20.328547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c11288-84a1-47f9-b782-5e602ffa8d21 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:20.332181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:20.332790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:20.333100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:20.333377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:20.342825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:20.344254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:20.354390 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4054/8127] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:06:20.549742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:20.551413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:20.565585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11702122-abe6-40c4-a79a-1629814bb306 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:20.576733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:20.577587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:20.577879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:20.578165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] PATH_INFO: `/v3/projects/5152e5e306d2474bac12338a8e722a00` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:20.579424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5152e5e306d2474bac12338a8e722a00)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:20.581383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:20.626084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:20.642101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5152e5e306d2474bac12338a8e722a00', 'request_id': 'req-bfa26552-a666-451f-8476-c2c8e43e2414'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.653717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5152e5e306d2474bac12338a8e722a00', 'request_id': 'req-bfa26552-a666-451f-8476-c2c8e43e2414'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.661929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5152e5e306d2474bac12338a8e722a00', 'request_id': 'req-bfa26552-a666-451f-8476-c2c8e43e2414'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.681936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] The token cache is being invalidate because project 5152e5e306d2474bac12338a8e722a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:06:20.682236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.682905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.684438 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4074/8128] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:06:20 2022] DELETE /identity/v3/projects/5152e5e306d2474bac12338a8e722a00 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:06:20.689068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:20.695143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:20.702960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17f3a6-57a6-4359-bf9b-716d1bc4f549 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:20.772302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:20.772972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:20.773263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:20.773546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] PATH_INFO: `/v3/users/6e29bfae20b14f55adfd6b13ed3e6fb8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:20.775247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e29bfae20b14f55adfd6b13ed3e6fb8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:20.777208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:20.825293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e29bfae20b14f55adfd6b13ed3e6fb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.838052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e29bfae20b14f55adfd6b13ed3e6fb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.838700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e29bfae20b14f55adfd6b13ed3e6fb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.846653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e29bfae20b14f55adfd6b13ed3e6fb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.847323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-af20b49f-f13c-448d-89c0-8752d09e7a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e29bfae20b14f55adfd6b13ed3e6fb8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:20.860207 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4055/8129] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:06:20 2022] DELETE /identity/v3/users/6e29bfae20b14f55adfd6b13ed3e6fb8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:06:21.147137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.148750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:21.165831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa26552-a666-451f-8476-c2c8e43e2414 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.226378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.227238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.227518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.227794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] PATH_INFO: `/v3/projects/1975ec952cd9497192efe90933a95204` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.228944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1975ec952cd9497192efe90933a95204)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.230839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.279246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1975ec952cd9497192efe90933a95204', 'request_id': 'req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:21.284814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1975ec952cd9497192efe90933a95204', 'request_id': 'req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:21.291281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1975ec952cd9497192efe90933a95204', 'request_id': 'req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:21.305041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] The token cache is being invalidate because project 1975ec952cd9497192efe90933a95204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:06:21.305298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:21.306453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5d6b42ba-8733-4e78-8f2a-0f02d3f53ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:06:21.311841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4075/8130] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:06:21 2022] DELETE /identity/v3/projects/1975ec952cd9497192efe90933a95204 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:06:21.313330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.313805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.314066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.363205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:21.364483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:21.416850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:21.427618 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4056/8131] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:06:21.436665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.436980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.437263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.458124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:21.459338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:21.467946 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4076/8132] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:06:21.473571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.485683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a40e6-2db6-4743-bb73-852dfb210c22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.493927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.494570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.494852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.495122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.495795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:06:21.496099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.497760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.514145 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4057/8133] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:06:21.515589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.525427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9f3f-1823-4a98-ae8d-ce87a83070f3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.530363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.531062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.531435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.531775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.532499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.534553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.571617 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4077/8134] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:06:21 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:06:21.576222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.586844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e33d4-b0e2-4659-a4f7-1ce081affced admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.661311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.662007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.662378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.662749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.663522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.666369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.691502 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4058/8135] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:06:21 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:06:21.695677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.706383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5888c0-7dc9-40b3-96c8-beeca726f470 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.711293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.712394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.712688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.712989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.713642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.715279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.725484 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4078/8136] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:06:21.730223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.740738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32193b71-0616-4e6d-97ff-6558aea715f8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.746083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76349-ae31-4249-9e7f-f26ba6757fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.746711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76349-ae31-4249-9e7f-f26ba6757fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.746995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76349-ae31-4249-9e7f-f26ba6757fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.747274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76349-ae31-4249-9e7f-f26ba6757fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.747930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76349-ae31-4249-9e7f-f26ba6757fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.750004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76349-ae31-4249-9e7f-f26ba6757fc6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.762197 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4059/8137] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:06:21.766767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:21.777972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e269ce-0d25-43d3-b3d1-332eb27731a8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:21.782808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:21.783467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.783780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.784062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] PATH_INFO: `/v3/projects/68101269cd8447ec89411b4eab950d51/users/ac015152532a44609827594179c68aa8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.793679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:21.801579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68101269cd8447ec89411b4eab950d51, user_id=ac015152532a44609827594179c68aa8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:21.804969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:21.819208 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4079/8138] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:06:21 2022] PUT /identity/v3/projects/68101269cd8447ec89411b4eab950d51/users/ac015152532a44609827594179c68aa8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:06:21.831426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:21.831715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:21.831992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:21.862118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] MFA Rules not processed for user `ac015152532a44609827594179c68aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:21.863311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:21.933657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4060/8139] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:06:21.938257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.002973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987813-fa43-43bd-844c-1cf999915645 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.007631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.008242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.008561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.009347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.010003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.011934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.041761 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4080/8140] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:06:21 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:06:22.045943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.057230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15f4e-d15b-4108-b49c-a837b996806b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.107434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:22.120072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.120685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.121003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.121413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.122060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.124025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.147074 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4061/8141] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:06:22 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:06:22.151591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.162191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587a65-59e1-49a9-b453-e385c83ab217 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.167091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.167684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.167958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.168234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.168881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.170523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.181537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4081/8142] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:06:22.186047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.197053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc30acb-4d4d-4011-b11d-b965696abedf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.201816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d9581-0185-485f-9724-8810e6b1a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.202426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d9581-0185-485f-9724-8810e6b1a8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.202707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d9581-0185-485f-9724-8810e6b1a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.202991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d9581-0185-485f-9724-8810e6b1a8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.203640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d9581-0185-485f-9724-8810e6b1a8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.205267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d9581-0185-485f-9724-8810e6b1a8dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.216169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4062/8143] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:06:22.220684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.230926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f7d75-d7ba-4d67-860a-c4b5f6284dc0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.235720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.236427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.236715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.237019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] PATH_INFO: `/v3/projects/127c5ddbee814f1b92f7a6d349f52875/users/f9e71010ebda48e2bb5c24979b9c9250/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.251823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=127c5ddbee814f1b92f7a6d349f52875, user_id=f9e71010ebda48e2bb5c24979b9c9250, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.254508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.268375 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4082/8144] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:06:22 2022] PUT /identity/v3/projects/127c5ddbee814f1b92f7a6d349f52875/users/f9e71010ebda48e2bb5c24979b9c9250/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:06:22.279454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.279857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.280209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.311492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] MFA Rules not processed for user `f9e71010ebda48e2bb5c24979b9c9250`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:22.312710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:22.383990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4063/8145] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:06:22.388700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.453175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8437-1818-44f6-8781-f1296fcb1cab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.457687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.458294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.458572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.458842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.459484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.461409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.492471 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4083/8146] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:06:22 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:06:22.495046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.505935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100d43a-5585-4e94-b51b-5170217188bf None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.564412 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.565078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.565374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.565650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.566285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.568199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.594633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4064/8147] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:06:22 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:06:22.595865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.607044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fde6d-4f28-4209-91d8-52c6327f42eb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.612089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.612699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.613007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.613283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.613929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.615524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.630678 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4084/8148] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:06:22.632264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.644721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477492-9e4d-4989-8f84-6994d36389d6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.653704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.654797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.655275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.655700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] PATH_INFO: `/v3/projects/90c71e151d7c40e4b40d703b0ef40abf/users/3daa1ba5b968425c96fe3ddc277f3d91/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.675214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c71e151d7c40e4b40d703b0ef40abf, user_id=3daa1ba5b968425c96fe3ddc277f3d91, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.677911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.691271 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4065/8149] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:06:22 2022] PUT /identity/v3/projects/90c71e151d7c40e4b40d703b0ef40abf/users/3daa1ba5b968425c96fe3ddc277f3d91/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:06:22.695448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.705827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb7b71-be57-46cb-ade2-e486dbda852b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.714604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:22.765457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693123b4-d6ee-4964-928f-8c94dd51fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.766069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693123b4-d6ee-4964-928f-8c94dd51fb61 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.766351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693123b4-d6ee-4964-928f-8c94dd51fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.766630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693123b4-d6ee-4964-928f-8c94dd51fb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.767299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693123b4-d6ee-4964-928f-8c94dd51fb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.768915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693123b4-d6ee-4964-928f-8c94dd51fb61 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.779256 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4085/8150] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:06:22.783504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.794955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72411-8d64-4306-9c64-d41c903695ff admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:22.799867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:22.800708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.801027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.801308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] PATH_INFO: `/v3/projects/90c71e151d7c40e4b40d703b0ef40abf/users/3daa1ba5b968425c96fe3ddc277f3d91/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.803254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c71e151d7c40e4b40d703b0ef40abf, user_id=3daa1ba5b968425c96fe3ddc277f3d91, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:22.807077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:22.828119 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4066/8151] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:06:22 2022] PUT /identity/v3/projects/90c71e151d7c40e4b40d703b0ef40abf/users/3daa1ba5b968425c96fe3ddc277f3d91/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:06:22.829802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:22.830098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:22.830380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:22.860595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] MFA Rules not processed for user `3daa1ba5b968425c96fe3ddc277f3d91`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:22.861857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:22.930219 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4086/8152] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:06:22.945783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:22.948661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:22.968794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:23.041766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8abcd-25c3-4a5b-a2d6-d2914ea720b3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:23.047391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:23.048003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:23.048284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:23.048557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:23.107569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:23.109200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:23.118719 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4067/8153] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:06:25.069969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:25.072767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:25.134941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be336255-0ff5-4ab6-8906-0b17a506e54b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:25.139975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f65cb-b8f8-426a-9846-224b570138ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:25.141029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f65cb-b8f8-426a-9846-224b570138ee service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:25.141214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f65cb-b8f8-426a-9846-224b570138ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:25.141453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f65cb-b8f8-426a-9846-224b570138ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:25.154926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f65cb-b8f8-426a-9846-224b570138ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:25.156579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f65cb-b8f8-426a-9846-224b570138ee service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:25.168857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4087/8154] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:06:26.937473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:26.939143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:27.074600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf2617-565d-4212-b079-b38e00c46ec8 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:27.082440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:27.083081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:27.083366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:27.083651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:27.088013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:27.106340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:27.108105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:27.140039 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4068/8155] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:06:29.371079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c405-231c-4029-8d32-efab9d10309a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:29.371554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c405-231c-4029-8d32-efab9d10309a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:29.371750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c405-231c-4029-8d32-efab9d10309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:29.415725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9762c405-231c-4029-8d32-efab9d10309a None None] MFA Rules not processed for user `ac015152532a44609827594179c68aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:06:29.417123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9762c405-231c-4029-8d32-efab9d10309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:29.431535 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4088/8156] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:06:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:06:37.119834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:39.392294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:06:55.935275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:55.937357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:55.951993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d58cd1-b50c-4192-a86c-40c59d27f14d service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:55.956311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:55.956947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:55.957235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:55.957511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:55.959411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:55.977145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:55.979120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0a01-61b7-4663-b8ca-5faeda2e0e23 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:55.993146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4069/8157] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:06:57.340501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762c405-231c-4029-8d32-efab9d10309a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:06:57.365684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762c405-231c-4029-8d32-efab9d10309a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:06:57.377988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:06:57.379790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:06:57.380074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:06:57.381327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:06:57.385818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:06:57.420995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:06:57.422475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786f790-2634-477f-8eed-4a9d4417533f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:06:57.452159 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4089/8158] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:06:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:07:00.023094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:07:00.023586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:07:00.023681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:07:00.090828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] MFA Rules not processed for user `ad3a53da0c764f0a893966aea6505fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:07:00.092457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:07:00.226662 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4070/8159] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:07:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:07:04.412293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:07:04.412817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:07:04.412931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:07:04.444123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] MFA Rules not processed for user `881baf1ede7e4fb5acf65268a81241ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:07:04.445480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:07:04.505049 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4090/8160] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:07:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:07:10.213557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=31 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:14.497924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=31 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:37.011116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:07:37.023682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a918a6-9da4-4aac-9711-e369a7db4d3d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:07:37.027989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:07:37.028621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:07:37.029105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:07:37.029387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:07:37.031187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:07:37.049960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:07:37.051284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e895-4756-4363-bb49-1e882e692707 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:07:37.064144 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4071/8161] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:07:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:07:46.057648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:07:46.070875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76962d-f649-4b26-864a-80eab8eae79c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:07:46.075117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:07:46.075683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:07:46.075967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:07:46.076244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:07:46.078054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:07:46.094094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:07:46.095563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:07:46.112288 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4091/8162] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:07:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:07:47.056530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:56.001581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:07:56.002498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:07:56.002498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:07:56.026318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] MFA Rules not processed for user `ac015152532a44609827594179c68aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:07:56.027807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:07:56.060670 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4072/8163] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:07:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:07:56.103178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:07:56.411091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:07:56.425043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f005f0-8b02-4cb0-a82e-8c88d0151bdf service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:07:56.428932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:07:56.429632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:07:56.429986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:07:56.430334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:07:56.433842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:07:56.452944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:07:56.454427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:07:56.468538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4092/8164] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:07:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:08:06.018626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:06.459406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:12.403532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:12.422658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590fcab-083b-4a63-89c0-c49f54cd56af None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:12.428855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:12.429791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:12.430233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:12.430837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:12.432997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:12.450120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:12.452022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d4a12-8a79-4011-996b-3ce9e3432ec7 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:12.468967 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4073/8165] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:08:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:08:22.461533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:26.288682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:26.363876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ce0b5-9c79-4ae0-b533-6d8477d273a7 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:26.369545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:26.370199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:26.370480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:26.370758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] PATH_INFO: `/v3/users/ac015152532a44609827594179c68aa8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:26.371937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac015152532a44609827594179c68aa8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:26.373909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:26.451103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac015152532a44609827594179c68aa8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:26.471907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac015152532a44609827594179c68aa8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:26.472857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac015152532a44609827594179c68aa8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:26.483560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac015152532a44609827594179c68aa8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:26.484794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac015152532a44609827594179c68aa8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:26.504841 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4093/8166] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:08:26 2022] DELETE /identity/v3/users/ac015152532a44609827594179c68aa8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:08:26.506261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:26.506740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:26.506961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:26.530956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:08:26.532614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:26.612718 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4074/8167] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:08:26.623269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:26.624813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:26.738426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572831e3-4481-4dc5-931e-cd44ea64ba87 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:26.749862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:26.750803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:26.751329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:26.751762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:26.776038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:26.778042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:26.798230 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4094/8168] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:08:27.035092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:27.037827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:27.054918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00027fb6-9e69-4d6b-a150-fd2ff5101eb8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:27.062952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:27.064126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:27.064588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:27.065725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] PATH_INFO: `/v3/projects/68101269cd8447ec89411b4eab950d51` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:27.067237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68101269cd8447ec89411b4eab950d51)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:27.069690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:27.137652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68101269cd8447ec89411b4eab950d51', 'request_id': 'req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.146032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68101269cd8447ec89411b4eab950d51', 'request_id': 'req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.153756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68101269cd8447ec89411b4eab950d51', 'request_id': 'req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.167880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] The token cache is being invalidate because project 68101269cd8447ec89411b4eab950d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:08:27.168245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.169196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.171178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4075/8169] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:08:27 2022] DELETE /identity/v3/projects/68101269cd8447ec89411b4eab950d51 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:08:27.175598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:27.186411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d61f6-feba-42e2-984c-3834f6c154a7 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:27.206509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:27.272064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:27.272064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:27.272064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:27.272064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] PATH_INFO: `/v3/users/f9e71010ebda48e2bb5c24979b9c9250` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:27.272952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e71010ebda48e2bb5c24979b9c9250)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:27.272952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:27.331092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e71010ebda48e2bb5c24979b9c9250'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.345434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e71010ebda48e2bb5c24979b9c9250'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.346328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e71010ebda48e2bb5c24979b9c9250'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.355401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e71010ebda48e2bb5c24979b9c9250'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.356041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e71010ebda48e2bb5c24979b9c9250'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.371801 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4095/8170] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:08:27 2022] DELETE /identity/v3/users/f9e71010ebda48e2bb5c24979b9c9250 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:08:27.695122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:27.696596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:27.721642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd8bdf-2e09-4fbe-8313-8430288d9b1c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:27.804779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:27.805458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:27.805740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:27.806017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] PATH_INFO: `/v3/projects/127c5ddbee814f1b92f7a6d349f52875` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:27.808234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127c5ddbee814f1b92f7a6d349f52875)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:27.810202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:27.862031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:27.886724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127c5ddbee814f1b92f7a6d349f52875', 'request_id': 'req-84b5c160-bfd6-4cf2-9008-6c0097f6b419'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.895858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127c5ddbee814f1b92f7a6d349f52875', 'request_id': 'req-84b5c160-bfd6-4cf2-9008-6c0097f6b419'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.905652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127c5ddbee814f1b92f7a6d349f52875', 'request_id': 'req-84b5c160-bfd6-4cf2-9008-6c0097f6b419'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.922621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] The token cache is being invalidate because project 127c5ddbee814f1b92f7a6d349f52875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:08:27.922922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.923700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:27.925261 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4076/8171] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:08:27 2022] DELETE /identity/v3/projects/127c5ddbee814f1b92f7a6d349f52875 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:08:27.929152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:27.930796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:27.945855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314a3c2-6dd2-41c5-87fd-bb4b361f797a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:28.016651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:28.017346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:28.017882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:28.018159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] PATH_INFO: `/v3/users/3daa1ba5b968425c96fe3ddc277f3d91` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:28.019365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3daa1ba5b968425c96fe3ddc277f3d91)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:28.021412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:28.078582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:28.081642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3daa1ba5b968425c96fe3ddc277f3d91'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.098552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3daa1ba5b968425c96fe3ddc277f3d91'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.099557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3daa1ba5b968425c96fe3ddc277f3d91'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.108599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3daa1ba5b968425c96fe3ddc277f3d91'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.109390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3daa1ba5b968425c96fe3ddc277f3d91'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.125239 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4096/8172] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:08:27 2022] DELETE /identity/v3/users/3daa1ba5b968425c96fe3ddc277f3d91 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:08:28.346666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:28.348369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:28.379572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c160-bfd6-4cf2-9008-6c0097f6b419 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:28.451653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:28.452697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:28.453158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:28.453587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] PATH_INFO: `/v3/projects/90c71e151d7c40e4b40d703b0ef40abf` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:28.454914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c71e151d7c40e4b40d703b0ef40abf)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:28.457153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:28.559267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c71e151d7c40e4b40d703b0ef40abf', 'request_id': 'req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.579364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c71e151d7c40e4b40d703b0ef40abf', 'request_id': 'req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.589904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c71e151d7c40e4b40d703b0ef40abf', 'request_id': 'req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.621904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] The token cache is being invalidate because project 90c71e151d7c40e4b40d703b0ef40abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:08:28.622200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.625309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:08:28.627619 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4077/8173] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:08:28 2022] DELETE /identity/v3/projects/90c71e151d7c40e4b40d703b0ef40abf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:08:30.540793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:30.542300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:30.617008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500bb6a-5911-42a1-8768-abed52c19dd1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:30.684610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:30.685252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:30.685537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:30.685816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:30.687560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:30.701767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:30.703432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:30.718737 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4097/8174] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:08:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:08:38.617712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:39.205904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:39.207388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:39.270820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4481cd3-0ad3-4da2-9bb1-aa5ad22344de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:39.275434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:39.276525 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:39.277661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:39.277951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:39.279987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:39.344199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:39.345678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac496-4442-4b29-b14c-a8cb1fb9ec94 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:39.356073 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4078/8175] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:08:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:08:40.709976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=4,keystone:SELECT=71,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:45.283257 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:45.315944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:45.453265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3226b3-30ca-45f4-90c7-69d1c61a0f61 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:45.460678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:45.461650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:45.462043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:45.462482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:45.468797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:45.546275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:45.548717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:45.566109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4098/8176] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:08:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:08:49.350798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=48 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:08:53.178632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:53.179197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:53.179197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:53.199457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] MFA Rules not processed for user `881baf1ede7e4fb5acf65268a81241ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:08:53.200586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:53.208455 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4079/8177] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:08:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:08:53.870501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:08:53.872485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:53.892391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902d2f6-b238-4535-b421-2f814065b277 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:08:53.897641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:08:53.898277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:08:53.898552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:08:53.899032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:08:53.901520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:08:53.918306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:08:53.919959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:08:53.933203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4099/8178] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:08:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:09:03.188534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:09:03.189983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:09:03.193834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:03.213745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443215d-7157-474c-a777-d48fdd7c58fc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:09:03.221001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:09:03.221729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:09:03.222081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:09:03.222428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:09:03.224450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:09:03.243150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:09:03.244989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:09:03.262299 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4080/8179] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:09:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:09:03.926031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=62 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:13.253524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:09:47.637351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:09:47.663685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb0873-c485-4967-8eb8-ca9f18b503e7 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:09:47.675868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:09:47.676497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:09:47.676789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:09:47.677104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:09:47.678928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:09:47.749124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:09:47.750720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:09:47.762009 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4100/8180] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:09:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:09:53.355568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:09:53.368942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4053e5-535c-419f-8cc9-10485f13e86f service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:09:53.373038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:09:53.373882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:09:53.374366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:09:53.374852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:09:53.377121 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:09:53.467821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:09:53.469760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06e80a-2ac2-45b9-b278-0fc0f2fe8c08 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:09:53.483994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4081/8181] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:09:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:09:55.832301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:09:55.834596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:09:55.872186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd0e4f-50e4-4e82-a85e-03ec7b3b1b72 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:09:55.878889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:09:55.879795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:09:55.880358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:09:55.880643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:09:55.884149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:09:55.927062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:09:55.929299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:09:55.944700 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4101/8182] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:09:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:02.787354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:02.788308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:02.788805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:02.820288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] MFA Rules not processed for user `ad3a53da0c764f0a893966aea6505fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:02.821540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:02.831863 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4082/8183] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:03.205855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:03.208046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:03.318501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b0e6-99d5-496f-bcfd-813163a63cdd service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:03.329398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:03.330366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:03.330868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:03.331449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:03.335684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:03.372185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:03.376704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e9f70-d7b8-41d8-a76f-600274fdbe9b service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:03.395662 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4102/8184] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:05.544105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:05.546218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:05.650489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb9217-46e0-4755-8417-eed01e5d510d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:05.655372 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:05.656545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:05.657038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:05.657642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] PATH_INFO: `/v3/users/ea7fccf567094c43aec0de4b4399538e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:05.661268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7fccf567094c43aec0de4b4399538e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:05.663408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:05.740843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7fccf567094c43aec0de4b4399538e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:05.771979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7fccf567094c43aec0de4b4399538e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:05.772744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7fccf567094c43aec0de4b4399538e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:05.783826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7fccf567094c43aec0de4b4399538e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:05.784731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7fccf567094c43aec0de4b4399538e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:05.802518 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4083/8185] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:10:05 2022] DELETE /identity/v3/users/ea7fccf567094c43aec0de4b4399538e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:05.806965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:05.807497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:05.807497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:05.845828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:05.847063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:05.926560 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4103/8186] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:05.945746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:05.947440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:05.966294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:06.036821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c660e-d8cd-472a-a976-3664a0e2b3f9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:06.041226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bac2a-60d7-4045-a878-2ab83c80358a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:06.041483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bac2a-60d7-4045-a878-2ab83c80358a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.041658 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bac2a-60d7-4045-a878-2ab83c80358a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.041931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bac2a-60d7-4045-a878-2ab83c80358a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.054657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bac2a-60d7-4045-a878-2ab83c80358a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:06.056337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bac2a-60d7-4045-a878-2ab83c80358a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:06.068685 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4084/8187] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:06.365249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:06.367063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:06.385506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fb91b-98fc-449e-b3eb-f8f6857f4449 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:06.398184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:06.399038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.399730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.400261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] PATH_INFO: `/v3/projects/ab1edf3cfeff48e7a295daa9dcb1877a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.402008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab1edf3cfeff48e7a295daa9dcb1877a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:06.404167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:06.462060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:06.512590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'request_id': 'req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:06.532290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'request_id': 'req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:06.541307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab1edf3cfeff48e7a295daa9dcb1877a', 'request_id': 'req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:06.562132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] The token cache is being invalidate because project ab1edf3cfeff48e7a295daa9dcb1877a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:10:06.564046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:06.564761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dd6a2ce1-64a2-47bd-866b-fdb1281bc446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:06.570379 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4104/8188] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:10:06 2022] DELETE /identity/v3/projects/ab1edf3cfeff48e7a295daa9dcb1877a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:06.572332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.572832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.572982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.603593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:06.604889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:06.679329 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4085/8189] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:06.686943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.687638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.688047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.709906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:06.711341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:06.721128 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4105/8190] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:10:06.725221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:06.737253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313673-86ca-4d78-8b70-6a456cb45eb5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:06.743280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:06.744011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.744404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.744771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.745588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:10:06.745962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:06.747758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:06.766362 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4086/8191] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:10:06.770595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:06.782646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe105-49a2-447b-b0a4-3995c9734523 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:06.791820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:06.792439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.792717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.793025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.793677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:06.795605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:06.849678 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4106/8192] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:10:06 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:06.851555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:06.863754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4ca2a-ca12-4607-a241-1fa02d52a1c1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:06.942810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:06.943767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.944053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.944332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.945020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:06.947005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:06.974830 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4087/8193] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:10:06 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:06.976401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:06.988208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace12274-7830-4a14-ac27-241d7444563f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:06.993075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:06.993699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:06.993982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:06.994256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:06.994917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:06.996522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:07.011435 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4107/8194] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:10:07.013122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:07.025002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637ef51-e86d-43cb-a32d-2dd7fdbc0367 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:07.029891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c564b-d7b7-4e75-a376-2363950f3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:07.030513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c564b-d7b7-4e75-a376-2363950f3dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:07.030830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c564b-d7b7-4e75-a376-2363950f3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:07.031237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c564b-d7b7-4e75-a376-2363950f3dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:07.031896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c564b-d7b7-4e75-a376-2363950f3dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:07.033544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c564b-d7b7-4e75-a376-2363950f3dd6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:07.049277 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4088/8195] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:07.050866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:07.062696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa7ea5-9471-494d-bde9-a787fe76c5f0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:07.068818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:07.069548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:07.070740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:07.071035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] PATH_INFO: `/v3/projects/844df86266e84091b00d4a8d67dc4eec/users/ead99a9f83bd43989bb7d2d45984aef6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:07.088593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=844df86266e84091b00d4a8d67dc4eec, user_id=ead99a9f83bd43989bb7d2d45984aef6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:07.091491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:07.125510 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4108/8196] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:10:07 2022] PUT /identity/v3/projects/844df86266e84091b00d4a8d67dc4eec/users/ead99a9f83bd43989bb7d2d45984aef6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:07.129795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:07.130086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:07.130366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:07.166901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] MFA Rules not processed for user `ead99a9f83bd43989bb7d2d45984aef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:07.168133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:07.179260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:07.246859 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4089/8197] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:07.259395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:07.261440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:07.323659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8788e-d33e-468f-818c-a7d00f42e89b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:07.328203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4d992-0efa-4653-afe9-04047f5939f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:07.329103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4d992-0efa-4653-afe9-04047f5939f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:07.329387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4d992-0efa-4653-afe9-04047f5939f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:07.329666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4d992-0efa-4653-afe9-04047f5939f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:07.338706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4d992-0efa-4653-afe9-04047f5939f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:07.340300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4d992-0efa-4653-afe9-04047f5939f3 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:07.351337 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4109/8198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:11.043316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:11.108926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f104a8-65bc-4d65-a5d0-dce73a8352c7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:11.113462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:11.114095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:11.114376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:11.114653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] PATH_INFO: `/v3/users/ead99a9f83bd43989bb7d2d45984aef6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:11.115798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead99a9f83bd43989bb7d2d45984aef6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:11.117750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:11.179708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead99a9f83bd43989bb7d2d45984aef6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.193613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead99a9f83bd43989bb7d2d45984aef6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.194327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead99a9f83bd43989bb7d2d45984aef6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.208060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead99a9f83bd43989bb7d2d45984aef6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.208786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead99a9f83bd43989bb7d2d45984aef6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.223399 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4090/8199] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:10:11 2022] DELETE /identity/v3/users/ead99a9f83bd43989bb7d2d45984aef6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:11.227885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:11.228361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:11.228462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:11.254614 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:11.256249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:11.298639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:11.348616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4110/8200] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:11.358309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:11.360378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:11.397502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:11.435012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8fdfc-85a9-4e5a-aa52-cd84c80babbd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:11.439766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e2fb-4333-4805-a9d1-23646b7c61db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:11.440408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e2fb-4333-4805-a9d1-23646b7c61db service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:11.440697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e2fb-4333-4805-a9d1-23646b7c61db service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:11.441011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e2fb-4333-4805-a9d1-23646b7c61db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:11.452336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e2fb-4333-4805-a9d1-23646b7c61db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:11.454912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e2fb-4333-4805-a9d1-23646b7c61db service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:11.469657 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4091/8201] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:11.754595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:11.756045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:11.770988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe0b7b-6e80-4d72-b743-73dc197d47da None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:11.775999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:11.776622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:11.776923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:11.777770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] PATH_INFO: `/v3/projects/844df86266e84091b00d4a8d67dc4eec` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:11.779120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844df86266e84091b00d4a8d67dc4eec)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:11.781189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:11.835226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844df86266e84091b00d4a8d67dc4eec', 'request_id': 'req-b35bc1c9-11b6-40a6-a23f-3b6235f46478'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.841583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844df86266e84091b00d4a8d67dc4eec', 'request_id': 'req-b35bc1c9-11b6-40a6-a23f-3b6235f46478'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.849198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844df86266e84091b00d4a8d67dc4eec', 'request_id': 'req-b35bc1c9-11b6-40a6-a23f-3b6235f46478'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.863570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] The token cache is being invalidate because project 844df86266e84091b00d4a8d67dc4eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:10:11.863935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.864539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b35bc1c9-11b6-40a6-a23f-3b6235f46478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:11.866271 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4111/8202] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:10:11 2022] DELETE /identity/v3/projects/844df86266e84091b00d4a8d67dc4eec => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:11.871067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:11.871353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:11.871635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:11.892496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:11.893820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:11.965906 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4092/8203] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:10:11.974418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:11.974714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:11.975004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:11.997837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:11.999544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:12.007681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4112/8204] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:12.012637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.022510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abafe14-08b3-42cc-94ae-c7f86f721e3d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.027225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.027836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.028127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.028408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.029091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:10:12.029543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.031981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.043836 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4093/8205] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:10:12.048985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.059776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec84fe7-cd99-4337-835e-d55deecb0c04 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.064875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.065672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.065890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.066232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.066903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.068846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.098702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4113/8206] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:10:12 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:10:12.102915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.114742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c902cb5-35f1-495b-adbc-b9908d86e0c7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.176456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.177103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.177388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.177665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.178308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.180238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.201841 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4094/8207] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:10:12 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:12.206172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.216546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48526b-53d2-497e-a0e8-140f5874aaca admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.221897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.222496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.222781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.223096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.223738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.225367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.235804 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4114/8208] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:12.239691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.249761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17053c-4568-4938-a753-2448bf3b69b6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.254382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ddfd-3553-469b-8848-9f1f70824624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.254984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ddfd-3553-469b-8848-9f1f70824624 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.255270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ddfd-3553-469b-8848-9f1f70824624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.255549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ddfd-3553-469b-8848-9f1f70824624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.256306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ddfd-3553-469b-8848-9f1f70824624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.258039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ddfd-3553-469b-8848-9f1f70824624 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.269529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4095/8209] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:12.273446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.283851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b5b03-70bc-472b-a3bc-7fe862d77197 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.288558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.289229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.289515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.289790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] PATH_INFO: `/v3/projects/f4fd788257c14071969f01f87389c036/users/969f949772c349e19b82b145acf0d75b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.304275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fd788257c14071969f01f87389c036, user_id=969f949772c349e19b82b145acf0d75b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.306960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.320835 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4115/8210] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:10:12 2022] PUT /identity/v3/projects/f4fd788257c14071969f01f87389c036/users/969f949772c349e19b82b145acf0d75b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:12.331886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.332183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.332464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.361831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] MFA Rules not processed for user `969f949772c349e19b82b145acf0d75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:12.363095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:12.390329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:12.431841 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4096/8211] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:12.444604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:12.449544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:12.521184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841cb66-ed96-4101-96c9-2035d0b70024 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:12.524994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbbfd6-7dcb-4c44-aa56-d10e73a0694b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:12.525619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbbfd6-7dcb-4c44-aa56-d10e73a0694b service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:12.525910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbbfd6-7dcb-4c44-aa56-d10e73a0694b service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:12.526195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbbfd6-7dcb-4c44-aa56-d10e73a0694b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:12.535051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbbfd6-7dcb-4c44-aa56-d10e73a0694b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:12.536792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbbfd6-7dcb-4c44-aa56-d10e73a0694b service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:12.541353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:12.547147 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4116/8212] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:22.428315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=15 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:29.940071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:30.011072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f1eb1-3ca6-47d3-b4c8-f6d9fabce4f4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:30.015719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:30.016359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.016644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.016954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] PATH_INFO: `/v3/users/969f949772c349e19b82b145acf0d75b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.018096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=969f949772c349e19b82b145acf0d75b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:30.020017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:30.072216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969f949772c349e19b82b145acf0d75b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.090311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969f949772c349e19b82b145acf0d75b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.091612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969f949772c349e19b82b145acf0d75b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.107013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969f949772c349e19b82b145acf0d75b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.109346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969f949772c349e19b82b145acf0d75b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.129973 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4097/8213] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:10:29 2022] DELETE /identity/v3/users/969f949772c349e19b82b145acf0d75b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:10:30.134973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.135884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.136381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.160464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:30.161876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:30.245138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4117/8214] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:30.251704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:30.253311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:30.315490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78748869-5926-4583-bc5c-2e1e7ca91aaf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:30.319175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f0542-0e46-4457-b20c-081d102ba132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:30.319778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f0542-0e46-4457-b20c-081d102ba132 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.320060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f0542-0e46-4457-b20c-081d102ba132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.320335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f0542-0e46-4457-b20c-081d102ba132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.330962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f0542-0e46-4457-b20c-081d102ba132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:30.332444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f0542-0e46-4457-b20c-081d102ba132 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:30.344218 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4098/8215] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:30.639974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:30.641550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:30.660255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee839cf-99ff-455a-8172-1b31b6c692b6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:30.666567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:30.667487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.667864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.668239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] PATH_INFO: `/v3/projects/f4fd788257c14071969f01f87389c036` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.669603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fd788257c14071969f01f87389c036)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:30.680394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:30.735025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fd788257c14071969f01f87389c036', 'request_id': 'req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.741192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fd788257c14071969f01f87389c036', 'request_id': 'req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.748800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fd788257c14071969f01f87389c036', 'request_id': 'req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.765559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] The token cache is being invalidate because project f4fd788257c14071969f01f87389c036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:10:30.766023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.766849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e8fac0dd-ccb6-459e-86b9-72cc2d17324e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:30.768945 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4118/8216] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:10:30 2022] DELETE /identity/v3/projects/f4fd788257c14071969f01f87389c036 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:30.773983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.774280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.774558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.795345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:30.796541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:30.815147 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:30.864463 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4099/8217] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:30.873422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.873794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.874085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.895400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:30.896712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:30.904843 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4119/8218] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:30.909105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:30.920948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05c2d-e0a4-4a8c-a801-dd7047468c92 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:30.925741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:30.926393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.926678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.926956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.927607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:10:30.927916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:30.929591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:30.945365 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4100/8219] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:10:30.947838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:30.958160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593944c9-6280-4554-b2f1-e149f5fa94e7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:30.962840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:30.963558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:30.963844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:30.964121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:30.964754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:30.966962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:31.004737 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4120/8220] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:10:30 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:31.006382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:31.018999 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba046-d9fd-4d73-becc-a3c4b42a745e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:31.096933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:31.097568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:31.097855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:31.098136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:31.098783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:31.100712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:31.128491 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4101/8221] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:10:31 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:31.130146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:31.142014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b2459-a9e5-4094-95b0-6d0a3020a2be admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:31.146921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:31.147528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:31.147834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:31.148175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:31.148829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:31.150473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:31.165491 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4121/8222] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:31.167300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:31.178753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327ff8d-bd53-4318-a511-ce37347cd9a4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:31.183590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a33e7-1148-4789-9484-72a012632e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:31.184264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a33e7-1148-4789-9484-72a012632e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:31.184546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a33e7-1148-4789-9484-72a012632e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:31.185255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a33e7-1148-4789-9484-72a012632e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:31.186431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a33e7-1148-4789-9484-72a012632e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:31.188035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a33e7-1148-4789-9484-72a012632e3f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:31.199454 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4102/8223] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:31.203979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:31.215301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1357e-dfc3-4ae2-8f0a-8c1aae74f415 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:31.221469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:31.222228 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:31.222583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:31.222933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] PATH_INFO: `/v3/projects/7870e0fcc68d4c72b38433b9842776e9/users/df2916e2193240d691e61a20e9f1b205/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:31.239470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7870e0fcc68d4c72b38433b9842776e9, user_id=df2916e2193240d691e61a20e9f1b205, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:31.242297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:31.256235 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4122/8224] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:10:31 2022] PUT /identity/v3/projects/7870e0fcc68d4c72b38433b9842776e9/users/df2916e2193240d691e61a20e9f1b205/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:31.261627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4cebf-3b32-4389-92b3-b6c6d1a9a254 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:31.262000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4cebf-3b32-4389-92b3-b6c6d1a9a254 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:31.262341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4cebf-3b32-4389-92b3-b6c6d1a9a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:31.282974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-08b4cebf-3b32-4389-92b3-b6c6d1a9a254 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:31.284198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-08b4cebf-3b32-4389-92b3-b6c6d1a9a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:31.344381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4103/8225] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:31.353882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:31.355579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:31.380885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:31.422331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b4cb2-192a-46f0-a911-4ab69b3ffdc7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:31.426061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:31.426700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:31.426984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:31.427260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:31.436703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:31.438185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:31.448049 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4123/8226] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:32.083627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.084433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.084433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.115542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] MFA Rules not processed for user `df2916e2193240d691e61a20e9f1b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:32.116664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:32.134508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:32.187446 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4104/8227] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:32.192114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:32.202775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c06f99-0cea-4901-97cf-910055121319 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:32.207407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:32.208009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.208296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.208579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.209259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:32.211171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:32.244446 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4124/8228] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:10:32 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:10:32.245872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:32.261632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a2c9-df97-4903-9080-99e84588480b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:32.330921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:32.331665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.332047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.332390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.333132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:32.335127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:32.360198 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4105/8229] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:10:32 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:32.364279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:32.375431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a35de-6b0d-49e3-9558-b358ece84f95 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:32.379993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:32.380594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.380877 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.381187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.381830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:32.383719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:32.394840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4125/8230] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:10:32.398915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:32.410271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627c00-96a6-4e4e-bad3-1ada504791bf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:32.415001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:32.415696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.415981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.416261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] PATH_INFO: `/v3/projects/6a7d3b2c53454af89005aff3ae928b46/users/d1bdfa104345408ca53a5e156d2cdb8b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.432962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7d3b2c53454af89005aff3ae928b46, user_id=d1bdfa104345408ca53a5e156d2cdb8b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:32.436482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:32.462442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:32.463153 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4106/8231] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:10:32 2022] PUT /identity/v3/projects/6a7d3b2c53454af89005aff3ae928b46/users/d1bdfa104345408ca53a5e156d2cdb8b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:32.478566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c1d1-0fa0-4b71-9a39-5ee718959e69 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:32.541565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a6445-98e3-4119-ae8e-b6b50cb714b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:32.542184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a6445-98e3-4119-ae8e-b6b50cb714b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.542471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a6445-98e3-4119-ae8e-b6b50cb714b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.542754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a6445-98e3-4119-ae8e-b6b50cb714b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.543407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a6445-98e3-4119-ae8e-b6b50cb714b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:32.546471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a6445-98e3-4119-ae8e-b6b50cb714b5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:32.557595 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4126/8232] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:32.563095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:32.573812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96821b28-3752-4590-a628-60fef80551a2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:32.579188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaa71c-6083-4553-bfda-167f948b4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:32.579850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaa71c-6083-4553-bfda-167f948b4fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:32.580266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaa71c-6083-4553-bfda-167f948b4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:32.580561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaa71c-6083-4553-bfda-167f948b4fea admin admin] PATH_INFO: `/v3/projects/6a7d3b2c53454af89005aff3ae928b46/users/d1bdfa104345408ca53a5e156d2cdb8b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:32.582553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaa71c-6083-4553-bfda-167f948b4fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7d3b2c53454af89005aff3ae928b46, user_id=d1bdfa104345408ca53a5e156d2cdb8b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:32.585288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deaa71c-6083-4553-bfda-167f948b4fea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:32.597010 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4107/8233] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:10:32 2022] PUT /identity/v3/projects/6a7d3b2c53454af89005aff3ae928b46/users/d1bdfa104345408ca53a5e156d2cdb8b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:33.259593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:33.260126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:33.260217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:33.290964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] MFA Rules not processed for user `d1bdfa104345408ca53a5e156d2cdb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:33.292259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:33.381035 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4127/8234] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:10:33.382851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:33.383604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:33.383692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:33.405711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] MFA Rules not processed for user `df2916e2193240d691e61a20e9f1b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:33.406953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:33.462622 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4108/8235] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:10:33.479535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:33.481030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:33.494770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:33.557865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c096e4-9c9c-4f2c-9d6e-bab986457286 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:33.563554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:33.564160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:33.564441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:33.564718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:33.572347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:33.573965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:33.583407 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4128/8236] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:37.488720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:37.490149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:37.511294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:37.572742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b62d6-4182-4dad-ac78-517222966d06 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:37.578784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:37.579654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:37.580107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:37.580380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:37.582167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:37.598600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:37.600206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:37.614991 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4109/8237] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:43.579470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=29 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:47.068956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:47.070522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:47.138639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10f9f-628b-44f4-a731-dbdafd33b618 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:47.143318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:47.144249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:47.144689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:47.145167 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:47.147256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:47.224318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:47.226617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:47.241965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4129/8238] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:47.609805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=25 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:50.827610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:50.829379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:50.853560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22768e95-8803-4cef-b82e-90b150755d20 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:50.859087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:50.859822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:50.860104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:50.861054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] PATH_INFO: `/v3/users/881baf1ede7e4fb5acf65268a81241ad` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:50.862598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881baf1ede7e4fb5acf65268a81241ad)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:50.864684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:50.922042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881baf1ede7e4fb5acf65268a81241ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:50.936576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881baf1ede7e4fb5acf65268a81241ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:50.937655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881baf1ede7e4fb5acf65268a81241ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:50.946308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881baf1ede7e4fb5acf65268a81241ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:50.947043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e2b2462f-5ee0-4852-8512-87592ad52776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881baf1ede7e4fb5acf65268a81241ad'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:50.961022 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4110/8239] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:10:50 2022] DELETE /identity/v3/users/881baf1ede7e4fb5acf65268a81241ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:51.165068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.175887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aacce-8706-47ac-9c61-bbcd15fb5274 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.235209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.235834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.236112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.236389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] PATH_INFO: `/v3/projects/7b99b6a5b1764f64a68793f37d4f9b96` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.237521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b99b6a5b1764f64a68793f37d4f9b96)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.239409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.285227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b99b6a5b1764f64a68793f37d4f9b96', 'request_id': 'req-dbdef149-fa31-4aab-a94b-6fdc13de50d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:51.287506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:51.293080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b99b6a5b1764f64a68793f37d4f9b96', 'request_id': 'req-dbdef149-fa31-4aab-a94b-6fdc13de50d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:51.299394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b99b6a5b1764f64a68793f37d4f9b96', 'request_id': 'req-dbdef149-fa31-4aab-a94b-6fdc13de50d7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:51.311810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] The token cache is being invalidate because project 7b99b6a5b1764f64a68793f37d4f9b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:10:51.312149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:51.312774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dbdef149-fa31-4aab-a94b-6fdc13de50d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:51.314291 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4130/8240] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:10:51 2022] DELETE /identity/v3/projects/7b99b6a5b1764f64a68793f37d4f9b96 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:51.319249 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.319540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.319821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.339823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:51.341077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:51.399326 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4111/8241] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:51.407251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.407541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.407820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.428845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:51.430095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:51.438890 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4131/8242] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:51.443389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.453142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be838f05-ab70-4ae1-a6fb-a790b4702928 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.457735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.458391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.458683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.458958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.459601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:10:51.459929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.461552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.477215 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4112/8243] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:10:51.478300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.488644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340eff2-ecdf-40cf-9ea0-a3870520a2ee None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.493345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.493980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.494261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.495271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.495783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.497752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.527164 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4132/8244] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:10:51 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:10:51.531063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.542045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4224b8-89c6-4db8-969e-833543dea09d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.605294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.605521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.605885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.606237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.606881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.608997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.618627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:51.636820 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4113/8245] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:10:51 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:10:51.641797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.655185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62095129-86bd-4435-9c95-67deb6c1fcb5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.660419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.661428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.661718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.661999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.662658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.664271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.675648 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4133/8246] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:10:51.679942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.691155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07268878-69c5-4c1d-a911-121d747a274b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.697131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46542f-658c-44c0-941a-575f00908d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.697131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46542f-658c-44c0-941a-575f00908d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.697341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46542f-658c-44c0-941a-575f00908d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.697480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46542f-658c-44c0-941a-575f00908d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.698673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46542f-658c-44c0-941a-575f00908d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.700328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46542f-658c-44c0-941a-575f00908d22 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.848978 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4114/8247] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:10:51.853443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:51.863420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d74c69-f95d-45c2-b498-3b6ea3677fd7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:51.867939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:51.869253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.870102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.870479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] PATH_INFO: `/v3/projects/793d0223f9b44d27bd2a1c58373554b9/users/4d727a6a2e36494082f70250123bc3d8/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.885969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=793d0223f9b44d27bd2a1c58373554b9, user_id=4d727a6a2e36494082f70250123bc3d8, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:51.888724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:51.903898 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4134/8248] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:10:51 2022] PUT /identity/v3/projects/793d0223f9b44d27bd2a1c58373554b9/users/4d727a6a2e36494082f70250123bc3d8/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:51.914206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:51.914490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:51.914906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:51.943805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] MFA Rules not processed for user `4d727a6a2e36494082f70250123bc3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:10:51.945136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:52.011104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4115/8249] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:10:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:10:52.021656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:52.023355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:52.084401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3517e0-f4b3-4648-bbf0-01fbeda3b57b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:52.088192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:52.089385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:52.089670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:52.089949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:52.098845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:52.100295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:52.110892 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4135/8250] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:10:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:10:59.284545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:59.286124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:10:59.371361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b816-866b-4cad-82ce-d55c81b18814 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:59.376792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:59.377673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:59.378013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:59.378535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] PATH_INFO: `/v3/users/df2916e2193240d691e61a20e9f1b205` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:59.380672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2916e2193240d691e61a20e9f1b205)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:59.383630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:59.463975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2916e2193240d691e61a20e9f1b205'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.480997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2916e2193240d691e61a20e9f1b205'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.481874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2916e2193240d691e61a20e9f1b205'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.487461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:59.505077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2916e2193240d691e61a20e9f1b205'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.505077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2916e2193240d691e61a20e9f1b205'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.526017 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4116/8251] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:10:59 2022] DELETE /identity/v3/users/df2916e2193240d691e61a20e9f1b205 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:59.757536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:10:59.773009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3a1e-9484-43d7-8531-c76901a7a5a8 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:10:59.889735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:10:59.890457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:10:59.890748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:10:59.891022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] PATH_INFO: `/v3/projects/7870e0fcc68d4c72b38433b9842776e9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:10:59.892191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7870e0fcc68d4c72b38433b9842776e9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:10:59.894620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:10:59.923828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:10:59.958113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7870e0fcc68d4c72b38433b9842776e9', 'request_id': 'req-db2c34c3-10e5-43da-a1b3-bd51c8509788'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.965388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7870e0fcc68d4c72b38433b9842776e9', 'request_id': 'req-db2c34c3-10e5-43da-a1b3-bd51c8509788'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.972141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7870e0fcc68d4c72b38433b9842776e9', 'request_id': 'req-db2c34c3-10e5-43da-a1b3-bd51c8509788'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.991132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] The token cache is being invalidate because project 7870e0fcc68d4c72b38433b9842776e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:10:59.991490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.992094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:10:59.997729 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4136/8252] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:10:59 2022] DELETE /identity/v3/projects/7870e0fcc68d4c72b38433b9842776e9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:10:59.999330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:00.000869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:00.018222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1def9a-9761-4ee8-beee-07c6b3302a5a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:00.095472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:00.096116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:00.096399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:00.096677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] PATH_INFO: `/v3/users/d1bdfa104345408ca53a5e156d2cdb8b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:00.097914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1bdfa104345408ca53a5e156d2cdb8b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:00.100293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:00.166008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1bdfa104345408ca53a5e156d2cdb8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.179874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1bdfa104345408ca53a5e156d2cdb8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.180626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1bdfa104345408ca53a5e156d2cdb8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.190527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1bdfa104345408ca53a5e156d2cdb8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.191339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1bdfa104345408ca53a5e156d2cdb8b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.213695 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4117/8253] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:10:59 2022] DELETE /identity/v3/users/d1bdfa104345408ca53a5e156d2cdb8b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:00.399730 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:00.401285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:00.414121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c34c3-10e5-43da-a1b3-bd51c8509788 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:00.485418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:00.486143 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:00.486457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:00.486803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] PATH_INFO: `/v3/projects/6a7d3b2c53454af89005aff3ae928b46` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:00.488057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7d3b2c53454af89005aff3ae928b46)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:00.490360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:00.575961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7d3b2c53454af89005aff3ae928b46', 'request_id': 'req-6d737212-0106-4959-b487-92e144b5ce6b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.582502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7d3b2c53454af89005aff3ae928b46', 'request_id': 'req-6d737212-0106-4959-b487-92e144b5ce6b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.589963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7d3b2c53454af89005aff3ae928b46', 'request_id': 'req-6d737212-0106-4959-b487-92e144b5ce6b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.602182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] The token cache is being invalidate because project 6a7d3b2c53454af89005aff3ae928b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:00.602477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.603121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d737212-0106-4959-b487-92e144b5ce6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:00.605253 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4137/8254] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:00 2022] DELETE /identity/v3/projects/6a7d3b2c53454af89005aff3ae928b46 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:03.810753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:03.812227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:03.825491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e515252-f0ed-4794-b0e2-8f71742613d8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:03.884706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:03.885367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:03.885650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:03.885958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] PATH_INFO: `/v3/users/4d727a6a2e36494082f70250123bc3d8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:03.887080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d727a6a2e36494082f70250123bc3d8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:03.889033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:03.894460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:03.936554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d727a6a2e36494082f70250123bc3d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:03.948746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d727a6a2e36494082f70250123bc3d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:03.949470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d727a6a2e36494082f70250123bc3d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:03.956959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d727a6a2e36494082f70250123bc3d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:03.957594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d727a6a2e36494082f70250123bc3d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:03.970763 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4118/8255] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:03 2022] DELETE /identity/v3/users/4d727a6a2e36494082f70250123bc3d8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:03.975242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:03.975718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:03.975824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:03.997444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:03.998742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:04.033588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:04.061836 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4138/8256] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:04.072160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.073792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:04.137726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06259e-7a66-4ea2-9f65-4080e261ad15 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.143722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda69cb-e69b-4f6d-9f5e-818bcae3459e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.144338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda69cb-e69b-4f6d-9f5e-818bcae3459e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.144621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda69cb-e69b-4f6d-9f5e-818bcae3459e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.144914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda69cb-e69b-4f6d-9f5e-818bcae3459e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.154485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda69cb-e69b-4f6d-9f5e-818bcae3459e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.155911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda69cb-e69b-4f6d-9f5e-818bcae3459e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.165885 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4119/8257] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:04.455231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.456732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:04.478929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c3991-40d6-4648-8d79-fd1a4be352b2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.484465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.485126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.485409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.485683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] PATH_INFO: `/v3/projects/793d0223f9b44d27bd2a1c58373554b9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.486820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] RBAC: Authorizing `identity:delete_project(project_id=793d0223f9b44d27bd2a1c58373554b9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.488819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.536790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793d0223f9b44d27bd2a1c58373554b9', 'request_id': 'req-860bd87d-eea1-4a7a-bd54-d2e8e98135be'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:04.542850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793d0223f9b44d27bd2a1c58373554b9', 'request_id': 'req-860bd87d-eea1-4a7a-bd54-d2e8e98135be'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:04.549350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793d0223f9b44d27bd2a1c58373554b9', 'request_id': 'req-860bd87d-eea1-4a7a-bd54-d2e8e98135be'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:04.562707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] The token cache is being invalidate because project 793d0223f9b44d27bd2a1c58373554b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:04.563001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:04.563624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-860bd87d-eea1-4a7a-bd54-d2e8e98135be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:04.565147 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4139/8258] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:04 2022] DELETE /identity/v3/projects/793d0223f9b44d27bd2a1c58373554b9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:04.570060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.570293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.570575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.599299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:04.600505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:04.659960 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4120/8259] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:04.668452 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.668742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.669052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.688744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:04.689971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:04.697726 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4140/8260] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:04.702053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.712735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cdc63-046d-4ce5-aa12-86b5c751903a None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.717531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.718144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.718421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.718690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.719408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:04.719710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.721325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.734284 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4121/8261] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:04.738658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.748200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce6e0f-8037-489f-a980-b82bb85a2fb8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.752854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.753513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.753794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.754071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.754738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.756935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.784571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4141/8262] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:04 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:04.788663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.799057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439c66-9308-4c27-add7-8d3fd36068be admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.810281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:04.864148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.864817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.864969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.865234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.865868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.867871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.894119 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4122/8263] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:04 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:04.898073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.910026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364278-57de-47bc-a6a0-e4d0da8627ca admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.914640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.915684 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.915964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.916237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.916878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.918492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.928521 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4142/8264] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:04.932682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.942587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537a718-f747-43d4-8db7-b8a03f571fea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.947742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b2742-2261-427a-8fd6-3473c7157650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.948328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b2742-2261-427a-8fd6-3473c7157650 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.948608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b2742-2261-427a-8fd6-3473c7157650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.948880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b2742-2261-427a-8fd6-3473c7157650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.949584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b2742-2261-427a-8fd6-3473c7157650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.951183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b2742-2261-427a-8fd6-3473c7157650 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:04.960852 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4123/8265] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:04.965537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:04.975577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b560-24d5-4e4c-b8af-864785704414 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:04.980181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:04.980831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:04.981152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:04.981433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] PATH_INFO: `/v3/projects/eed7dc8e2aa2451b832b14079fa5b1fe/users/207a74cf9d5b4aaca82071817589c517/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:04.996062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed7dc8e2aa2451b832b14079fa5b1fe, user_id=207a74cf9d5b4aaca82071817589c517, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:04.998776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:05.012110 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4143/8266] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:04 2022] PUT /identity/v3/projects/eed7dc8e2aa2451b832b14079fa5b1fe/users/207a74cf9d5b4aaca82071817589c517/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:05.022244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:05.022538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:05.022816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:05.050750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] MFA Rules not processed for user `207a74cf9d5b4aaca82071817589c517`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:05.051946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:05.115042 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4124/8267] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:05.127441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:05.129249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:05.188908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:05.209057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08da99b-d3eb-4a29-b6e5-ea1125db447b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:05.215302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f537b5-5446-4569-81c2-3b6dbd71e30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:05.215915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f537b5-5446-4569-81c2-3b6dbd71e30d service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:05.216227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f537b5-5446-4569-81c2-3b6dbd71e30d service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:05.216502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f537b5-5446-4569-81c2-3b6dbd71e30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:05.224349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f537b5-5446-4569-81c2-3b6dbd71e30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:05.225985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f537b5-5446-4569-81c2-3b6dbd71e30d service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:05.236001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4144/8268] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:05.434751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:05.514172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e4f7b-f8b0-40ec-b074-27ddea7c35a1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:05.518605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:05.519229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:05.519508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:05.519780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] PATH_INFO: `/v3/users/207a74cf9d5b4aaca82071817589c517` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:05.520892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=207a74cf9d5b4aaca82071817589c517)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:05.522890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:05.551313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:05.570803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207a74cf9d5b4aaca82071817589c517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:05.583251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207a74cf9d5b4aaca82071817589c517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:05.583920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207a74cf9d5b4aaca82071817589c517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:05.592128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207a74cf9d5b4aaca82071817589c517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:05.593050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207a74cf9d5b4aaca82071817589c517'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:05.605356 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4125/8269] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:05 2022] DELETE /identity/v3/users/207a74cf9d5b4aaca82071817589c517 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:05.609923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:05.610213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:05.610516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:05.629182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:05.630314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:05.688525 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4145/8270] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:05.699018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:05.700422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:05.759942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c99de-a4ec-4e2d-9620-e3116b9e6f3e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:05.763597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341eba-becd-4fd7-890e-c8d567f2c1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:05.764197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341eba-becd-4fd7-890e-c8d567f2c1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:05.764480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341eba-becd-4fd7-890e-c8d567f2c1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:05.764759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341eba-becd-4fd7-890e-c8d567f2c1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:05.773701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1341eba-becd-4fd7-890e-c8d567f2c1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:05.775843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1341eba-becd-4fd7-890e-c8d567f2c1d0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:05.788234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4126/8271] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:06.057567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.059035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:06.072831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54487dd-71f9-4e30-8a26-b374acb3b1e8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.077731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.078383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.078671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.078950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] PATH_INFO: `/v3/projects/eed7dc8e2aa2451b832b14079fa5b1fe` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.080094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed7dc8e2aa2451b832b14079fa5b1fe)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.082110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.128050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed7dc8e2aa2451b832b14079fa5b1fe', 'request_id': 'req-7eaba7f6-b04c-430a-af5c-00420edb4f07'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:06.133946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed7dc8e2aa2451b832b14079fa5b1fe', 'request_id': 'req-7eaba7f6-b04c-430a-af5c-00420edb4f07'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:06.140350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed7dc8e2aa2451b832b14079fa5b1fe', 'request_id': 'req-7eaba7f6-b04c-430a-af5c-00420edb4f07'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:06.153385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] The token cache is being invalidate because project eed7dc8e2aa2451b832b14079fa5b1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:06.153685 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:06.154291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7eaba7f6-b04c-430a-af5c-00420edb4f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:06.155793 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4146/8272] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:06 2022] DELETE /identity/v3/projects/eed7dc8e2aa2451b832b14079fa5b1fe => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:06.160703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.161202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.161325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.181399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:06.182769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:06.241755 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4127/8273] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:06.253419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.253711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.253995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.275056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:06.276271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:06.284130 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4147/8274] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:06.288421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.298593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa050ebe-7265-432e-9b98-5165732eb8a0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.303126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.303709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.303987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.304257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.304885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:06.305218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.307393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.318668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4128/8275] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:06.323236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.332506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eb99a-1c96-422b-9d51-aa51abc430f6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.337800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.338399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.338683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.338959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.339591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.341529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.370969 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4148/8276] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:06.374886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.385051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bd1ed-4434-43c2-8a76-8d05d39b04d2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.415492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:06.443701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.444300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.444584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.444861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.445532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.447442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.467722 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4129/8277] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:06.471851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.483476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43760f6-95b3-4d34-8bcc-674c02783c02 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.488131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.488732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.489061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.489344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.490006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.491587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.503072 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4149/8278] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:06.507344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.517708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96ff78-cd33-4dda-a150-7b93064c7a88 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.522276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aec964-08a4-4422-b4d6-dac22aa49817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.522897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec964-08a4-4422-b4d6-dac22aa49817 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.523177 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec964-08a4-4422-b4d6-dac22aa49817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.523450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec964-08a4-4422-b4d6-dac22aa49817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.524107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aec964-08a4-4422-b4d6-dac22aa49817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.525935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aec964-08a4-4422-b4d6-dac22aa49817 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.536290 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4130/8279] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:06.540735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.550712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cd099-43b6-455f-8d10-c50b230cff78 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.556206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.557037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.557329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.557611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] PATH_INFO: `/v3/projects/3abeef8eb00345b49f1322b31daf2dc3/users/e97e360aedd741a4bf43e6ae32c6e428/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.573300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abeef8eb00345b49f1322b31daf2dc3, user_id=e97e360aedd741a4bf43e6ae32c6e428, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.576055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.589621 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4150/8280] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:06 2022] PUT /identity/v3/projects/3abeef8eb00345b49f1322b31daf2dc3/users/e97e360aedd741a4bf43e6ae32c6e428/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:06.600074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.600362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.600638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.628153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] MFA Rules not processed for user `e97e360aedd741a4bf43e6ae32c6e428`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:06.629380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:06.692997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4131/8281] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:11:06.697451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.702981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:06.760662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3806fc-aa0e-41cc-8a9c-e226b5a0fc44 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.765304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.765928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.766207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.766480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.767115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.769034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.795745 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4151/8282] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:06.800201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.811411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d2a2-02cc-4e6b-b9ee-01da014e7a32 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.868595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.869241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.869536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.869941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.870606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.872535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.898325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4132/8283] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:06 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:06.899583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.909708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b390e0-a45b-480c-a7cf-43a593a68f10 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.914224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.914921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.915220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.915495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.916133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.917805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.927977 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4152/8284] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:11:06.932564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.942322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f2753-814c-4e87-9167-f5a5dd6b8bcf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:06.947679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:06.948321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:06.948598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:06.948869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] PATH_INFO: `/v3/projects/9bd4e041491c43d198fb8484c95e16ba/users/15ee8ebeecb8434a9b904587051846f2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:06.963136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd4e041491c43d198fb8484c95e16ba, user_id=15ee8ebeecb8434a9b904587051846f2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:06.965815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:06.979282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4133/8285] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:06 2022] PUT /identity/v3/projects/9bd4e041491c43d198fb8484c95e16ba/users/15ee8ebeecb8434a9b904587051846f2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:06.983158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:06.993031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d47d1-8399-4e64-b234-7419ed14a281 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.050099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d70743-417b-470b-8c48-96500e921f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.050705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70743-417b-470b-8c48-96500e921f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.050988 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70743-417b-470b-8c48-96500e921f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.051267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d70743-417b-470b-8c48-96500e921f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.051902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d70743-417b-470b-8c48-96500e921f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.053563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d70743-417b-470b-8c48-96500e921f5c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.063747 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4153/8286] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:07.067878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.078162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be0612-8901-4eae-ae4d-9360818bdeac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.082908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.083551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.083827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.084118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] PATH_INFO: `/v3/projects/9bd4e041491c43d198fb8484c95e16ba/users/15ee8ebeecb8434a9b904587051846f2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.086041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd4e041491c43d198fb8484c95e16ba, user_id=15ee8ebeecb8434a9b904587051846f2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.088727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.090942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:07.101156 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4134/8287] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:07 2022] PUT /identity/v3/projects/9bd4e041491c43d198fb8484c95e16ba/users/15ee8ebeecb8434a9b904587051846f2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:07.111890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.112180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.112457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.140808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] MFA Rules not processed for user `15ee8ebeecb8434a9b904587051846f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:07.142046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:07.209711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:07.214121 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4154/8288] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:07.218500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.229609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b12e9-bae6-45aa-8f2a-d5a29ad25f3e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.234281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.234879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.235161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.235458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.236115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.237728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.252771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4135/8289] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/services => generated 290 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:07.257217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.266832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89c6c6-43a1-4586-a0a9-cd6179c8d5b2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.281219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.281823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.282105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.282378 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.283033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.284044 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.284044 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:11:07.284044 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:07.284937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.297219 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4155/8290] 10.222.0.16 () {60 vars in 1213 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:07.301769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.312591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208fb4e-0b02-465a-898b-239697cca0af tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.317215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.317809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.318095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.318371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.319012 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.320623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.334677 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4136/8291] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/services => generated 289 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:07.339133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.349032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3a30e-dccf-49b8-ab76-f173105dcb54 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.364014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.364606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.364890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.365196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.365886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.367474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.377527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4156/8292] 10.222.0.16 () {60 vars in 1213 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:07.381806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.392945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40417f-75e6-4031-b32a-97cd688b0f86 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.397668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.398271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.398554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.398830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.399518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.400516 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.400516 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:07.400516 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:07.401441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.407987 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4137/8293] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 5 03:11:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:07.411799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.421597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4af8-bce8-4311-910f-542fde182e8c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.426217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.426827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.427110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.427390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.427972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=93704c94e8d3454c9a6cd3b6d68e3559)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.428998 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.428998 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:11:07.428998 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:07.429864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.436481 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4157/8294] 10.222.0.16 () {58 vars in 1290 bytes} [Wed Oct 5 03:11:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559 => generated 333 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:07.440195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.450591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd05505-5dcf-4293-b9fd-d1a3fb178b1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.455201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.455808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `HEAD` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.456092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.456376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.456990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=93704c94e8d3454c9a6cd3b6d68e3559)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.457969 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.457969 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:07.457969 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:07.458832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.464533 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4138/8295] 10.222.0.16 () {58 vars in 1291 bytes} [Wed Oct 5 03:11:07 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559 => generated 0 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 05 03:11:07.468048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.477768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f675121-ae25-47f3-9ca0-8e3e84e81864 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.482366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.482982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.483269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.483552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.484133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=93704c94e8d3454c9a6cd3b6d68e3559)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.485169 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.485169 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:11:07.485169 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:07.486042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.496642 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4158/8296] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:07.500423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.511420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5b09-ff55-442d-ac3e-65638ce16113 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.515983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.516580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.516860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.517173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.517790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.519333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.523747 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4139/8297] 10.222.0.16 () {58 vars in 1191 bytes} [Wed Oct 5 03:11:07 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:07.527631 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.537613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658391-18f0-4f37-ab69-27be79de102b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.542327 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.542954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.543243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.543529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.544114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=93704c94e8d3454c9a6cd3b6d68e3559)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.545770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Could not find Endpoint Group: 93704c94e8d3454c9a6cd3b6d68e3559.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 93704c94e8d3454c9a6cd3b6d68e3559. Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 05 03:11:07.560811 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 05 03:11:07.561996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 05 03:11:07.561996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 05 03:11:07.561996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 05 03:11:07.561996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 05 03:11:07.561996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 93704c94e8d3454c9a6cd3b6d68e3559. Oct 05 03:11:07.561996 n-d-858272-3 devstack@keystone.service[81826]: ERROR keystone.server.flask.application Oct 05 03:11:07.562484 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4159/8298] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/93704c94e8d3454c9a6cd3b6d68e3559 => generated 120 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 03:11:07.565831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.576350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d0612-42f0-4b85-8bf3-c1e6b059114e tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.581068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.581687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.581976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.582255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services/9cf20a23b4a84435a171bbf97a62e067` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.582865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9cf20a23b4a84435a171bbf97a62e067)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.584464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.606633 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4140/8299] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/services/9cf20a23b4a84435a171bbf97a62e067 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:07.611713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.622381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcebe9-ed59-4c76-95f3-cff6c5074f28 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.637737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.638338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.638627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.638905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.639560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.641193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.656338 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4160/8300] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/services => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:07.660484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.671419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5df036-69ec-4cf6-8fce-0bce04477c3d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.686374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.686976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.687259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.687534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.688178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.689208 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.689208 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:07.689208 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:07.690088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.701473 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4141/8301] 10.222.0.16 () {60 vars in 1213 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:07.705623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.716136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270068b-e8fe-4d52-b920-46cdd187c5b4 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.720768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.721385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.721673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.721953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.722637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.724226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.739373 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4161/8302] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:07 2022] POST /identity/v3/services => generated 288 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:07.743954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.753760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3589f74-1a99-48f4-abfa-525b7db7d6b5 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.768794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.769441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.769721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.769997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d3453d63eb8141aa8295c83d90b88046` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.770661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=d3453d63eb8141aa8295c83d90b88046)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.771640 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.771640 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:07.771640 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:07.772521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.783591 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4142/8303] 10.222.0.16 () {60 vars in 1313 bytes} [Wed Oct 5 03:11:07 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/d3453d63eb8141aa8295c83d90b88046 => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:11:07.787598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.798476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4339b-e166-46c0-bc97-b83ef0ea0e20 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.803406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.804021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.804304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.804580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services/33148559a00946268769e505d6b72fd2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.805193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_service(service_id=33148559a00946268769e505d6b72fd2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.807357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.828553 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4162/8304] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/services/33148559a00946268769e505d6b72fd2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:07.833523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.844442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323d9f-576a-42a7-80f3-e780d862c369 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.859247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.859871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.860152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.860428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d3453d63eb8141aa8295c83d90b88046` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.861035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d3453d63eb8141aa8295c83d90b88046)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.862029 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:07.862029 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:07.862029 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:07.862911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.873132 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4143/8305] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d3453d63eb8141aa8295c83d90b88046 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:07.877323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.888144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3d65d-5374-477e-b461-6d84b4a4647c tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.892731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.893380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.893665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.893944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services/4b28c7abf3014bf4915df0eda01a6093` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.894549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4b28c7abf3014bf4915df0eda01a6093)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.896139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.916987 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4163/8306] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/services/4b28c7abf3014bf4915df0eda01a6093 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:07.922038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.932515 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98febd7-f307-46ab-a343-f83c9bff2f1a tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.946541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.947155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.947436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.947711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/fecc4c4022774e6a9b8087e9d9ade741` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.948281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=fecc4c4022774e6a9b8087e9d9ade741)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.949875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:07.958670 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4144/8307] 10.222.0.16 () {58 vars in 1293 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/fecc4c4022774e6a9b8087e9d9ade741 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:07.963001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:07.973549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3540f-291e-476c-90bc-751857381338 tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:07.978756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717461f-3098-4832-abee-d85e30ea532b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ee8ebeecb8434a9b904587051846f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bd4e041491c43d198fb8484c95e16ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:07.979376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717461f-3098-4832-abee-d85e30ea532b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:07.979662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717461f-3098-4832-abee-d85e30ea532b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:07.979941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717461f-3098-4832-abee-d85e30ea532b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] PATH_INFO: `/v3/services/ae3accbdb75d4b3ebe801c68bc60b5cc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:07.980529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717461f-3098-4832-abee-d85e30ea532b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ae3accbdb75d4b3ebe801c68bc60b5cc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:07.982154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717461f-3098-4832-abee-d85e30ea532b tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:08.003329 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4164/8308] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:07 2022] DELETE /identity/v3/services/ae3accbdb75d4b3ebe801c68bc60b5cc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:08.007416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:08.064317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:08.081724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cd25c-f2fc-4e0e-a339-b1bc2eb8829d tempest-EndPointGroupsTest-558343128 tempest-EndPointGroupsTest-558343128-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:08.096602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:08.097259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:08.097549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:08.097829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] PATH_INFO: `/v3/users/e97e360aedd741a4bf43e6ae32c6e428` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:08.098996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97e360aedd741a4bf43e6ae32c6e428)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:08.101008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:08.147136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97e360aedd741a4bf43e6ae32c6e428'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.159563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97e360aedd741a4bf43e6ae32c6e428'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.160236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97e360aedd741a4bf43e6ae32c6e428'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.168611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97e360aedd741a4bf43e6ae32c6e428'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.169280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97e360aedd741a4bf43e6ae32c6e428'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.182096 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4145/8309] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:08 2022] DELETE /identity/v3/users/e97e360aedd741a4bf43e6ae32c6e428 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:08.186559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:08.187065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:08.187174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:08.206457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:08.207664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:08.251596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:08.270534 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4165/8310] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:08.281375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:08.282808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:08.351591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555b584-b5ac-4a40-92fb-a031091002e9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:08.356310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:08.356933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:08.357218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:08.357502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:08.366389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:08.367826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:08.377063 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4146/8311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:08.646636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:08.648063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:08.660706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a05c0-845f-4043-8647-0fc62a321d84 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:08.665337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:08.666315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:08.666315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:08.666550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] PATH_INFO: `/v3/projects/3abeef8eb00345b49f1322b31daf2dc3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:08.667675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abeef8eb00345b49f1322b31daf2dc3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:08.669644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:08.717364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abeef8eb00345b49f1322b31daf2dc3', 'request_id': 'req-b22a33c7-1fd0-410e-a185-81be2fae0dfb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.722758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abeef8eb00345b49f1322b31daf2dc3', 'request_id': 'req-b22a33c7-1fd0-410e-a185-81be2fae0dfb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.729098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abeef8eb00345b49f1322b31daf2dc3', 'request_id': 'req-b22a33c7-1fd0-410e-a185-81be2fae0dfb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.741066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] The token cache is being invalidate because project 3abeef8eb00345b49f1322b31daf2dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:08.741355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.741995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.743668 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4166/8312] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:08 2022] DELETE /identity/v3/projects/3abeef8eb00345b49f1322b31daf2dc3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:08.747806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:08.757689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41321ae0-a575-465f-9f36-1ff6f0122ef3 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:08.803653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:08.815643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:08.816279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:08.816556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:08.816824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] PATH_INFO: `/v3/users/15ee8ebeecb8434a9b904587051846f2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:08.817961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ee8ebeecb8434a9b904587051846f2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:08.819933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:08.867385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ee8ebeecb8434a9b904587051846f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.879708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ee8ebeecb8434a9b904587051846f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.880371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ee8ebeecb8434a9b904587051846f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.888561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ee8ebeecb8434a9b904587051846f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.889215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9dcc287a-3f57-4f14-87d0-8d73060320d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ee8ebeecb8434a9b904587051846f2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:08.901481 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4147/8313] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:08 2022] DELETE /identity/v3/users/15ee8ebeecb8434a9b904587051846f2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:09.170767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.172241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:09.186643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a33c7-1fd0-410e-a185-81be2fae0dfb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.248220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.248851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.249158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.249432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] PATH_INFO: `/v3/projects/9bd4e041491c43d198fb8484c95e16ba` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.250527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd4e041491c43d198fb8484c95e16ba)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.252418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.435117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd4e041491c43d198fb8484c95e16ba', 'request_id': 'req-f226022e-00d9-41f2-92e0-f8cd33206d66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:09.440638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd4e041491c43d198fb8484c95e16ba', 'request_id': 'req-f226022e-00d9-41f2-92e0-f8cd33206d66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:09.447026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd4e041491c43d198fb8484c95e16ba', 'request_id': 'req-f226022e-00d9-41f2-92e0-f8cd33206d66'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:09.456095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:09.460437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] The token cache is being invalidate because project 9bd4e041491c43d198fb8484c95e16ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:09.461396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:09.462212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f226022e-00d9-41f2-92e0-f8cd33206d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:09.463965 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4167/8314] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:09 2022] DELETE /identity/v3/projects/9bd4e041491c43d198fb8484c95e16ba => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:09.469178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.469664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.469791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.489638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:09.490881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:09.550495 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4148/8315] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:09.639957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.640240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.640544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.661182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:09.662376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:09.670849 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4168/8316] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:09.675225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.685006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245e62-cef9-492e-97cd-118549d194fe None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.689612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.690149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.690431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.690703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.691368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:09.691675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.693301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.704971 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4149/8317] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:09.709299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.719063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a7231-5f82-46ee-9cc9-d15f7f5e3680 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.723953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.724550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.724832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.725131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.725772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.728353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.755293 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4169/8318] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:09 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:09.759769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.769905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e5b0e-fd79-4a4d-918f-8fe359c176a1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.821991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:09.828885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.829547 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.830123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.830464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.831977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.834677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.856967 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4150/8319] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:09 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:09.861090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.871243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910af1-b92b-4d08-9f17-6648270881c6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.875773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.876362 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.876642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.876923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.877580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.879187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.889145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4170/8320] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:09.892894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.903636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063d10e-218a-4ca6-a75f-3543bde8484a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.908233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a287bd-7b06-46a1-816d-9d156b001d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.908823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a287bd-7b06-46a1-816d-9d156b001d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.909264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a287bd-7b06-46a1-816d-9d156b001d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.909541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a287bd-7b06-46a1-816d-9d156b001d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.910172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a287bd-7b06-46a1-816d-9d156b001d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.911820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a287bd-7b06-46a1-816d-9d156b001d3c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.923258 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4151/8321] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:09.927412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:09.937325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9276f0-2a06-4fb7-8bcd-237affb4955b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:09.941897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:09.942478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.942754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.943026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] PATH_INFO: `/v3/projects/96180edfde264fc59fede4ca743cdd9b/users/a933f3fee3e3418f9063d56e365ff27e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:09.957579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96180edfde264fc59fede4ca743cdd9b, user_id=a933f3fee3e3418f9063d56e365ff27e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:09.960223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:09.973884 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4171/8322] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:09 2022] PUT /identity/v3/projects/96180edfde264fc59fede4ca743cdd9b/users/a933f3fee3e3418f9063d56e365ff27e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:09.984324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:09.984619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:09.984909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.013151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] MFA Rules not processed for user `a933f3fee3e3418f9063d56e365ff27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:10.014371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:10.077137 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4152/8323] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:10.081579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.142080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e170bf5-1183-427c-81aa-f088ee89ee4c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.146620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.147214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.147493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.147765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.148383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.150899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.176601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4172/8324] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:10 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:10.180776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.191178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a0dd1-4076-4efd-851a-34677eb1b20d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.248599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.249165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.249449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.249722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.250364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.252274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.275064 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4153/8325] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:10 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:10.279071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.289246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717822-b662-4ec2-9c33-43e006715061 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.294311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.294917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.295199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.295472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.296112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.297809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.309840 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4173/8326] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:10.314059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.324673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af09171-94db-4f7a-b09c-c63cf7b910c6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.329332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.329979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.330256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.330527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] PATH_INFO: `/v3/projects/122e4793c53648eeac62986b6f858be4/users/3ab6e73b75cf45338d5d7b888c9abf74/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.345847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122e4793c53648eeac62986b6f858be4, user_id=3ab6e73b75cf45338d5d7b888c9abf74, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.348495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.361990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4154/8327] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:10 2022] PUT /identity/v3/projects/122e4793c53648eeac62986b6f858be4/users/3ab6e73b75cf45338d5d7b888c9abf74/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:10.365848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.376048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780011ac-7b68-4304-baf4-9a0f2d5863f5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.434884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4f3e0-882d-43d8-942e-d9e4fd2ee91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.435493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4f3e0-882d-43d8-942e-d9e4fd2ee91f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.435776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4f3e0-882d-43d8-942e-d9e4fd2ee91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.436054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4f3e0-882d-43d8-942e-d9e4fd2ee91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.436698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4f3e0-882d-43d8-942e-d9e4fd2ee91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.438324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4f3e0-882d-43d8-942e-d9e4fd2ee91f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.449225 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4174/8328] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:10.453184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.464746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69ad94-261e-47c3-8ad5-ab69ac21b0d9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.469567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.470226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.470505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.470780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] PATH_INFO: `/v3/projects/122e4793c53648eeac62986b6f858be4/users/3ab6e73b75cf45338d5d7b888c9abf74/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.472706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=122e4793c53648eeac62986b6f858be4, user_id=3ab6e73b75cf45338d5d7b888c9abf74, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.475447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.485784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4155/8329] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:10 2022] PUT /identity/v3/projects/122e4793c53648eeac62986b6f858be4/users/3ab6e73b75cf45338d5d7b888c9abf74/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:10.496060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.496354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.496651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.510893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:10.526080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] MFA Rules not processed for user `3ab6e73b75cf45338d5d7b888c9abf74`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:10.527294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:10.593384 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4175/8330] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:10.598247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.608966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a152f-9abb-4eff-89bd-83151c4e9d6e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.613494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.614081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.614365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.614645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.615266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.617134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.634705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:10.649833 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4156/8331] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:10 2022] POST /identity/v3/projects => generated 358 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:10.653995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.663623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b329d3-5918-40b1-a5ee-b4af9a6ada01 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.718817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.719462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.719749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.720025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-670482948` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.721235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=10f0b58b6d284191ae4d067961814855, value=tempest-tag-670482948)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.723346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.777301 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-670482948. To ensure interoperability, identifiers should be a valid uuid. Oct 05 03:11:10.777301 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 03:11:10.777301 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:10.782990 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4176/8332] 10.222.0.16 () {60 vars in 1330 bytes} [Wed Oct 5 03:11:10 2022] PUT /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-670482948 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Oct 05 03:11:10.787428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.798332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cba1a-f9de-4a3a-be8e-c87b3111880a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.803301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.804036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.804320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.804598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-670482948` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.815923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=10f0b58b6d284191ae4d067961814855, value=tempest-tag-670482948)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.818155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.829235 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4157/8333] 10.222.0.16 () {58 vars in 1311 bytes} [Wed Oct 5 03:11:10 2022] GET /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-670482948 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:10.834138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.844152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a6895-351e-46d6-b6c3-0bf4bedd4424 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.848722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.849372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.849652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.849925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.851090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=10f0b58b6d284191ae4d067961814855)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.853838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.900022 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4177/8334] 10.222.0.16 () {60 vars in 1265 bytes} [Wed Oct 5 03:11:10 2022] PUT /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags => generated 140 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:10.904162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.914288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a765e-c4bc-4977-a707-d67e633396b6 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.919750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.920409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.920694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.921009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.932665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=10f0b58b6d284191ae4d067961814855)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.934984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.946346 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4158/8335] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 03:11:10 2022] GET /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags => generated 140 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:10.950435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:10.960475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3cbf7-5a93-474f-9f73-91726fafc745 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:10.965665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:10.966300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:10.966581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:10.966862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-125071865` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:10.967982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=10f0b58b6d284191ae4d067961814855, value=tempest-tag-125071865)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:10.970158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:10.972184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:11.012560 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-125071865. To ensure interoperability, identifiers should be a valid uuid. Oct 05 03:11:11.012560 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 05 03:11:11.012560 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:11.017680 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4178/8336] 10.222.0.16 () {58 vars in 1314 bytes} [Wed Oct 5 03:11:10 2022] DELETE /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-125071865 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:11.021897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.032601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0041d59-f6be-445b-abdc-5407fcb78fa3 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.037151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.037782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.038072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.038349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-125071865` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.049348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=10f0b58b6d284191ae4d067961814855, value=tempest-tag-125071865)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.051400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Could not find project tag: tempest-tag-125071865.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-125071865. Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 05 03:11:11.065425 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-125071865. Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 03:11:11.066613 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4159/8337] 10.222.0.16 () {58 vars in 1311 bytes} [Wed Oct 5 03:11:11 2022] GET /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags/tempest-tag-125071865 => generated 106 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 03:11:11.070561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.084376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c1b9-9387-4495-bb95-07297056aa00 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.089929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.090564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.090845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.091124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.092255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=10f0b58b6d284191ae4d067961814855)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.094417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.135172 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4179/8338] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:11:11 2022] DELETE /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:11.139352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.149467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc904a05-e12f-4c4b-95ee-d977626f9a6a tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.154046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.154695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.154982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.155284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855/tags` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.166377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=10f0b58b6d284191ae4d067961814855)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.168429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.178303 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4160/8339] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Oct 5 03:11:11 2022] GET /identity/v3/projects/10f0b58b6d284191ae4d067961814855/tags => generated 66 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 05 03:11:11.184073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.193578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36019d5e-7b6f-4ddc-874a-a862bc5e2201 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.199155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ab6e73b75cf45338d5d7b888c9abf74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '122e4793c53648eeac62986b6f858be4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.199766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.200053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.200332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] PATH_INFO: `/v3/projects/10f0b58b6d284191ae4d067961814855` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.201494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorizing `identity:delete_project(project_id=10f0b58b6d284191ae4d067961814855)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.203420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.250004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f0b58b6d284191ae4d067961814855', 'request_id': 'req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.255758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f0b58b6d284191ae4d067961814855', 'request_id': 'req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.263503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f0b58b6d284191ae4d067961814855', 'request_id': 'req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.276347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] The token cache is being invalidate because project 10f0b58b6d284191ae4d067961814855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:11.276639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.277297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f2c3a7cc-3000-4a45-a0a0-ed7ad1102545 tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.278790 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4180/8340] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:11 2022] DELETE /identity/v3/projects/10f0b58b6d284191ae4d067961814855 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:11.284020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.285908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:11.350816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fad446-07a3-4053-a31f-0eb4fc3aabee tempest-IdentityV3ProjectTagsTest-1860737156 tempest-IdentityV3ProjectTagsTest-1860737156-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.407142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.407771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.408053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.408329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] PATH_INFO: `/v3/users/a933f3fee3e3418f9063d56e365ff27e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.409473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a933f3fee3e3418f9063d56e365ff27e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.411474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.427027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:11.455987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a933f3fee3e3418f9063d56e365ff27e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.468110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a933f3fee3e3418f9063d56e365ff27e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.468872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a933f3fee3e3418f9063d56e365ff27e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.476428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a933f3fee3e3418f9063d56e365ff27e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.478585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a933f3fee3e3418f9063d56e365ff27e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:11.490841 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4161/8341] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:11 2022] DELETE /identity/v3/users/a933f3fee3e3418f9063d56e365ff27e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:11.495624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.496108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.496214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.516655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:11.517954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:11.576594 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4181/8342] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:11.586879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.588381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:11.647868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660307-2848-438a-8430-c78960ee9b97 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.652201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.652977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.653264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.653543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.662984 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.664511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.674201 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4162/8343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:11.944485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:11.946577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:11.959927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65973d01-4bd9-4f4b-9748-8d4de6fb0eeb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:11.965390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:11.966049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:11.966380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:11.966601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] PATH_INFO: `/v3/projects/96180edfde264fc59fede4ca743cdd9b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:11.967747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96180edfde264fc59fede4ca743cdd9b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:11.969884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:11.978768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:12.021964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96180edfde264fc59fede4ca743cdd9b', 'request_id': 'req-e3b5c719-b0e6-417e-afdd-4676822dca22'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.027539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96180edfde264fc59fede4ca743cdd9b', 'request_id': 'req-e3b5c719-b0e6-417e-afdd-4676822dca22'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.033592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96180edfde264fc59fede4ca743cdd9b', 'request_id': 'req-e3b5c719-b0e6-417e-afdd-4676822dca22'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.045922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] The token cache is being invalidate because project 96180edfde264fc59fede4ca743cdd9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:12.046215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.046845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.048320 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4182/8344] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:11 2022] DELETE /identity/v3/projects/96180edfde264fc59fede4ca743cdd9b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:12.052564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:12.063198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaca3f-c5ca-4a22-bee0-c072209470c8 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:12.120426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:12.121017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.121306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.121585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] PATH_INFO: `/v3/users/3ab6e73b75cf45338d5d7b888c9abf74` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.122733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab6e73b75cf45338d5d7b888c9abf74)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:12.124645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:12.164145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:12.171139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab6e73b75cf45338d5d7b888c9abf74'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.184446 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab6e73b75cf45338d5d7b888c9abf74'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.185140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab6e73b75cf45338d5d7b888c9abf74'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.192353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab6e73b75cf45338d5d7b888c9abf74'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.193020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1e5a0f8f-e4ff-49eb-a672-eea3f764488d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab6e73b75cf45338d5d7b888c9abf74'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.207178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4163/8345] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:12 2022] DELETE /identity/v3/users/3ab6e73b75cf45338d5d7b888c9abf74 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:12.484208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:12.485724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:12.499843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c719-b0e6-417e-afdd-4676822dca22 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:12.564269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:12.564923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.565204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.565482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] PATH_INFO: `/v3/projects/122e4793c53648eeac62986b6f858be4` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.566598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=122e4793c53648eeac62986b6f858be4)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:12.568514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:12.615128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122e4793c53648eeac62986b6f858be4', 'request_id': 'req-6876e668-2d23-4f62-aaa2-7549f6adf42d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.620670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122e4793c53648eeac62986b6f858be4', 'request_id': 'req-6876e668-2d23-4f62-aaa2-7549f6adf42d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.628491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122e4793c53648eeac62986b6f858be4', 'request_id': 'req-6876e668-2d23-4f62-aaa2-7549f6adf42d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.640800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] The token cache is being invalidate because project 122e4793c53648eeac62986b6f858be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:12.641144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.641773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6876e668-2d23-4f62-aaa2-7549f6adf42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:12.643232 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4183/8346] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:12 2022] DELETE /identity/v3/projects/122e4793c53648eeac62986b6f858be4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:12.648111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.649114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.649257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.669688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:12.670884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:12.730058 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4164/8347] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:11:12.737719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.738033 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.738316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.757813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:12.759019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:12.766786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4184/8348] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:12.770982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:12.781377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2538af-28a0-4bf3-a313-f3a83664ef1b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:12.786118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:12.786749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.787055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.787329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.787970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:12.788274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:12.790740 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:12.802158 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4165/8349] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:12.806343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:12.815547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b5915-2d9b-4bcd-9aee-dc26711cba87 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:12.820100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:12.820719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.821024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.821306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.821937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:12.823816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:12.844688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:12.853222 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4185/8350] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:12 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:12.857220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:12.867025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e4d51-4756-4e03-af60-78f8f55b4f79 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:12.927582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:12.928095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.928373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.928642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.929295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:12.931305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:12.952580 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4166/8351] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:12 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:12.956722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:12.967608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5393a97-2a36-412a-97ae-5ecfc42aa9d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:12.972116 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:12.972706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:12.973026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:12.973304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:12.973949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:12.975549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:12.986007 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4186/8352] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:12.989887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.000169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70a1c-e1c4-4e73-8270-60d469c577ee admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.004762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7620169-c32d-4a6e-8298-f3068783473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.005652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620169-c32d-4a6e-8298-f3068783473b admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.005929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620169-c32d-4a6e-8298-f3068783473b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.006200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7620169-c32d-4a6e-8298-f3068783473b admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.006862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7620169-c32d-4a6e-8298-f3068783473b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.009127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7620169-c32d-4a6e-8298-f3068783473b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.020179 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4167/8353] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:13.024865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.034952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b20498-c52c-4069-94ab-e1c4b1d9fc28 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.039893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.040541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.040824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.041131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] PATH_INFO: `/v3/projects/89189a14458844a9b1223868e0306b81/users/f85a8bc976294284bf56588e9a72ca96/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.056164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89189a14458844a9b1223868e0306b81, user_id=f85a8bc976294284bf56588e9a72ca96, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.058840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.072224 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4187/8354] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:13 2022] PUT /identity/v3/projects/89189a14458844a9b1223868e0306b81/users/f85a8bc976294284bf56588e9a72ca96/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:13.082201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.082491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.082772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.110987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] MFA Rules not processed for user `f85a8bc976294284bf56588e9a72ca96`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:13.112194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:13.121729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:13.178117 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4168/8355] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:13.182676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.249566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de672f-b190-4458-a97e-127987f3ed18 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.254282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.254893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.255540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.255826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.256458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.259487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.286647 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4188/8356] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:13 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:13.290822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.301673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df60a07-816e-47f4-8e1f-ec0f35e22c68 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.358863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.359472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.359756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.360033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.360665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.362610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.384589 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4169/8357] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:13 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:13.389233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.399710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61b6f8-f940-4dca-bacf-2d6d377f1281 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.404412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.405048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.405334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.405616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.406259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.408062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.418653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4189/8358] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:13.422922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.433411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569fb2-37a7-4f46-966f-a6392f247a02 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.437952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.438594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.438878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.439151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] PATH_INFO: `/v3/projects/e7a59114543145c2a72e28a3c8804ab4/users/6f2b0a470f17407990bde9559f29a264/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.455102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a59114543145c2a72e28a3c8804ab4, user_id=6f2b0a470f17407990bde9559f29a264, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.457777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.470219 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4170/8359] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:13 2022] PUT /identity/v3/projects/e7a59114543145c2a72e28a3c8804ab4/users/6f2b0a470f17407990bde9559f29a264/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:13.474115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.484147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0aa0-279b-4360-91c9-17ab69f64888 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.541388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81d4fe-6e9b-4189-8eff-02d69ddc3d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.542074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d4fe-6e9b-4189-8eff-02d69ddc3d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.542266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d4fe-6e9b-4189-8eff-02d69ddc3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.542542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81d4fe-6e9b-4189-8eff-02d69ddc3d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.543188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81d4fe-6e9b-4189-8eff-02d69ddc3d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.544784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81d4fe-6e9b-4189-8eff-02d69ddc3d18 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.554609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4190/8360] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:13.559424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.569778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e667084-5a39-4cd7-a06a-4f8e6e97bf8d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.574927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.575572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.575873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.576161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] PATH_INFO: `/v3/projects/e7a59114543145c2a72e28a3c8804ab4/users/6f2b0a470f17407990bde9559f29a264/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.578085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a59114543145c2a72e28a3c8804ab4, user_id=6f2b0a470f17407990bde9559f29a264, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.580718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.590749 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4171/8361] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:13 2022] PUT /identity/v3/projects/e7a59114543145c2a72e28a3c8804ab4/users/6f2b0a470f17407990bde9559f29a264/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:13.602090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.602404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.602700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.631325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] MFA Rules not processed for user `6f2b0a470f17407990bde9559f29a264`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:13.632521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:13.652777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:13.702041 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4191/8362] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:13.706863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.717574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e065e3-4267-4611-a32c-bd445d593476 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.722106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.722705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.722989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.723266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.723900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.725519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.741497 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4172/8363] 10.222.0.16 () {60 vars in 1152 bytes} [Wed Oct 5 03:11:13 2022] POST /identity/v3/services => generated 240 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:13.746043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.755563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33387b-cf3f-4e8d-9979-a2ddab41b186 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.770235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.770871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.771158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.771435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/04e7acd6eda24f3bb79e20715ee99663` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.772019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:delete_service(service_id=04e7acd6eda24f3bb79e20715ee99663)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.773666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.794651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4192/8364] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:13 2022] DELETE /identity/v3/services/04e7acd6eda24f3bb79e20715ee99663 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:13.799911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.811436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef3dc-e8aa-49b7-8a61-80ea3ab13d6b tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.826314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.826926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.827211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.827488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.828142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.829770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.854528 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4173/8365] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:13 2022] POST /identity/v3/services => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:13.855650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.866184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff8a2-ca26-49a7-a9f9-4f7956a1d673 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.881772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.882402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `PATCH` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.882692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.883098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/100c6f80d10444c6bcc406a78ce61469` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.884185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:update_service(service_id=100c6f80d10444c6bcc406a78ce61469)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.885264 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:13.885264 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:11:13.885264 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:13.886150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.903234 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4193/8366] 10.222.0.16 () {60 vars in 1252 bytes} [Wed Oct 5 03:11:13 2022] PATCH /identity/v3/services/100c6f80d10444c6bcc406a78ce61469 => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:11:13.907599 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.918714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd01f9d-2c55-4f61-82f6-8b79f64a45b6 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.933586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.934210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.934493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.934774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/100c6f80d10444c6bcc406a78ce61469` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.935351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:get_service(service_id=100c6f80d10444c6bcc406a78ce61469)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.936347 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:13.936347 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:13.936347 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:13.937268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.942642 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4174/8367] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 03:11:13 2022] GET /identity/v3/services/100c6f80d10444c6bcc406a78ce61469 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:13.946639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:13.956819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36a714-3ca8-4360-8f2e-7183fe8215e1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:13.961498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:13.962136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:13.962423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:13.962703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/100c6f80d10444c6bcc406a78ce61469` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:13.963298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:delete_service(service_id=100c6f80d10444c6bcc406a78ce61469)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:13.964894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:13.985469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4194/8368] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:13 2022] DELETE /identity/v3/services/100c6f80d10444c6bcc406a78ce61469 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:13.989597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.000503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7021-38a4-45a5-b1fa-5455787a1df0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.011516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:14.017356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.018212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.018497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.018775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/100c6f80d10444c6bcc406a78ce61469` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.019359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:get_service(service_id=100c6f80d10444c6bcc406a78ce61469)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.020954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Could not find service: 100c6f80d10444c6bcc406a78ce61469.: keystone.exception.ServiceNotFound: Could not find service: 100c6f80d10444c6bcc406a78ce61469. Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 100c6f80d10444c6bcc406a78ce61469. Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:11:14.029837 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 03:11:14.031273 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 100c6f80d10444c6bcc406a78ce61469. Oct 05 03:11:14.032724 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 03:11:14.034504 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4175/8369] 10.222.0.16 () {58 vars in 1230 bytes} [Wed Oct 5 03:11:13 2022] GET /identity/v3/services/100c6f80d10444c6bcc406a78ce61469 => generated 113 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 05 03:11:14.035855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.046704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0769d5-13f2-4edb-8a4b-76dd22561a96 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.051241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.051855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.052138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.052417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.053101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.054682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.070307 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4195/8370] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:14 2022] POST /identity/v3/services => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:14.074360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.085047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da2bc2-5e38-4169-b75c-bde14cbdc155 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.100611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.101239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.101529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.102419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.103434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.105058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.119084 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4176/8371] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:14 2022] POST /identity/v3/services => generated 275 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:14.123078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.134344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ce26-e54c-4a79-8bf9-7520eebba49c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.149748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.150351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.150638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.150916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.151560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.153186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.168383 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4196/8372] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:14 2022] POST /identity/v3/services => generated 275 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:14.172296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.182843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69225c4-8cbf-44b9-8fba-6f684eb2b145 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.197089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.197688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.197972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.198252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.198850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.199851 n-d-858272-3 devstack@keystone.service[81827]: WARNING py.warnings [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:14.199851 n-d-858272-3 devstack@keystone.service[81827]: warnings.warn(msg) Oct 05 03:11:14.199851 n-d-858272-3 devstack@keystone.service[81827]: Oct 05 03:11:14.200735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.208360 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4177/8373] 10.222.0.16 () {58 vars in 1131 bytes} [Wed Oct 5 03:11:14 2022] GET /identity/v3/services => generated 2980 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:14.213224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.223497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8456ed-0d8a-4e56-a70d-1e22c69af1b1 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.228983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.229578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.229863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.230139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.230763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2099494983) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:14.231068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.232065 n-d-858272-3 devstack@keystone.service[81826]: WARNING py.warnings [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 05 03:11:14.232065 n-d-858272-3 devstack@keystone.service[81826]: warnings.warn(msg) Oct 05 03:11:14.232065 n-d-858272-3 devstack@keystone.service[81826]: Oct 05 03:11:14.232962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.240587 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4197/8374] 10.222.0.16 () {58 vars in 1222 bytes} [Wed Oct 5 03:11:14 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2099494983 => generated 418 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:14.241844 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.255736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c45f-a907-4b3f-bb3b-c780a5330fe9 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.261181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.261779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.262066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.262347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.262976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1786749335) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:14.263284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.264859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.269849 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4178/8375] 10.222.0.16 () {58 vars in 1222 bytes} [Wed Oct 5 03:11:14 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1786749335 => generated 418 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:14.273788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.283453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433b27a-6c7d-48ff-8c49-09159fa0718e tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.288065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.288653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.288972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.289271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.289895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2045111133) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:14.290197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.291771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.296488 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4198/8376] 10.222.0.16 () {58 vars in 1222 bytes} [Wed Oct 5 03:11:14 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2045111133 => generated 418 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:14.300380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.310666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f93e4-237f-434e-9aee-e37c43faa5c0 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.315358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.315967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.316255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.316536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/b20fa026f5424fba9dbba6d9fe2db943` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.317158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b20fa026f5424fba9dbba6d9fe2db943)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.318716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.341679 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4179/8377] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:14 2022] DELETE /identity/v3/services/b20fa026f5424fba9dbba6d9fe2db943 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:14.345911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.355921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88639a1-f12e-40dd-89bb-94baa03621c3 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.371056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.371681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.371965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.372244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/d4b73dea6b654b098b32256d5b7a91aa` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.372821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d4b73dea6b654b098b32256d5b7a91aa)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.374451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.395388 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4199/8378] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:14 2022] DELETE /identity/v3/services/d4b73dea6b654b098b32256d5b7a91aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:14.399548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.409875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a078-1fba-4ba2-b573-dbb2b1da73e2 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.424153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb866d-3c05-4799-a0a3-789041be161c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2b0a470f17407990bde9559f29a264', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7a59114543145c2a72e28a3c8804ab4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.424773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb866d-3c05-4799-a0a3-789041be161c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.425083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb866d-3c05-4799-a0a3-789041be161c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.425363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb866d-3c05-4799-a0a3-789041be161c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] PATH_INFO: `/v3/services/bc232fe4650748d19f1d01eadeaf2e73` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.425938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb866d-3c05-4799-a0a3-789041be161c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bc232fe4650748d19f1d01eadeaf2e73)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.427527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb866d-3c05-4799-a0a3-789041be161c tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.450230 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4180/8379] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:14 2022] DELETE /identity/v3/services/bc232fe4650748d19f1d01eadeaf2e73 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:14.455267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.467711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:14.530303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b389dd-dbdc-4700-a64c-908c98903203 tempest-ServicesTestJSON-1676434881 tempest-ServicesTestJSON-1676434881-project-admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.544610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.545278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.545560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.545838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] PATH_INFO: `/v3/users/f85a8bc976294284bf56588e9a72ca96` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.547009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85a8bc976294284bf56588e9a72ca96)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.548947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.594670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85a8bc976294284bf56588e9a72ca96'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:14.608258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85a8bc976294284bf56588e9a72ca96'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:14.608962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85a8bc976294284bf56588e9a72ca96'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:14.616780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85a8bc976294284bf56588e9a72ca96'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:14.618067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85a8bc976294284bf56588e9a72ca96'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:14.630092 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4200/8380] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:14 2022] DELETE /identity/v3/users/f85a8bc976294284bf56588e9a72ca96 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:14.634916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.635200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.635475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.654806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:14.656008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:14.715703 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4181/8381] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:14.725347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:14.727288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:14.797131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c35b5e-ad85-43db-b4fc-e40a3b3de6a2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:14.800718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:14.801504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:14.801780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:14.802080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:14.811170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:14.812784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:14.822953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4201/8382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:15.098046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:15.099461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:15.112814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d975152-6402-4a39-aec6-1e3ab9ca203e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:15.118678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:15.119320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.119602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.119908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] PATH_INFO: `/v3/projects/89189a14458844a9b1223868e0306b81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.121085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89189a14458844a9b1223868e0306b81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:15.123003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:15.168325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:15.172445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89189a14458844a9b1223868e0306b81', 'request_id': 'req-d2d412b4-0614-417f-83fc-955a544e038e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.181276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89189a14458844a9b1223868e0306b81', 'request_id': 'req-d2d412b4-0614-417f-83fc-955a544e038e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.186892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89189a14458844a9b1223868e0306b81', 'request_id': 'req-d2d412b4-0614-417f-83fc-955a544e038e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.198398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] The token cache is being invalidate because project 89189a14458844a9b1223868e0306b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:15.198687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.199329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.200797 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4182/8383] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:15 2022] DELETE /identity/v3/projects/89189a14458844a9b1223868e0306b81 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:15.205235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:15.219382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ebfe6-4de5-4218-ba7a-7fa2b24cb84e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:15.223133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:15.279368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:15.279993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.280276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.280552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] PATH_INFO: `/v3/users/6f2b0a470f17407990bde9559f29a264` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.281704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2b0a470f17407990bde9559f29a264)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:15.283616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:15.331445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2b0a470f17407990bde9559f29a264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.343236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2b0a470f17407990bde9559f29a264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.343902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2b0a470f17407990bde9559f29a264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.351139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2b0a470f17407990bde9559f29a264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.352283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-a02a35b7-0538-4091-a0c9-b2f354c5a368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2b0a470f17407990bde9559f29a264'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.364626 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4202/8384] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:15 2022] DELETE /identity/v3/users/6f2b0a470f17407990bde9559f29a264 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:15.633405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:15.634845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:15.647810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d412b4-0614-417f-83fc-955a544e038e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:15.705020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:15.705652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.705935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.706212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] PATH_INFO: `/v3/projects/e7a59114543145c2a72e28a3c8804ab4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.707324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a59114543145c2a72e28a3c8804ab4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:15.709271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:15.754548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a59114543145c2a72e28a3c8804ab4', 'request_id': 'req-945180d9-42cb-4ff0-be19-975de1af4370'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.762440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a59114543145c2a72e28a3c8804ab4', 'request_id': 'req-945180d9-42cb-4ff0-be19-975de1af4370'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.767947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a59114543145c2a72e28a3c8804ab4', 'request_id': 'req-945180d9-42cb-4ff0-be19-975de1af4370'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.779577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] The token cache is being invalidate because project e7a59114543145c2a72e28a3c8804ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:15.780002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.780724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-945180d9-42cb-4ff0-be19-975de1af4370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:15.782352 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4183/8385] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:15 2022] DELETE /identity/v3/projects/e7a59114543145c2a72e28a3c8804ab4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:15.788419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.789298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.789298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.810709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:15.811896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:15.871994 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4203/8386] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:15.879964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a16c6f-f735-4970-904e-14556448745d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.880510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a16c6f-f735-4970-904e-14556448745d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.880795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a16c6f-f735-4970-904e-14556448745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.901888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-05a16c6f-f735-4970-904e-14556448745d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:15.903098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-05a16c6f-f735-4970-904e-14556448745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:15.910980 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4184/8387] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:15.915184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:15.924926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997e63e-9326-45cb-a24e-3bb74f362752 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:15.929432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:15.930506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.930785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.931055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.931687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:15.931985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:15.933589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:15.944843 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4204/8388] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:11:15.949855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a16c6f-f735-4970-904e-14556448745d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:15.959022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a16c6f-f735-4970-904e-14556448745d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:15.963849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:15.964443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:15.964726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:15.965035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:15.965675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:15.967572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:15.994929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4185/8389] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:15 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:15.999244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.010407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd03e6-e77f-4562-a9ba-e8b62c2d6bd2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.019256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:16.068985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.069627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.069914 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.070742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.071603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.073665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.096033 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4205/8390] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:15 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:16.100384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.111072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28af2b-55a1-40b6-b58f-253cc1cd573b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.115714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.116312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.116592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.116865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.117798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.119380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.129227 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4186/8391] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:16.134029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.143868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3f5e0-f56e-41a5-9b0a-5c51e46dccc5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.149225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3c82-c1d2-4b22-89ca-91da5f4c13fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.149817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3c82-c1d2-4b22-89ca-91da5f4c13fb admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.150098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3c82-c1d2-4b22-89ca-91da5f4c13fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.150369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3c82-c1d2-4b22-89ca-91da5f4c13fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.151005 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3c82-c1d2-4b22-89ca-91da5f4c13fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.152585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3c82-c1d2-4b22-89ca-91da5f4c13fb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.163014 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4206/8392] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:16.167526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.177607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a68e97-9d08-46c9-94e9-9570b47ce885 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.182348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.182991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.183275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.183554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] PATH_INFO: `/v3/projects/7c684526e6d44ee1985e7af5a462f151/users/afccff7e927c4389833e093063c515f9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.198352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c684526e6d44ee1985e7af5a462f151, user_id=afccff7e927c4389833e093063c515f9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.201062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.209033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:16.216115 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4187/8393] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:16 2022] PUT /identity/v3/projects/7c684526e6d44ee1985e7af5a462f151/users/afccff7e927c4389833e093063c515f9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.227014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.227303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.227583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.254586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] MFA Rules not processed for user `afccff7e927c4389833e093063c515f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:16.256046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:16.319537 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4207/8394] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:11:16.324618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.334564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eee67b-2c0a-40dd-a116-d0fd5c4f7a07 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.339255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.339884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.340170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.340450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.341114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.342598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.361674 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4188/8395] 10.222.0.16 () {60 vars in 1299 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2 => generated 367 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:16.366011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.374505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af6228-9f63-416a-bbce-01980c05d6b2 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.378744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.379379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.379663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.379941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/30f3421c778841a4bfe459138dcfd81e` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.382300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=afccff7e927c4389833e093063c515f9, credential_id=30f3421c778841a4bfe459138dcfd81e)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.383786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.400352 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4208/8396] 10.222.0.16 () {58 vars in 1380 bytes} [Wed Oct 5 03:11:16 2022] DELETE /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/30f3421c778841a4bfe459138dcfd81e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.405754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.416045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b57ef0-db15-496d-8df0-a8b4df63d5b6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.420234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.420866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.421187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.421470 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.422091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.423579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.437759 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4189/8397] 10.222.0.16 () {60 vars in 1299 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2 => generated 367 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:16.441773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.452868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d2db-78f7-47ba-8d5d-1f919718a540 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.457001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.457636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.457919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.458195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/6262c0289dd04f37b6861d01ca486f93` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.460110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=afccff7e927c4389833e093063c515f9, credential_id=6262c0289dd04f37b6861d01ca486f93)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.462206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.477828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4209/8398] 10.222.0.16 () {58 vars in 1380 bytes} [Wed Oct 5 03:11:16 2022] DELETE /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/6262c0289dd04f37b6861d01ca486f93 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.482019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.491471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed58e-25c9-4581-b0ae-ccf7fa03f8eb tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.496251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.496917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.497223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.497501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/6262c0289dd04f37b6861d01ca486f93` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Could not find credential: 886a31d68009e20288e06f6643ee6605d3f0ba2f5085c4bb8405949718f5071d.: keystone.exception.CredentialNotFound: Could not find credential: 886a31d68009e20288e06f6643ee6605d3f0ba2f5085c4bb8405949718f5071d. Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 05 03:11:16.525539 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.get_or_create( Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application with Lock( Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 05 03:11:16.526821 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._enter() Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.creator() Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application created_value = creator( Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 886a31d68009e20288e06f6643ee6605d3f0ba2f5085c4bb8405949718f5071d. Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: ERROR keystone.server.flask.application Oct 05 03:11:16.528161 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4190/8399] 10.222.0.16 () {58 vars in 1377 bytes} [Wed Oct 5 03:11:16 2022] GET /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/6262c0289dd04f37b6861d01ca486f93 => generated 148 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 05 03:11:16.531644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.541805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c7ed9-f09c-4ab4-8405-e6daef3636e6 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.545879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.546508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.546778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.547053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.547674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.549300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.563798 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4210/8400] 10.222.0.16 () {60 vars in 1299 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2 => generated 367 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:16.567766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.577782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf45a60-212c-43ef-9b3f-f5cb5d37a705 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.581856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.582492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.582760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.583038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.583645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.585175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.600254 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4191/8401] 10.222.0.16 () {60 vars in 1299 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2 => generated 367 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:16.604728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.614232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b9815-66cf-4e85-9bbe-f5fc6a16a959 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.618406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.619025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.619325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.619583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.620160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.621791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.632414 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4211/8402] 10.222.0.16 () {58 vars in 1278 bytes} [Wed Oct 5 03:11:16 2022] GET /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2 => generated 865 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:16.636495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.645633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e353e-6f90-4e43-aaed-6e09833500d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.650717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.651355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.651640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.651913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/17820ea550414f5cac1d1f60fa222dae` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.653925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=afccff7e927c4389833e093063c515f9, credential_id=17820ea550414f5cac1d1f60fa222dae)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.655332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.672402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4192/8403] 10.222.0.16 () {58 vars in 1380 bytes} [Wed Oct 5 03:11:16 2022] DELETE /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/17820ea550414f5cac1d1f60fa222dae => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.676591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.686243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c3e9-1896-4496-a0ea-ff84065e24dc tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.690437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.691073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.691356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.691633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/fe1cfb0e4bb24eecae3e808849992e0a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.693584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=afccff7e927c4389833e093063c515f9, credential_id=fe1cfb0e4bb24eecae3e808849992e0a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.694995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.710532 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4212/8404] 10.222.0.16 () {58 vars in 1380 bytes} [Wed Oct 5 03:11:16 2022] DELETE /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/fe1cfb0e4bb24eecae3e808849992e0a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.716210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.725539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2fd0-6f81-45fb-912a-2aa90372b1d1 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.730366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.730986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.731270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.731550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.732175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.733720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.747848 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4193/8405] 10.222.0.16 () {60 vars in 1299 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2 => generated 367 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:16.752106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.762210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04524ba0-3751-4b02-9100-0fca7d4373a3 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.766374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.767011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.767314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.767588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/768bf2953abc44349b530bf9cc979b8a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.769574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=afccff7e927c4389833e093063c515f9, credential_id=768bf2953abc44349b530bf9cc979b8a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.771109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.774633 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4213/8406] 10.222.0.16 () {58 vars in 1377 bytes} [Wed Oct 5 03:11:16 2022] GET /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/768bf2953abc44349b530bf9cc979b8a => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:16.778583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.787914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ae207-3e52-4a5a-bf29-b32ed40b6f01 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.792072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc892a-1a34-4fce-a102-4a3abf6e9cd4 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afccff7e927c4389833e093063c515f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c684526e6d44ee1985e7af5a462f151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.792698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc892a-1a34-4fce-a102-4a3abf6e9cd4 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.793007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc892a-1a34-4fce-a102-4a3abf6e9cd4 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.793284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc892a-1a34-4fce-a102-4a3abf6e9cd4 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/768bf2953abc44349b530bf9cc979b8a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.795181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc892a-1a34-4fce-a102-4a3abf6e9cd4 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=afccff7e927c4389833e093063c515f9, credential_id=768bf2953abc44349b530bf9cc979b8a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.796576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc892a-1a34-4fce-a102-4a3abf6e9cd4 tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.812210 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4194/8407] 10.222.0.16 () {58 vars in 1380 bytes} [Wed Oct 5 03:11:16 2022] DELETE /identity/v3/users/afccff7e927c4389833e093063c515f9/credentials/OS-EC2/768bf2953abc44349b530bf9cc979b8a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.816747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:16.827519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:16.884014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b855c-53a2-451c-b7a2-7c9c7d70e37f tempest-EC2CredentialsTest-1995942854 tempest-EC2CredentialsTest-1995942854-project] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:16.888565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:16.889223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.889504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.889813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] PATH_INFO: `/v3/users/afccff7e927c4389833e093063c515f9` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:16.891100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=afccff7e927c4389833e093063c515f9)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:16.893347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:16.940842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afccff7e927c4389833e093063c515f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:16.953861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afccff7e927c4389833e093063c515f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:16.954549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afccff7e927c4389833e093063c515f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:16.962678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afccff7e927c4389833e093063c515f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:16.963303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afccff7e927c4389833e093063c515f9'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:16.975832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4214/8408] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:16 2022] DELETE /identity/v3/users/afccff7e927c4389833e093063c515f9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:16.980704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c47393-77f4-451f-ba50-859557566832 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:16.981040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c47393-77f4-451f-ba50-859557566832 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:16.981326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c47393-77f4-451f-ba50-859557566832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.001369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-40c47393-77f4-451f-ba50-859557566832 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:17.002579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40c47393-77f4-451f-ba50-859557566832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:17.063566 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4195/8409] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:17.073604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.075016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:17.137427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a8e6f-b14a-47c9-8e0c-49af3b68bfaa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.141177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49aa2e6-11a9-4624-8e9e-d0fb80794653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.141784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aa2e6-11a9-4624-8e9e-d0fb80794653 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.142066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aa2e6-11a9-4624-8e9e-d0fb80794653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.142346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49aa2e6-11a9-4624-8e9e-d0fb80794653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.152244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aa2e6-11a9-4624-8e9e-d0fb80794653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.153711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49aa2e6-11a9-4624-8e9e-d0fb80794653 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.164371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4215/8410] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:17.437418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c47393-77f4-451f-ba50-859557566832 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.438836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-40c47393-77f4-451f-ba50-859557566832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:17.453536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c47393-77f4-451f-ba50-859557566832 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.458342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.458980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.459265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.459571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] PATH_INFO: `/v3/projects/7c684526e6d44ee1985e7af5a462f151` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.461252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c684526e6d44ee1985e7af5a462f151)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.463393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.510900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c684526e6d44ee1985e7af5a462f151', 'request_id': 'req-4f70a176-00b7-4d53-b545-ff713a694b68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:17.518252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c684526e6d44ee1985e7af5a462f151', 'request_id': 'req-4f70a176-00b7-4d53-b545-ff713a694b68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:17.522135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:17.524924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c684526e6d44ee1985e7af5a462f151', 'request_id': 'req-4f70a176-00b7-4d53-b545-ff713a694b68'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:17.538508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] The token cache is being invalidate because project 7c684526e6d44ee1985e7af5a462f151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:17.538943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:17.539673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4f70a176-00b7-4d53-b545-ff713a694b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:17.541176 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4196/8411] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:17 2022] DELETE /identity/v3/projects/7c684526e6d44ee1985e7af5a462f151 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:17.546112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.546485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.546771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.567082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:17.568272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:17.593682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:17.629185 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4216/8412] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:17.638493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.638786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.639063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.658954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:17.660145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:17.669143 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4197/8413] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:11:17.673543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.683985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e225fc-2911-482f-8cce-81092d8f40ff None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.688448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.689083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.689364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.689639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.690280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:17.690585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.692174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.703546 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4217/8414] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:17.707644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.717247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f34a9-5606-4b19-99d2-a85985cf4824 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.721877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.722468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.722747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.723019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.723641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.725558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.752878 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4198/8415] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:17 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:17.757240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.767275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e61a-a132-42c8-a150-764d7207ead5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.822096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.822891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.823202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.823487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.824224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.826157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.847218 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4218/8416] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:17 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:17.852605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.868496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13eb61-fdd2-4eeb-9521-50e8e181e047 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.873151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.873746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.874030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.874306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.874946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.876545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.886632 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4199/8417] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:17.890800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.901638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b7b82-e5a6-4480-969a-8c7caccdc9dd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.906193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbe656-85f5-4676-8b7b-927b73653a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.906781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbe656-85f5-4676-8b7b-927b73653a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.907068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbe656-85f5-4676-8b7b-927b73653a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.907343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbe656-85f5-4676-8b7b-927b73653a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.908016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbe656-85f5-4676-8b7b-927b73653a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.909622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbe656-85f5-4676-8b7b-927b73653a8b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.921402 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4219/8418] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:17.926120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:17.935739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c68e-c1cc-4517-b632-e7abb3d6e04f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:17.940376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:17.941068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.941357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.941638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] PATH_INFO: `/v3/projects/746d1327078544afbf98dada71d97a8d/users/e5e9c9ee5f1e430c8fa08e9a6b135bdb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:17.956009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746d1327078544afbf98dada71d97a8d, user_id=e5e9c9ee5f1e430c8fa08e9a6b135bdb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:17.958717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:17.973676 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4200/8419] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:17 2022] PUT /identity/v3/projects/746d1327078544afbf98dada71d97a8d/users/e5e9c9ee5f1e430c8fa08e9a6b135bdb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:17.985619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:17.986071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:17.986350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.014120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] MFA Rules not processed for user `e5e9c9ee5f1e430c8fa08e9a6b135bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:18.015318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:18.083534 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4220/8420] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:18.088129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.162115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866098-63e7-4bfc-bb29-1ba9a91ea831 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.167043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.167774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.168063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.168352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.169006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.170930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.198685 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4201/8421] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:18 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:18.202952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.215471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0fead-d076-4a7a-9439-e73cb48dc310 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.243400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:18.277657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.278267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.278552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.278826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.279460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.281402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.302527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4221/8422] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:18 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:18.306558 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.317941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741efef-ac64-438f-b960-4a3bb0a96796 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.324049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.324650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.324985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.325261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.325901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.327488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.339379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4202/8423] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:18.343344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.353652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc849e-56f3-4699-a745-20faee419598 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.359099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb515-9311-49c7-b231-fe2f68f2ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.359740 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb515-9311-49c7-b231-fe2f68f2ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.360024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb515-9311-49c7-b231-fe2f68f2ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.360300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb515-9311-49c7-b231-fe2f68f2ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.361027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb515-9311-49c7-b231-fe2f68f2ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.362635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb515-9311-49c7-b231-fe2f68f2ecf4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.373084 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4222/8424] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:18.377320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.388553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cbee7-ea6c-46a7-8c60-62e3a2af4aea admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.393211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.393861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.394146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.394428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] PATH_INFO: `/v3/projects/507bfc0c8cc84f69802203ea105694f6/users/ce56fa71cf6a4207a395de125b6f9c61/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.409912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507bfc0c8cc84f69802203ea105694f6, user_id=ce56fa71cf6a4207a395de125b6f9c61, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.412581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.425673 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4203/8425] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:18 2022] PUT /identity/v3/projects/507bfc0c8cc84f69802203ea105694f6/users/ce56fa71cf6a4207a395de125b6f9c61/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:18.436389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badce60-c22d-4e5b-9cc1-a92e063079a2 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.436725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badce60-c22d-4e5b-9cc1-a92e063079a2 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.437068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badce60-c22d-4e5b-9cc1-a92e063079a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.466119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6badce60-c22d-4e5b-9cc1-a92e063079a2 None None] MFA Rules not processed for user `ce56fa71cf6a4207a395de125b6f9c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:18.467259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6badce60-c22d-4e5b-9cc1-a92e063079a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:18.530950 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4223/8426] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:18.535831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.587607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:18.609968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58e22c-882d-4b9e-990c-599d67aab9d5 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.614171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92fd2f-322f-47f7-b038-19542309396a tempest-IdentityV3ProjectsTest-50690733 tempest-IdentityV3ProjectsTest-50690733-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e9c9ee5f1e430c8fa08e9a6b135bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '746d1327078544afbf98dada71d97a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.614816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92fd2f-322f-47f7-b038-19542309396a tempest-IdentityV3ProjectsTest-50690733 tempest-IdentityV3ProjectsTest-50690733-project] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.615106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92fd2f-322f-47f7-b038-19542309396a tempest-IdentityV3ProjectsTest-50690733 tempest-IdentityV3ProjectsTest-50690733-project] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.615387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92fd2f-322f-47f7-b038-19542309396a tempest-IdentityV3ProjectsTest-50690733 tempest-IdentityV3ProjectsTest-50690733-project] PATH_INFO: `/v3/users/e5e9c9ee5f1e430c8fa08e9a6b135bdb/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.616575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92fd2f-322f-47f7-b038-19542309396a tempest-IdentityV3ProjectsTest-50690733 tempest-IdentityV3ProjectsTest-50690733-project] RBAC: Authorizing `identity:list_user_projects(user_id=e5e9c9ee5f1e430c8fa08e9a6b135bdb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.618929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92fd2f-322f-47f7-b038-19542309396a tempest-IdentityV3ProjectsTest-50690733 tempest-IdentityV3ProjectsTest-50690733-project] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.656771 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4204/8427] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Oct 5 03:11:18 2022] GET /identity/v3/users/e5e9c9ee5f1e430c8fa08e9a6b135bdb/projects => generated 513 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:18.661401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.661687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.661964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.691003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] MFA Rules not processed for user `e5e9c9ee5f1e430c8fa08e9a6b135bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:18.692203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:18.700165 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4224/8428] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:11:18.704758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.705086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.705366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.724379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] MFA Rules not processed for user `e5e9c9ee5f1e430c8fa08e9a6b135bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:18.725533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:18.770328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.models.token_model [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] User e5e9c9ee5f1e430c8fa08e9a6b135bdb has no access to project 507bfc0c8cc84f69802203ea105694f6 {{(pid=81827) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 05 03:11:18.774134 n-d-858272-3 devstack@keystone.service[81827]: WARNING keystone.server.flask.application [None req-59601660-19c5-46f3-a246-0b09efe038b0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 05 03:11:18.775458 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4205/8429] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:18 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 72 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 05 03:11:18.780567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:18.843696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb06330-d31a-42a1-bba3-84d8c9674635 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:18.848259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:18.848936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.849218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.849500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] PATH_INFO: `/v3/users/e5e9c9ee5f1e430c8fa08e9a6b135bdb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.850636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e9c9ee5f1e430c8fa08e9a6b135bdb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:18.852752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:18.875720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:18.901485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e9c9ee5f1e430c8fa08e9a6b135bdb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:18.913705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e9c9ee5f1e430c8fa08e9a6b135bdb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:18.914598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e9c9ee5f1e430c8fa08e9a6b135bdb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:18.922105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e9c9ee5f1e430c8fa08e9a6b135bdb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:18.922886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e9c9ee5f1e430c8fa08e9a6b135bdb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:18.938026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4225/8430] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:18 2022] DELETE /identity/v3/users/e5e9c9ee5f1e430c8fa08e9a6b135bdb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:18.942524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:18.943305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:18.943305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:18.963040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:18.964512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:19.027478 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4206/8431] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:19.037147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:19.039118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:19.100039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd219a-a43f-4a00-a0e1-152da16b2c0d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:19.104694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:19.105333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:19.105619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:19.105898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:19.114996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:19.116427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:19.127031 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4226/8432] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:19.415088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:19.416560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:19.428827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a1b55-7af3-4450-9553-a9ce697a2e96 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:19.434154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:19.434796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:19.435084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:19.435364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] PATH_INFO: `/v3/projects/746d1327078544afbf98dada71d97a8d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:19.436613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746d1327078544afbf98dada71d97a8d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:19.438579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:19.486815 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746d1327078544afbf98dada71d97a8d', 'request_id': 'req-fee3f27c-588c-4938-bea1-e359c95e39d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.490622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:19.494759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746d1327078544afbf98dada71d97a8d', 'request_id': 'req-fee3f27c-588c-4938-bea1-e359c95e39d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.501892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746d1327078544afbf98dada71d97a8d', 'request_id': 'req-fee3f27c-588c-4938-bea1-e359c95e39d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.514159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] The token cache is being invalidate because project 746d1327078544afbf98dada71d97a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:19.514454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.515112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.516598 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4207/8433] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:19 2022] DELETE /identity/v3/projects/746d1327078544afbf98dada71d97a8d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:19.520659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:19.531049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f155db7-3ec2-4f13-aba9-6d7cd311862e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:19.588996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:19.590027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:19.590483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:19.591030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] PATH_INFO: `/v3/users/ce56fa71cf6a4207a395de125b6f9c61` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:19.592268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce56fa71cf6a4207a395de125b6f9c61)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:19.594466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:19.643923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:19.645887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce56fa71cf6a4207a395de125b6f9c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.660765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce56fa71cf6a4207a395de125b6f9c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.661926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce56fa71cf6a4207a395de125b6f9c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.670399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce56fa71cf6a4207a395de125b6f9c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.671106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6176383d-e86e-46a2-9a2f-037eaf875b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce56fa71cf6a4207a395de125b6f9c61'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:19.683651 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4227/8434] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:19 2022] DELETE /identity/v3/users/ce56fa71cf6a4207a395de125b6f9c61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:19.957160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:19.958673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:19.974202 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f27c-588c-4938-bea1-e359c95e39d8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.034153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.034795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.035083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.035364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] PATH_INFO: `/v3/projects/507bfc0c8cc84f69802203ea105694f6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.036496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507bfc0c8cc84f69802203ea105694f6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.038445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.084589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507bfc0c8cc84f69802203ea105694f6', 'request_id': 'req-6347b008-3b18-4f97-a3fe-ee5f748c95e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:20.093028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507bfc0c8cc84f69802203ea105694f6', 'request_id': 'req-6347b008-3b18-4f97-a3fe-ee5f748c95e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:20.099114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507bfc0c8cc84f69802203ea105694f6', 'request_id': 'req-6347b008-3b18-4f97-a3fe-ee5f748c95e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:20.110474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] The token cache is being invalidate because project 507bfc0c8cc84f69802203ea105694f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:20.110770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:20.111421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6347b008-3b18-4f97-a3fe-ee5f748c95e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:20.112981 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4208/8435] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:19 2022] DELETE /identity/v3/projects/507bfc0c8cc84f69802203ea105694f6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:20.119597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.120119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.120240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.140153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:20.141391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:20.199542 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4228/8436] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:20.208510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.209007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.209290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.229278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:20.230559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:20.238849 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4209/8437] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:20.243484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.253192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358215e2-38c1-46a4-afd0-95a4a6420d96 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.258587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.259185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.259483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.259729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.260376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:20.260682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.262314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.274321 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4229/8438] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:20.278531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.287842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc102-085a-42f8-b590-9525bf97be79 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.293140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.293737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.294028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.294308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.294952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.296857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.323488 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4210/8439] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:20.327600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.338063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb27467-1af7-4763-bbc1-ecc53ead398c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.393475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.394083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.394370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.394649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.395277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.397223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.419245 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4230/8440] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:20.423390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.434014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee004e-1a48-49a1-bb8a-6f868e4ab515 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.438713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.439311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.439595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.439873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.440514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.442188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.452519 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4211/8441] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:20.458347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.470602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735132df-bcb4-4011-a545-8c30a3b4682e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.475294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f0cd7-0ca0-4610-a2ad-fccb01ae6c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.476519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0cd7-0ca0-4610-a2ad-fccb01ae6c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.476985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0cd7-0ca0-4610-a2ad-fccb01ae6c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.477277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f0cd7-0ca0-4610-a2ad-fccb01ae6c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.477945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f0cd7-0ca0-4610-a2ad-fccb01ae6c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.479540 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f0cd7-0ca0-4610-a2ad-fccb01ae6c52 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.490665 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4231/8442] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:20.495138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.505713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b09a-f00b-4363-baee-9723209224ac admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.511106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.511757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.512040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.512318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] PATH_INFO: `/v3/projects/2121caee4c7847659612cbbfbcab4acd/users/d13faac9b80f4bc882036336f671f2a1/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.527784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2121caee4c7847659612cbbfbcab4acd, user_id=d13faac9b80f4bc882036336f671f2a1, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.530498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.543544 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4212/8443] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:20 2022] PUT /identity/v3/projects/2121caee4c7847659612cbbfbcab4acd/users/d13faac9b80f4bc882036336f671f2a1/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:20.553825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.554171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.554557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.582076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] MFA Rules not processed for user `d13faac9b80f4bc882036336f671f2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:20.583286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:20.600035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:20.649949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4232/8444] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:20.654447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.664670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:20.718355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8e85-bf9b-4016-9ca9-0079dbe7c0d9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.723027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.723625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.723908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.724187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.724823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.726948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.756168 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4213/8445] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:20.757794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.769203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903ad9c-cea9-470c-b859-bb65bdf5233f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.825962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.826561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.826843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.827119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.827742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.829700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.851793 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4233/8446] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:20.855733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.865976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dab9b-e976-4c62-b970-a9019c6f4149 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.871433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.872028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.872311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.872587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.873259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.874847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.886234 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4214/8447] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:20.890132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.900205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf238-7a29-4170-bd71-aad3b33c3ad5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.904794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5b11c-562a-446c-b048-fe85743d9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.905450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b11c-562a-446c-b048-fe85743d9dde admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.905738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b11c-562a-446c-b048-fe85743d9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.906019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5b11c-562a-446c-b048-fe85743d9dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.906660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b11c-562a-446c-b048-fe85743d9dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.908251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5b11c-562a-446c-b048-fe85743d9dde admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.918299 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4234/8448] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:20.922270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:20.932722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b6230-47d8-4a36-9057-6ba95a4b2be9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:20.937852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:20.938686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.938966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.939292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] PATH_INFO: `/v3/projects/4475a603c0eb4232b77b231ccc9f661c/users/07440dbbf75b488799e92eab0045752b/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:20.959451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4475a603c0eb4232b77b231ccc9f661c, user_id=07440dbbf75b488799e92eab0045752b, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:20.962333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:20.977149 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4215/8449] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:20 2022] PUT /identity/v3/projects/4475a603c0eb4232b77b231ccc9f661c/users/07440dbbf75b488799e92eab0045752b/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:20.987301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:20.987616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:20.987898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:21.017408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] MFA Rules not processed for user `07440dbbf75b488799e92eab0045752b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:21.018621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:21.085332 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4235/8450] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:21.099561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:21.102233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:21.185196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b4ad2-03c3-4a01-a3d5-a4ca83ba3dcd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:21.188784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:21.189414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:21.189692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:21.189962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:21.247578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:21.252535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:21.254197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:21.266822 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4216/8451] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:21.394141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:21.406365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeabb9c-c149-4b74-92ea-4272ad46d02b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:21.410106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdc656-0e05-4c86-a354-c9dd39b523b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:21.410707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdc656-0e05-4c86-a354-c9dd39b523b0 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:21.410985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdc656-0e05-4c86-a354-c9dd39b523b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:21.411258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdc656-0e05-4c86-a354-c9dd39b523b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:21.420050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdc656-0e05-4c86-a354-c9dd39b523b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:21.421490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdc656-0e05-4c86-a354-c9dd39b523b0 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:21.430859 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4236/8452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:21.764819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:21.827036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24be7c-6ef0-4cee-88a3-fd481d83acb6 service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:21.831857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:21.832574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:21.832881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:21.833219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] PATH_INFO: `/v3/users/d13faac9b80f4bc882036336f671f2a1` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:21.834422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13faac9b80f4bc882036336f671f2a1)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:21.837119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:21.882422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13faac9b80f4bc882036336f671f2a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:21.894349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13faac9b80f4bc882036336f671f2a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:21.894957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13faac9b80f4bc882036336f671f2a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:21.903595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13faac9b80f4bc882036336f671f2a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:21.904232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13faac9b80f4bc882036336f671f2a1'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:21.917421 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4217/8453] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:21 2022] DELETE /identity/v3/users/d13faac9b80f4bc882036336f671f2a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:21.922163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474376f-f93e-4357-8750-a3977086e00c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:21.922450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474376f-f93e-4357-8750-a3977086e00c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:21.922725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474376f-f93e-4357-8750-a3977086e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:21.942237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7474376f-f93e-4357-8750-a3977086e00c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:21.943420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7474376f-f93e-4357-8750-a3977086e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:21.952204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:22.003678 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4237/8454] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:22.013805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:22.015184 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:22.073911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39b70f-0f47-4cc2-acd6-1e8218853c20 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:22.077506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:22.078103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:22.078407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:22.078679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:22.087577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:22.089095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:22.098443 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4218/8455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:22.373424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474376f-f93e-4357-8750-a3977086e00c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:22.374865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7474376f-f93e-4357-8750-a3977086e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:22.387242 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474376f-f93e-4357-8750-a3977086e00c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:22.391847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:22.392512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:22.392793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:22.393106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] PATH_INFO: `/v3/projects/2121caee4c7847659612cbbfbcab4acd` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:22.394224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2121caee4c7847659612cbbfbcab4acd)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:22.396146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:22.444099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2121caee4c7847659612cbbfbcab4acd', 'request_id': 'req-e4ac9fda-9673-4dfc-994e-e92ee61bc880'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.449581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2121caee4c7847659612cbbfbcab4acd', 'request_id': 'req-e4ac9fda-9673-4dfc-994e-e92ee61bc880'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.455727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2121caee4c7847659612cbbfbcab4acd', 'request_id': 'req-e4ac9fda-9673-4dfc-994e-e92ee61bc880'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.468746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] The token cache is being invalidate because project 2121caee4c7847659612cbbfbcab4acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:22.469077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.469715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.471218 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4238/8456] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:22 2022] DELETE /identity/v3/projects/2121caee4c7847659612cbbfbcab4acd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:22.475243 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:22.486043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad819-22be-43e0-9024-3a3eabd0f4dc service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:22.498317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:22.547917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:22.548555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:22.548846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:22.549157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] PATH_INFO: `/v3/users/07440dbbf75b488799e92eab0045752b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:22.550309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07440dbbf75b488799e92eab0045752b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:22.552749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:22.597704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07440dbbf75b488799e92eab0045752b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.609396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07440dbbf75b488799e92eab0045752b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.610058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07440dbbf75b488799e92eab0045752b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.617712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07440dbbf75b488799e92eab0045752b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.618348 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-7f265f2e-79ba-403c-9630-cfdaa85ff3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07440dbbf75b488799e92eab0045752b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:22.630600 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4219/8457] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:22 2022] DELETE /identity/v3/users/07440dbbf75b488799e92eab0045752b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:22.904112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:22.905839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:22.920262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9fda-9673-4dfc-994e-e92ee61bc880 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:22.977846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:22.978418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:22.978701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:22.979004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] PATH_INFO: `/v3/projects/4475a603c0eb4232b77b231ccc9f661c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:22.980165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4475a603c0eb4232b77b231ccc9f661c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:22.982098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.021587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:23.030002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4475a603c0eb4232b77b231ccc9f661c', 'request_id': 'req-36c31091-492f-4974-9b6b-11d2e8e6368a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:23.035696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4475a603c0eb4232b77b231ccc9f661c', 'request_id': 'req-36c31091-492f-4974-9b6b-11d2e8e6368a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:23.042387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4475a603c0eb4232b77b231ccc9f661c', 'request_id': 'req-36c31091-492f-4974-9b6b-11d2e8e6368a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:23.054491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] The token cache is being invalidate because project 4475a603c0eb4232b77b231ccc9f661c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:23.055454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:23.056093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-36c31091-492f-4974-9b6b-11d2e8e6368a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:23.057620 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4239/8458] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:22 2022] DELETE /identity/v3/projects/4475a603c0eb4232b77b231ccc9f661c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:23.063420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.063918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.064028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.083352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:23.084570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:23.143485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4220/8459] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:23.152431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.152725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.153032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.173097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:23.174306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:23.182425 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4240/8460] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:23.186655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.196494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200a5a-143e-4131-8ceb-722d58073470 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.201137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.201736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.202021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.202300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.202946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:23.203256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.204848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.216722 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4221/8461] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:23.221250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.231366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f44939-251f-46c2-84c1-e2c5eddbb335 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.236301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.236927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.237225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.237554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.238135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.240038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.269145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4241/8462] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:23 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:23.274252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.284246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93aafa-90e1-4241-b174-7778bca59305 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.303062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:23.341763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.342363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.342645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.342923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.343560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.345501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.366764 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4222/8463] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:23 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:23.370911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.381734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c7703-7969-41c2-b788-19de5fd96556 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.386315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.386913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.387192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.387465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.388102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.389723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.400213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4242/8464] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:23.404182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.414804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d312e-6737-478f-beca-48c3742bfdc0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.419429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39248b64-fa48-4a18-b3b6-9d97c45ad588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.420053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39248b64-fa48-4a18-b3b6-9d97c45ad588 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.420341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39248b64-fa48-4a18-b3b6-9d97c45ad588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.420617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39248b64-fa48-4a18-b3b6-9d97c45ad588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.421364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39248b64-fa48-4a18-b3b6-9d97c45ad588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.422922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39248b64-fa48-4a18-b3b6-9d97c45ad588 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.433508 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4223/8465] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:23.437787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.448241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56da67-45c7-4294-9f0a-6cc04e79f692 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.452842 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.453510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.453787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.454060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] PATH_INFO: `/v3/projects/f5fae5d4ea85477781a31a6aee7c7da8/users/aa57aa46ede9435b995c3b0b5d220ea0/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.469213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fae5d4ea85477781a31a6aee7c7da8, user_id=aa57aa46ede9435b995c3b0b5d220ea0, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.471965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.484927 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4243/8466] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:23 2022] PUT /identity/v3/projects/f5fae5d4ea85477781a31a6aee7c7da8/users/aa57aa46ede9435b995c3b0b5d220ea0/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:23.495847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.496141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.496420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.526597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] MFA Rules not processed for user `aa57aa46ede9435b995c3b0b5d220ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:23.527833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:23.592658 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4224/8467] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:23.604321 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:23.606132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:23.666306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f429-9b7a-4581-a7a1-4173b093c820 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:23.670388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189970cd-e827-438e-963e-228310d29328 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:23.670995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189970cd-e827-438e-963e-228310d29328 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:23.671276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189970cd-e827-438e-963e-228310d29328 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:23.671554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189970cd-e827-438e-963e-228310d29328 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:23.680567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189970cd-e827-438e-963e-228310d29328 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:23.682381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189970cd-e827-438e-963e-228310d29328 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:23.691483 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4244/8468] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:24.052152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:24.114588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6158-6061-421c-8289-fa744f06b5c1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:24.119791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:24.120428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.120704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.121014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] PATH_INFO: `/v3/users/aa57aa46ede9435b995c3b0b5d220ea0` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.122143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa57aa46ede9435b995c3b0b5d220ea0)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:24.124046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:24.159964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:24.175246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa57aa46ede9435b995c3b0b5d220ea0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.187360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa57aa46ede9435b995c3b0b5d220ea0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.188040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa57aa46ede9435b995c3b0b5d220ea0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.195927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa57aa46ede9435b995c3b0b5d220ea0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.196585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa57aa46ede9435b995c3b0b5d220ea0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.208844 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4225/8469] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:24 2022] DELETE /identity/v3/users/aa57aa46ede9435b995c3b0b5d220ea0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:24.214068 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.214351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.214625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.233886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:24.235112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:24.295696 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4245/8470] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:24.305378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:24.306797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:24.365784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0130ef-fa86-4428-8e6d-864fd7d6c341 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:24.369626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d8434-8075-4c5f-b2fe-a41d9048a3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:24.370233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d8434-8075-4c5f-b2fe-a41d9048a3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.370544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d8434-8075-4c5f-b2fe-a41d9048a3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.370820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d8434-8075-4c5f-b2fe-a41d9048a3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.380066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d8434-8075-4c5f-b2fe-a41d9048a3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:24.381575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d8434-8075-4c5f-b2fe-a41d9048a3f0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:24.391748 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4226/8471] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:24.653531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:24.655152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:24.669884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719d8f1-ed8e-4d48-86cc-5aa68a665cde None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:24.675498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:24.676159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.676412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.676691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] PATH_INFO: `/v3/projects/f5fae5d4ea85477781a31a6aee7c7da8` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.677855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fae5d4ea85477781a31a6aee7c7da8)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:24.680503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:24.682389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:24.730450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fae5d4ea85477781a31a6aee7c7da8', 'request_id': 'req-3a232588-304c-439b-b5c9-6697772da79b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.735933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fae5d4ea85477781a31a6aee7c7da8', 'request_id': 'req-3a232588-304c-439b-b5c9-6697772da79b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.742751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fae5d4ea85477781a31a6aee7c7da8', 'request_id': 'req-3a232588-304c-439b-b5c9-6697772da79b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.755649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] The token cache is being invalidate because project f5fae5d4ea85477781a31a6aee7c7da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:24.756000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.756585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a232588-304c-439b-b5c9-6697772da79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:24.758735 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4246/8472] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:24 2022] DELETE /identity/v3/projects/f5fae5d4ea85477781a31a6aee7c7da8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:24.763734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.764010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.764281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.783659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:24.784839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:24.844305 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4227/8473] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:24.853190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.853481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.853756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.874816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:24.876011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:24.884655 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4247/8474] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:24.888960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:24.898895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01773b8c-d431-4f45-8fb8-8df9779aa362 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:24.903481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:24.904104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.904387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.904666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.905338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:24.905646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:24.907222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:24.918654 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4228/8475] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:11:24.922852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:24.932488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b26d09-91d3-4b93-9a15-53a2ac31d8e1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:24.937053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:24.937647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:24.937924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:24.938194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:24.938846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:24.940720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:24.967358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4248/8476] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:24 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:24.971478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:24.982172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcbf30-6d1e-4f23-846a-280222769eef admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.019932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:25.040516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.041154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.041440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.041718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.042357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.044260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.065414 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4229/8477] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:24 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:25.069632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.079813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1c4e1-fe19-4f28-84cf-923265a710ec admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.084581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.085217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.085496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.085768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.086412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.087980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.098374 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4249/8478] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:25.102712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.112617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860f8e-4ae9-430a-bfe6-7ec2ff8a32ad admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.117931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920082b-1391-40fa-999a-a1df97973558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.118523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920082b-1391-40fa-999a-a1df97973558 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.118792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920082b-1391-40fa-999a-a1df97973558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.119067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920082b-1391-40fa-999a-a1df97973558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.119705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920082b-1391-40fa-999a-a1df97973558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.121347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920082b-1391-40fa-999a-a1df97973558 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.132121 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4230/8479] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:25.136437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.146312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ec79c-f0d1-4418-a0b0-d34e1f9639f6 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.150920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.151556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.151833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.152107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] PATH_INFO: `/v3/projects/9b0c143874ba4e41ad591bb4e45a80fb/users/5a23a8c2a0484f2cadd23ec21c2be11a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.166807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b0c143874ba4e41ad591bb4e45a80fb, user_id=5a23a8c2a0484f2cadd23ec21c2be11a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.169509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.182649 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4250/8480] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:25 2022] PUT /identity/v3/projects/9b0c143874ba4e41ad591bb4e45a80fb/users/5a23a8c2a0484f2cadd23ec21c2be11a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:25.193238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.193531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.193812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.221140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] MFA Rules not processed for user `5a23a8c2a0484f2cadd23ec21c2be11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:25.222342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:25.287444 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4231/8481] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:25.292613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.357162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5738-fe5d-45ea-b8f1-4d9792b82dab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.362524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.363128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.363411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.363683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.364317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.366239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.393176 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4251/8482] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:25 2022] POST /identity/v3/projects => generated 411 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:25.397410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.408606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83d22d-016b-4192-bc54-0896f2b888ec None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.465275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.465877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.466161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.466444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.467080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.469015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.490915 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4232/8483] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:25 2022] POST /identity/v3/users => generated 312 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:25.494895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.505364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509a48f-55b0-4555-a1ef-d0af582b8f68 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.510058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.510654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.510936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.511211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.511853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.513504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.518629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:25.525926 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4252/8484] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:25.530139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.541597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0415f-058b-4d09-8d88-8805a95ff083 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.546413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.547076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.547361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.547641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] PATH_INFO: `/v3/projects/a975b5b753b04779ae7736e4fea1be2c/users/459c2fdb386841108ceee2687f60f37a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.566776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a975b5b753b04779ae7736e4fea1be2c, user_id=459c2fdb386841108ceee2687f60f37a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.569495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.582818 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4233/8485] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:25 2022] PUT /identity/v3/projects/a975b5b753b04779ae7736e4fea1be2c/users/459c2fdb386841108ceee2687f60f37a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:25.587443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.597691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431f72-2f7d-4fa1-bce5-73389513cc73 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.653448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aa403-75fe-4520-bed4-57e16906f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.653973 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aa403-75fe-4520-bed4-57e16906f23f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.654511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aa403-75fe-4520-bed4-57e16906f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.654511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aa403-75fe-4520-bed4-57e16906f23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.655139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aa403-75fe-4520-bed4-57e16906f23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.656761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aa403-75fe-4520-bed4-57e16906f23f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.667348 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4253/8486] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:25.671701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.682480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93d9da-227a-40ab-b1ce-58aa647be392 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.687327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.687954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.688233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.688507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] PATH_INFO: `/v3/projects/a975b5b753b04779ae7736e4fea1be2c/users/459c2fdb386841108ceee2687f60f37a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.690437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a975b5b753b04779ae7736e4fea1be2c, user_id=459c2fdb386841108ceee2687f60f37a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.693106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.700134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:25.705164 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4234/8487] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:25 2022] PUT /identity/v3/projects/a975b5b753b04779ae7736e4fea1be2c/users/459c2fdb386841108ceee2687f60f37a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:25.715894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.716189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.716474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.744891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] MFA Rules not processed for user `459c2fdb386841108ceee2687f60f37a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:25.746133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:25.818113 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4254/8488] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:25 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:25.828735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:25.830467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:25.895042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549bae-817f-4084-aeb6-6154932acbf9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:25.898745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec4446-fb42-4461-bbd0-cc222af97057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:25.899353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec4446-fb42-4461-bbd0-cc222af97057 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:25.899630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec4446-fb42-4461-bbd0-cc222af97057 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:25.899899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec4446-fb42-4461-bbd0-cc222af97057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:25.909178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec4446-fb42-4461-bbd0-cc222af97057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:25.910532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec4446-fb42-4461-bbd0-cc222af97057 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:25.920844 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4235/8489] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:25 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:27.470819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:27.532675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62c30e-7845-41cf-ad78-48ca01b95fa5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:27.537137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:27.537758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:27.538042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:27.538313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] PATH_INFO: `/v3/users/5a23a8c2a0484f2cadd23ec21c2be11a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:27.540093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a23a8c2a0484f2cadd23ec21c2be11a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:27.542062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:27.564545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:27.588752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a23a8c2a0484f2cadd23ec21c2be11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:27.601025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a23a8c2a0484f2cadd23ec21c2be11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:27.602305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a23a8c2a0484f2cadd23ec21c2be11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:27.609216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a23a8c2a0484f2cadd23ec21c2be11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:27.609846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a23a8c2a0484f2cadd23ec21c2be11a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:27.622103 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4255/8490] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:27 2022] DELETE /identity/v3/users/5a23a8c2a0484f2cadd23ec21c2be11a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:27.626614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c593-9a86-423e-91da-515c237add42 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:27.627083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c593-9a86-423e-91da-515c237add42 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:27.627187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8c593-9a86-423e-91da-515c237add42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:27.646218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-acb8c593-9a86-423e-91da-515c237add42 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:27.647345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-acb8c593-9a86-423e-91da-515c237add42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:27.718014 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4236/8491] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:27.728403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:27.729947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:27.789888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26eeb5-77bf-4673-bce3-bbe135e31bd3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:27.793691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:27.794301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:27.794586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:27.794868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:27.803962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:27.805926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:27.815450 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4256/8492] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:28.097411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8c593-9a86-423e-91da-515c237add42 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:28.098842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-acb8c593-9a86-423e-91da-515c237add42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:28.110905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8c593-9a86-423e-91da-515c237add42 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:28.116665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:28.117744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.118100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.118384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] PATH_INFO: `/v3/projects/9b0c143874ba4e41ad591bb4e45a80fb` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.119860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b0c143874ba4e41ad591bb4e45a80fb)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:28.121776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:28.169995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0c143874ba4e41ad591bb4e45a80fb', 'request_id': 'req-1cc3275f-66ec-42b8-9273-0daba56487a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.177783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0c143874ba4e41ad591bb4e45a80fb', 'request_id': 'req-1cc3275f-66ec-42b8-9273-0daba56487a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.183590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0c143874ba4e41ad591bb4e45a80fb', 'request_id': 'req-1cc3275f-66ec-42b8-9273-0daba56487a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.194506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] The token cache is being invalidate because project 9b0c143874ba4e41ad591bb4e45a80fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:28.195290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.196129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.197656 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4237/8493] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:28 2022] DELETE /identity/v3/projects/9b0c143874ba4e41ad591bb4e45a80fb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:28.201692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:28.211823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb91e88-0c4f-4d7e-b68a-c3625eefc00f service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:28.267936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:28.268572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.268856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.269163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] PATH_INFO: `/v3/users/459c2fdb386841108ceee2687f60f37a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.270288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=459c2fdb386841108ceee2687f60f37a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:28.272220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:28.317806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:28.319395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459c2fdb386841108ceee2687f60f37a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.333701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459c2fdb386841108ceee2687f60f37a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.334386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459c2fdb386841108ceee2687f60f37a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.342800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459c2fdb386841108ceee2687f60f37a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.343559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8497f2ba-5409-4b13-a076-dbb44df1a5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459c2fdb386841108ceee2687f60f37a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.357433 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4257/8494] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:28 2022] DELETE /identity/v3/users/459c2fdb386841108ceee2687f60f37a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:28.533806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:28.535522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:28.553376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3275f-66ec-42b8-9273-0daba56487a6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:28.580276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:28.614472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:28.615106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.615390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.615669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] PATH_INFO: `/v3/projects/a975b5b753b04779ae7736e4fea1be2c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.617659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a975b5b753b04779ae7736e4fea1be2c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:28.619646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:28.676126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a975b5b753b04779ae7736e4fea1be2c', 'request_id': 'req-b59e3cca-bc5c-4801-9a17-54e55f99909d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.685340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a975b5b753b04779ae7736e4fea1be2c', 'request_id': 'req-b59e3cca-bc5c-4801-9a17-54e55f99909d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.691031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a975b5b753b04779ae7736e4fea1be2c', 'request_id': 'req-b59e3cca-bc5c-4801-9a17-54e55f99909d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.703371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] The token cache is being invalidate because project a975b5b753b04779ae7736e4fea1be2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:28.703666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.704316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b59e3cca-bc5c-4801-9a17-54e55f99909d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:28.705845 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4238/8495] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:28 2022] DELETE /identity/v3/projects/a975b5b753b04779ae7736e4fea1be2c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:28.711120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.711581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.711581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.731355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:28.732548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:28.791885 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4258/8496] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:28.801192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.801481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.801760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.821897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:28.823089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:28.830924 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4239/8497] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:28.836647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:28.847418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9bf60-65c4-4e29-ac47-a40c1016e0cd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:28.853020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:28.853632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.853921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.854203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.854850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:28.855158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:28.856762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:28.869427 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4259/8498] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:28.873797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:28.883595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82c009-cc76-49ae-adb9-00234b0b1851 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:28.888284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:28.888883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.889200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.889479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.890109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:28.892056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:28.919964 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4240/8499] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:28.924067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:28.935430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe3fb-45e7-48cd-bd19-5d4f6d9eb875 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:28.997007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:28.997585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:28.997868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:28.998145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:28.998790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.000743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.022197 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4260/8500] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:28 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:29.026438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.036699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188767-3713-43cf-b6b4-319771304e94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.042393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.042997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.043282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.043560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.044201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.045829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.057164 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4241/8501] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:29.061092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.071131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2cb1e-7932-4a6e-97da-24ed3dfdca2f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.075960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa643f-af9c-4c45-bb2f-9a9581325bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.076595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa643f-af9c-4c45-bb2f-9a9581325bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.076880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa643f-af9c-4c45-bb2f-9a9581325bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.077189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa643f-af9c-4c45-bb2f-9a9581325bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.077835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa643f-af9c-4c45-bb2f-9a9581325bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.079470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa643f-af9c-4c45-bb2f-9a9581325bfd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.090833 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4261/8502] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:29.094974 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.106345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b12344-20a4-4a2c-80ab-5581d202e413 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.110965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.111617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.111901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.112185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] PATH_INFO: `/v3/projects/0f9fdf2070784b80bac4c19cfc85a44c/users/471b225b6acf436b987b7738fc1b3d14/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.126742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9fdf2070784b80bac4c19cfc85a44c, user_id=471b225b6acf436b987b7738fc1b3d14, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.129676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.142146 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4242/8503] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:29 2022] PUT /identity/v3/projects/0f9fdf2070784b80bac4c19cfc85a44c/users/471b225b6acf436b987b7738fc1b3d14/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:29.153180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.153475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.153752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.181387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] MFA Rules not processed for user `471b225b6acf436b987b7738fc1b3d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:29.182601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:29.199481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:29.248347 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4262/8504] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:29.252861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.311561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:29.330494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405fdc-7067-41e1-9081-3cf3e0456158 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.335581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.336132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.336416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.336693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.337377 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.339283 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.365468 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4243/8505] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:29 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:29.370233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.381105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39ce4b-8482-4264-adad-c0bb670e9440 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.436503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.437188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.437473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.437752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.438383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.440336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.462954 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4263/8506] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:29 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:29.466973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.477810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925eee7-d3f5-4b24-8aae-a8c2aa17cb3c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.482436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.483030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.483313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.483590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.484232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.485865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.497078 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4244/8507] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:29.501306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.511621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa62-8c44-4ec1-a02e-16aa8ad9974c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.516177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.516824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.517140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.517417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] PATH_INFO: `/v3/projects/5511ad48df5943b690eeb4469bc0e694/users/7d9f18e79c0249edaf7052f81c2eebb2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.531993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5511ad48df5943b690eeb4469bc0e694, user_id=7d9f18e79c0249edaf7052f81c2eebb2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.534689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.549574 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4264/8508] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:29 2022] PUT /identity/v3/projects/5511ad48df5943b690eeb4469bc0e694/users/7d9f18e79c0249edaf7052f81c2eebb2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:29.553607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.564229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439bb0f-2ca0-479e-b16c-104f2094f53e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.635148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d015e-0d5c-464e-827b-c97f2fb76ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.635988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d015e-0d5c-464e-827b-c97f2fb76ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.636336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d015e-0d5c-464e-827b-c97f2fb76ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.636665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d015e-0d5c-464e-827b-c97f2fb76ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.637344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d015e-0d5c-464e-827b-c97f2fb76ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.638918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d015e-0d5c-464e-827b-c97f2fb76ef6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.650412 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4245/8509] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:29.654027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.664498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf7142-e075-4906-a88d-1011774e590e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.669159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.669811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.670088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.670363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] PATH_INFO: `/v3/projects/5511ad48df5943b690eeb4469bc0e694/users/7d9f18e79c0249edaf7052f81c2eebb2/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.672263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5511ad48df5943b690eeb4469bc0e694, user_id=7d9f18e79c0249edaf7052f81c2eebb2, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.674916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.686451 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4265/8510] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:29 2022] PUT /identity/v3/projects/5511ad48df5943b690eeb4469bc0e694/users/7d9f18e79c0249edaf7052f81c2eebb2/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:29.696642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.697174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.697336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.725299 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] MFA Rules not processed for user `7d9f18e79c0249edaf7052f81c2eebb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:29.727033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:29.797560 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4246/8511] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:29.808518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:29.810382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:29.877889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70159cf-62b3-4b1d-9660-d3edc10e9217 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:29.881975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:29.883222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:29.883604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:29.883944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:29.893476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:29.894908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:29.905034 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4266/8512] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:30.692538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:30.694085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:30.748197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:30.785032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f36e-26cc-4eb2-be52-14b7479e8a6f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:30.791032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:30.791664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:30.791946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:30.792224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:30.794109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:30.809053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:30.810661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:30.824095 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4247/8513] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:31.050447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:31.051930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:31.067086 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959ef82-cd35-4e04-957c-f35c1585cf0a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:31.071076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:31.071708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:31.072021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:31.072302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:31.074093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:31.088786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:31.090272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:31.095075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:31.107593 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4267/8514] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:11:31.251204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:31.264487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c320d1-9720-45a1-a2b1-e03e39c55883 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:31.268296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:31.268940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:31.269227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:31.269514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:31.271220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:31.347725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:31.349209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:31.374119 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4248/8515] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:31.872695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:31.874236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:31.893307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44a892-2bbc-433a-8ffe-013fb486bc23 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:31.901155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:31.901776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:31.902057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:31.902330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:31.904178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:31.920555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:31.922170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938078-7eb2-4034-8b58-2aba8ba62310 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:31.936138 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4268/8516] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:32.271725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:32.341231 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a1ddd-43e5-44ae-9407-e7dedc8c8a08 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:32.345917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:32.346550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:32.346850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:32.347104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] PATH_INFO: `/v3/users/471b225b6acf436b987b7738fc1b3d14` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:32.348230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471b225b6acf436b987b7738fc1b3d14)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:32.350181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:32.400219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471b225b6acf436b987b7738fc1b3d14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:32.401409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:32.415149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471b225b6acf436b987b7738fc1b3d14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:32.415857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471b225b6acf436b987b7738fc1b3d14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:32.423410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471b225b6acf436b987b7738fc1b3d14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:32.424274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471b225b6acf436b987b7738fc1b3d14'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:32.438393 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4249/8517] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:32 2022] DELETE /identity/v3/users/471b225b6acf436b987b7738fc1b3d14 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:32.442986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:32.443480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:32.443660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:32.463630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:32.465132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:32.525894 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4269/8518] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:32.535543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:32.537093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:32.604477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81e525-d7d9-480e-a175-ca71b7a3dcb9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:32.611654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:32.611654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:32.611903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:32.612551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:32.624329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:32.625831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:32.638265 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4250/8519] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:33.047850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:33.049399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:33.073232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4345c-4f9d-46d6-bcc2-d51b0178194f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:33.080636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:33.081496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:33.081962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:33.082164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] PATH_INFO: `/v3/projects/0f9fdf2070784b80bac4c19cfc85a44c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:33.083318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9fdf2070784b80bac4c19cfc85a44c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:33.085325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:33.135802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9fdf2070784b80bac4c19cfc85a44c', 'request_id': 'req-5afae7ba-bbf2-4085-b672-b104eca5d073'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.141443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9fdf2070784b80bac4c19cfc85a44c', 'request_id': 'req-5afae7ba-bbf2-4085-b672-b104eca5d073'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.148602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9fdf2070784b80bac4c19cfc85a44c', 'request_id': 'req-5afae7ba-bbf2-4085-b672-b104eca5d073'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.161700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] The token cache is being invalidate because project 0f9fdf2070784b80bac4c19cfc85a44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:33.161994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.163170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.164495 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4270/8520] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:33 2022] DELETE /identity/v3/projects/0f9fdf2070784b80bac4c19cfc85a44c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:33.168183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:33.177577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2fa2a-694a-4038-b405-591e17ead24c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:33.235381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:33.236182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:33.236474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:33.236805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] PATH_INFO: `/v3/users/7d9f18e79c0249edaf7052f81c2eebb2` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:33.237985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9f18e79c0249edaf7052f81c2eebb2)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:33.240134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:33.291356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9f18e79c0249edaf7052f81c2eebb2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.303442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9f18e79c0249edaf7052f81c2eebb2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.304804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9f18e79c0249edaf7052f81c2eebb2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.308827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:33.314906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9f18e79c0249edaf7052f81c2eebb2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.315760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a3521147-c8c4-4374-9194-7adce5805a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9f18e79c0249edaf7052f81c2eebb2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.332072 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4251/8521] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:33 2022] DELETE /identity/v3/users/7d9f18e79c0249edaf7052f81c2eebb2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:33.648091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:33.650555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:33.668976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afae7ba-bbf2-4085-b672-b104eca5d073 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:33.732295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:33.733168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:33.733514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:33.733855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] PATH_INFO: `/v3/projects/5511ad48df5943b690eeb4469bc0e694` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:33.735149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5511ad48df5943b690eeb4469bc0e694)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:33.737551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:33.750184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:33.789245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5511ad48df5943b690eeb4469bc0e694', 'request_id': 'req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.795284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5511ad48df5943b690eeb4469bc0e694', 'request_id': 'req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.801629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5511ad48df5943b690eeb4469bc0e694', 'request_id': 'req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.814947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] The token cache is being invalidate because project 5511ad48df5943b690eeb4469bc0e694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:33.815246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.815881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-e09b6b18-dd3d-4f7d-9609-0ebf95164fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:33.817419 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4271/8522] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:33 2022] DELETE /identity/v3/projects/5511ad48df5943b690eeb4469bc0e694 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:33.822849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:33.823144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:33.823429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:33.846965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:33.848091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:33.927485 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4252/8523] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:33.929319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:33.929688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:33.929974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:33.952992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:33.955282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:33.966739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4272/8524] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:11:33.971219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:33.981877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e253d3-ace3-4965-b02a-5190d04fcb91 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:33.986604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:33.987216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:33.987504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:33.987785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:33.988436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:33.988744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:33.990514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.002614 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4253/8525] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:11:34.008080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.017741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28dd87-0be6-4303-944d-92a966dc163b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.025762 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.026796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.027280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.027746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.029037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.031465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.070652 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4273/8526] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:34 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:34.077230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.090215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f4f9b-897a-4c76-b94f-f7b4be88bdfb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.151694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.152341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.152625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.152923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.153596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.155663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.179166 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4254/8527] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:34 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:34.183353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.194837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e50cad-77be-4823-b71f-fc1000032f88 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.199638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.200277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.200559 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.200833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.201521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.203122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.213751 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4274/8528] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:34.217796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.228505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ae70b-5b88-41d3-b8ed-053d10602b69 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.233705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8735a-3309-4d80-a332-9db76c7089e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.234309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8735a-3309-4d80-a332-9db76c7089e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.234615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8735a-3309-4d80-a332-9db76c7089e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.234887 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8735a-3309-4d80-a332-9db76c7089e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.235530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8735a-3309-4d80-a332-9db76c7089e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.237273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8735a-3309-4d80-a332-9db76c7089e1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.248603 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4255/8529] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:34.252871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.264114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818cc8-9ef6-4106-b156-420e1c29da8a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.268773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.269457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.269739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.270309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] PATH_INFO: `/v3/projects/56391274e7e34a4bbd35097956cd28ee/users/b493f655878d4f38a244cb8859a7ffe2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.285996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56391274e7e34a4bbd35097956cd28ee, user_id=b493f655878d4f38a244cb8859a7ffe2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.289256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.303213 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4275/8530] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:34 2022] PUT /identity/v3/projects/56391274e7e34a4bbd35097956cd28ee/users/b493f655878d4f38a244cb8859a7ffe2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:34.315702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.316329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.316719 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.346926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] MFA Rules not processed for user `b493f655878d4f38a244cb8859a7ffe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:34.348150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:34.391680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:34.418181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4256/8531] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:34.423174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.497535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6e6df-44c3-4e6a-a960-aa04e8739d3d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.503022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.503698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.504377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.504663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.505370 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.508468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.535590 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4276/8532] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:34 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:34.539606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.551043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48745ac-855d-490a-b9bc-37d219d50297 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.612921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.613553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.613836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.614112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.614747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.617279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.642172 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4257/8533] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:34 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:34.643359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.657118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fcd4-3a9a-4e72-8ecc-deacbc2b6213 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.667165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.668064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.668352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.668628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.669346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.670955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.687658 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4277/8534] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:34.689076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.700115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd24de-fa7f-4421-aab1-4ec77a5a1c6e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.704895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.705587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.705873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.706156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] PATH_INFO: `/v3/projects/a76eb193e27a42e9915ccaeb2afe08fa/users/8826d37936ed4f769ad9d9cef08834de/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.722016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76eb193e27a42e9915ccaeb2afe08fa, user_id=8826d37936ed4f769ad9d9cef08834de, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.724676 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.738668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4258/8535] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:34 2022] PUT /identity/v3/projects/a76eb193e27a42e9915ccaeb2afe08fa/users/8826d37936ed4f769ad9d9cef08834de/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:34.751169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.761800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93369c98-fb74-4216-a7e0-3466db6e8e16 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.774014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:34.831524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a84bf-3c19-486a-b5fd-8db2e57e8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.832139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a84bf-3c19-486a-b5fd-8db2e57e8415 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.832477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a84bf-3c19-486a-b5fd-8db2e57e8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.832764 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a84bf-3c19-486a-b5fd-8db2e57e8415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.833482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a84bf-3c19-486a-b5fd-8db2e57e8415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.835381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a84bf-3c19-486a-b5fd-8db2e57e8415 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.851280 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4278/8536] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:34.852783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:34.863145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5727e-2876-48b6-a9d3-e48edd5128f0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:34.868549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:34.869360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.869715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.870046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] PATH_INFO: `/v3/projects/a76eb193e27a42e9915ccaeb2afe08fa/users/8826d37936ed4f769ad9d9cef08834de/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.872032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76eb193e27a42e9915ccaeb2afe08fa, user_id=8826d37936ed4f769ad9d9cef08834de, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:34.874771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:34.886357 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4259/8537] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:34 2022] PUT /identity/v3/projects/a76eb193e27a42e9915ccaeb2afe08fa/users/8826d37936ed4f769ad9d9cef08834de/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:34.898450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:34.898450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:34.898707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:34.926652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] MFA Rules not processed for user `8826d37936ed4f769ad9d9cef08834de`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:34.927867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:34.995223 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4279/8538] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:35.006056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:35.008830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:35.071349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba306cb-ec3e-491c-ac8b-fcfcb20b1885 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:35.075058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d630-ffe9-4673-ba25-25e77345472a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:35.075661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d630-ffe9-4673-ba25-25e77345472a service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:35.075946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d630-ffe9-4673-ba25-25e77345472a service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:35.076223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d630-ffe9-4673-ba25-25e77345472a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:35.086518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d630-ffe9-4673-ba25-25e77345472a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:35.087953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d630-ffe9-4673-ba25-25e77345472a service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:35.097671 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4260/8539] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:37.385584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:37.448221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7af1b-9da5-4a8e-a56f-533ad1af670b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:37.452881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:37.453534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:37.453815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:37.454087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] PATH_INFO: `/v3/users/b493f655878d4f38a244cb8859a7ffe2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:37.455189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b493f655878d4f38a244cb8859a7ffe2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:37.457128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:37.496679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:37.508156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b493f655878d4f38a244cb8859a7ffe2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:37.521438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b493f655878d4f38a244cb8859a7ffe2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:37.523282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b493f655878d4f38a244cb8859a7ffe2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:37.530875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b493f655878d4f38a244cb8859a7ffe2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:37.531547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b493f655878d4f38a244cb8859a7ffe2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:37.545546 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4280/8540] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:37 2022] DELETE /identity/v3/users/b493f655878d4f38a244cb8859a7ffe2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:37.550265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:37.550736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:37.550885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:37.569863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:37.571073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:37.609089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:37.641064 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4261/8541] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:37.654109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:37.655558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:37.722831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e937233-4a06-4c66-bd77-db6a0b304e29 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:37.727090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:37.727905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:37.728285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:37.728656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:37.738966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:37.740417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:37.751783 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4281/8542] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:38.022809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.024302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:38.037001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b74c0-45d5-49c1-9ad3-c526da09b759 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.042580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.043569 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.044083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.044533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] PATH_INFO: `/v3/projects/56391274e7e34a4bbd35097956cd28ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.046539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56391274e7e34a4bbd35097956cd28ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.049112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.101245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56391274e7e34a4bbd35097956cd28ee', 'request_id': 'req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.108664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56391274e7e34a4bbd35097956cd28ee', 'request_id': 'req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.114281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56391274e7e34a4bbd35097956cd28ee', 'request_id': 'req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.125821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] The token cache is being invalidate because project 56391274e7e34a4bbd35097956cd28ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:38.126113 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.126746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.128230 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4262/8543] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:38 2022] DELETE /identity/v3/projects/56391274e7e34a4bbd35097956cd28ee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:38.133493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.143120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e37f4-493a-4286-a6e5-ecd23d909e79 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.199499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.200053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.200340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.200621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] PATH_INFO: `/v3/users/8826d37936ed4f769ad9d9cef08834de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.201780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8826d37936ed4f769ad9d9cef08834de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.203703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.249024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8826d37936ed4f769ad9d9cef08834de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.256792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:38.262934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8826d37936ed4f769ad9d9cef08834de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.263876 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8826d37936ed4f769ad9d9cef08834de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.273297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8826d37936ed4f769ad9d9cef08834de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.273922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-44f27742-76d4-4cf3-9a5a-b50d77514fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8826d37936ed4f769ad9d9cef08834de'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.286300 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4282/8544] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:11:38 2022] DELETE /identity/v3/users/8826d37936ed4f769ad9d9cef08834de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:11:38.466856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.468294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:38.484443 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2d977-2ba5-4bf7-baaa-6f835bb8b2d8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.543678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.544336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.544617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.544893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] PATH_INFO: `/v3/projects/a76eb193e27a42e9915ccaeb2afe08fa` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.546053 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76eb193e27a42e9915ccaeb2afe08fa)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.547954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.594438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76eb193e27a42e9915ccaeb2afe08fa', 'request_id': 'req-d18951a2-e44d-4e64-b80e-130ff60d358f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.602811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76eb193e27a42e9915ccaeb2afe08fa', 'request_id': 'req-d18951a2-e44d-4e64-b80e-130ff60d358f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.607897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:38.609248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76eb193e27a42e9915ccaeb2afe08fa', 'request_id': 'req-d18951a2-e44d-4e64-b80e-130ff60d358f'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.623789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] The token cache is being invalidate because project a76eb193e27a42e9915ccaeb2afe08fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:11:38.624083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.624730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d18951a2-e44d-4e64-b80e-130ff60d358f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:11:38.626366 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4263/8545] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:11:38 2022] DELETE /identity/v3/projects/a76eb193e27a42e9915ccaeb2afe08fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:38.632449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.632962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.633070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.652722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:38.653965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:38.714424 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4283/8546] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:38.721968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.722256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.722533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.743045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:38.744260 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:38.752139 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4264/8547] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:38.756697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.766789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c1eab-1f5b-40c7-bb55-d2a408ad93b6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.771368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.772121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.772401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.772679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.773357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:11:38.773664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.775268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.790557 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4284/8548] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:11:38.792030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.801642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa14b6d-4687-4cf7-8587-c8e246dba7be None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.807193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.807800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.808079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.808352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.809027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.810945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.842388 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4265/8549] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:11:38 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:11:38.845535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.856600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742ab8-5ef7-4759-a3c7-166de94b5685 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.917224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.917839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.918122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.918400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.919072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.921031 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.944296 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4285/8550] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:11:38 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:11:38.948436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.962418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246c8ed-e1bf-424d-bce8-bbd7973ef066 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.967227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:38.967766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:38.968047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:38.968321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:38.968994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:38.970587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:38.981133 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4266/8551] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:38.985269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:38.995157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6031-bc12-4823-9d05-81ef5226cfae admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:38.999676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32987d-9b69-4bdf-b411-79f3b0f2ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:39.000267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32987d-9b69-4bdf-b411-79f3b0f2ae84 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:39.000549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32987d-9b69-4bdf-b411-79f3b0f2ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:39.000824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32987d-9b69-4bdf-b411-79f3b0f2ae84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:39.001500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32987d-9b69-4bdf-b411-79f3b0f2ae84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:39.003077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32987d-9b69-4bdf-b411-79f3b0f2ae84 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:39.014240 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4286/8552] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:11:39.018314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:39.028801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c0e70-693f-47f3-ab33-6dcb236df0f0 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:39.033436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:39.034082 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:39.034363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:39.034636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] PATH_INFO: `/v3/projects/1e1a8555eb584b89ae03167f05edba24/users/fa4a5f9c8e834f2983d6a055e1f9287e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:39.049711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a8555eb584b89ae03167f05edba24, user_id=fa4a5f9c8e834f2983d6a055e1f9287e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:39.052363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:39.065438 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4267/8553] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:11:39 2022] PUT /identity/v3/projects/1e1a8555eb584b89ae03167f05edba24/users/fa4a5f9c8e834f2983d6a055e1f9287e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:11:39.075671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:39.075964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:39.076275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:39.104765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] MFA Rules not processed for user `fa4a5f9c8e834f2983d6a055e1f9287e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:11:39.106094 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:39.140502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:39.178681 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4287/8554] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:11:39.188606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:39.190314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:39.249332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8f1b1-55fd-4828-a387-58b52ccfb774 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:39.252880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8d9a9-f1e2-49d6-992b-e3ba5daee8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:39.253499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8d9a9-f1e2-49d6-992b-e3ba5daee8df service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:39.254031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8d9a9-f1e2-49d6-992b-e3ba5daee8df service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:39.254411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8d9a9-f1e2-49d6-992b-e3ba5daee8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:39.263094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8d9a9-f1e2-49d6-992b-e3ba5daee8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:39.264540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8d9a9-f1e2-49d6-992b-e3ba5daee8df service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:39.274052 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4268/8555] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:11:49.175803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=14 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:49.269353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:11:53.587875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:11:53.589601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:53.744704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48046adb-d3d0-4220-a6dd-3450ea9eed7e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:11:53.750264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:11:53.751494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:11:53.751494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:11:53.751494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:11:53.753608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:11:53.771648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:11:53.773319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:11:53.787314 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4288/8556] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:11:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:00.600254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:00.600964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:00.601226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:00.635801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] MFA Rules not processed for user `ad3a53da0c764f0a893966aea6505fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:12:00.637169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:00.731593 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4269/8557] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:12:00.774049 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:00.777435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:00.924078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fcd26-9090-42eb-ae65-b30dfad1c9a3 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:00.928611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:00.930489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:00.930794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:00.931139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:00.950427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:01.118895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:01.120380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:01.155182 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4289/8558] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:12:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:02.239660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:02.241208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:02.265743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fae450-a5f9-4a13-9728-cba59b0ae4da None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:02.275093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:02.276040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:02.276850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:02.277215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:02.279468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:02.313549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:02.315858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:02.340888 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4270/8559] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:12:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:05.902711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:05.904544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:05.947898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167bad8-e9c9-42d9-99c4-fce63d27d57c service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:05.954214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:05.954949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:05.955240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:05.955519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:05.957749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:05.978353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:05.980509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d87e74-72b7-4cd6-b2be-fe5a2a64673c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:06.025325 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4290/8560] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:12:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:12.324528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=35 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:16.005647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:24.481234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:24.545663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8bd3-b37d-4cdb-bd34-53d78930fd71 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:24.550279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:24.550897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:24.551178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:24.551451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] PATH_INFO: `/v3/users/fa4a5f9c8e834f2983d6a055e1f9287e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:24.552560 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4a5f9c8e834f2983d6a055e1f9287e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:24.554506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:24.600394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4a5f9c8e834f2983d6a055e1f9287e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:24.612227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4a5f9c8e834f2983d6a055e1f9287e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:24.612922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4a5f9c8e834f2983d6a055e1f9287e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:24.622137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4a5f9c8e834f2983d6a055e1f9287e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:24.622901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4a5f9c8e834f2983d6a055e1f9287e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:24.636350 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4271/8561] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:12:24 2022] DELETE /identity/v3/users/fa4a5f9c8e834f2983d6a055e1f9287e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:12:24.640857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:24.641387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:24.641511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:24.661494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:12:24.662690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:24.721091 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4291/8562] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:12:24.731350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:24.732781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:24.794214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c9a32-133c-4db9-88e8-a00881e8c8dd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:24.797928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304547d-7caf-4a71-bbdf-24d4f85db91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:24.798544 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304547d-7caf-4a71-bbdf-24d4f85db91d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:24.798824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304547d-7caf-4a71-bbdf-24d4f85db91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:24.799155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304547d-7caf-4a71-bbdf-24d4f85db91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:24.808615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304547d-7caf-4a71-bbdf-24d4f85db91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:24.810097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304547d-7caf-4a71-bbdf-24d4f85db91d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:24.820158 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4272/8563] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:24.986003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:24.987591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:24.999991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945ad6-6a91-467b-9883-5da6acf9591e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.005353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.006074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.006425 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.006839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] PATH_INFO: `/v3/projects/1e1a8555eb584b89ae03167f05edba24` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.008045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1a8555eb584b89ae03167f05edba24)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.010229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.056599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1a8555eb584b89ae03167f05edba24', 'request_id': 'req-8a0febac-8b5d-4559-90da-1a73145f0d07'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:25.062070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1a8555eb584b89ae03167f05edba24', 'request_id': 'req-8a0febac-8b5d-4559-90da-1a73145f0d07'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:25.068168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1a8555eb584b89ae03167f05edba24', 'request_id': 'req-8a0febac-8b5d-4559-90da-1a73145f0d07'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:25.080647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] The token cache is being invalidate because project 1e1a8555eb584b89ae03167f05edba24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:12:25.081471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:25.082256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8a0febac-8b5d-4559-90da-1a73145f0d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:12:25.083739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4292/8564] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:12:24 2022] DELETE /identity/v3/projects/1e1a8555eb584b89ae03167f05edba24 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:12:25.089006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.089301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.089582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.109794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:12:25.111010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:25.128244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:25.172524 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4273/8565] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:12:25.181554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578545fa-2466-4163-887a-35c564543981 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.181840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578545fa-2466-4163-887a-35c564543981 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.182124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578545fa-2466-4163-887a-35c564543981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.201828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-578545fa-2466-4163-887a-35c564543981 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:12:25.203014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-578545fa-2466-4163-887a-35c564543981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:25.211664 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4293/8566] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:12:25.215814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.226026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135ed9-2ca1-48b4-8c79-8ed25c0f9ce0 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.230576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.231169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.231452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.231731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.232368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:12:25.232791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.234413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.246743 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4274/8567] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:12:25.251239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578545fa-2466-4163-887a-35c564543981 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.261277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578545fa-2466-4163-887a-35c564543981 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.266019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.266612 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.266895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.267202 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.267846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.269800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.296960 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4294/8568] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:12:25 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:12:25.301699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.312084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efda933-94f2-4797-941a-152c57bdaee1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.369522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.370122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.370404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.370677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.371310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.373238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.394428 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4275/8569] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:12:25 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:12:25.398619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.409532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb212-b3a5-44d9-aad3-54efd09317c5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.414104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.414704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.414991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.415268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.415911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.417538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.428122 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4295/8570] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:12:25.432134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.442244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e7c26-7f2d-4f40-b50e-4ea617c3d55f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.446914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770dc24-2bc6-411e-8323-a7728f60fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.447541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dc24-2bc6-411e-8323-a7728f60fe4d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.447823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dc24-2bc6-411e-8323-a7728f60fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.448097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770dc24-2bc6-411e-8323-a7728f60fe4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.448733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770dc24-2bc6-411e-8323-a7728f60fe4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.450344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770dc24-2bc6-411e-8323-a7728f60fe4d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.460959 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4276/8571] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:12:25.465156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.476392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197113e-f010-4287-8598-49d731ff4eef admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.480981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.481641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.481909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.482545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] PATH_INFO: `/v3/projects/58d86dcf76cc471fb5d0b1313939d3ee/users/cc617ec6c9bd413199bcbfd93ee4d783/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.498073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d86dcf76cc471fb5d0b1313939d3ee, user_id=cc617ec6c9bd413199bcbfd93ee4d783, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.500996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.514161 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4296/8572] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:12:25 2022] PUT /identity/v3/projects/58d86dcf76cc471fb5d0b1313939d3ee/users/cc617ec6c9bd413199bcbfd93ee4d783/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:12:25.528065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.528576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.528773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.557851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] MFA Rules not processed for user `cc617ec6c9bd413199bcbfd93ee4d783`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:12:25.559167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:25.622668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4277/8573] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:12:25.633414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:25.635099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:25.656767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:25.697499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877cd1e-a23e-4406-96b8-aad5a919fa21 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:25.701145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:25.701748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:25.702029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:25.702304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:25.711449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:25.712870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:25.722339 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4297/8574] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:12:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:35.619711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:35.717584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=17 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:12:41.884356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:12:41.901580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aee1a-0a08-465c-8caa-745965a72f61 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:12:41.906294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:12:41.908274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:12:41.908742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:12:41.909235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:12:41.911210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:12:41.927341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:12:41.929559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cff71-6e51-4d0f-aa5a-eff943994a86 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:12:41.945597 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4278/8575] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:12:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:12:51.938453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:22.715736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:22.776676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d82cd-eb9b-422c-8080-e74a5c9e6392 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:22.781332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:22.781889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:22.782171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:22.782443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] PATH_INFO: `/v3/users/cc617ec6c9bd413199bcbfd93ee4d783` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:22.783547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc617ec6c9bd413199bcbfd93ee4d783)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:22.785485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:22.832431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc617ec6c9bd413199bcbfd93ee4d783'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:22.844731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc617ec6c9bd413199bcbfd93ee4d783'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:22.845365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc617ec6c9bd413199bcbfd93ee4d783'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:22.852674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc617ec6c9bd413199bcbfd93ee4d783'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:22.853309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc617ec6c9bd413199bcbfd93ee4d783'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:22.865732 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4298/8576] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:22 2022] DELETE /identity/v3/users/cc617ec6c9bd413199bcbfd93ee4d783 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:22.870201 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:22.870724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:22.870860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:22.890690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:22.891878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:22.949242 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4279/8577] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:22.960278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:22.961729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:23.025895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8925183-e217-4d83-b88c-798c266e3b1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.029542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24667b8f-8697-4ea8-909b-9596a6196810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.030745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24667b8f-8697-4ea8-909b-9596a6196810 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.031027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24667b8f-8697-4ea8-909b-9596a6196810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.031303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24667b8f-8697-4ea8-909b-9596a6196810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.040256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24667b8f-8697-4ea8-909b-9596a6196810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.041668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24667b8f-8697-4ea8-909b-9596a6196810 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.051561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4299/8578] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:23.220704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.222165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:23.234669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db76b-9833-491d-aa22-45d21f9d4333 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.239275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.239915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.240200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.240477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] PATH_INFO: `/v3/projects/58d86dcf76cc471fb5d0b1313939d3ee` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.241630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d86dcf76cc471fb5d0b1313939d3ee)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.243578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.300096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d86dcf76cc471fb5d0b1313939d3ee', 'request_id': 'req-9ef329e8-266e-4a60-81f8-3fa48517a1d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:23.309686 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d86dcf76cc471fb5d0b1313939d3ee', 'request_id': 'req-9ef329e8-266e-4a60-81f8-3fa48517a1d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:23.316286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d86dcf76cc471fb5d0b1313939d3ee', 'request_id': 'req-9ef329e8-266e-4a60-81f8-3fa48517a1d2'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:23.328417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] The token cache is being invalidate because project 58d86dcf76cc471fb5d0b1313939d3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:23.328742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:23.329439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-9ef329e8-266e-4a60-81f8-3fa48517a1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:23.330951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4280/8579] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:23 2022] DELETE /identity/v3/projects/58d86dcf76cc471fb5d0b1313939d3ee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:23.335810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.336105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.336396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.357786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:23.360189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:23.378906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:23.427191 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4300/8580] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:23.435076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.435362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.435636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.455552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:23.456752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:23.464607 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4281/8581] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:23.469625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.479459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0a6f8-0270-41bb-b244-9c0a446cae18 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.484269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.484866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.485178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.485455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.486101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:13:23.486410 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.488014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.499835 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4301/8582] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:13:23.504006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.513355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61191a8-9e93-4a61-add3-b25bf7e03783 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.518674 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.519267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.519551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.519827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.520461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.522382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.550050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4282/8583] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:23 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:23.554250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.564728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c5f30-d9dd-4c52-af07-4547bde64c90 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.632727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.633380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.633692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.634001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.634649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.636617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.673955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4302/8584] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:23 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:23.677587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.689343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c332388-f8f0-4602-8e1d-fa721ccfecb3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.693500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.694119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.694394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.694801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.695496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.697128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.708208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4283/8585] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:13:23.712090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.722846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc0da-e973-43b0-9b8f-27c3ed4faf8d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.728465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f3b36-e307-4af9-b9b3-2a14acffca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.729110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3b36-e307-4af9-b9b3-2a14acffca21 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.729394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3b36-e307-4af9-b9b3-2a14acffca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.729671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f3b36-e307-4af9-b9b3-2a14acffca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.730326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3b36-e307-4af9-b9b3-2a14acffca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.731910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f3b36-e307-4af9-b9b3-2a14acffca21 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.743707 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4303/8586] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:23.747401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:23.758682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867724a-beff-47ca-9bf3-e520e423c282 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:23.763949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:23.765468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.765753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.766033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] PATH_INFO: `/v3/projects/8d9e12d275cf405a9c068ca4ccafe4f4/users/d8da9cb761a3456cad6eadf8f363c7e7/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.781856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9e12d275cf405a9c068ca4ccafe4f4, user_id=d8da9cb761a3456cad6eadf8f363c7e7, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:23.784512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:23.797525 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4284/8587] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:23 2022] PUT /identity/v3/projects/8d9e12d275cf405a9c068ca4ccafe4f4/users/d8da9cb761a3456cad6eadf8f363c7e7/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:23.898575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:23.898787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:23.899039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:23.927455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] MFA Rules not processed for user `d8da9cb761a3456cad6eadf8f363c7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:23.928664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:23.996010 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4304/8588] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:24.007986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:24.009730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:24.031483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:24.073863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fcc4a-5d51-402c-9bb0-600cc0099b9b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:24.078229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0145a-2c80-4e05-b580-963dd3d50102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:24.078840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0145a-2c80-4e05-b580-963dd3d50102 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:24.079123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0145a-2c80-4e05-b580-963dd3d50102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:24.079399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0145a-2c80-4e05-b580-963dd3d50102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:24.087958 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0145a-2c80-4e05-b580-963dd3d50102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:24.089434 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0145a-2c80-4e05-b580-963dd3d50102 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:24.098364 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4285/8589] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:28.249930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:28.269769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:28.315036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ac9f7-5ddf-4fce-adee-1ba52ec38866 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:28.319561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:28.320185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:28.320464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:28.320739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] PATH_INFO: `/v3/users/d8da9cb761a3456cad6eadf8f363c7e7` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:28.321928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8da9cb761a3456cad6eadf8f363c7e7)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:28.323830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:28.369736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8da9cb761a3456cad6eadf8f363c7e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.383077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8da9cb761a3456cad6eadf8f363c7e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.383812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8da9cb761a3456cad6eadf8f363c7e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.391989 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8da9cb761a3456cad6eadf8f363c7e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.392588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8da9cb761a3456cad6eadf8f363c7e7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.406597 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4305/8590] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:28 2022] DELETE /identity/v3/users/d8da9cb761a3456cad6eadf8f363c7e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:28.411199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:28.412059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:28.412344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:28.431619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:28.432828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:28.495118 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4286/8591] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:28.506073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:28.507493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:28.572646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c728bac-3ddd-4866-acb5-ba51c189d069 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:28.577075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081e2a2-2b90-48c8-9eb4-23cbb2464ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:28.577841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e2a2-2b90-48c8-9eb4-23cbb2464ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:28.578129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e2a2-2b90-48c8-9eb4-23cbb2464ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:28.578403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e2a2-2b90-48c8-9eb4-23cbb2464ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:28.587383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e2a2-2b90-48c8-9eb4-23cbb2464ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:28.588826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e2a2-2b90-48c8-9eb4-23cbb2464ae2 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:28.598403 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4306/8592] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:28.769044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:28.770596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:28.784623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461f8e-78ec-4483-ad3f-e22a00ea1e69 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:28.790103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:28.790741 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:28.791069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:28.791350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] PATH_INFO: `/v3/projects/8d9e12d275cf405a9c068ca4ccafe4f4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:28.792603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9e12d275cf405a9c068ca4ccafe4f4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:28.794699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:28.843232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9e12d275cf405a9c068ca4ccafe4f4', 'request_id': 'req-e474de55-6704-4199-b214-d7c957755fb4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.851073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9e12d275cf405a9c068ca4ccafe4f4', 'request_id': 'req-e474de55-6704-4199-b214-d7c957755fb4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.857039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9e12d275cf405a9c068ca4ccafe4f4', 'request_id': 'req-e474de55-6704-4199-b214-d7c957755fb4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.869120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] The token cache is being invalidate because project 8d9e12d275cf405a9c068ca4ccafe4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:28.869418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.870067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e474de55-6704-4199-b214-d7c957755fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:28.871590 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4287/8593] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:28 2022] DELETE /identity/v3/projects/8d9e12d275cf405a9c068ca4ccafe4f4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:28.877826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:28.878120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:28.878403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:28.898276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:28.899494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:28.932356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:28.959284 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4307/8594] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:28.966904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:28.967194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:28.967478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:28.987610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:28.988809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:28.996653 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4288/8595] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:29.001644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.011204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90a1a8-e8a9-4c75-bf30-695bc213d7c3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.015858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.016400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.016683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.016987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.017629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:13:29.017934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.019523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.031561 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4308/8596] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:13:29.035851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.045652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8e43e-5d28-46b2-8de9-f16e7c577edc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.050324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.050918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.051203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.051480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.052120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.054048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.080686 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4289/8597] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:29 2022] POST /identity/v3/projects => generated 353 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:29.085079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.095719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef75f6-6863-4ff4-a6ce-f38a7b0604dc admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.153987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.155103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.155395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.155670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.156302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.158264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.179963 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4309/8598] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:29 2022] POST /identity/v3/users => generated 277 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:29.184077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.194362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf75721-a5b7-4b48-9262-fc900b336444 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.198924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.199516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.199797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.200074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.200711 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.202494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.212149 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4290/8599] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:29.215958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.226533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b946c-fb19-4918-b86f-9a43cef772de admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.231140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b51c1-fd64-4504-9554-9e20b9b7f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.231735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b51c1-fd64-4504-9554-9e20b9b7f9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.232022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b51c1-fd64-4504-9554-9e20b9b7f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.232306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b51c1-fd64-4504-9554-9e20b9b7f9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.233525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b51c1-fd64-4504-9554-9e20b9b7f9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.235114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b51c1-fd64-4504-9554-9e20b9b7f9ee admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.246789 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4310/8600] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:29.251178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.261236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9b3ea-ad52-43da-a066-fe8bd4a15351 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.266154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.266750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.267035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.267345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] PATH_INFO: `/v3/projects/328dde3e8737455e969d417b449af6c9/users/0b94467d5cc745cfa04000b72959c7fc/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.269625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:29.284729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328dde3e8737455e969d417b449af6c9, user_id=0b94467d5cc745cfa04000b72959c7fc, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.287436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.300403 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4291/8601] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:29 2022] PUT /identity/v3/projects/328dde3e8737455e969d417b449af6c9/users/0b94467d5cc745cfa04000b72959c7fc/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:29.312151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.312677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.312790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.340365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] MFA Rules not processed for user `0b94467d5cc745cfa04000b72959c7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:29.341651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:29.406108 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4311/8602] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:29.416033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:29.417761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:29.477862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d41cf-2f5c-4944-a8f7-a487ec2fa072 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:29.481573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabc254-ebbd-48c8-947d-366bca697056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:29.482178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabc254-ebbd-48c8-947d-366bca697056 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:29.482977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabc254-ebbd-48c8-947d-366bca697056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:29.483254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabc254-ebbd-48c8-947d-366bca697056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:29.491675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabc254-ebbd-48c8-947d-366bca697056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:29.493122 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabc254-ebbd-48c8-947d-366bca697056 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:29.502637 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4292/8603] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:13:31.076567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:31.127243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:31.152217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7771e40-4bf3-478e-bebe-94ef56a4ffeb None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:31.156867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:31.157521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.157806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.158087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] PATH_INFO: `/v3/users/0b94467d5cc745cfa04000b72959c7fc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.159207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b94467d5cc745cfa04000b72959c7fc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:31.161160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:31.209644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b94467d5cc745cfa04000b72959c7fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.221385 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b94467d5cc745cfa04000b72959c7fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.222041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b94467d5cc745cfa04000b72959c7fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.229569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b94467d5cc745cfa04000b72959c7fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.230178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b94467d5cc745cfa04000b72959c7fc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.243139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4312/8604] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:31 2022] DELETE /identity/v3/users/0b94467d5cc745cfa04000b72959c7fc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:31.247981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.248484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.248594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.268239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:31.269479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:31.328129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4293/8605] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:31.338056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:31.339442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:31.400007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7375f-1514-4e68-ac6b-bd33761dd006 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:31.403641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6e66a-865e-4396-8d4e-6884987d148e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:31.404266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6e66a-865e-4396-8d4e-6884987d148e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.404570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6e66a-865e-4396-8d4e-6884987d148e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.404841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6e66a-865e-4396-8d4e-6884987d148e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.415128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6e66a-865e-4396-8d4e-6884987d148e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:31.416621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6e66a-865e-4396-8d4e-6884987d148e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:31.427348 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4313/8606] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:13:31.606850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:31.608285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:31.621114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc484af-e2cf-4d98-a3ec-99cfe2c6c4e7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:31.626556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:31.627315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.627703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.628085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] PATH_INFO: `/v3/projects/328dde3e8737455e969d417b449af6c9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.629309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328dde3e8737455e969d417b449af6c9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:31.639146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:31.691304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328dde3e8737455e969d417b449af6c9', 'request_id': 'req-c2330678-0c50-4250-8386-100d079b9051'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.699172 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328dde3e8737455e969d417b449af6c9', 'request_id': 'req-c2330678-0c50-4250-8386-100d079b9051'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.706492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328dde3e8737455e969d417b449af6c9', 'request_id': 'req-c2330678-0c50-4250-8386-100d079b9051'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.722353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] The token cache is being invalidate because project 328dde3e8737455e969d417b449af6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:31.722353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.722721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c2330678-0c50-4250-8386-100d079b9051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:31.724226 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4294/8607] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:31 2022] DELETE /identity/v3/projects/328dde3e8737455e969d417b449af6c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:31.729054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.729350 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.729634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.754134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:31.755331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:31.804737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:31.815539 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4314/8608] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:31.823287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.823579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.823863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.844843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:31.846255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:31.854300 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4295/8609] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:31.858657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:31.868291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd0f06-4bf9-428e-8b30-354828e1fe66 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:31.873091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:31.873690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.874048 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.874406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.875276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:13:31.875620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:31.877258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:31.889026 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4315/8610] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:13:31.893917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:31.898369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:31.904754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc551b-ad52-4916-870e-55d205a0f3f3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:31.911494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:31.912092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:31.912378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:31.912650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:31.913324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:31.915252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:31.941836 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4296/8611] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:31 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:31.945851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:31.956274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39580e89-f6f8-421e-b181-87518194624d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.017830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.018712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.019136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.019549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.020557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.023672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.050190 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4316/8612] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:31 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:32.054181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:32.066145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffb9c9-223d-4837-85d7-3f020eb59c77 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.070880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.071577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.071872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.072181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.072834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.074835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.086032 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4297/8613] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:32.090218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:32.102389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4bf4f-9ec1-4a67-b967-566334c454d0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.107120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a0a14-c865-4784-8854-84f79554ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.107734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0a14-c865-4784-8854-84f79554ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.108021 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0a14-c865-4784-8854-84f79554ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.108354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a0a14-c865-4784-8854-84f79554ebbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.109703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0a14-c865-4784-8854-84f79554ebbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.111319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a0a14-c865-4784-8854-84f79554ebbf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.126623 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4317/8614] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:32.127986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:32.138495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3991e52-df1e-467d-a1c9-b4e6ffffca00 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.144141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.144833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.145150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.145454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] PATH_INFO: `/v3/projects/a4ff4f1aac6c441faec04e2a131b8a4d/users/eaa6e8c8a732445d98edd538dba40b12/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.161108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ff4f1aac6c441faec04e2a131b8a4d, user_id=eaa6e8c8a732445d98edd538dba40b12, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.164363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.177948 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4298/8615] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:32 2022] PUT /identity/v3/projects/a4ff4f1aac6c441faec04e2a131b8a4d/users/eaa6e8c8a732445d98edd538dba40b12/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:32.189126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.189502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.189858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.218936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] MFA Rules not processed for user `eaa6e8c8a732445d98edd538dba40b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:32.220154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:32.285787 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4318/8616] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:32.303611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:32.305398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:32.367267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb388-7213-468b-8790-36bce3681755 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.371192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61147755-cde3-4c92-84bc-eeb16ab1b6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.371826 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147755-cde3-4c92-84bc-eeb16ab1b6ce service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.372361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147755-cde3-4c92-84bc-eeb16ab1b6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.372649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61147755-cde3-4c92-84bc-eeb16ab1b6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.382727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61147755-cde3-4c92-84bc-eeb16ab1b6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.385510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61147755-cde3-4c92-84bc-eeb16ab1b6ce service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.397529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4299/8617] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:32.411336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:32.463575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:32.475692 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd3b91-e647-43e7-8933-d7051bb76ce1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.480388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.481053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.481339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.481623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] PATH_INFO: `/v3/users/eaa6e8c8a732445d98edd538dba40b12` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.482755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa6e8c8a732445d98edd538dba40b12)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.484757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.532665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa6e8c8a732445d98edd538dba40b12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:32.544455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa6e8c8a732445d98edd538dba40b12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:32.545192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa6e8c8a732445d98edd538dba40b12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:32.552700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa6e8c8a732445d98edd538dba40b12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:32.553418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa6e8c8a732445d98edd538dba40b12'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:32.566146 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4319/8618] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:32 2022] DELETE /identity/v3/users/eaa6e8c8a732445d98edd538dba40b12 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:32.570643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.570934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.571207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.590451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:32.591640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:32.650282 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4300/8619] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:32.660813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:32.662297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:32.725246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8dbcb-cd0c-4f40-827a-617d54826bac admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:32.728798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039f6f1-45b9-475e-9781-93f683bea108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:32.729431 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f6f1-45b9-475e-9781-93f683bea108 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:32.729718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f6f1-45b9-475e-9781-93f683bea108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:32.729996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f6f1-45b9-475e-9781-93f683bea108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:32.738858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039f6f1-45b9-475e-9781-93f683bea108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:32.740288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039f6f1-45b9-475e-9781-93f683bea108 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:32.750338 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4320/8620] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:33.021587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.023076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:33.038126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82e9d9-75f0-45ec-b3e1-39b96a5056a4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.042868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.043513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.043849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.044069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] PATH_INFO: `/v3/projects/a4ff4f1aac6c441faec04e2a131b8a4d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.045329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ff4f1aac6c441faec04e2a131b8a4d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.047865 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.093788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:33.098005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ff4f1aac6c441faec04e2a131b8a4d', 'request_id': 'req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:33.107626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ff4f1aac6c441faec04e2a131b8a4d', 'request_id': 'req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:33.114208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ff4f1aac6c441faec04e2a131b8a4d', 'request_id': 'req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:33.127027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] The token cache is being invalidate because project a4ff4f1aac6c441faec04e2a131b8a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:33.127325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:33.127973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-bc3f85ba-ef4f-4324-8118-737ecd0a8bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:33.129490 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4301/8621] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:33 2022] DELETE /identity/v3/projects/a4ff4f1aac6c441faec04e2a131b8a4d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:33.134619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.135114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.135233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.155897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:33.157485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:33.221067 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4321/8622] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:13:33.230161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.230450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.230721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.252018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:33.253265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:33.261319 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4302/8623] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:33.265903 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.276536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65243-1b6a-44e6-bc82-f757b0f3ec6e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.281622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.282245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.282527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.282804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.283481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:13:33.283787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.285714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.298360 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4322/8624] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:13:33.302760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.314047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2d61-cd35-4211-99f1-7a0614974d0f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.318907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.319644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.320000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.320347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.321155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.323145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.356739 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4303/8625] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:33.357938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.365093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:33.371620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f262cf2-fb4b-41a1-b887-7515466b024f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.436139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.437345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.437620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.437891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.438548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.440488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.461723 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4323/8626] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:33.465791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.476164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810e8b-e2ed-4aa8-a7eb-375e222810de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.480749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.481376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.481661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.481936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.482574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.484671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.494606 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4304/8627] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:33.498738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.509795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfcb30-5d4f-48d8-abb3-b095f4e3ff56 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.514457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c67b2-0e72-472b-bded-80bbddbc299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.515438 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c67b2-0e72-472b-bded-80bbddbc299a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.515723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c67b2-0e72-472b-bded-80bbddbc299a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.516098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c67b2-0e72-472b-bded-80bbddbc299a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.516657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c67b2-0e72-472b-bded-80bbddbc299a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.518294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c67b2-0e72-472b-bded-80bbddbc299a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.529200 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4324/8628] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:33.533874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.543710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5591b7-691a-48d2-b4f0-e220c5e0c194 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.548973 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.549623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.549907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.550188 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] PATH_INFO: `/v3/projects/8bf29d83b93d47e3b87f628dd83e9e4b/users/403b4ae952e04af5a48917d29224fb5c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.564406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf29d83b93d47e3b87f628dd83e9e4b, user_id=403b4ae952e04af5a48917d29224fb5c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.567100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.580410 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4305/8629] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:33 2022] PUT /identity/v3/projects/8bf29d83b93d47e3b87f628dd83e9e4b/users/403b4ae952e04af5a48917d29224fb5c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:33.590681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.590964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.591239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.619663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] MFA Rules not processed for user `403b4ae952e04af5a48917d29224fb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:33.620870 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:33.686766 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4325/8630] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:33.691326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.752690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee9da-1782-4bf3-8527-1ea671c15122 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.757597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.758195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.758476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.758753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.759390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.761346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.788858 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4306/8631] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:33.792957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.804279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df6ec-ff5f-4af0-8e3b-f3d719f399de None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.860264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.860864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.861174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.861450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.862085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.864022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.880549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:33.886328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4326/8632] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:33 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:33.891101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.901300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b268196-23a6-4605-a0b5-2430abe41e5d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.906670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.907259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.907539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.907808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.908447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.910062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.920450 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4307/8633] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:33.924661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.934603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146dd177-86ed-4c42-a791-0ff6d174ae56 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:33.939351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:33.939998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:33.940281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:33.940557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] PATH_INFO: `/v3/projects/658a696b0c204e6ea9c3c1cc15d969a2/users/60fe741009e44e78bb78e811839c42a8/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:33.955586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658a696b0c204e6ea9c3c1cc15d969a2, user_id=60fe741009e44e78bb78e811839c42a8, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:33.958310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:33.971830 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4327/8634] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:33 2022] PUT /identity/v3/projects/658a696b0c204e6ea9c3c1cc15d969a2/users/60fe741009e44e78bb78e811839c42a8/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:33.975843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:33.985858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b62a-fbb1-4481-b5c2-f631d224c165 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:34.026576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:34.045045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d594c43-4213-415a-a9ad-ffbefd16db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:34.045689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d594c43-4213-415a-a9ad-ffbefd16db4f admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.046211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d594c43-4213-415a-a9ad-ffbefd16db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.046555 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d594c43-4213-415a-a9ad-ffbefd16db4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.047211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d594c43-4213-415a-a9ad-ffbefd16db4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:34.048772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d594c43-4213-415a-a9ad-ffbefd16db4f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:34.058381 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4308/8635] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:34.062698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:34.072980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce6df7-b6d2-409a-9d7f-e33fc2b18185 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:34.077531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:34.078759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.079063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.079360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] PATH_INFO: `/v3/projects/658a696b0c204e6ea9c3c1cc15d969a2/users/60fe741009e44e78bb78e811839c42a8/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.081296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=658a696b0c204e6ea9c3c1cc15d969a2, user_id=60fe741009e44e78bb78e811839c42a8, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:34.083917 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:34.094671 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4328/8636] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:34 2022] PUT /identity/v3/projects/658a696b0c204e6ea9c3c1cc15d969a2/users/60fe741009e44e78bb78e811839c42a8/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:34.104510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.104816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.105134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.133068 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] MFA Rules not processed for user `60fe741009e44e78bb78e811839c42a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:34.134289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:34.204583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4309/8637] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:34.218293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:34.221240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:34.293041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855c33-db9a-4d45-85cb-db10e8073aca admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:34.296855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c188c1-4e0f-413f-9d5c-3d57cb61d421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:34.297433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c188c1-4e0f-413f-9d5c-3d57cb61d421 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.297717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c188c1-4e0f-413f-9d5c-3d57cb61d421 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.297994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c188c1-4e0f-413f-9d5c-3d57cb61d421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.306911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c188c1-4e0f-413f-9d5c-3d57cb61d421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:34.308337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c188c1-4e0f-413f-9d5c-3d57cb61d421 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:34.318328 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4329/8638] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:34.435553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:34.504116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbb882-ec16-4546-a951-d1490de47124 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:34.508881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:34.509657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.509881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.510158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] PATH_INFO: `/v3/users/403b4ae952e04af5a48917d29224fb5c` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.511293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=403b4ae952e04af5a48917d29224fb5c)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:34.513259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:34.563988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403b4ae952e04af5a48917d29224fb5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:34.576596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403b4ae952e04af5a48917d29224fb5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:34.577436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403b4ae952e04af5a48917d29224fb5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:34.580241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:34.587269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403b4ae952e04af5a48917d29224fb5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:34.588136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403b4ae952e04af5a48917d29224fb5c'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:34.602311 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4310/8639] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:34 2022] DELETE /identity/v3/users/403b4ae952e04af5a48917d29224fb5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:13:34.606771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.607062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.607390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.627209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:34.628407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:34.690338 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4330/8640] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:34.700037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:34.701531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:34.761487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416c0e-a42f-4167-a0b1-ed698741a05f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:34.765086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:34.765742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:34.766073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:34.766365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:34.775291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:34.776796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:34.786849 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4311/8641] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:35.066336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:35.067794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:35.080296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486962c-eb96-4934-b271-f189e8279c23 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:35.085286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:35.086647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.086893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.087170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] PATH_INFO: `/v3/projects/8bf29d83b93d47e3b87f628dd83e9e4b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.088702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf29d83b93d47e3b87f628dd83e9e4b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:35.090830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:35.138264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf29d83b93d47e3b87f628dd83e9e4b', 'request_id': 'req-602af870-a771-4cec-85b3-15659603bfa4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.140226 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:35.145320 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf29d83b93d47e3b87f628dd83e9e4b', 'request_id': 'req-602af870-a771-4cec-85b3-15659603bfa4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.152536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf29d83b93d47e3b87f628dd83e9e4b', 'request_id': 'req-602af870-a771-4cec-85b3-15659603bfa4'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.165127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] The token cache is being invalidate because project 8bf29d83b93d47e3b87f628dd83e9e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:35.165418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.166060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.167549 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4331/8642] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:35 2022] DELETE /identity/v3/projects/8bf29d83b93d47e3b87f628dd83e9e4b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:35.171532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:35.181798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac1f40-143e-42ae-a03d-2a0373cd96b6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:35.237631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:35.238253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.238533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.238807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] PATH_INFO: `/v3/users/60fe741009e44e78bb78e811839c42a8` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.239904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fe741009e44e78bb78e811839c42a8)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:35.241849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:35.285960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fe741009e44e78bb78e811839c42a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.301684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fe741009e44e78bb78e811839c42a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.302704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fe741009e44e78bb78e811839c42a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.311777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fe741009e44e78bb78e811839c42a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.313127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-a2347e3e-bddc-41a3-9e76-0ad298799b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fe741009e44e78bb78e811839c42a8'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.325983 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4312/8643] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:35 2022] DELETE /identity/v3/users/60fe741009e44e78bb78e811839c42a8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:35.593482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:35.595589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:35.621687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af870-a771-4cec-85b3-15659603bfa4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:35.683886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:35.684555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.684834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.685141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] PATH_INFO: `/v3/projects/658a696b0c204e6ea9c3c1cc15d969a2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.686258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658a696b0c204e6ea9c3c1cc15d969a2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:35.688255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:35.739485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658a696b0c204e6ea9c3c1cc15d969a2', 'request_id': 'req-1572badd-bfa7-488c-8475-b41dd2c3b4b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.747184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658a696b0c204e6ea9c3c1cc15d969a2', 'request_id': 'req-1572badd-bfa7-488c-8475-b41dd2c3b4b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.756300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658a696b0c204e6ea9c3c1cc15d969a2', 'request_id': 'req-1572badd-bfa7-488c-8475-b41dd2c3b4b2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.773915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] The token cache is being invalidate because project 658a696b0c204e6ea9c3c1cc15d969a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:35.774192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.774994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-1572badd-bfa7-488c-8475-b41dd2c3b4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:35.776925 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4332/8644] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:35 2022] DELETE /identity/v3/projects/658a696b0c204e6ea9c3c1cc15d969a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:35.781634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.782130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.782252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.791038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:35.806664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:35.807908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:35.873330 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4313/8645] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:35.881576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.881961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.882305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.903469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:35.904782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:35.913380 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4333/8646] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:35.917244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:35.926972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f474c7-89c2-402d-a6d8-38e6adb8066d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:35.932153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:35.932379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.932661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.932968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.933617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:13:35.933922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:35.935543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:35.949460 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4314/8647] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:13:35.954752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:35.964223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf4368-b2ce-442e-a974-3cd114be484c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:35.968962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:35.969563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:35.969847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:35.970124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:35.970752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:35.972657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.001083 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4334/8648] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:35 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:36.005736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.016293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44447edb-ff45-48d7-8456-3c58916dac69 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.071891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.072497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.072777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.073085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.073716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.075613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.098504 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4315/8649] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:36 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:36.102633 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.113618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396644b2-cd77-4183-8419-08d3c07180ba admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.118344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.118952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.119238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.119522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.120168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.121799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.133572 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4335/8650] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:36.137637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.147814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363358b9-056f-4ada-b791-97fd1b2a721b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.152410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba49bca-2452-4bf1-8c74-990c21332ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.153043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49bca-2452-4bf1-8c74-990c21332ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.153327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49bca-2452-4bf1-8c74-990c21332ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.153605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba49bca-2452-4bf1-8c74-990c21332ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.154245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49bca-2452-4bf1-8c74-990c21332ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.155829 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba49bca-2452-4bf1-8c74-990c21332ee2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.166715 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4316/8651] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:36.170705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.181727 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b5c51-273c-4eaa-a409-47590532e27a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.186448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.187103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.188407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.188696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] PATH_INFO: `/v3/projects/6e7377a7c39d4f2387484476546ae144/users/18d9100eaced4efc8c3c1099fbe79da6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.203549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7377a7c39d4f2387484476546ae144, user_id=18d9100eaced4efc8c3c1099fbe79da6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.206268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.219495 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4336/8652] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:36 2022] PUT /identity/v3/projects/6e7377a7c39d4f2387484476546ae144/users/18d9100eaced4efc8c3c1099fbe79da6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:36.229985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.230295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.230576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.259955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] MFA Rules not processed for user `18d9100eaced4efc8c3c1099fbe79da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:36.261215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:36.322803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:36.327376 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4317/8653] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:13:36.331809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.340677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:36.396519 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aad8b-6584-4f97-a897-1f428b9cc2a0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.401135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.401733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.402013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.402286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.402906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.404795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.430916 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4337/8654] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:36 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:36.434935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.446265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383136c3-e622-49cb-b256-30a02d0a3982 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.503640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.504254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.504536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.504812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.505468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.507388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.528221 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4318/8655] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:36 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:13:36.532688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.543198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11862ba-c2b0-43e3-8ce3-b36b5de66d17 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.548664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.549308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.549589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.549864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.550507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.552102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.562828 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4338/8656] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:36.567117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.577088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16c12f-c38e-4570-ba77-131ab0cd57df admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.581836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.582479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.582761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.583036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] PATH_INFO: `/v3/projects/c0d155c4a8bf4852ab3972a29ce1c9ac/users/e24ddc7b0c7b4b37bd6ebd2af852d0e6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.599360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d155c4a8bf4852ab3972a29ce1c9ac, user_id=e24ddc7b0c7b4b37bd6ebd2af852d0e6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.602127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.615529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4319/8657] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:36 2022] PUT /identity/v3/projects/c0d155c4a8bf4852ab3972a29ce1c9ac/users/e24ddc7b0c7b4b37bd6ebd2af852d0e6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:36.619607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.630311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b795fef-bfc8-485e-b908-321f29147310 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.694107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3227-cef0-4950-8449-eadf2e28289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.694717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3227-cef0-4950-8449-eadf2e28289d admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.694999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3227-cef0-4950-8449-eadf2e28289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.695276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3227-cef0-4950-8449-eadf2e28289d admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.695916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3227-cef0-4950-8449-eadf2e28289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.697541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3227-cef0-4950-8449-eadf2e28289d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.707371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4339/8658] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:36.711601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.722615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ed91-9d74-4f70-a581-7c16372b8a41 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.727290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.727942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.728228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.728504 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] PATH_INFO: `/v3/projects/c0d155c4a8bf4852ab3972a29ce1c9ac/users/e24ddc7b0c7b4b37bd6ebd2af852d0e6/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.730442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d155c4a8bf4852ab3972a29ce1c9ac, user_id=e24ddc7b0c7b4b37bd6ebd2af852d0e6, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.733117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.743960 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4320/8659] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:36 2022] PUT /identity/v3/projects/c0d155c4a8bf4852ab3972a29ce1c9ac/users/e24ddc7b0c7b4b37bd6ebd2af852d0e6/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:36.755575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.755866 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.756147 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.785719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] MFA Rules not processed for user `e24ddc7b0c7b4b37bd6ebd2af852d0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:36.786990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:36.859357 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4340/8660] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:36.870090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:36.872179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:36.936508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02addfb4-ea79-4c30-8728-78b24387d023 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:36.940183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:36.940792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:36.941102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:36.941378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:36.951127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:36.952629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:36.963370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4321/8661] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:37.072196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:37.076799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:37.086661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811faa3-6793-4dad-9e35-9761f57ee835 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:37.090225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736ddb8-d153-48f3-ae7e-fc5653508cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:37.090830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736ddb8-d153-48f3-ae7e-fc5653508cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:37.091117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736ddb8-d153-48f3-ae7e-fc5653508cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:37.091389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736ddb8-d153-48f3-ae7e-fc5653508cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:37.147853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736ddb8-d153-48f3-ae7e-fc5653508cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:37.149312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736ddb8-d153-48f3-ae7e-fc5653508cc0 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:37.158813 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4341/8662] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:40.820496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:40.879104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:40.885250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e556f00-120e-40f3-81fb-eb84c8cca5a9 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:40.891258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:40.891896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:40.892178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:40.892454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] PATH_INFO: `/v3/users/18d9100eaced4efc8c3c1099fbe79da6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:40.893600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d9100eaced4efc8c3c1099fbe79da6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:40.895575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:40.942213 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d9100eaced4efc8c3c1099fbe79da6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:40.955332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d9100eaced4efc8c3c1099fbe79da6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:40.956030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d9100eaced4efc8c3c1099fbe79da6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:40.963398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d9100eaced4efc8c3c1099fbe79da6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:40.964289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d9100eaced4efc8c3c1099fbe79da6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:40.978744 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4322/8663] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:40 2022] DELETE /identity/v3/users/18d9100eaced4efc8c3c1099fbe79da6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:40.983177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:40.983650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:40.983853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:41.010775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:41.011985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:41.075981 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4342/8664] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:41.086513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:41.087991 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:41.157960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03a912-3ebb-4b71-9b3e-1ad01ca171ab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:41.161666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841617-e354-478b-a63e-54744826b975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:41.162307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841617-e354-478b-a63e-54744826b975 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:41.162590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841617-e354-478b-a63e-54744826b975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:41.162868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10841617-e354-478b-a63e-54744826b975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:41.173045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841617-e354-478b-a63e-54744826b975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:41.174632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10841617-e354-478b-a63e-54744826b975 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:41.184194 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4323/8665] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:41.476862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:41.478444 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:41.503642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0a9d6-d320-4388-be07-b63bae8917f8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:41.508832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:41.509509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:41.509808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:41.510071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] PATH_INFO: `/v3/projects/6e7377a7c39d4f2387484476546ae144` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:41.511250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7377a7c39d4f2387484476546ae144)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:41.513280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:41.568576 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7377a7c39d4f2387484476546ae144', 'request_id': 'req-beae375a-ed16-4bf4-95dd-dd87ff894bc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.575881 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7377a7c39d4f2387484476546ae144', 'request_id': 'req-beae375a-ed16-4bf4-95dd-dd87ff894bc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.584040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7377a7c39d4f2387484476546ae144', 'request_id': 'req-beae375a-ed16-4bf4-95dd-dd87ff894bc2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.602422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] The token cache is being invalidate because project 6e7377a7c39d4f2387484476546ae144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:41.602670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.603505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.610861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4343/8666] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:41 2022] DELETE /identity/v3/projects/6e7377a7c39d4f2387484476546ae144 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:41.611825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841617-e354-478b-a63e-54744826b975 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:41.622643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10841617-e354-478b-a63e-54744826b975 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:41.696254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:41.697026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:41.697400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:41.697747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] PATH_INFO: `/v3/users/e24ddc7b0c7b4b37bd6ebd2af852d0e6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:41.698944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24ddc7b0c7b4b37bd6ebd2af852d0e6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:41.701006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:41.724978 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:41.759868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24ddc7b0c7b4b37bd6ebd2af852d0e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.773714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24ddc7b0c7b4b37bd6ebd2af852d0e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.774505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24ddc7b0c7b4b37bd6ebd2af852d0e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.783627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24ddc7b0c7b4b37bd6ebd2af852d0e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.784324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-d554c40e-040f-4622-b614-d17e20975e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24ddc7b0c7b4b37bd6ebd2af852d0e6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:41.797161 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4324/8667] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:13:41 2022] DELETE /identity/v3/users/e24ddc7b0c7b4b37bd6ebd2af852d0e6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:42.090118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.091739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:42.109307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae375a-ed16-4bf4-95dd-dd87ff894bc2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.131545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:42.171189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.171968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.172250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.172523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] PATH_INFO: `/v3/projects/c0d155c4a8bf4852ab3972a29ce1c9ac` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.173664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d155c4a8bf4852ab3972a29ce1c9ac)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.175563 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.228053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d155c4a8bf4852ab3972a29ce1c9ac', 'request_id': 'req-f56c29cb-d79b-4968-8a25-b80860c6f923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:42.236855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d155c4a8bf4852ab3972a29ce1c9ac', 'request_id': 'req-f56c29cb-d79b-4968-8a25-b80860c6f923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:42.244440 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d155c4a8bf4852ab3972a29ce1c9ac', 'request_id': 'req-f56c29cb-d79b-4968-8a25-b80860c6f923'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:42.260474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] The token cache is being invalidate because project c0d155c4a8bf4852ab3972a29ce1c9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:13:42.261024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:42.261704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f56c29cb-d79b-4968-8a25-b80860c6f923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:13:42.263225 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4344/8668] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:13:42 2022] DELETE /identity/v3/projects/c0d155c4a8bf4852ab3972a29ce1c9ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:42.268342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.268821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.269039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.289115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:42.290300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:42.353690 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4325/8669] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:42.362222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.362512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.362789 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.383618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:42.384819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:42.393058 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4345/8670] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:42.397282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.407064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db939269-3041-4435-aed0-3aa2f2bd8f77 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.411645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.412311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.412606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.412863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.413531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:13:42.413834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.415406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.427311 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4326/8671] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:13:42.432106 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.442029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d5209-4ec5-4a5b-9086-5e472e8a56df None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.446667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.447262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.447543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.447820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.448482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.450433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.480603 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4346/8672] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:13:42 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:13:42.482601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.493204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae3311-597a-4d57-89d1-32813b4b93b7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.551074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.551734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.552016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.552294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.552948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.554910 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.575800 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4327/8673] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:13:42 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:13:42.580306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.590530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396f0d-0c71-498c-976b-552fd27899ff admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.595931 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.596538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.596819 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.597186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.597834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.599828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.610498 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4347/8674] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:42.614433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.624452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06226-39ae-4ca9-b7f4-1e14015e4a5e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.629063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15628b3-82dd-44e8-9d8c-ad7dd3c86598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.629659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15628b3-82dd-44e8-9d8c-ad7dd3c86598 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.629936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15628b3-82dd-44e8-9d8c-ad7dd3c86598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.630209 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15628b3-82dd-44e8-9d8c-ad7dd3c86598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.630843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15628b3-82dd-44e8-9d8c-ad7dd3c86598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.632411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15628b3-82dd-44e8-9d8c-ad7dd3c86598 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.642944 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4328/8675] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:13:42.647084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.657920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8a2aa-1660-41cf-9db0-7f594e8a03ec admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.662980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.663650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.663935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.664213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] PATH_INFO: `/v3/projects/075c9a907e8d4d33b0d4a959ef78a230/users/7e359277869c4e63b8520064e5837f59/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.680155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=075c9a907e8d4d33b0d4a959ef78a230, user_id=7e359277869c4e63b8520064e5837f59, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.682791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.695469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4348/8676] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:13:42 2022] PUT /identity/v3/projects/075c9a907e8d4d33b0d4a959ef78a230/users/7e359277869c4e63b8520064e5837f59/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:13:42.706393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.706717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.706976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.714075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:42.738892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] MFA Rules not processed for user `7e359277869c4e63b8520064e5837f59`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:13:42.740091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:42.803247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4329/8677] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:13:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:13:42.814791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:42.816462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:42.879770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c395-b005-4776-9ab0-389bd09510bd admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:42.883521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:42.884132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:42.884415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:42.884738 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:42.890754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:13:42.895810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:42.897544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:42.909057 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4349/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:13:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:13:50.778022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:13:50.779473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:13:50.872461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09d255-dab7-4b6c-9c98-410325acdddc None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:13:50.878105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:13:50.878710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:13:50.878988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:13:50.879259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:13:50.886896 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:13:50.888465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:13:50.897370 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4330/8679] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:13:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:13:52.904225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:00.894061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=72 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:12.408556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:12.410081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:12.495681 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded6f8a-641f-4ad8-bd6b-c83889d454db service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:12.501437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:12.502046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:12.502331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:12.502613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:12.504361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:12.587176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:12.588686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc28999-b711-406a-8c4c-3df525b4e174 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:12.598571 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4350/8680] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:14:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:14:22.594064 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=65 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:29.050347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:29.115052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799bf7d-4b20-4fd7-a101-88300e970e3c service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:29.119851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:29.120621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.121035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.121327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] PATH_INFO: `/v3/users/7e359277869c4e63b8520064e5837f59` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.122517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e359277869c4e63b8520064e5837f59)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:29.124451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:29.175971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e359277869c4e63b8520064e5837f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.188272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e359277869c4e63b8520064e5837f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.189298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e359277869c4e63b8520064e5837f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.197694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e359277869c4e63b8520064e5837f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.198466 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e359277869c4e63b8520064e5837f59'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.211431 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4331/8681] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:14:29 2022] DELETE /identity/v3/users/7e359277869c4e63b8520064e5837f59 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:29.216603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.217126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.217325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.236864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:29.238084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:29.298310 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4351/8682] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:14:29.308508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:29.310140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:29.371620 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b057f7-230e-497f-b23b-a8ff0860a344 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:29.375055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d640-9aba-4e9f-bc68-c2eb0655217c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:29.375671 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d640-9aba-4e9f-bc68-c2eb0655217c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.375953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d640-9aba-4e9f-bc68-c2eb0655217c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.376228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d640-9aba-4e9f-bc68-c2eb0655217c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.385870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0d640-9aba-4e9f-bc68-c2eb0655217c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:29.387816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0d640-9aba-4e9f-bc68-c2eb0655217c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:29.397590 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4332/8683] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:14:29.677160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:29.678611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:29.696129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4bfb-ac63-4041-b3e8-581757a1c5cf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:29.701430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:29.702084 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.702365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.702642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] PATH_INFO: `/v3/projects/075c9a907e8d4d33b0d4a959ef78a230` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.703841 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=075c9a907e8d4d33b0d4a959ef78a230)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:29.706075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:29.763082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075c9a907e8d4d33b0d4a959ef78a230', 'request_id': 'req-2ad09678-d29a-4d26-a7fe-219be2cf94dc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.770051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075c9a907e8d4d33b0d4a959ef78a230', 'request_id': 'req-2ad09678-d29a-4d26-a7fe-219be2cf94dc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.777175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075c9a907e8d4d33b0d4a959ef78a230', 'request_id': 'req-2ad09678-d29a-4d26-a7fe-219be2cf94dc'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.790441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] The token cache is being invalidate because project 075c9a907e8d4d33b0d4a959ef78a230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:14:29.790737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.791364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-2ad09678-d29a-4d26-a7fe-219be2cf94dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:29.793265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4352/8684] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:14:29 2022] DELETE /identity/v3/projects/075c9a907e8d4d33b0d4a959ef78a230 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:29.798315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.798601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.798882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.818809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:29.820004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:29.837189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:29.882111 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4333/8685] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:14:29.889921 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.890207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.890487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.910556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:29.911749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:29.920358 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4353/8686] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:14:29.924556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:29.934847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fe4aa-8c13-42b6-8040-ffd1abe93aec None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:29.939370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:29.939962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.940241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.940512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.941182 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:14:29.941487 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:29.943063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:29.955303 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4334/8687] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:14:29.959358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:29.968700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa0bc5-0239-4b87-a407-fdb10b1c155f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:29.973339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:29.973941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:29.974220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:29.974494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:29.975115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:29.977046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:30.007281 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4354/8688] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:14:29 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:14:30.012153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:30.022097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d6ce-8d34-4acd-aa12-c7b4556b1268 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:30.078120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:30.078805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:30.078987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:30.079261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:30.079884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:30.081924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:30.102467 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4335/8689] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:14:30 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:14:30.107269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:30.117476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4e0ef-9e51-4d5c-b1dd-32b8dc547507 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:30.122895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:30.123488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:30.123768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:30.124041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:30.124678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:30.126329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:30.136141 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4355/8690] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:14:30.140014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:30.149788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b8093-e40d-4957-bf5f-055ac24eba27 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:30.154499 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb28f4-a898-4607-aba9-18d812630406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:30.155093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb28f4-a898-4607-aba9-18d812630406 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:30.155368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb28f4-a898-4607-aba9-18d812630406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:30.155640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb28f4-a898-4607-aba9-18d812630406 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:30.156271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb28f4-a898-4607-aba9-18d812630406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:30.157882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb28f4-a898-4607-aba9-18d812630406 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:30.168848 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4336/8691] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:14:30.172847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:30.182815 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038d04d-5a12-4f40-9d74-78cf66e08819 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:30.188779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:30.189489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:30.189774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:30.190053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] PATH_INFO: `/v3/projects/95aa9473c46b47a99b41cc65fd51f1de/users/91a095f4acf547b0baf3f5d8e39b4b96/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:30.205123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aa9473c46b47a99b41cc65fd51f1de, user_id=91a095f4acf547b0baf3f5d8e39b4b96, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:30.207781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:30.221331 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4356/8692] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:14:30 2022] PUT /identity/v3/projects/95aa9473c46b47a99b41cc65fd51f1de/users/91a095f4acf547b0baf3f5d8e39b4b96/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:14:30.232127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:30.232424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:30.232694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:30.260625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] MFA Rules not processed for user `91a095f4acf547b0baf3f5d8e39b4b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:30.261956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:30.329590 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4337/8693] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:14:30.342073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:30.343785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:30.366451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:30.407381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8cbc1a-2d05-4963-a037-040365a76447 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:30.411054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c84ba0-6397-4683-9c40-af4f65acadc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:30.411718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c84ba0-6397-4683-9c40-af4f65acadc2 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:30.412006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c84ba0-6397-4683-9c40-af4f65acadc2 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:30.412288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c84ba0-6397-4683-9c40-af4f65acadc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:30.421660 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c84ba0-6397-4683-9c40-af4f65acadc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:30.423193 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c84ba0-6397-4683-9c40-af4f65acadc2 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:30.431985 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4357/8694] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:14:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:14:40.325726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:40.427977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=17 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:51.740953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:51.745313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:51.880350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9397e-ca8c-4789-89a6-f55957495512 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:51.888656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:51.891450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:51.891450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:51.891450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] PATH_INFO: `/v3/users/ad3a53da0c764f0a893966aea6505fa7` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:51.892156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3a53da0c764f0a893966aea6505fa7)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:51.894391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:51.981781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3a53da0c764f0a893966aea6505fa7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:51.998937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3a53da0c764f0a893966aea6505fa7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.000680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3a53da0c764f0a893966aea6505fa7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.013266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3a53da0c764f0a893966aea6505fa7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.013960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3a53da0c764f0a893966aea6505fa7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.030419 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4338/8695] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:14:51 2022] DELETE /identity/v3/users/ad3a53da0c764f0a893966aea6505fa7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:52.035268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:52.035810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:52.035810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:52.064042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:52.065807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:52.170978 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4358/8696] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:14:52.183652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:52.185388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:52.295262 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0007515-4f8b-491b-b8f1-1495b2826981 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:52.302044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:52.302838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:52.303221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:52.303817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:52.318052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:52.319783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:52.331768 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4339/8697] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:14:52.653120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:52.654590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:52.673373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed1bd-f2d8-4f39-a2c6-a7e1057d0bde None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:52.679629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:52.681476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:52.682058 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:52.682333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] PATH_INFO: `/v3/projects/a86e3137c6764eeb948b9c7dab895c34` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:52.683495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86e3137c6764eeb948b9c7dab895c34)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:52.686015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:52.757796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86e3137c6764eeb948b9c7dab895c34', 'request_id': 'req-dc55bffb-53f0-443a-8be6-923377dd291e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.766610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86e3137c6764eeb948b9c7dab895c34', 'request_id': 'req-dc55bffb-53f0-443a-8be6-923377dd291e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.777386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86e3137c6764eeb948b9c7dab895c34', 'request_id': 'req-dc55bffb-53f0-443a-8be6-923377dd291e'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.799015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] The token cache is being invalidate because project a86e3137c6764eeb948b9c7dab895c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:14:52.799543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.801121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:52.804402 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4359/8698] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:14:52 2022] DELETE /identity/v3/projects/a86e3137c6764eeb948b9c7dab895c34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:52.809241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:52.823383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4f52-022b-40ec-a67e-12a048e31264 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:52.844764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:52.923529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:52.924343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:52.924461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:52.924705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] PATH_INFO: `/v3/users/0589f01c6bb44698b9e060a659c8679b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:52.949975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0589f01c6bb44698b9e060a659c8679b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:52.951859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:53.059329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0589f01c6bb44698b9e060a659c8679b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.090465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0589f01c6bb44698b9e060a659c8679b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.091198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0589f01c6bb44698b9e060a659c8679b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.112352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0589f01c6bb44698b9e060a659c8679b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.114655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c4b69b65-7943-448e-aa51-f8a7df60b6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0589f01c6bb44698b9e060a659c8679b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.132609 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4340/8699] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:14:52 2022] DELETE /identity/v3/users/0589f01c6bb44698b9e060a659c8679b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:53.376583 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:53.379276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:53.401170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55bffb-53f0-443a-8be6-923377dd291e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:53.471643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:53.472107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:53.472394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:53.472810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] PATH_INFO: `/v3/projects/519c294387a04ca5bcdeab3e4e574eb5` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:53.486103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=519c294387a04ca5bcdeab3e4e574eb5)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:53.488221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:53.506690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:53.559411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519c294387a04ca5bcdeab3e4e574eb5', 'request_id': 'req-9d03b280-5db3-4643-b829-a459d976cd2b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.571372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519c294387a04ca5bcdeab3e4e574eb5', 'request_id': 'req-9d03b280-5db3-4643-b829-a459d976cd2b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.589037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519c294387a04ca5bcdeab3e4e574eb5', 'request_id': 'req-9d03b280-5db3-4643-b829-a459d976cd2b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.603443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] The token cache is being invalidate because project 519c294387a04ca5bcdeab3e4e574eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:14:53.604141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.604532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9d03b280-5db3-4643-b829-a459d976cd2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:14:53.606332 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4360/8700] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:14:53 2022] DELETE /identity/v3/projects/519c294387a04ca5bcdeab3e4e574eb5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:53.611408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:53.611871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:53.612326 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:53.643240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:53.644589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:53.737620 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4341/8701] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:14:53.749585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:53.749898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:53.750135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:53.776134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:53.777475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:53.786236 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4361/8702] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:14:53.790900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:53.802616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b616a-ef40-4c0b-bfa7-d55bbc285278 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:53.810194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:53.810918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:53.811364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:53.811654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:53.812342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:14:53.812654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:53.814306 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:53.828867 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4342/8703] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:14:53.833784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:53.845076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cc44d-6a5c-4f18-a193-09d3f161f4a3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:53.851286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:53.852004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:53.852287 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:53.852578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:53.853555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:53.857470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:53.894332 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4362/8704] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:14:53 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:14:53.896510 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:53.908080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426af56-7764-427a-8882-f3704ca1a6e8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:53.922488 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:53.974988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:53.975608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:53.975882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:53.976255 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:53.976894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:53.978962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:54.002507 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4343/8705] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:14:53 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:14:54.007725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:54.019481 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca07d-06c4-4973-8b5c-be36eb80df4e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:54.024239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:54.024873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:54.025326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:54.025602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:54.026244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:54.027908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:54.038682 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4363/8706] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:14:54.042772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:54.053779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d3727-b7a6-4614-b61a-7a9c18f29498 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:54.059757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c66a0d-d5af-46f6-a7c5-c68ebcc4b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:54.060461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66a0d-d5af-46f6-a7c5-c68ebcc4b117 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:54.060749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66a0d-d5af-46f6-a7c5-c68ebcc4b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:54.061077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c66a0d-d5af-46f6-a7c5-c68ebcc4b117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:54.061745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c66a0d-d5af-46f6-a7c5-c68ebcc4b117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:54.063344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c66a0d-d5af-46f6-a7c5-c68ebcc4b117 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:54.078705 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4344/8707] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:14:54.079845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:54.094594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87918c-f388-4489-97c1-f74fd8f3ca5e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:54.100097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafba97-10fa-4721-898b-58f142b6b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:54.100794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafba97-10fa-4721-898b-58f142b6b6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:54.101252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafba97-10fa-4721-898b-58f142b6b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:54.101528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafba97-10fa-4721-898b-58f142b6b6e2 admin admin] PATH_INFO: `/v3/projects/bcd2ca89d6ca440692f7839338ee9da3/users/6a01ce5e835b4ecbb8639db9874517f5/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:54.121607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafba97-10fa-4721-898b-58f142b6b6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd2ca89d6ca440692f7839338ee9da3, user_id=6a01ce5e835b4ecbb8639db9874517f5, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:54.125547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafba97-10fa-4721-898b-58f142b6b6e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:54.151420 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4364/8708] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:14:54 2022] PUT /identity/v3/projects/bcd2ca89d6ca440692f7839338ee9da3/users/6a01ce5e835b4ecbb8639db9874517f5/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:54.158329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:54.158765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:54.159264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:54.186125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:54.187861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:54.255517 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4345/8709] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:14:54.264655 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c332f9-faf5-4c02-820e-e3ee5adc256f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:54.264982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c332f9-faf5-4c02-820e-e3ee5adc256f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:54.265268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c332f9-faf5-4c02-820e-e3ee5adc256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:54.317472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-62c332f9-faf5-4c02-820e-e3ee5adc256f None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:54.319581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-62c332f9-faf5-4c02-820e-e3ee5adc256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:54.375489 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4365/8710] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:14:54.381564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:54.392090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08433e4b-31bb-4576-b1c2-5c1e75b4dffd None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:54.396226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:54.397078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:54.397352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:54.397626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:54.411680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:54.415099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:54.426670 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4346/8711] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:14:59.222545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.223117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.225037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.271728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] MFA Rules not processed for user `6a01ce5e835b4ecbb8639db9874517f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:14:59.273982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:14:59.297746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:59.386625 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4366/8712] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:14:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:14:59.388023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:59.398993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6eef-a09d-495a-a99f-8c84d5bd5525 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:59.423678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:59.424364 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.424699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.425170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.426090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:59.428934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:59.462908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4347/8713] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:14:59 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:14:59.466776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:59.481262 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af2712-7a5b-45ae-a567-19380521fb72 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:59.564088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:59.564709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.565032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.565314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.565977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:59.567934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:59.594880 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4367/8714] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:14:59 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:14:59.597738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:59.608849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7cdb9-5104-496f-a7f1-eb82c695fa79 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:59.613390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:59.613983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.614264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.614539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.615180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:59.616765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:59.627558 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4348/8715] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:14:59.631813 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:59.641915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e140ce-991d-4ef7-9e57-4de3c05e7112 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:59.646566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:59.647218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.647502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.647782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] PATH_INFO: `/v3/projects/f6a21383a93d439a930235e08ca9bffc/users/2f912483147f473cbdbe2a2e0cf49136/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.665993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a21383a93d439a930235e08ca9bffc, user_id=2f912483147f473cbdbe2a2e0cf49136, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:59.668664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:59.682567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4368/8716] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:14:59 2022] PUT /identity/v3/projects/f6a21383a93d439a930235e08ca9bffc/users/2f912483147f473cbdbe2a2e0cf49136/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:14:59.686772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:59.697263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244616-2072-4f6a-ba89-ea674c15ed22 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:59.752694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:14:59.763245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ce5cb-397c-4594-98ce-08b75585b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:59.763855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ce5cb-397c-4594-98ce-08b75585b563 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.764138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ce5cb-397c-4594-98ce-08b75585b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.764417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ce5cb-397c-4594-98ce-08b75585b563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.765139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ce5cb-397c-4594-98ce-08b75585b563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:59.766731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ce5cb-397c-4594-98ce-08b75585b563 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:59.777129 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4349/8717] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:14:59.781271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:14:59.792328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae783424-437d-43dc-a0d0-1bc825233f00 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:14:59.796891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:14:59.797567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:14:59.797850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:14:59.798129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] PATH_INFO: `/v3/projects/f6a21383a93d439a930235e08ca9bffc/users/2f912483147f473cbdbe2a2e0cf49136/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:14:59.800036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a21383a93d439a930235e08ca9bffc, user_id=2f912483147f473cbdbe2a2e0cf49136, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:14:59.802709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:14:59.812793 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4369/8718] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:14:59 2022] PUT /identity/v3/projects/f6a21383a93d439a930235e08ca9bffc/users/2f912483147f473cbdbe2a2e0cf49136/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:05.375461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa614c-3f4e-45e8-ae7b-2bb046898392 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:05.375963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa614c-3f4e-45e8-ae7b-2bb046898392 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:05.376072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa614c-3f4e-45e8-ae7b-2bb046898392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:05.420532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0daa614c-3f4e-45e8-ae7b-2bb046898392 None None] MFA Rules not processed for user `2f912483147f473cbdbe2a2e0cf49136`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:05.422642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0daa614c-3f4e-45e8-ae7b-2bb046898392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:05.524840 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4350/8719] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:05.534621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:05.536678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:05.638560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ca82e-6bcb-4eea-a82c-325e11de8e03 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:05.645409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:05.646423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:05.646423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:05.646669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:05.655670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:05.658158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:05.659825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:05.672861 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4370/8720] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:05.727585 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:05.727963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:05.728312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:05.750461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] MFA Rules not processed for user `6a01ce5e835b4ecbb8639db9874517f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:05.751843 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:05.831325 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4351/8721] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:06.191179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:06.270714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387181-be93-4adc-ae1c-2a27db92eb90 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:06.275172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:06.275797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:06.276085 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:06.276365 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:06.279333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:06.293259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:06.294822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:06.306784 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4371/8722] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:07.724842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:07.726498 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:07.869753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbabb0e-7ad0-4e54-9ce4-c672c8e46d48 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:07.880937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:07.881900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:07.882350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:07.883804 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:07.887392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:07.905830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:07.907507 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:07.923262 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4352/8723] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:10.917241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:10.979041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b279370-ea90-4fda-8392-c0f65a5f84f6 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:10.983158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:10.983770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:10.984054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:10.984329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:10.986617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:11.032206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:11.033874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:11.046122 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4372/8724] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:11.849522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:11.853851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:11.869575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:11.943356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4805b-8fdf-4dc2-8b52-8fe2587e6633 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:11.951445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:11.952428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:11.952937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:11.953423 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:11.955997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:11.974820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:11.977393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e8a2b-4e6c-490f-8534-4650fcf03af7 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:12.004948 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4353/8725] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:18.485832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:18.523402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c99f67-dab6-4f32-92cb-fb54837044db service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:18.540297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:18.542096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:18.542400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:18.542747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:18.544747 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:18.564371 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:18.566297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:18.583919 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4373/8726] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:21.402922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:21.403413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:21.403536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:21.424320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] MFA Rules not processed for user `6a01ce5e835b4ecbb8639db9874517f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:21.425817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:21.433804 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4354/8727] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:21.695675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:21.706800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf984f-68ba-4762-bc33-e711899c6627 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:21.711408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:21.712017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:21.712298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:21.712574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:21.714334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:21.728331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:21.730691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95f2d5-4afa-4a4f-972a-1a1c544ca50e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:21.743363 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4374/8728] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:15:22.829286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:22.830848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:22.900228 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5c3d-9522-439c-86ad-e00ff3fa18c3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:22.905839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:22.906490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:22.906777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:22.907062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] PATH_INFO: `/v3/users/91a095f4acf547b0baf3f5d8e39b4b96` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:22.908238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a095f4acf547b0baf3f5d8e39b4b96)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:22.910246 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:22.959312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a095f4acf547b0baf3f5d8e39b4b96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:22.971935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a095f4acf547b0baf3f5d8e39b4b96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:22.972702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a095f4acf547b0baf3f5d8e39b4b96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:22.982063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a095f4acf547b0baf3f5d8e39b4b96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:22.982935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-75cad8f5-6f9a-4cbe-86d4-e56999fd6611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a095f4acf547b0baf3f5d8e39b4b96'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:22.996184 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4355/8729] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:15:22 2022] DELETE /identity/v3/users/91a095f4acf547b0baf3f5d8e39b4b96 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:23.000704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:23.001211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:23.001443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:23.030254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:23.031776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:23.100418 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4375/8730] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:23.110541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:23.110911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:23.111256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:23.133941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:23.135509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:23.167232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:23.228472 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4356/8731] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 03:15:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:23.241799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:23.255594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be843ba5-6219-4989-9fcc-afe241ab629d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:23.264022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89293c3-a6fb-40f5-ac00-80b2a0848a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:23.264680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89293c3-a6fb-40f5-ac00-80b2a0848a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:23.264995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89293c3-a6fb-40f5-ac00-80b2a0848a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:23.265275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89293c3-a6fb-40f5-ac00-80b2a0848a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:23.276329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89293c3-a6fb-40f5-ac00-80b2a0848a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:23.278020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89293c3-a6fb-40f5-ac00-80b2a0848a19 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:23.292154 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4376/8732] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:23.843254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:23.844817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:23.861731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80930cea-f9a9-406f-813f-7989648f79b8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:23.866556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:23.868211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:23.868812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:23.868812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] PATH_INFO: `/v3/projects/95aa9473c46b47a99b41cc65fd51f1de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:23.870275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95aa9473c46b47a99b41cc65fd51f1de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:23.872318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:23.976187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95aa9473c46b47a99b41cc65fd51f1de', 'request_id': 'req-92d09b3e-a347-43e5-b7f9-49038adf3902'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:23.994836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95aa9473c46b47a99b41cc65fd51f1de', 'request_id': 'req-92d09b3e-a347-43e5-b7f9-49038adf3902'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:24.003714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95aa9473c46b47a99b41cc65fd51f1de', 'request_id': 'req-92d09b3e-a347-43e5-b7f9-49038adf3902'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:24.018064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] The token cache is being invalidate because project 95aa9473c46b47a99b41cc65fd51f1de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:15:24.018370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:24.019070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-92d09b3e-a347-43e5-b7f9-49038adf3902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:24.025278 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4357/8733] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:15:23 2022] DELETE /identity/v3/projects/95aa9473c46b47a99b41cc65fd51f1de => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:24.026603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.027062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.027141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.072828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:24.074178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:24.110713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:24.178689 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4377/8734] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:15:24.187279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.187546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.187827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.210406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:24.211787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:24.224121 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4358/8735] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:24.225075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.235670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e3178-0315-4ac6-88b9-0cf8f925eaad None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.241029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.242554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.242554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.242864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.243645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:15:24.244426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.246083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.258992 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4378/8736] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:15:24.264192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.274084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875f3b2-2cd9-47d5-8a65-e23884d9b5d3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.278872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.279420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.279706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.280015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.280650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.282608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.319116 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4359/8737] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:15:24 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:15:24.320953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.332570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bea470-69a7-4818-bbf6-eee5a23201b1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.403947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.404572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.405309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.405309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.405987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.408334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.433186 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4379/8738] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:15:24 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:15:24.437399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.449402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ce684-6add-4aac-8ce7-99c84bcf6075 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.454960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.455579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.455868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.456144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.456813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.458594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.469642 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4360/8739] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:15:24.473777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.493822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af06c-5302-48e8-840f-2ff108e611b3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.499340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846be47d-86af-460f-ad5c-21b6ccf8bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.499892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846be47d-86af-460f-ad5c-21b6ccf8bef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.500170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846be47d-86af-460f-ad5c-21b6ccf8bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.500562 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846be47d-86af-460f-ad5c-21b6ccf8bef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.501248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846be47d-86af-460f-ad5c-21b6ccf8bef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.502958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846be47d-86af-460f-ad5c-21b6ccf8bef2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.515702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4380/8740] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:15:24.519637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.531426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6cc3c-918a-45ae-a96f-0376430df19c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.536602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.537311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.537600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.537882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] PATH_INFO: `/v3/projects/08d3a8fbab994baa993e2e4b20a9df43/users/a9aa70e1e7424553a51aa91e215b093e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.553533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d3a8fbab994baa993e2e4b20a9df43, user_id=a9aa70e1e7424553a51aa91e215b093e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.556413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.569531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4361/8741] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:15:24 2022] PUT /identity/v3/projects/08d3a8fbab994baa993e2e4b20a9df43/users/a9aa70e1e7424553a51aa91e215b093e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:15:24.581123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05736364-f1de-411d-93db-700ce87ed22b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.581507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05736364-f1de-411d-93db-700ce87ed22b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.581964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05736364-f1de-411d-93db-700ce87ed22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.611329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-05736364-f1de-411d-93db-700ce87ed22b None None] MFA Rules not processed for user `a9aa70e1e7424553a51aa91e215b093e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:24.612545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-05736364-f1de-411d-93db-700ce87ed22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:24.684595 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4381/8742] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:24.695684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:24.697371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:24.756819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:24.792267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc40b3-1ded-414a-93a9-072dc4f50d94 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:24.796421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:24.797144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:24.797492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:24.797832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:24.806979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:24.808417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:24.817336 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4362/8743] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:26.191677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd2e2f-8c2b-4e02-a557-3ec318160207 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:26.192172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd2e2f-8c2b-4e02-a557-3ec318160207 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:26.192252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd2e2f-8c2b-4e02-a557-3ec318160207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:26.211393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-acbd2e2f-8c2b-4e02-a557-3ec318160207 None None] MFA Rules not processed for user `a9aa70e1e7424553a51aa91e215b093e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:26.212669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-acbd2e2f-8c2b-4e02-a557-3ec318160207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:26.221120 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4382/8744] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:34.813286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:36.205769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:38.840307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:38.841786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:38.932216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2761e2e-9455-4979-8d35-4d43d12fd154 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:38.937185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:38.937789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:38.938069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:38.938343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:38.940025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:38.954586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:38.956193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:38.969231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4363/8745] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:43.537755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0cb4-8051-4bfc-a755-41b396a74407 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:43.538192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0cb4-8051-4bfc-a755-41b396a74407 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:43.538430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf0cb4-8051-4bfc-a755-41b396a74407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:43.589110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-39cf0cb4-8051-4bfc-a755-41b396a74407 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:43.590323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-39cf0cb4-8051-4bfc-a755-41b396a74407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:43.663105 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4383/8746] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:43.707363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:43.708920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:43.780332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14452-bbaa-4ddc-b9ae-71ede1a7da58 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:43.785851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:43.786450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:43.786730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:43.787004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:43.795575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:43.797175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:43.804965 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4364/8747] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:15:44.274802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0073c3-b66b-46b1-affc-ca5ba8c93469 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:44.275089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0073c3-b66b-46b1-affc-ca5ba8c93469 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:44.275368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0073c3-b66b-46b1-affc-ca5ba8c93469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:44.295280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9c0073c3-b66b-46b1-affc-ca5ba8c93469 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:44.296477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9c0073c3-b66b-46b1-affc-ca5ba8c93469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:44.303567 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4384/8748] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:15:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:44.315808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:44.332783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d0569-88e4-4584-87cd-c5b2f369d536 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:44.339602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:44.340217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:44.340501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:44.340778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:44.349393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:44.351019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:44.360299 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4365/8749] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:15:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:15:44.605694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904ee5-47ef-401e-9608-2ab0ca42a5ca None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:44.606180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904ee5-47ef-401e-9608-2ab0ca42a5ca None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:44.606394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26904ee5-47ef-401e-9608-2ab0ca42a5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:44.626465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-26904ee5-47ef-401e-9608-2ab0ca42a5ca None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:44.627777 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-26904ee5-47ef-401e-9608-2ab0ca42a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:44.636395 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4385/8750] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:15:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:44.649778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:44.672292 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad234d52-b058-4360-97b3-8a6bf02b3268 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:44.678316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:44.678941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:44.679226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:44.679505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:44.690006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:44.691622 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:44.700498 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4366/8751] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:15:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:15:45.044319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:45.044758 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:45.045066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:45.065663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:45.066811 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:45.075085 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4386/8752] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:15:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:45.088776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:45.102002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0cc85-3d75-4845-8c7a-61b992aecb98 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:45.107159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:45.107762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:45.108046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:45.108322 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:45.116715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:45.119132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:45.127976 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4367/8753] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:15:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:15:47.908215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:47.909731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:47.936598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d4b72-86ca-4b31-8073-c4601ce3833d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:47.941860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:47.942475 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:47.942754 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:47.943200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:47.945654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:47.965654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:47.970455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded133b-4303-4dcc-8a20-a7ea11870d9b service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:47.999313 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4387/8754] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:48.428803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:48.464128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:48.503281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699d205-ac27-460e-ba8f-517d97393f09 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:48.508606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:48.509501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:48.510088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:48.511761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] PATH_INFO: `/v3/users/a9aa70e1e7424553a51aa91e215b093e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:48.513338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9aa70e1e7424553a51aa91e215b093e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:48.515554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:48.585119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9aa70e1e7424553a51aa91e215b093e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:48.603349 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9aa70e1e7424553a51aa91e215b093e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:48.604111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9aa70e1e7424553a51aa91e215b093e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:48.613738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9aa70e1e7424553a51aa91e215b093e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:48.614455 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9aa70e1e7424553a51aa91e215b093e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:48.635668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4368/8755] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:15:48 2022] DELETE /identity/v3/users/a9aa70e1e7424553a51aa91e215b093e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:48.640459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:48.641122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:48.641584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:48.677704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:48.678940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:48.744811 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4388/8756] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:48.755037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:48.756654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:48.823336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb8ed8-1d68-4aab-9b42-1f24ae90671a admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:48.827927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc729c-f294-472c-ae50-cf98f1b30e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:48.828126 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc729c-f294-472c-ae50-cf98f1b30e44 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:48.828479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc729c-f294-472c-ae50-cf98f1b30e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:48.828831 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc729c-f294-472c-ae50-cf98f1b30e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:48.839587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc729c-f294-472c-ae50-cf98f1b30e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:48.841160 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc729c-f294-472c-ae50-cf98f1b30e44 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:48.853446 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4369/8757] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:49.114134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.115668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:49.140209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e1a42-0505-44df-a656-2406bb5470aa None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.177705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.178642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.179070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.179690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] PATH_INFO: `/v3/projects/08d3a8fbab994baa993e2e4b20a9df43` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.181155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d3a8fbab994baa993e2e4b20a9df43)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.183428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.227375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:49.249375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d3a8fbab994baa993e2e4b20a9df43', 'request_id': 'req-bbea9ecc-06df-486c-830c-5b775900d10f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:49.255578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d3a8fbab994baa993e2e4b20a9df43', 'request_id': 'req-bbea9ecc-06df-486c-830c-5b775900d10f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:49.262534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d3a8fbab994baa993e2e4b20a9df43', 'request_id': 'req-bbea9ecc-06df-486c-830c-5b775900d10f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:49.278067 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] The token cache is being invalidate because project 08d3a8fbab994baa993e2e4b20a9df43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:15:49.278607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:49.279443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bbea9ecc-06df-486c-830c-5b775900d10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:49.281318 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4389/8758] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:15:49 2022] DELETE /identity/v3/projects/08d3a8fbab994baa993e2e4b20a9df43 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:49.289912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.290220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.290468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.312533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:49.313780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:49.375854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:49.401982 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4370/8759] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:49.410115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.410413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.410694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.437366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:49.454117 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:49.478500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4390/8760] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:49.480591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.493967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443029-6aba-41e9-8bc3-c398d4d20cae None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.504490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.505250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.505532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.505806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.506491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:15:49.506808 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.509396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.521427 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4371/8761] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:15:49.526088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.536197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0eb25-659c-4ee6-af63-1aaab2c1af2c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.564589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.565251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.565700 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.565986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.566644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.568570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.624875 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4391/8762] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:15:49 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:15:49.629040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.640131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfccc9-a39b-4950-b3d2-adfc781845bb admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.723680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.726214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.726214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.726214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.726214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.733037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.759665 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4372/8763] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:15:49 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:15:49.764170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.775862 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60798f7a-1443-486c-80fe-992832c5fd1d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.780797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.781439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.781879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.782329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.782981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.784814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.798118 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4392/8764] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:15:49.803615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.827250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdc8da-3c34-4294-a426-1dfed4b26d5c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.834167 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5841-fee6-4258-a355-4d8cba401f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.834879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5841-fee6-4258-a355-4d8cba401f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.835170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5841-fee6-4258-a355-4d8cba401f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.835766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5841-fee6-4258-a355-4d8cba401f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.836823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5841-fee6-4258-a355-4d8cba401f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.839634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5841-fee6-4258-a355-4d8cba401f51 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.858836 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4373/8765] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:15:49.859101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:49.871032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efbcb8-9398-4748-b9d5-f48292528db1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:49.876873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:49.877701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.878051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.878397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] PATH_INFO: `/v3/projects/713e3a431a2441548123f404b23ce0da/users/ee8daf94c54c4dd7b69310674d73211a/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.910351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713e3a431a2441548123f404b23ce0da, user_id=ee8daf94c54c4dd7b69310674d73211a, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:49.915757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:49.932062 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4393/8766] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:15:49 2022] PUT /identity/v3/projects/713e3a431a2441548123f404b23ce0da/users/ee8daf94c54c4dd7b69310674d73211a/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:15:49.937471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:49.937972 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:49.938346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:49.959729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:49.961725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:50.029905 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4374/8767] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:15:50.040136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:50.042130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:50.108554 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b83a-d0d8-4bcb-9301-2ce03ef6a9d3 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:50.112233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:50.112846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:50.113204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:50.113486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:50.131975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:50.140151 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:50.156301 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4394/8768] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:15:51.749944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:51.751613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:51.770312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460bfb-4ca5-46e4-befa-4aff67d37cb5 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:51.775774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:51.776690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:51.777100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:51.777471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] PATH_INFO: `/v3/users/6a01ce5e835b4ecbb8639db9874517f5` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:51.779155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a01ce5e835b4ecbb8639db9874517f5)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:51.781330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:51.836983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a01ce5e835b4ecbb8639db9874517f5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:51.842989 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:51.855269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a01ce5e835b4ecbb8639db9874517f5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:51.856718 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a01ce5e835b4ecbb8639db9874517f5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:51.869878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a01ce5e835b4ecbb8639db9874517f5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:51.870820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a01ce5e835b4ecbb8639db9874517f5'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:51.891320 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4375/8769] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:15:51 2022] DELETE /identity/v3/users/6a01ce5e835b4ecbb8639db9874517f5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:52.090165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:52.100182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774c96c-ef25-4f75-9468-abb5956764bd service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:52.178019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:52.191173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:52.193354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:52.193732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:52.193900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] PATH_INFO: `/v3/projects/bcd2ca89d6ca440692f7839338ee9da3` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:52.195678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd2ca89d6ca440692f7839338ee9da3)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:52.197848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:52.254771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd2ca89d6ca440692f7839338ee9da3', 'request_id': 'req-edfb0c17-8716-4b91-ac87-8491725f69e8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.261940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd2ca89d6ca440692f7839338ee9da3', 'request_id': 'req-edfb0c17-8716-4b91-ac87-8491725f69e8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.270155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd2ca89d6ca440692f7839338ee9da3', 'request_id': 'req-edfb0c17-8716-4b91-ac87-8491725f69e8'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.297225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] The token cache is being invalidate because project bcd2ca89d6ca440692f7839338ee9da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:15:52.297524 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.298211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.299744 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4395/8770] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:15:52 2022] DELETE /identity/v3/projects/bcd2ca89d6ca440692f7839338ee9da3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:52.303720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:52.305773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:52.321570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d140d31-9425-444f-864c-61ff2dcc7218 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:52.405229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:52.406951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:52.407321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:52.408411 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] PATH_INFO: `/v3/users/2f912483147f473cbdbe2a2e0cf49136` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:52.410597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f912483147f473cbdbe2a2e0cf49136)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:52.413280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:52.489992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f912483147f473cbdbe2a2e0cf49136'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.506379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f912483147f473cbdbe2a2e0cf49136'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.507437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f912483147f473cbdbe2a2e0cf49136'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.524565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f912483147f473cbdbe2a2e0cf49136'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.525314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2a9626a6-3a24-4b9d-ac95-61546a777237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f912483147f473cbdbe2a2e0cf49136'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:52.541917 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4376/8771] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:15:52 2022] DELETE /identity/v3/users/2f912483147f473cbdbe2a2e0cf49136 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:52.809290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:52.810829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:52.828550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb0c17-8716-4b91-ac87-8491725f69e8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:52.902518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:52.903213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:52.903486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:52.903775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] PATH_INFO: `/v3/projects/f6a21383a93d439a930235e08ca9bffc` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:52.905352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a21383a93d439a930235e08ca9bffc)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:52.907196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:53.000044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a21383a93d439a930235e08ca9bffc', 'request_id': 'req-40af9ccf-9225-404d-8102-713ef28713f5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:53.006199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a21383a93d439a930235e08ca9bffc', 'request_id': 'req-40af9ccf-9225-404d-8102-713ef28713f5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:53.015568 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a21383a93d439a930235e08ca9bffc', 'request_id': 'req-40af9ccf-9225-404d-8102-713ef28713f5'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:53.032718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] The token cache is being invalidate because project f6a21383a93d439a930235e08ca9bffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:15:53.033066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:53.034420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:15:53.036129 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4396/8772] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:15:52 2022] DELETE /identity/v3/projects/f6a21383a93d439a930235e08ca9bffc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:55.296729 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.297320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.297716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.354021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:15:55.355696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:55.403047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:55.441610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4377/8773] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:15:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:15:55.447256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:55.448781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:15:55.467817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:15:55.515439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9ccf-9225-404d-8102-713ef28713f5 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:55.520056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:55.520663 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.520982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.521264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.521907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:55.524622 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:55.551270 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4397/8774] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:15:55 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:15:55.556043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:55.566774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafe04a-42a3-4541-83d5-d42df347b982 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:55.623877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:55.623877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.624081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.624332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.625002 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:55.626944 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:55.651281 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4378/8775] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:15:55 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:15:55.655406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:55.667190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b3adb-45a8-4ef1-afda-f8a11777d695 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:55.672108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:55.672717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.673028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.673306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.673950 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:55.675590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:55.686035 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4398/8776] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:15:55.690279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:55.701447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957545-f264-4fc5-a649-0a0a25c53f7f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:55.706180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:55.706866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.707151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.707429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] PATH_INFO: `/v3/projects/3c5fca607688484fb1a5c90110aa3570/users/7a0039a3d6d042018a713e89b63e5fc4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.724530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5fca607688484fb1a5c90110aa3570, user_id=7a0039a3d6d042018a713e89b63e5fc4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:55.727923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:55.741723 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4379/8777] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:15:55 2022] PUT /identity/v3/projects/3c5fca607688484fb1a5c90110aa3570/users/7a0039a3d6d042018a713e89b63e5fc4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:15:55.745639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:55.755686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c8356-91a4-4ffc-a207-065cf44a5129 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:55.812119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaeca76-4169-45b6-be39-07898f3e92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:55.812739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeca76-4169-45b6-be39-07898f3e92e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.813057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeca76-4169-45b6-be39-07898f3e92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.813335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaeca76-4169-45b6-be39-07898f3e92e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.813977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeca76-4169-45b6-be39-07898f3e92e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:55.815582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaeca76-4169-45b6-be39-07898f3e92e9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:55.826252 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4399/8778] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:15:55.830463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:15:55.841467 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173bd81-b705-42ab-8d51-a7535a875d96 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:15:55.846195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5202c-cbd4-477d-ba43-cc667d8bf74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:15:55.846848 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5202c-cbd4-477d-ba43-cc667d8bf74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:15:55.847130 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5202c-cbd4-477d-ba43-cc667d8bf74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:15:55.847408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5202c-cbd4-477d-ba43-cc667d8bf74a admin admin] PATH_INFO: `/v3/projects/3c5fca607688484fb1a5c90110aa3570/users/7a0039a3d6d042018a713e89b63e5fc4/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:15:55.849394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5202c-cbd4-477d-ba43-cc667d8bf74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5fca607688484fb1a5c90110aa3570, user_id=7a0039a3d6d042018a713e89b63e5fc4, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:15:55.852046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5202c-cbd4-477d-ba43-cc667d8bf74a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:15:55.864879 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4380/8779] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:15:55 2022] PUT /identity/v3/projects/3c5fca607688484fb1a5c90110aa3570/users/7a0039a3d6d042018a713e89b63e5fc4/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:16:00.188530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:00.189095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:00.189095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:00.224173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] MFA Rules not processed for user `7a0039a3d6d042018a713e89b63e5fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:16:00.228453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:00.320954 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4400/8780] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:16:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:16:00.331678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:00.332516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:00.332780 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:00.384169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] MFA Rules not processed for user `b074e2c621494cdfa6efc21e4a5c021b`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:16:00.385604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:00.445983 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4381/8781] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Oct 5 03:16:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:16:00.451677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:16:00.463928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6bb04-a165-435a-84c8-9c223df67742 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:16:00.470181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b7168-807f-4d9f-b757-cf90b627d36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:16:00.470635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7168-807f-4d9f-b757-cf90b627d36d service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:00.470922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7168-807f-4d9f-b757-cf90b627d36d service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:00.471198 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b7168-807f-4d9f-b757-cf90b627d36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:00.482728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b7168-807f-4d9f-b757-cf90b627d36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:16:00.484293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b7168-807f-4d9f-b757-cf90b627d36d service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:16:00.489293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:00.509107 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4401/8782] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:16:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:16:00.599564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:16:00.608308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2846f19-1bb5-4eac-b18d-3017d7d05aee None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:16:00.612073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b8bb-eef8-48db-ba80-f28815bce04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:16:00.612695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b8bb-eef8-48db-ba80-f28815bce04e service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:00.613010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b8bb-eef8-48db-ba80-f28815bce04e service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:00.613294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b8bb-eef8-48db-ba80-f28815bce04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:00.640877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:00.680807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b8bb-eef8-48db-ba80-f28815bce04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:16:00.682347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b8bb-eef8-48db-ba80-f28815bce04e service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:16:00.693784 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4382/8783] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:16:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:16:02.164285 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:02.164817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:02.164817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:02.186787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:16:02.188000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:02.195019 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4402/8784] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:16:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:16:02.918781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb279f-40ee-492d-b3c2-f98646e9d0d4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:02.919400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb279f-40ee-492d-b3c2-f98646e9d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:02.919400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb279f-40ee-492d-b3c2-f98646e9d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:02.978899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e8eb279f-40ee-492d-b3c2-f98646e9d0d4 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:16:02.980483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8eb279f-40ee-492d-b3c2-f98646e9d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:03.051691 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4383/8785] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:16:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:16:03.065102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:16:03.066498 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:03.085974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e593f-f9c3-4b2b-8369-c042e0eabc10 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:16:03.091082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88608bb3-1ee6-496f-add1-24ee7b6147a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:16:03.092012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88608bb3-1ee6-496f-add1-24ee7b6147a6 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:03.092361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88608bb3-1ee6-496f-add1-24ee7b6147a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:03.092737 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88608bb3-1ee6-496f-add1-24ee7b6147a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:03.101997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88608bb3-1ee6-496f-add1-24ee7b6147a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:16:03.103879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88608bb3-1ee6-496f-add1-24ee7b6147a6 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:16:03.114907 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4403/8786] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:16:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:16:13.042481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=51 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:13.110718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:33.399840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:33.400367 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:33.400465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:33.420768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:16:33.422007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:33.429990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4384/8787] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:16:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:16:34.114132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:34.114848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:34.114940 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:34.146264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:16:34.147534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:34.156298 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4404/8788] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:16:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:16:34.172276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:16:34.172276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:34.187893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a7cdb-ef53-4878-9e5c-7f3530a3d86e None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:16:34.192812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086511d1-b000-4fa8-ba01-2c9585ae8ed4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:16:34.193442 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086511d1-b000-4fa8-ba01-2c9585ae8ed4 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:34.193727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086511d1-b000-4fa8-ba01-2c9585ae8ed4 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:34.194003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086511d1-b000-4fa8-ba01-2c9585ae8ed4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:34.202155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086511d1-b000-4fa8-ba01-2c9585ae8ed4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:16:34.203734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086511d1-b000-4fa8-ba01-2c9585ae8ed4 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:16:34.213406 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4385/8789] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:16:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:16:44.140964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:44.209746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:16:49.607817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:16:49.621732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd111b-f955-4cc2-82fc-908914fd5490 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:16:49.626987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:16:49.627600 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:16:49.627884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:16:49.628164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:16:49.629945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:16:49.645071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:16:49.647853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:16:49.661429 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4405/8790] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:16:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:16:59.653961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:16.878456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:17:16.879032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:17:16.879032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:17:16.897875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:17:16.899080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:17:16.906197 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4386/8791] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:17:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:17:16.945845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:17:16.954859 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a3ec-bd38-45ce-bae8-b7d21cda97f2 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:17:16.958551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:17:16.959145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:17:16.959426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:17:16.959703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:17:16.961533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:17:17.048098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:17:17.049590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:17:17.063769 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4406/8792] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:17:17.672435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:17:17.673919 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:17:17.748151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03983d59-6f4c-4df4-9d02-e62a20584447 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:17:17.751783 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:17:17.752570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:17:17.752856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:17:17.753157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:17:17.755425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:17:17.772812 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:17:17.774277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b56fff-ba1c-4e1c-8a1b-8045a26b33d6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:17:17.787748 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4387/8793] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:17:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:17:27.056652 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=39 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:27.780284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=34 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:17:43.895450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:17:43.905208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfdcd0-0c3a-4839-b1ae-73a9408f0c76 service cinder] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:17:43.908936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:17:43.910060 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:17:43.910337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:17:43.910611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:17:43.912496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:17:43.924871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:17:43.927174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4df51-cd97-40bd-a81d-ef4526b84585 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:17:43.938582 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4407/8794] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:17:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:17:53.931689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:16.851928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688ac6a-c2ab-46c9-83f5-05335f263b6c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:18:16.852482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688ac6a-c2ab-46c9-83f5-05335f263b6c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:18:16.852482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688ac6a-c2ab-46c9-83f5-05335f263b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:18:16.873066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1688ac6a-c2ab-46c9-83f5-05335f263b6c None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:18:16.874438 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1688ac6a-c2ab-46c9-83f5-05335f263b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:18:16.881456 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4388/8795] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:18:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:18:26.867645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:37.454458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:18:37.454932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:18:37.455200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:18:37.475548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:18:37.476817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:18:37.535802 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4408/8796] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:18:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:18:37.583091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd80f-fdf5-48c3-92d0-a55e45042441 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:18:37.583567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd80f-fdf5-48c3-92d0-a55e45042441 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:18:37.583678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd80f-fdf5-48c3-92d0-a55e45042441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:18:37.623385 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c17fd80f-fdf5-48c3-92d0-a55e45042441 None None] MFA Rules not processed for user `4c0d9417ce05468695abebca3b0abde3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:18:37.624609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c17fd80f-fdf5-48c3-92d0-a55e45042441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:18:37.689500 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4389/8797] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Oct 5 03:18:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:18:37.696367 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:18:37.708820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c0f1-05fb-4c74-ac7c-eb70a19a68ba None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:18:37.713910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf7fed-b04b-494e-978b-4ae76a93e719 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:18:37.714528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7fed-b04b-494e-978b-4ae76a93e719 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:18:37.714816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7fed-b04b-494e-978b-4ae76a93e719 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:18:37.715095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf7fed-b04b-494e-978b-4ae76a93e719 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:18:37.724348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7fed-b04b-494e-978b-4ae76a93e719 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:18:37.725984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf7fed-b04b-494e-978b-4ae76a93e719 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:18:37.734167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4409/8798] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:18:39.010272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:18:39.010706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:18:39.010809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:18:39.031108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:18:39.032307 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:18:39.039441 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4390/8799] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:18:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:18:47.731126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=31 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:18:49.026194 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=38 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:33.015577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971621-4e7b-4a23-be6b-1d32450b7c5a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:19:33.016119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971621-4e7b-4a23-be6b-1d32450b7c5a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:19:33.016584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971621-4e7b-4a23-be6b-1d32450b7c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:19:33.045770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ff971621-4e7b-4a23-be6b-1d32450b7c5a None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:19:33.047012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ff971621-4e7b-4a23-be6b-1d32450b7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:19:33.054670 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4410/8800] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:19:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:19:33.071527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:19:33.085013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cacdb3-eb8e-4a90-8e28-7f1c9fa3e7a7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:19:33.090583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:19:33.091185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:19:33.091463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:19:33.091733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:19:33.100645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:19:33.102387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:19:33.110940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4391/8801] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:19:43.039571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:43.107251 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:19:49.703150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:19:49.703680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:19:49.703680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:19:49.722977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:19:49.724268 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:19:49.731354 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4411/8802] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:19:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:19:59.717211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:20:10.501469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:20:10.502921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:20:10.521269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffdd5c-2842-4fe1-ac1f-54a3baeee8fa service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:20:10.527386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:20:10.527985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:20:10.528264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:20:10.528538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:20:10.530268 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:20:10.546006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:20:10.547653 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:20:10.561543 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4392/8803] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:20:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:20:20.554169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:20:44.440052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:20:44.454590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affdf2b-e933-4f31-bbd4-427d485d340b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:20:44.459372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:20:44.459965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:20:44.460243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:20:44.460517 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:20:44.462248 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:20:44.476180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:20:44.477780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:20:44.490748 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4412/8804] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:20:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:20:54.484103 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:21:52.544078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:21:52.568151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5e2b-dea5-4a8e-b676-749fef55394f service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:21:52.573206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:21:52.573801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:21:52.574915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:21:52.575193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:21:52.586659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:21:52.588248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:21:52.601769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4393/8805] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:21:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:02.594647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:05.927610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:05.929192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:22:05.956390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bd087-1034-4448-ac61-97777c89c530 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:05.961975 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e6c8-d139-43f8-a9dc-842ad7169f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:05.962572 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e6c8-d139-43f8-a9dc-842ad7169f53 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:05.962855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e6c8-d139-43f8-a9dc-842ad7169f53 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:05.963133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e6c8-d139-43f8-a9dc-842ad7169f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:05.971332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e6c8-d139-43f8-a9dc-842ad7169f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:05.972892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e6c8-d139-43f8-a9dc-842ad7169f53 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:05.982433 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4413/8806] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:08.980548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:08.996564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7080750-2510-41b4-a5d0-488c6011b8a5 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:09.003395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:09.003997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:09.004452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:09.004925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:09.008290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:22:09.027069 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:09.029418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:09.044238 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4394/8807] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:14.269546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:14.270024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:14.270200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:14.289199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:22:14.290402 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:22:14.297421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4414/8808] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:22:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:22:14.606890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:14.627205 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad20be-7517-4c56-b632-612538aa9167 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:14.631329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:14.631937 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:14.632223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:14.632500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:14.634295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:22:14.647298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:14.648710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:14.659937 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4395/8809] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:15.121398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:15.136449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501344c-88f0-426a-9ffa-10bff5c41677 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:15.141996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:15.142606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:15.142886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:15.143163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:15.152081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:15.153755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:15.164866 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4415/8810] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:17.355025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:17.364915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b266-0f04-4c1e-a3ba-1435c1abc02f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:17.369728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:17.370289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:17.370636 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:17.370997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:17.390533 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:17.392447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:17.409324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4396/8811] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:19.933256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:19.949601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f09a23-54a8-4ec6-bc97-e7bb376b56c6 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:19.953843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:19.954469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:19.954752 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:19.955025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:19.969180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:19.970628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:19.985504 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4416/8812] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:22:27.399954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=22 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:29.977190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=25 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:31.000097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:31.016107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5270477-2f73-48d6-af15-c9cecdca7c33 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:31.022254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:31.022912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:31.023256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:31.023594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:31.025518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:22:31.040203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:31.041873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:31.055736 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4397/8813] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:33.544345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:33.553322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da66d-f31c-49be-8030-f0abb715f752 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:33.556953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58a209-9f6b-4db4-bfb5-f33f6d494254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:33.557550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58a209-9f6b-4db4-bfb5-f33f6d494254 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:33.557837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58a209-9f6b-4db4-bfb5-f33f6d494254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:33.558118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58a209-9f6b-4db4-bfb5-f33f6d494254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:33.567093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58a209-9f6b-4db4-bfb5-f33f6d494254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:33.568520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58a209-9f6b-4db4-bfb5-f33f6d494254 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:33.578027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4417/8814] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:41.048870 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:43.573743 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:22:53.824526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:53.834352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd44e2d-e4ca-4e9d-b5b5-620a00d6f430 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:53.837959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:53.838553 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:53.838836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:53.839109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:53.849758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:53.851388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:53.864144 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4398/8815] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:22:54.570930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b504-4eb5-4c1d-a658-49d3e801c93a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:54.571469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b504-4eb5-4c1d-a658-49d3e801c93a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:54.571469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b504-4eb5-4c1d-a658-49d3e801c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:54.591878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7924b504-4eb5-4c1d-a658-49d3e801c93a None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:22:54.593288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7924b504-4eb5-4c1d-a658-49d3e801c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:22:54.603610 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4418/8816] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Oct 5 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:22:54.616416 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:22:54.633085 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4376781-797e-472b-a207-be7250ab5516 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:22:54.638445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad471b-7084-46e6-9174-a55185c839f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:22:54.639066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad471b-7084-46e6-9174-a55185c839f9 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:22:54.639355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad471b-7084-46e6-9174-a55185c839f9 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:22:54.639635 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad471b-7084-46e6-9174-a55185c839f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:22:54.651350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad471b-7084-46e6-9174-a55185c839f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:22:54.653065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad471b-7084-46e6-9174-a55185c839f9 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:22:54.666309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4399/8817] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:22:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:23:04.586403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:23:04.666077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:23:49.456468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:23:49.457090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:23:49.457090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:23:49.476442 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:23:49.477687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:23:49.486406 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4419/8818] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 5 03:23:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:23:49.500204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7796b-2716-49f1-90d6-a21f1c647292 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:23:49.500659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7796b-2716-49f1-90d6-a21f1c647292 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:23:49.500759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7796b-2716-49f1-90d6-a21f1c647292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:23:49.520464 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-93a7796b-2716-49f1-90d6-a21f1c647292 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:23:49.521760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-93a7796b-2716-49f1-90d6-a21f1c647292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:23:49.530247 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4400/8819] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 03:23:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:23:49.536056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:23:49.546330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1609bf-a4fe-49f4-a365-e8f94e1e27bc None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:23:49.551269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:23:49.551867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:23:49.552673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:23:49.552987 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:23:49.561322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:23:49.562895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:23:49.573436 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4420/8820] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:23:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:23:59.515675 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:23:59.569093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=9 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:13.541902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce722843-73f4-4181-bb8d-c94984558e69 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:13.542395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce722843-73f4-4181-bb8d-c94984558e69 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:13.542493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce722843-73f4-4181-bb8d-c94984558e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:13.560942 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ce722843-73f4-4181-bb8d-c94984558e69 None None] MFA Rules not processed for user `ee8daf94c54c4dd7b69310674d73211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:24:13.562106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ce722843-73f4-4181-bb8d-c94984558e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:24:13.568939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4401/8821] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:24:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:24:13.906604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:24:13.926667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd66df-3e13-4e41-b164-3bcfb2003907 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:24:13.930363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:24:13.930971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:13.931256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:13.931539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:13.933310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:24:13.948395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:24:13.950589 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:24:13.962492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4421/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:24:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:24:15.426795 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:15.427221 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:15.427380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:15.447639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:24:15.448845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:24:15.457978 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4402/8823] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 03:24:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:24:15.464433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:24:15.476343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef2680-11fd-4baa-a220-33bc08c3aa62 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:24:15.481615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed083a-b407-4855-a810-d79547339d26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:24:15.482210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed083a-b407-4855-a810-d79547339d26 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:15.482489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed083a-b407-4855-a810-d79547339d26 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:15.482768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed083a-b407-4855-a810-d79547339d26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:15.491746 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed083a-b407-4855-a810-d79547339d26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:24:15.493441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed083a-b407-4855-a810-d79547339d26 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:24:15.503538 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4422/8824] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:24:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:24:19.311838 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:24:19.321673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f03f07-389a-47f2-a99b-d41096ad0736 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:24:19.325242 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:24:19.325852 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:19.326132 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:19.326404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:19.328196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:24:19.341505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:24:19.343101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:24:19.359130 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4403/8825] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:24:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:24:25.499387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:29.348341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:24:56.132053 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f65d-8abd-48dc-9729-066e5181c185 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:56.132732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f65d-8abd-48dc-9729-066e5181c185 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:56.132849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f65d-8abd-48dc-9729-066e5181c185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:56.182669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e9e3f65d-8abd-48dc-9729-066e5181c185 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:24:56.183906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9e3f65d-8abd-48dc-9729-066e5181c185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:24:56.190389 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4423/8826] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 5 03:24:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:24:56.202449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:24:56.211592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3511f7-82a3-4537-8b98-8b3285de5479 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:24:56.215152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:24:56.215743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:24:56.216027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:24:56.216300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:24:56.223136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:24:56.224554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:24:56.232610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4404/8827] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:24:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:25:01.301646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773c0c-330e-4ee0-b076-fda47f75db43 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:25:01.302191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773c0c-330e-4ee0-b076-fda47f75db43 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:25:01.302191 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773c0c-330e-4ee0-b076-fda47f75db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:25:01.323900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-85773c0c-330e-4ee0-b076-fda47f75db43 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:25:01.325115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-85773c0c-330e-4ee0-b076-fda47f75db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:25:01.331475 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4424/8828] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Oct 5 03:25:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:25:01.347752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:25:01.357682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569a494-e687-4042-b2a7-37e3e0a15366 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:25:01.361516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e847b7-2a9f-4555-9454-ae9fd48b4de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:25:01.362247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e847b7-2a9f-4555-9454-ae9fd48b4de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:25:01.362500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e847b7-2a9f-4555-9454-ae9fd48b4de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:25:01.362793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e847b7-2a9f-4555-9454-ae9fd48b4de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:25:01.370939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e847b7-2a9f-4555-9454-ae9fd48b4de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:25:01.372414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e847b7-2a9f-4555-9454-ae9fd48b4de7 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:25:01.380464 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4405/8829] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:25:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:25:11.318768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=16 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:25:11.376951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:22.378885 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:22.379424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:22.379424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:22.435302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:22.436525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:22.505786 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4425/8830] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:26:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:22.529765 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7a37b-618b-4733-80f9-69c4d7941a8e None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:22.530316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7a37b-618b-4733-80f9-69c4d7941a8e None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:22.530316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7a37b-618b-4733-80f9-69c4d7941a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:22.551388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dde7a37b-618b-4733-80f9-69c4d7941a8e None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:22.553076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dde7a37b-618b-4733-80f9-69c4d7941a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:22.564109 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4406/8831] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 03:26:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:22.572098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:22.584638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa40a4-7dee-486b-ad9b-3b3257a1c951 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:22.591900 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12c837-ff69-46f8-a283-5f245ff96df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:22.593150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c837-ff69-46f8-a283-5f245ff96df5 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:22.593556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c837-ff69-46f8-a283-5f245ff96df5 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:22.593908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12c837-ff69-46f8-a283-5f245ff96df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:22.605342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12c837-ff69-46f8-a283-5f245ff96df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:22.607336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12c837-ff69-46f8-a283-5f245ff96df5 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:22.618791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:22.619070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:22.619402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:22.624960 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4426/8832] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:22.642393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:22.643960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:22.664534 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4407/8833] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 03:26:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:26:22.670555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b1d2-8087-422b-b187-5e9f0a531e60 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:22.670555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b1d2-8087-422b-b187-5e9f0a531e60 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:22.670555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30b1d2-8087-422b-b187-5e9f0a531e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:22.691207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-dc30b1d2-8087-422b-b187-5e9f0a531e60 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:22.692405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-dc30b1d2-8087-422b-b187-5e9f0a531e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:22.702445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4427/8834] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:26:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:22.713144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:22.722695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52a4ec-188f-4ac9-b146-607ca6fee74b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:22.726414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:22.727117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:22.727475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:22.727816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:22.738847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:22.740282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:22.752437 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4408/8835] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:23.944122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883b0c-0bad-4ed8-9176-657636ce5fe1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:23.945284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883b0c-0bad-4ed8-9176-657636ce5fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:23.945284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c883b0c-0bad-4ed8-9176-657636ce5fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:23.965726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1c883b0c-0bad-4ed8-9176-657636ce5fe1 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:23.967260 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1c883b0c-0bad-4ed8-9176-657636ce5fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:23.976736 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4428/8836] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:26:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:23.990495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:23.999109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b59ac-deb2-4280-8fd2-0458319fc4f8 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:24.002835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:24.003440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:24.003727 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:24.004655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:24.016528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:24.018005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:24.030475 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4409/8837] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:33.959069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=46 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:34.025421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=18 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:35.874967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:35.875474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:35.875556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:35.921003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:35.922258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:35.931998 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4429/8838] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:26:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:35.947347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:35.962778 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2c26-d5be-4a10-9f7b-881e648e71f3 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:35.969270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fa742-7a7a-488d-8dae-78db4b8f4026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:35.969905 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fa742-7a7a-488d-8dae-78db4b8f4026 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:35.970210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fa742-7a7a-488d-8dae-78db4b8f4026 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:35.970485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fa742-7a7a-488d-8dae-78db4b8f4026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:35.980436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fa742-7a7a-488d-8dae-78db4b8f4026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:35.982055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fa742-7a7a-488d-8dae-78db4b8f4026 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:35.995482 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4410/8839] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:45.915656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:45.988458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:46.926436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:46.928446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:46.940017 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23f728-f534-4e80-bf98-020ca308fa57 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:46.944479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:46.953055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:46.953055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:46.953055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:46.953055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:47.036531 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:47.038623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:47.058194 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4430/8840] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:50.222215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f488-70cb-45fb-a7f9-9d1377367a49 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:50.222705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f488-70cb-45fb-a7f9-9d1377367a49 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:50.222819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110f488-70cb-45fb-a7f9-9d1377367a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:50.290645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2110f488-70cb-45fb-a7f9-9d1377367a49 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:50.292135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2110f488-70cb-45fb-a7f9-9d1377367a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:50.367967 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4411/8841] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:26:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:50.379271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:50.391598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10caf35-58ad-4d2e-b50a-873f75ae5439 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:50.396867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:50.397467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:50.397749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:50.398026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:50.406827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:50.408400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:50.418241 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4431/8842] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:53.148136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:53.148742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:53.148742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:53.180115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:26:53.182425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:53.196825 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4412/8843] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:26:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:26:53.212689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:53.223564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:53.229550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:53.234861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc22e3d-d500-4cc3-8bdd-d3f88ad7a721 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:53.243112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:53.243918 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:53.244384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:53.244664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:53.262131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b5bb-60bd-462c-ae8a-471d8cac8924 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:53.262992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:53.265689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:53.267597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:53.268587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:53.269168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:53.269615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] PATH_INFO: `/v3/users/ee8daf94c54c4dd7b69310674d73211a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:53.280296 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4432/8844] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:26:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:26:53.300775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8daf94c54c4dd7b69310674d73211a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:53.311578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:53.403055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8daf94c54c4dd7b69310674d73211a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.418810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8daf94c54c4dd7b69310674d73211a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.420977 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8daf94c54c4dd7b69310674d73211a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.431026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8daf94c54c4dd7b69310674d73211a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.431809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8daf94c54c4dd7b69310674d73211a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.446076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4413/8845] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:26:53 2022] DELETE /identity/v3/users/ee8daf94c54c4dd7b69310674d73211a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:26:53.624626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:53.636932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446a83-637f-4082-bf08-9ca33d31ae43 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:53.712591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:53.713185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:53.713472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:53.713750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] PATH_INFO: `/v3/projects/713e3a431a2441548123f404b23ce0da` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:53.724241 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713e3a431a2441548123f404b23ce0da)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:53.726419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:53.760715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:53.774078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713e3a431a2441548123f404b23ce0da', 'request_id': 'req-bc131eca-1c64-413e-86b0-9ca336a1bc88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.779793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713e3a431a2441548123f404b23ce0da', 'request_id': 'req-bc131eca-1c64-413e-86b0-9ca336a1bc88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.786494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713e3a431a2441548123f404b23ce0da', 'request_id': 'req-bc131eca-1c64-413e-86b0-9ca336a1bc88'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.798553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] The token cache is being invalidate because project 713e3a431a2441548123f404b23ce0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:26:53.798867 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.799480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.801006 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4433/8846] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:26:53 2022] DELETE /identity/v3/projects/713e3a431a2441548123f404b23ce0da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:26:53.805101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:53.806520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:53.820023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ee5c4-da22-4c4d-9cc5-b76bddf732fe admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:53.844704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:26:53.878563 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:53.879190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:53.879472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:53.879745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] PATH_INFO: `/v3/users/7a0039a3d6d042018a713e89b63e5fc4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:53.899609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0039a3d6d042018a713e89b63e5fc4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:53.901650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:53.949197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0039a3d6d042018a713e89b63e5fc4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.962240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0039a3d6d042018a713e89b63e5fc4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.963244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0039a3d6d042018a713e89b63e5fc4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.971394 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0039a3d6d042018a713e89b63e5fc4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.972057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-29929741-0963-4eb3-a640-9c603ced7fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0039a3d6d042018a713e89b63e5fc4'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:53.984865 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4414/8847] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:26:53 2022] DELETE /identity/v3/users/7a0039a3d6d042018a713e89b63e5fc4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:26:54.158579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:26:54.160183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:26:54.173908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc131eca-1c64-413e-86b0-9ca336a1bc88 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:26:54.232003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:26:54.232621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:26:54.232831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:26:54.233139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] PATH_INFO: `/v3/projects/3c5fca607688484fb1a5c90110aa3570` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:26:54.243548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5fca607688484fb1a5c90110aa3570)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:26:54.245512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:26:54.291835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5fca607688484fb1a5c90110aa3570', 'request_id': 'req-7670441b-a471-43ff-8a88-4c5d2c516d2d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:54.297310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5fca607688484fb1a5c90110aa3570', 'request_id': 'req-7670441b-a471-43ff-8a88-4c5d2c516d2d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:54.303942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5fca607688484fb1a5c90110aa3570', 'request_id': 'req-7670441b-a471-43ff-8a88-4c5d2c516d2d'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:54.316487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] The token cache is being invalidate because project 3c5fca607688484fb1a5c90110aa3570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:26:54.316778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:54.317502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7670441b-a471-43ff-8a88-4c5d2c516d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:26:54.319319 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4434/8848] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:26:54 2022] DELETE /identity/v3/projects/3c5fca607688484fb1a5c90110aa3570 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:03.837805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:03.838338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:03.838338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:03.887054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:03.888207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:03.948608 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4415/8849] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:03.957827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:03.958800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:03.958944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:03.979216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:03.980417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:03.988246 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4435/8850] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:03.993120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.002680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc958195-fe03-4897-8741-d59a5486d5c9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.007222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.007813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.008100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.008373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.009048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:27:04.009353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.010929 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.019350 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:04.023409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4416/8851] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:27:04.035938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.045661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4461a-c7ab-46a5-89db-fd9ebd517b45 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.050354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.050945 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.051224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.051496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.052254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.054175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.090530 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4436/8852] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:27:04.094822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.105980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fa906-02fd-4752-ac31-de5dee3714c9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.163178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.163993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.164282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.164557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.165234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.167398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.189503 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4417/8853] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:27:04.194138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.200736 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:04.204578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9b0b-6019-48aa-b4ec-4542242c8faa admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.210599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.211526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.212012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.212454 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.213483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.215235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.226120 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4437/8854] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:27:04.230448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.241218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f0332-6a50-4558-af48-80f5595cf273 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.245789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a32bc-bb34-4ad5-9d44-aaf3446911a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.246389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a32bc-bb34-4ad5-9d44-aaf3446911a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.246670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a32bc-bb34-4ad5-9d44-aaf3446911a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.246945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a32bc-bb34-4ad5-9d44-aaf3446911a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.247580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a32bc-bb34-4ad5-9d44-aaf3446911a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.249227 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a32bc-bb34-4ad5-9d44-aaf3446911a0 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.260012 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4418/8855] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:27:04.264131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.274699 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752bb9c-00da-40ae-89dd-c92e60124e0e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.279412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.280057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.280339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.280616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] PATH_INFO: `/v3/projects/bfeb755072464c4688e55c2b2e5e9581/users/b1bfbb2a47dc4ad0bbea68ac5ad864bb/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.296051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfeb755072464c4688e55c2b2e5e9581, user_id=b1bfbb2a47dc4ad0bbea68ac5ad864bb, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.298744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.312167 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4438/8856] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:27:04 2022] PUT /identity/v3/projects/bfeb755072464c4688e55c2b2e5e9581/users/b1bfbb2a47dc4ad0bbea68ac5ad864bb/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:27:04.325129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.325436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.325714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.353657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] MFA Rules not processed for user `b1bfbb2a47dc4ad0bbea68ac5ad864bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:04.354856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:04.417705 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4419/8857] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:04.422137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.483155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a94175-a313-4bd1-b064-2ad34e8b037a admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.487879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.488479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.488759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.489074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.490265 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.492164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.520765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4439/8858] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:27:04.522071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.533017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eb4ec-cde3-440e-956d-4d39a37791d9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.590809 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.591427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.591714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.592020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.592650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.594608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.610737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:04.617156 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4420/8859] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:27:04.621043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.631495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6577c02-3d34-4c5f-8b96-452fecb630d9 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.636112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.636708 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.637023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.637300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.637943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.639541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.650969 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4440/8860] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:27:04.655233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.666660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a9371-479f-4dc5-95d3-6ba1123cf45c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.671328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.671923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.672203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.672478 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] PATH_INFO: `/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad/users/cbd917c4db784cf0a4c34a643176359f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.687095 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a6c5863034f4bae1c4f907ecb67ad, user_id=cbd917c4db784cf0a4c34a643176359f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.689793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.702454 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4421/8861] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:27:04 2022] PUT /identity/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad/users/cbd917c4db784cf0a4c34a643176359f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:04.706404 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.718682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3ebc3-62b7-483e-8724-86ab25198c69 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.774674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4cc32-6e47-4e95-a2e6-4b3d6d962282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.775273 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4cc32-6e47-4e95-a2e6-4b3d6d962282 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.775550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4cc32-6e47-4e95-a2e6-4b3d6d962282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.775826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4cc32-6e47-4e95-a2e6-4b3d6d962282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.776457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4cc32-6e47-4e95-a2e6-4b3d6d962282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.778080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4cc32-6e47-4e95-a2e6-4b3d6d962282 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.788194 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4441/8862] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:27:04.792357 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:04.802537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bc1cb-6a79-4e37-8eca-acd3e8592b1f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:04.807145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b7bf-abbf-4268-8d3e-d037c21b7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:04.807786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b7bf-abbf-4268-8d3e-d037c21b7b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.808066 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b7bf-abbf-4268-8d3e-d037c21b7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.808340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b7bf-abbf-4268-8d3e-d037c21b7b16 admin admin] PATH_INFO: `/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad/users/cbd917c4db784cf0a4c34a643176359f/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.810267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58b7bf-abbf-4268-8d3e-d037c21b7b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a6c5863034f4bae1c4f907ecb67ad, user_id=cbd917c4db784cf0a4c34a643176359f, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:04.812912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58b7bf-abbf-4268-8d3e-d037c21b7b16 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:04.823050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4422/8863] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:27:04 2022] PUT /identity/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad/users/cbd917c4db784cf0a4c34a643176359f/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:04.832986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.833750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.834087 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.863599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] MFA Rules not processed for user `cbd917c4db784cf0a4c34a643176359f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:04.865078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:04.893352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:04.935502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4442/8864] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:04.948890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9a715-73d5-4e4d-b770-e6e78318de26 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:04.949382 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9a715-73d5-4e4d-b770-e6e78318de26 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:04.949473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9a715-73d5-4e4d-b770-e6e78318de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:04.968728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c7a9a715-73d5-4e4d-b770-e6e78318de26 None None] MFA Rules not processed for user `b1bfbb2a47dc4ad0bbea68ac5ad864bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:04.969954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c7a9a715-73d5-4e4d-b770-e6e78318de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:05.025110 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4423/8865] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:05.039066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:05.040546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:05.112974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802db271-bcf0-4f50-a6c5-d415ce5a31b0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:05.119109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:05.119720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:05.120051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:05.120330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:05.128121 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:05.129766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:05.139265 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4443/8866] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:15.017586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=41,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:15.135208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=50 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:16.115963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:16.116483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:16.116578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:16.139334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:16.140770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:16.151800 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4424/8867] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:27:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:16.182548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:16.199359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1af80a-eb34-4998-846c-2e02f1e5cefd service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:16.206710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d4f4c-2329-4884-bcc5-465fd15dcc35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:16.207478 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d4f4c-2329-4884-bcc5-465fd15dcc35 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:16.208392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d4f4c-2329-4884-bcc5-465fd15dcc35 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:16.208673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d4f4c-2329-4884-bcc5-465fd15dcc35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:16.218348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d4f4c-2329-4884-bcc5-465fd15dcc35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:16.219968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d4f4c-2329-4884-bcc5-465fd15dcc35 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:16.231798 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4444/8868] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:27:18.529934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:18.531482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:18.560004 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a99b6d-3d4e-4da8-9482-a9526d9f393b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:18.566199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:18.566904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:18.567285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:18.567564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:18.576480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:18.578199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:18.590922 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4425/8869] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:18.607245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57595fa-39d2-448c-83cb-825c1c8bb436 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:18.607778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57595fa-39d2-448c-83cb-825c1c8bb436 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:18.607778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57595fa-39d2-448c-83cb-825c1c8bb436 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:18.609157 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4445/8870] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 03:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 03:27:18.613840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 03:27:18.626379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:18.636329 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421bd8c-8775-4a5f-903a-8a625c9bb59a service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:18.641103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd917c4db784cf0a4c34a643176359f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77a6c5863034f4bae1c4f907ecb67ad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:18.641734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:18.642018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:18.642301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] PATH_INFO: `/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:18.643440 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] RBAC: Authorizing `identity:get_project(project_id=f77a6c5863034f4bae1c4f907ecb67ad)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:18.645361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:18.651617 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4426/8871] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 03:27:18 2022] GET /identity/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad => generated 391 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:27:18.829695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1a8b7-8249-4033-9ade-3a2a847d6ba0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:18.829991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1a8b7-8249-4033-9ade-3a2a847d6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:18.830298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1a8b7-8249-4033-9ade-3a2a847d6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:18.863880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-07e1a8b7-8249-4033-9ade-3a2a847d6ba0 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:18.865222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-07e1a8b7-8249-4033-9ade-3a2a847d6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:18.932546 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4446/8872] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:27:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:18.945001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:18.946723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:18.960316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dc820-4919-4d24-b5eb-6ffb767786a0 tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:18.964166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:18.964773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:18.965089 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:18.965365 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:18.972789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:18.974884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:18.983757 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4427/8873] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:19.158222 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaed0a-826b-4143-8687-9371b5be7113 None None] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:19.158510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaed0a-826b-4143-8687-9371b5be7113 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:19.158786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaed0a-826b-4143-8687-9371b5be7113 None None] PATH_INFO: `/` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:19.160144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4447/8874] 10.222.0.16 () {54 vars in 912 bytes} [Wed Oct 5 03:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 05 03:27:19.171798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] Authenticating service token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 05 03:27:19.179564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:19.191506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e095f-2656-4c46-a874-69dc11aceb4e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:19.197481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd917c4db784cf0a4c34a643176359f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f77a6c5863034f4bae1c4f907ecb67ad', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:19.198120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:19.198403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:19.198680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] PATH_INFO: `/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:19.199837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] RBAC: Authorizing `identity:get_project(project_id=f77a6c5863034f4bae1c4f907ecb67ad)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:19.202328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:19.203990 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4428/8875] 10.222.0.16 () {58 vars in 1443 bytes} [Wed Oct 5 03:27:19 2022] GET /identity/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad => generated 391 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:27:19.358539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:19.358828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:19.359108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:19.379398 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:19.380812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:19.387307 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4448/8876] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:27:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:19.398773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:19.408552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12713-0efb-4058-8c47-2d9a222a367f tempest-ServersAdminNegativeTestJSON-108461897 tempest-ServersAdminNegativeTestJSON-108461897-project-admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:19.412757 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac759c4b-0d68-45e9-91c0-9d9631640e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:19.413386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac759c4b-0d68-45e9-91c0-9d9631640e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:19.413661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac759c4b-0d68-45e9-91c0-9d9631640e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:19.413928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac759c4b-0d68-45e9-91c0-9d9631640e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:19.420769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac759c4b-0d68-45e9-91c0-9d9631640e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:19.422222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac759c4b-0d68-45e9-91c0-9d9631640e35 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:19.430545 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4429/8877] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:23.204578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:23.273004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd2a75-537a-4101-ba99-3ddd5723690e None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:23.277520 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:23.278155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:23.278437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:23.278715 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] PATH_INFO: `/v3/users/b1bfbb2a47dc4ad0bbea68ac5ad864bb` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:23.279851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bfbb2a47dc4ad0bbea68ac5ad864bb)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:23.281846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:23.331806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.344558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.345279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.352590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.353480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bfbb2a47dc4ad0bbea68ac5ad864bb'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.361299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:23.367497 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4449/8878] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:27:23 2022] DELETE /identity/v3/users/b1bfbb2a47dc4ad0bbea68ac5ad864bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:23.372287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:23.372797 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:23.372885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:23.392097 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:23.393318 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:23.450789 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4430/8879] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:27:23.460391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:23.461797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:23.519020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441c79-9a58-4c45-92b6-1b02c53fe276 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:23.522776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:23.523376 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:23.523658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:23.523928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:23.532761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:23.534218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:23.544429 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4450/8880] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:23.716425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:23.718099 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:23.731550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc502792-8cbb-4669-ba86-3736a347ea71 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:23.736480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:23.737137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:23.737417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:23.737688 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] PATH_INFO: `/v3/projects/bfeb755072464c4688e55c2b2e5e9581` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:23.738806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfeb755072464c4688e55c2b2e5e9581)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:23.741777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:23.789672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfeb755072464c4688e55c2b2e5e9581', 'request_id': 'req-6e6a39c4-bf12-461b-b1f6-d839703abcfa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.796759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfeb755072464c4688e55c2b2e5e9581', 'request_id': 'req-6e6a39c4-bf12-461b-b1f6-d839703abcfa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.802316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfeb755072464c4688e55c2b2e5e9581', 'request_id': 'req-6e6a39c4-bf12-461b-b1f6-d839703abcfa'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.813950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] The token cache is being invalidate because project bfeb755072464c4688e55c2b2e5e9581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:27:23.814240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.814876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.816340 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4431/8881] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:27:23 2022] DELETE /identity/v3/projects/bfeb755072464c4688e55c2b2e5e9581 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:23.820521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:23.830722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9659b1-2b46-4b95-91a5-e7d6eb7d71ce service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:23.889240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:23.889906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:23.890190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:23.890470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] PATH_INFO: `/v3/users/cbd917c4db784cf0a4c34a643176359f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:23.891621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd917c4db784cf0a4c34a643176359f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:23.893577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:23.941026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd917c4db784cf0a4c34a643176359f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.953157 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd917c4db784cf0a4c34a643176359f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.953827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd917c4db784cf0a4c34a643176359f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.961720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd917c4db784cf0a4c34a643176359f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.962289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-474bb767-39fb-49a5-b1cc-1e19c68d034c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd917c4db784cf0a4c34a643176359f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:23.976027 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4451/8882] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:27:23 2022] DELETE /identity/v3/users/cbd917c4db784cf0a4c34a643176359f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:24.250833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.252390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:24.266611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a39c4-bf12-461b-b1f6-d839703abcfa admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.272871 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:24.327074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.327706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.327994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.328270 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] PATH_INFO: `/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.329421 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77a6c5863034f4bae1c4f907ecb67ad)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.331325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.377108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77a6c5863034f4bae1c4f907ecb67ad', 'request_id': 'req-38dc9205-6ce8-454a-8e3a-b7d390258a55'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:24.385075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77a6c5863034f4bae1c4f907ecb67ad', 'request_id': 'req-38dc9205-6ce8-454a-8e3a-b7d390258a55'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:24.390652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77a6c5863034f4bae1c4f907ecb67ad', 'request_id': 'req-38dc9205-6ce8-454a-8e3a-b7d390258a55'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:24.401966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] The token cache is being invalidate because project f77a6c5863034f4bae1c4f907ecb67ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:27:24.402261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:24.402909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-38dc9205-6ce8-454a-8e3a-b7d390258a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:27:24.404396 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4432/8883] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:27:24 2022] DELETE /identity/v3/projects/f77a6c5863034f4bae1c4f907ecb67ad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:27:24.410299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.410790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.411004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.431401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:24.432607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:24.445897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:24.495605 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4452/8884] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:27:24.503764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.504055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.504337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.525100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:24.526309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:24.534210 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4433/8885] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:24.538542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.548291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c26255-6c1b-4d73-a095-42ab24bdd5ef None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.552780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.553491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.553771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.554051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.554687 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:27:24.555016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.556596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.568639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4453/8886] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:27:24.573107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.582885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c99c5-aa0b-409b-b69d-d8e46e056120 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.588818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.589493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.589777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.590060 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.590708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.592615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.623079 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4434/8887] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:27:24 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:27:24.627236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.638120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37052e32-45e9-4a01-a333-973d766a9a5b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.694817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.695429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.695704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.695976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.696596 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.698538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.720955 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4454/8888] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:27:24 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:27:24.725483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.736096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f320ff-62d8-4e2e-8abd-17c77c09ebf2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.740915 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.741523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.741806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.742083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.742754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.744340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.754394 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4435/8889] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:27:24.758812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.768669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145eeb3-50b4-4202-8dcf-81f36c4abd1f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.773835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e1828-5c85-47d5-81da-fe8fbfd80ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.774423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e1828-5c85-47d5-81da-fe8fbfd80ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.774703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e1828-5c85-47d5-81da-fe8fbfd80ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.774980 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e1828-5c85-47d5-81da-fe8fbfd80ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.775882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e1828-5c85-47d5-81da-fe8fbfd80ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.777551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e1828-5c85-47d5-81da-fe8fbfd80ce9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.788421 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4455/8890] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:27:24.792517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.803175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc9004-19b5-480c-ac27-584505306e9d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:24.807903 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:24.808551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.808834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.809143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] PATH_INFO: `/v3/projects/7dbe394870c44ea89d4af55ef70552b9/users/8992b0e6086d49f29a831c6fb498dcbe/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.824309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbe394870c44ea89d4af55ef70552b9, user_id=8992b0e6086d49f29a831c6fb498dcbe, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:24.827048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:24.839900 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4436/8891] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:27:24 2022] PUT /identity/v3/projects/7dbe394870c44ea89d4af55ef70552b9/users/8992b0e6086d49f29a831c6fb498dcbe/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:27:24.844968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090691c-2957-4ffe-97fd-cda72610c9ae None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:24.845259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090691c-2957-4ffe-97fd-cda72610c9ae None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:24.845533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090691c-2957-4ffe-97fd-cda72610c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:24.864606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-d090691c-2957-4ffe-97fd-cda72610c9ae None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:24.866317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d090691c-2957-4ffe-97fd-cda72610c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:24.926814 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4456/8892] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:27:24.937052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:24.938716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:24.980145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:24.998908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c033ee-cccd-4f0f-8b3c-dee90bd18223 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:25.002595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5258f44-2605-4723-8b3e-953b0582fcc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:25.003196 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5258f44-2605-4723-8b3e-953b0582fcc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:25.003481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5258f44-2605-4723-8b3e-953b0582fcc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:25.003759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5258f44-2605-4723-8b3e-953b0582fcc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:25.012895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5258f44-2605-4723-8b3e-953b0582fcc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:25.014327 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5258f44-2605-4723-8b3e-953b0582fcc1 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:25.024393 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4437/8893] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:29.130180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:29.130837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:29.130837 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:29.160643 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] MFA Rules not processed for user `8992b0e6086d49f29a831c6fb498dcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:29.162720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:29.176688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:29.244090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4457/8894] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:29.255996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fc815-951b-471c-b8a2-3c95c270bd35 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:29.256417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fc815-951b-471c-b8a2-3c95c270bd35 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:29.256492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fc815-951b-471c-b8a2-3c95c270bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:29.279485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f14fc815-951b-471c-b8a2-3c95c270bd35 None None] MFA Rules not processed for user `8992b0e6086d49f29a831c6fb498dcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:29.280705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f14fc815-951b-471c-b8a2-3c95c270bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:29.310078 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4438/8895] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:27:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:29.312239 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:29.313941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:29.403680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e23076-54e9-4e99-b88f-903b0d3a831d None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:29.409564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:29.410150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:29.410435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:29.410717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:29.422717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:29.424344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:29.435530 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4458/8896] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:27:39.272461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=13 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:39.430571 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=54 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:43.236508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc252a6f-5e9e-42cf-9b46-9afe78b30b18 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:43.237079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc252a6f-5e9e-42cf-9b46-9afe78b30b18 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:43.237079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc252a6f-5e9e-42cf-9b46-9afe78b30b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:43.257436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-dc252a6f-5e9e-42cf-9b46-9afe78b30b18 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:43.258624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dc252a6f-5e9e-42cf-9b46-9afe78b30b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:43.265513 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4439/8897] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:43.277744 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:43.279232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:43.292066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b5956-576c-4b0e-8e8b-89bf7a79204a service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:43.296082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:43.299998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:43.299998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:43.299998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:43.307401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:43.308845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:43.320589 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4459/8898] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:43.402000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:43.402288 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:43.402561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:43.423648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:27:43.424833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:43.487439 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4440/8899] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:27:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:27:43.499464 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:43.500830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:43.515735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bbe7a-90b2-4abd-b1c7-9b7be1636e21 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:43.520701 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:43.521352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:43.521634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:43.521906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:43.530956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:43.532523 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:43.542855 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4460/8900] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:43.723019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:43.732750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc55813-5dd4-4d22-af30-a534ba11f402 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:43.736289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:43.736884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:43.737191 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:43.737514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:43.739152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:43.755301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:43.756715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:43.770476 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4441/8901] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:43.830875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:27:43.841346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aab47-1697-41af-93d8-cb89b5a99148 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:27:43.846267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:27:43.846855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:27:43.847133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:27:43.847407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:27:43.849108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:27:43.860704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:27:43.862314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:27:43.872739 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4461/8902] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:27:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:27:53.763232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=38 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:27:53.868534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=18 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:00.621368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:00.622767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:00.637481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5eeb8-19be-4322-8479-0ed5fc3fcc95 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:00.642568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:00.643165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:00.643450 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:00.643731 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:00.645457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:00.657492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:00.659078 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:00.669441 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4442/8903] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:28:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:28:10.664948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:25.078091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.089608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87fbad-dd31-449f-b80a-775c8d9ee26e service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.094334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.094972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.095311 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.095595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] PATH_INFO: `/v3/users/8992b0e6086d49f29a831c6fb498dcbe` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.096771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8992b0e6086d49f29a831c6fb498dcbe)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.098705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.144641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8992b0e6086d49f29a831c6fb498dcbe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.157182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8992b0e6086d49f29a831c6fb498dcbe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.157850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8992b0e6086d49f29a831c6fb498dcbe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.165042 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8992b0e6086d49f29a831c6fb498dcbe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.165673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-171222c6-11ca-4811-9540-43113c6a5d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8992b0e6086d49f29a831c6fb498dcbe'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.178953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4462/8904] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:28:25 2022] DELETE /identity/v3/users/8992b0e6086d49f29a831c6fb498dcbe => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:28:25.355230 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.366024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17794-5b22-4461-a5ab-1ad665b0a072 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.442080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.442752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.443034 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.443308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] PATH_INFO: `/v3/projects/7dbe394870c44ea89d4af55ef70552b9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.444431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbe394870c44ea89d4af55ef70552b9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.446469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.493276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbe394870c44ea89d4af55ef70552b9', 'request_id': 'req-2c9577ef-eb5a-434b-abd3-260e69c364c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.501931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbe394870c44ea89d4af55ef70552b9', 'request_id': 'req-2c9577ef-eb5a-434b-abd3-260e69c364c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.507802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbe394870c44ea89d4af55ef70552b9', 'request_id': 'req-2c9577ef-eb5a-434b-abd3-260e69c364c7'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.519955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] The token cache is being invalidate because project 7dbe394870c44ea89d4af55ef70552b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:28:25.520244 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.520873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-2c9577ef-eb5a-434b-abd3-260e69c364c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:28:25.522382 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4443/8905] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:28:25 2022] DELETE /identity/v3/projects/7dbe394870c44ea89d4af55ef70552b9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:28:25.527603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.527908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.528179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.548886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:28:25.550129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:25.610465 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4463/8906] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:28:25.620070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.620360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.620642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.640947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:28:25.642159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:25.650608 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4444/8907] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:28:25.655070 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.665206 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b5056-8721-4f7a-809d-67b635362ee5 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.669926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.670555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.670835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.671107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.671751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:28:25.672055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.673694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.685921 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4464/8908] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:28:25.690605 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.701517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8095b5-4e70-4fec-bb44-c60be85a85d1 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.706225 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.706821 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.707111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.707386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.708032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.709987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.737613 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4445/8909] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:28:25 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:28:25.741821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.752210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723045f0-3c74-45f9-a70a-dcd116ab3e61 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.807666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.808259 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.808535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.808803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.809466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.811356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.819208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:25.837109 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4465/8910] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:28:25 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:28:25.838375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.848708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416780d7-a8f7-4e40-865d-484a442b3503 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.854111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.854705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.854987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.855286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.855928 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.857557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.867608 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4446/8911] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:28:25.872212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.882233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bf3d9-0361-4128-8814-0d233d75c98e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.886888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357f846-ca68-4126-aeba-ef3f0e10a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.887482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357f846-ca68-4126-aeba-ef3f0e10a20a admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.887766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357f846-ca68-4126-aeba-ef3f0e10a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.888037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357f846-ca68-4126-aeba-ef3f0e10a20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.888679 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357f846-ca68-4126-aeba-ef3f0e10a20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.890342 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357f846-ca68-4126-aeba-ef3f0e10a20a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.901077 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4466/8912] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:28:25.905154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:25.916721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f9942-270b-40ba-a209-e371429ced9e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:25.922689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:25.923573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.924009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.924346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] PATH_INFO: `/v3/projects/1ac0643217d0435887d49994cd7620e4/users/4e9ae5054256463d8c9b1a0b8f627283/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.940195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac0643217d0435887d49994cd7620e4, user_id=4e9ae5054256463d8c9b1a0b8f627283, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:25.942883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:25.955379 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4447/8913] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:28:25 2022] PUT /identity/v3/projects/1ac0643217d0435887d49994cd7620e4/users/4e9ae5054256463d8c9b1a0b8f627283/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:28:25.960435 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda856e-82fd-46a7-b673-e210e23364e3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:25.960724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda856e-82fd-46a7-b673-e210e23364e3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:25.961041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda856e-82fd-46a7-b673-e210e23364e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:25.980880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ceda856e-82fd-46a7-b673-e210e23364e3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:28:25.982113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ceda856e-82fd-46a7-b673-e210e23364e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:26.039883 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4467/8914] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:28:26.049985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:26.051687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:26.082764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:26.111238 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9f99-2638-4ad1-b434-b1a74b788ddc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:26.114900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea58a25-e83e-4a48-95dd-6c20763367e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:26.115503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea58a25-e83e-4a48-95dd-6c20763367e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:26.115787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea58a25-e83e-4a48-95dd-6c20763367e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:26.116061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea58a25-e83e-4a48-95dd-6c20763367e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:26.125521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea58a25-e83e-4a48-95dd-6c20763367e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:26.126947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea58a25-e83e-4a48-95dd-6c20763367e6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:26.137304 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4448/8915] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:28:29.861235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:29.861772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:29.861772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:29.890346 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] MFA Rules not processed for user `4e9ae5054256463d8c9b1a0b8f627283`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:28:29.891607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:29.958604 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4468/8916] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:28:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:28:29.969715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:29.970222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:29.970359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:29.991131 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] MFA Rules not processed for user `4e9ae5054256463d8c9b1a0b8f627283`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:28:29.992358 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:30.000206 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4449/8917] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:28:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:28:30.011648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:30.013180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:30.088598 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b00704-b3a2-4feb-9b02-95356dec2f39 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:30.094186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea5bc2-a24e-4576-b587-f7b13d22251c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:30.094800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5bc2-a24e-4576-b587-f7b13d22251c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:30.095223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5bc2-a24e-4576-b587-f7b13d22251c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:30.095334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea5bc2-a24e-4576-b587-f7b13d22251c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:30.100153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:30.105029 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5bc2-a24e-4576-b587-f7b13d22251c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:30.107036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea5bc2-a24e-4576-b587-f7b13d22251c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:30.119311 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4469/8918] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:28:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:28:39.984993 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=17 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:40.120153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:28:54.428817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:28:54.430252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:54.499063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecacdc-fd79-47ab-8f11-c33d09e52112 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:28:54.504042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:28:54.504645 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:28:54.504953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:28:54.505233 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:28:54.506941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:28:54.519030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:28:54.520644 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:28:54.531076 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4450/8919] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:28:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:29:04.526998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=32 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:22.413341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:29:22.413888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:29:22.413888 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:29:22.433348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] MFA Rules not processed for user `4e9ae5054256463d8c9b1a0b8f627283`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:29:22.434537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:29:22.441255 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4470/8920] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:29:23.009181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:29:23.010817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:29:23.023763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b1eab-6619-4960-975b-bdcafa23dfa6 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:29:23.029020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:29:23.029627 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:29:23.029912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:29:23.030189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:29:23.031934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:29:23.044052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:29:23.045672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:29:23.055853 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4451/8921] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:29:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:29:32.427189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:29:33.052168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:01.197232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:01.198801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:01.212325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f060304-584e-4eff-928c-f01df5e96c15 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:01.216720 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:01.217354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:01.217634 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:01.217909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:01.219666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:01.230123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:01.232180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:01.241724 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4471/8922] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:30:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:30:04.215626 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:04.226014 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3e514-0d09-4639-af29-1d8ef57b8da5 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:04.229922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:04.231032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:04.231317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:04.231598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:04.233570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:04.244016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:04.245523 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:04.255198 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4452/8923] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:30:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:30:11.238091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:14.251395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:17.475939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:17.491852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7c1e-b890-43dd-b3c2-fb3d1fba23d4 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:17.498406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:17.499266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:17.499545 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:17.499821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] PATH_INFO: `/v3/users/4e9ae5054256463d8c9b1a0b8f627283` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:17.501339 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9ae5054256463d8c9b1a0b8f627283)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:17.503256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:17.558610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9ae5054256463d8c9b1a0b8f627283'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.578765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9ae5054256463d8c9b1a0b8f627283'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.579527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9ae5054256463d8c9b1a0b8f627283'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.590197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9ae5054256463d8c9b1a0b8f627283'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.591347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3794d9f7-a6e2-4ac9-b4ae-abb11d7e3b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9ae5054256463d8c9b1a0b8f627283'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.611185 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4472/8924] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:30:17 2022] DELETE /identity/v3/users/4e9ae5054256463d8c9b1a0b8f627283 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:30:17.786750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:17.799065 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348ec5b-3f70-41bf-a68e-163185a7d27d service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:17.860578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:17.860578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:17.860578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:17.860578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] PATH_INFO: `/v3/projects/1ac0643217d0435887d49994cd7620e4` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:17.861093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac0643217d0435887d49994cd7620e4)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:17.861816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:17.920876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac0643217d0435887d49994cd7620e4', 'request_id': 'req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.928266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac0643217d0435887d49994cd7620e4', 'request_id': 'req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.934709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac0643217d0435887d49994cd7620e4', 'request_id': 'req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.945766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] The token cache is being invalidate because project 1ac0643217d0435887d49994cd7620e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:30:17.946063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.946710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-62e9a4e6-6e98-43d3-9567-6d3f6cabc1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:30:17.948357 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4453/8925] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:30:17 2022] DELETE /identity/v3/projects/1ac0643217d0435887d49994cd7620e4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:30:17.953585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:17.953905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:17.954182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:17.975218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:30:17.976437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:18.039492 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4473/8926] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:30:18.048975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.049361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.049649 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.071362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:30:18.072572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:18.081200 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4454/8927] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:30:18.085445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.095818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77948446-32af-4b99-8dee-0b64b40c3b19 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.100434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.101075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.101361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.101639 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.102535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:30:18.102838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.104433 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.116543 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4474/8928] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:30:18.120791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.129935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37238a6-5158-43ee-8d27-ae1f0c970b1f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.134508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.135092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.135371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.135643 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.136883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.138788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.168494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4455/8929] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:30:18 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:30:18.170153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.180512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f78af3-97b1-437c-b53a-823d4ef3dee0 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.239149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.239761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.240040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.240313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.240978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.242944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.252071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:18.267273 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4475/8930] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:30:18 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:30:18.271615 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.282512 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297191f-67f4-48ff-b0af-9cc4a1533f67 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.287300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.287842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.288127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.288404 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.289083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.290679 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.302077 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4456/8931] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:30:18.306163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.316646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87470d2a-4ccd-4a7d-b32f-664eaf0034eb admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.321244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72873-3777-4720-a92e-cd4cdc884060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.321838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72873-3777-4720-a92e-cd4cdc884060 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.322119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72873-3777-4720-a92e-cd4cdc884060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.322394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72873-3777-4720-a92e-cd4cdc884060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.323032 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72873-3777-4720-a92e-cd4cdc884060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.324721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72873-3777-4720-a92e-cd4cdc884060 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.335710 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4476/8932] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:30:18.340521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.350596 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb707d-bf13-4279-ac3f-5af11c021809 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.356656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.357371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.357655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.357936 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] PATH_INFO: `/v3/projects/cb907a92ab7949ebb3cb2e3b5d372ece/users/64375d765c0949dbb75c91906f8bca3c/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.373480 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb907a92ab7949ebb3cb2e3b5d372ece, user_id=64375d765c0949dbb75c91906f8bca3c, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.376153 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.389127 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4457/8933] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:30:18 2022] PUT /identity/v3/projects/cb907a92ab7949ebb3cb2e3b5d372ece/users/64375d765c0949dbb75c91906f8bca3c/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:30:18.394178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5eec-1b84-4e63-9d59-47cc21aa2938 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.394499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5eec-1b84-4e63-9d59-47cc21aa2938 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.394782 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5eec-1b84-4e63-9d59-47cc21aa2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.413642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ec4e5eec-1b84-4e63-9d59-47cc21aa2938 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:30:18.414850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec4e5eec-1b84-4e63-9d59-47cc21aa2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:18.473581 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4477/8934] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:30:18.484452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:18.486195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:18.516952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:18.546105 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30a53-0204-48dc-9bd8-d85a012f31d9 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:18.549775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:18.550376 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:18.550661 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:18.550938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:18.559955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:18.561493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:18.570986 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4458/8935] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:30:22.765749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf99-b574-49f4-8bc2-6867a4db1904 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:22.766318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf99-b574-49f4-8bc2-6867a4db1904 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:22.766318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf99-b574-49f4-8bc2-6867a4db1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:22.806025 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8d0bcf99-b574-49f4-8bc2-6867a4db1904 None None] MFA Rules not processed for user `64375d765c0949dbb75c91906f8bca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:30:22.807381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8d0bcf99-b574-49f4-8bc2-6867a4db1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:22.897502 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4478/8936] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:30:22.914232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:30:22.915784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:23.001851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8f5ed-f6ab-47b6-b9c2-0826a74dcc69 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:30:23.007324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:30:23.007935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:23.008219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:23.008494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:23.017992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:30:23.019591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:30:23.029010 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4459/8937] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:30:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:30:24.677034 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:30:24.677986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:30:24.678334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:30:24.709473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] MFA Rules not processed for user `64375d765c0949dbb75c91906f8bca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:30:24.710706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:30:24.718564 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4479/8938] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:30:33.024677 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=48 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:30:34.702334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:43.116391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:31:43.126127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0985-ed43-4348-8a2a-58e21772b035 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:31:43.129781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:31:43.130383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:31:43.130666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:31:43.130946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:31:43.132670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:31:43.146531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:31:43.147961 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:31:43.158939 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4460/8939] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:31:43.349001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:31:43.359577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3a5ed-e3cb-4198-958f-e2fcf1caff7b None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:31:43.364249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:31:43.365019 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:31:43.365306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:31:43.365584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:31:43.367351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:31:43.381503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:31:43.383118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bea12d-0dfb-4c1b-832b-796a6fb304e3 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:31:43.395132 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4480/8940] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:31:53.154179 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:53.390169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:31:58.300997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:31:58.313165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0608fb7-f188-493c-ad6e-39e4c7eef144 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:31:58.319144 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:31:58.319789 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:31:58.320076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:31:58.320355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:31:58.322229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:31:58.334602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:31:58.336195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:31:58.347791 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4461/8941] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:31:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:32:08.343199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:10.305276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:32:10.305755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:32:10.305855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:32:10.324575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] MFA Rules not processed for user `64375d765c0949dbb75c91906f8bca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:32:10.325954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:32:10.332740 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4481/8942] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:32:19.763885 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:32:19.785981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae80033-e7be-456b-8b3f-01b213186ede service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:32:19.791524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:32:19.792128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:32:19.792875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:32:19.792875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:32:19.794444 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:32:19.806883 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:32:19.808465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:32:19.819373 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4462/8943] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:32:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:32:20.319703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:32:29.814703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:04.527879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:33:04.529421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:04.607658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165b6e-051a-46b4-8136-fd473eecbb6f None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:33:04.612656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:33:04.613906 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:04.614189 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:04.614468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:04.616164 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:04.627956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:33:04.629560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:33:04.639343 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4482/8944] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:33:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:33:14.635096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=36 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:46.059010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:33:46.060552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:46.082048 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2f8eb-7954-4a99-b905-3d9f4884c69f service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:33:46.085777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:33:46.086383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:46.086665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:46.086940 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:46.088660 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:46.098625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:33:46.100061 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff0dac-aa2b-47ea-bb2e-434159275141 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:33:46.109151 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4463/8945] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:33:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:33:46.187713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:33:46.189243 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:46.202779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4bdd-6ad8-4021-9ccb-8a6e156ffc12 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:33:46.208169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:33:46.208781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:46.209131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:46.209409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:46.211582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:46.223854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:33:46.225466 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:33:46.235723 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4483/8946] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:33:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:33:46.406371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:46.406659 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:46.406965 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:46.426897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:33:46.428106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:46.437127 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4464/8947] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:33:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:33:46.447098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:33:46.456735 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9b2bd-dded-4148-8bfc-1691c2387354 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:33:46.460325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:33:46.460997 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:46.461266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:46.461662 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:46.472538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:33:46.474059 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:33:46.485140 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4484/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:33:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:33:46.549980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:33:46.561705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e9eb7-6aba-4c5b-ab51-c34735dea37b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:33:46.566722 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:33:46.567319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:46.567601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:46.567873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:46.569594 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:46.581454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:33:46.583030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4511bee-2fc1-40f7-8ba4-651cd5f73d99 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:33:46.592951 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4465/8949] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:33:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:33:56.480363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:56.588616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=19 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:33:59.406383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:33:59.418177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4dedf-503a-408b-a9ff-cbb5d6e7dfc8 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:33:59.423236 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:33:59.423846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:33:59.424130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:33:59.424408 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:33:59.426183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:33:59.438235 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:33:59.439814 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:33:59.450447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4485/8950] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:33:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:34:05.010417 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:34:05.010914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:34:05.011091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:34:05.029866 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] MFA Rules not processed for user `64375d765c0949dbb75c91906f8bca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:34:05.031062 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:34:05.037887 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4466/8951] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:34:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:34:05.347345 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:34:05.357592 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7aea-8542-40af-81eb-4fe41c3aa1fd service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:34:05.361159 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:34:05.361749 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:34:05.362030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:34:05.362303 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:34:05.363991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:34:05.373760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:34:05.375178 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:34:05.383227 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4486/8952] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:34:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:34:15.025046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:34:15.379618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:07.115165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:35:07.124806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a702b7-fd05-48fd-a1cc-d0df63412e1c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:35:07.128374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:35:07.129008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:35:07.129294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:35:07.129565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:35:07.131257 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:35:07.140876 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:35:07.142308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:35:07.149900 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4467/8953] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:35:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:35:17.146562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:29.413889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:35:29.415500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:35:29.430999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae2bb3-0eed-457f-b51b-a10e5712616d service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:35:29.436688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495058a4-681b-41ee-8b2b-93d28efa8fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:35:29.437317 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495058a4-681b-41ee-8b2b-93d28efa8fc2 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:35:29.437601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495058a4-681b-41ee-8b2b-93d28efa8fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:35:29.437874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495058a4-681b-41ee-8b2b-93d28efa8fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:35:29.445538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495058a4-681b-41ee-8b2b-93d28efa8fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:35:29.447096 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495058a4-681b-41ee-8b2b-93d28efa8fc2 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:35:29.456373 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4487/8954] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:35:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:35:39.452403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:35:43.708807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:35:43.718152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f551566-b682-4c85-b723-75489307b3d2 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:35:43.721766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:35:43.722363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:35:43.722646 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:35:43.722921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:35:43.724634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:35:43.734428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:35:43.735947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:35:43.745210 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4468/8955] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:35:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:35:53.741379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:02.584923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:36:02.585415 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:36:02.585515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:36:02.605723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] MFA Rules not processed for user `64375d765c0949dbb75c91906f8bca3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:36:02.606982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:36:02.613823 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4488/8956] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:36:03.259266 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:36:03.273104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede4d1-e69d-4120-95d3-e8cfc10cfa33 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:36:03.278433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:36:03.279226 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:36:03.279513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:36:03.279782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:36:03.281613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:36:03.293995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:36:03.295891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:36:03.306104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4469/8957] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:36:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:36:12.600238 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:36:13.301630 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:19.673847 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:37:19.692889 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d590-5f26-47b1-89b7-26d3a03837d3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:37:19.696470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:37:19.697099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:37:19.697379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:37:19.697651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:37:19.735831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:37:19.737283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:37:19.747900 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4489/8958] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:37:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:37:19.939452 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:37:19.940849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:37:20.046734 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17885dc-1d56-4b23-a11a-74ab004f6ba5 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:37:20.050387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:37:20.050985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:37:20.051265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:37:20.051540 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:37:20.061531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:37:20.062950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:37:20.073630 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4470/8959] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:37:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:37:29.743201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=23 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:30.068856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=48 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:32.129471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:37:32.137916 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b42916-8a95-46e0-980a-3b499e77794e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:37:32.141485 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:37:32.142080 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:37:32.142360 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:37:32.142640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:37:32.144338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:37:32.165505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:37:32.166861 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:37:32.175203 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4490/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:37:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:37:42.171656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=11 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:37:53.895614 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:37:53.908013 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efb54f-462a-4973-8fbd-61942fe5b531 service cinder] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:37:53.914768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:37:53.915529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:37:53.915811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:37:53.916116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:37:53.926217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:37:53.927810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:37:53.950811 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4471/8961] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:38:03.935092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:08.517319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:08.529095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319bff5-6cd1-4570-8560-82717de68d9a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:08.534707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:08.535302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:08.535582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:08.535858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:08.544184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:08.545828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:08.556139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4491/8962] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:38:09.840613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:09.853531 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8040ea8-e0ad-48fb-83f7-5263b0b0d4a1 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:09.860038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:09.860651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:09.860956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:09.861427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:09.870857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:09.872449 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:09.884173 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4472/8963] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:38:18.552079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:19.879777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:42.913946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:42.923465 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77001d-6d3c-4bff-8288-68fac8d1713b service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:42.927113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:42.927702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:42.927981 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:42.928255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:42.938625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:42.940044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:42.967713 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4492/8964] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:38:46.158057 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:46.169010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f09a48-d1b7-4b8c-9d04-268afb50bfaa service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:46.174742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:46.175408 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.175739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.176010 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.177888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:46.207284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:46.209162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:46.217036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:46.227825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83cfe-9558-427d-884a-5b19c94a5c1f service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:46.233174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:46.234188 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.234690 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.235208 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] PATH_INFO: `/v3/users/64375d765c0949dbb75c91906f8bca3c` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.236539 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4473/8965] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:38:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:38:46.237343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64375d765c0949dbb75c91906f8bca3c)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:46.239422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:46.291316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64375d765c0949dbb75c91906f8bca3c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.303995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64375d765c0949dbb75c91906f8bca3c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.304666 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64375d765c0949dbb75c91906f8bca3c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.312678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64375d765c0949dbb75c91906f8bca3c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.313359 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-3a7f4aaa-d040-498b-ae67-66c90c77e45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64375d765c0949dbb75c91906f8bca3c'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.325744 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4493/8966] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:38:46 2022] DELETE /identity/v3/users/64375d765c0949dbb75c91906f8bca3c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:38:46.491801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:46.504337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75059b-4fcf-4439-831e-2bbd5d99b04a service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:46.562335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:46.562971 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.563256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.563534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] PATH_INFO: `/v3/projects/cb907a92ab7949ebb3cb2e3b5d372ece` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.564650 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb907a92ab7949ebb3cb2e3b5d372ece)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:46.566597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:46.612294 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'request_id': 'req-32690d8a-0f31-4340-a9cb-37ee1f28ef18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.619705 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'request_id': 'req-32690d8a-0f31-4340-a9cb-37ee1f28ef18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.626343 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb907a92ab7949ebb3cb2e3b5d372ece', 'request_id': 'req-32690d8a-0f31-4340-a9cb-37ee1f28ef18'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.652021 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] The token cache is being invalidate because project cb907a92ab7949ebb3cb2e3b5d372ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:38:46.652402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.653210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-32690d8a-0f31-4340-a9cb-37ee1f28ef18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:38:46.654928 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4474/8967] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:38:46 2022] DELETE /identity/v3/projects/cb907a92ab7949ebb3cb2e3b5d372ece => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:38:46.660618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.660925 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.661215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.718761 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:38:46.720001 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:46.778744 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4494/8968] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:38:46.787017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.787310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.787590 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.807296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:38:46.808495 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:46.816531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4475/8969] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:38:46.820865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:46.830897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168a15c-d736-4e2c-b6de-9ea31eb8a1a0 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:46.835518 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:46.836114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.836395 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.836669 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.837373 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:38:46.837676 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:46.839253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:46.848403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:46.852469 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4495/8970] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:38:46.856587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:46.866699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f0746-9fb4-4007-8bd1-6951c6038d70 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:46.871264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:46.871855 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.872133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.872403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.873058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:46.875023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:46.911712 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4476/8971] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:38:46 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:38:46.915601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:46.926132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c9df-5965-4592-a952-497516fd946c admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:46.982330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:46.982933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:46.983217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:46.983561 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:46.984194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:46.986166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:47.010142 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4496/8972] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:38:46 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:38:47.014717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:47.025786 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfac0d-36b3-41d5-94a2-134a65c066cd admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:47.030575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:47.030985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:47.031264 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:47.031535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:47.032173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:47.033798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:47.043946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4477/8973] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:38:47.048507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:47.058468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86c544-4248-4b2b-9e47-a0c7a3175240 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:47.063882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081edf3-9f3f-44b2-b918-95c0b5dd985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:47.064512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081edf3-9f3f-44b2-b918-95c0b5dd985c admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:47.064792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081edf3-9f3f-44b2-b918-95c0b5dd985c admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:47.065114 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081edf3-9f3f-44b2-b918-95c0b5dd985c admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:47.065763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081edf3-9f3f-44b2-b918-95c0b5dd985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:47.067406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081edf3-9f3f-44b2-b918-95c0b5dd985c admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:47.079527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4497/8974] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:38:47.083513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:47.094054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ee84-1fcd-46ce-93ca-bbbe14264336 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:47.098748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:47.099398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:47.099683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:47.099964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] PATH_INFO: `/v3/projects/926dfcc8429e4fdd99cb433569c494bc/users/377b0fcd349d4c3eae51feadde81b59f/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:47.102420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:47.118709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926dfcc8429e4fdd99cb433569c494bc, user_id=377b0fcd349d4c3eae51feadde81b59f, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:47.121340 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:47.134929 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4478/8975] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:38:47 2022] PUT /identity/v3/projects/926dfcc8429e4fdd99cb433569c494bc/users/377b0fcd349d4c3eae51feadde81b59f/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:38:47.140494 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71578-0de0-44ec-aab3-0f2d3d5704dc None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:47.140786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71578-0de0-44ec-aab3-0f2d3d5704dc None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:47.141091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71578-0de0-44ec-aab3-0f2d3d5704dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:47.159893 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-10d71578-0de0-44ec-aab3-0f2d3d5704dc None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:38:47.161124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-10d71578-0de0-44ec-aab3-0f2d3d5704dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:47.218862 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4498/8976] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:38:47.228700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:47.230403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:47.287051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54585eb-fc65-44d9-818a-1c1467cdcdb1 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:47.290782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc7068-5db2-494d-b4f5-7c31b69a589f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:47.291383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc7068-5db2-494d-b4f5-7c31b69a589f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:47.291667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc7068-5db2-494d-b4f5-7c31b69a589f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:47.291943 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc7068-5db2-494d-b4f5-7c31b69a589f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:47.301602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc7068-5db2-494d-b4f5-7c31b69a589f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:47.303031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc7068-5db2-494d-b4f5-7c31b69a589f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:47.313107 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4479/8977] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:38:51.117798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:51.118291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:51.118441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:51.148082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] MFA Rules not processed for user `377b0fcd349d4c3eae51feadde81b59f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:38:51.149417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:51.219867 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4499/8978] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:38:51.232468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa264-eacd-4a0e-8e08-f79ff6847896 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:51.232894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa264-eacd-4a0e-8e08-f79ff6847896 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:51.233108 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa264-eacd-4a0e-8e08-f79ff6847896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:51.253150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-958aa264-eacd-4a0e-8e08-f79ff6847896 None None] MFA Rules not processed for user `377b0fcd349d4c3eae51feadde81b59f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:38:51.254621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-958aa264-eacd-4a0e-8e08-f79ff6847896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:51.262948 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4480/8979] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:38:51.274769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:38:51.276177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:38:51.291171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:38:51.371984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f35713-93f7-4dc5-9705-92cfeca02c69 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:38:51.378647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:38:51.379263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:38:51.379547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:38:51.379829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:38:51.387858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:38:51.390047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:38:51.399447 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4500/8980] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:38:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:01.246698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:01.395113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=35 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:03.787384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:03.787877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:03.787976 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:03.807216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] MFA Rules not processed for user `377b0fcd349d4c3eae51feadde81b59f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:03.808681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:03.815825 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4481/8981] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:39:04.400927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:04.402577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:04.472772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66455ee4-871e-4ff7-95a8-08611e1f1ce7 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:04.478016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:04.478617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:04.478898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:04.479172 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:04.480860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:04.492417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:04.494051 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:04.504926 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4501/8982] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:05.007129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:05.008551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:05.024031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8e96-fe3b-4008-9a2f-7931cc1292da None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:05.029028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:05.030361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:05.030813 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:05.031098 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:05.032840 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:05.043986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:05.045802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:05.055615 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4482/8983] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:14.500553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=32 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:15.051352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=9 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:28.079982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.096135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c8f0c-7e7b-4986-94ab-651f945b00b8 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.105082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.105927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.105927 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.106115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] PATH_INFO: `/v3/users/377b0fcd349d4c3eae51feadde81b59f` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.107381 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=377b0fcd349d4c3eae51feadde81b59f)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.109393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.179855 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377b0fcd349d4c3eae51feadde81b59f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.193024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377b0fcd349d4c3eae51feadde81b59f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.193732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377b0fcd349d4c3eae51feadde81b59f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.200963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377b0fcd349d4c3eae51feadde81b59f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.201581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-189d3ecc-df04-4bee-b4f9-c6770a438e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377b0fcd349d4c3eae51feadde81b59f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.214718 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4502/8984] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:39:28 2022] DELETE /identity/v3/users/377b0fcd349d4c3eae51feadde81b59f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:28.384713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.397477 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b1979-54db-4ec5-a5e6-55cb1be407e6 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.459917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.460546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.460833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.461171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] PATH_INFO: `/v3/projects/926dfcc8429e4fdd99cb433569c494bc` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.462286 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926dfcc8429e4fdd99cb433569c494bc)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.464490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.510746 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926dfcc8429e4fdd99cb433569c494bc', 'request_id': 'req-c38bf22f-d005-4d36-a974-6c5eacce5fa3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.518359 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926dfcc8429e4fdd99cb433569c494bc', 'request_id': 'req-c38bf22f-d005-4d36-a974-6c5eacce5fa3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.524064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926dfcc8429e4fdd99cb433569c494bc', 'request_id': 'req-c38bf22f-d005-4d36-a974-6c5eacce5fa3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.535217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] The token cache is being invalidate because project 926dfcc8429e4fdd99cb433569c494bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:39:28.535639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.536284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-c38bf22f-d005-4d36-a974-6c5eacce5fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:28.537796 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4483/8985] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:39:28 2022] DELETE /identity/v3/projects/926dfcc8429e4fdd99cb433569c494bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:28.542714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.543002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.543278 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.563688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:28.565081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:28.623047 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4503/8986] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:28.632278 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.632564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.632858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.658336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:28.659571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:28.667639 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4484/8987] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:28.671935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.682195 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039380af-b752-49af-bd50-64d2c8a2d259 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.686750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.687344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.687626 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.687904 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.688543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:39:28.689511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.691107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.702490 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4504/8988] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:39:28.707317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.716493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449079e-5f49-4a63-a737-86c0f5399043 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.721407 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.721998 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.722279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.722549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.723204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.725114 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.753777 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4485/8989] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:39:28 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:39:28.757998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.767941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe258c-0c00-4361-abe9-eabb065679f4 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.824335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.824873 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.825194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.825476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.826119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.828055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.836766 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:28.851574 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4505/8990] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:39:28 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:39:28.855787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.867752 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429e030-b84d-4950-9774-8132a51918a3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.872475 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.873110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.873398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.873681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.874355 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.875983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.887024 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4486/8991] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:39:28.890905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.900922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77e2e6-5eae-4573-ba60-0b64d2643e6d admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.905878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9b7c-9cd4-4329-999c-2ef87741c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.906482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9b7c-9cd4-4329-999c-2ef87741c180 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.906767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9b7c-9cd4-4329-999c-2ef87741c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.907046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9b7c-9cd4-4329-999c-2ef87741c180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.907797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9b7c-9cd4-4329-999c-2ef87741c180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.909471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9b7c-9cd4-4329-999c-2ef87741c180 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.920259 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4506/8992] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:39:28.924860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:28.934742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cf4ad-0fba-485c-a462-ac69b541ba43 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:28.940141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:28.940781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.941084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.941362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] PATH_INFO: `/v3/projects/b9ae78f955e24f1a82fc7926cf4dc9de/users/2bae066033ea45ce8cf78454f3cdff7e/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:28.956008 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ae78f955e24f1a82fc7926cf4dc9de, user_id=2bae066033ea45ce8cf78454f3cdff7e, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:28.958753 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:28.972208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4487/8993] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:39:28 2022] PUT /identity/v3/projects/b9ae78f955e24f1a82fc7926cf4dc9de/users/2bae066033ea45ce8cf78454f3cdff7e/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:28.983056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:28.983349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:28.983636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:29.013045 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] MFA Rules not processed for user `2bae066033ea45ce8cf78454f3cdff7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:29.014267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:29.077314 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4507/8994] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:29.087522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:29.089347 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:29.122025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:29.149556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1389d-4269-4380-a525-1a4db9a8e148 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:29.153164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:29.153764 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:29.154043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:29.154317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:29.162957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:29.164374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:29.173578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4488/8995] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:34.244691 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:34.246232 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:34.351838 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e2003-910a-4b4b-9b1c-9fb0f938f7af None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:34.364792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:34.365926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:34.366312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:34.366689 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:34.369379 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:34.392672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:34.394960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d4ef-cd60-4def-a636-ac8c0d0ba5e1 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:34.412063 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4508/8996] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:39.169199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=14 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:41.018336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:41.083472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88562-8654-4294-9b90-39850a2a012c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:41.088164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:41.088892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.089208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.089483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] PATH_INFO: `/v3/users/2bae066033ea45ce8cf78454f3cdff7e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.090793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bae066033ea45ce8cf78454f3cdff7e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:41.092725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:41.140699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bae066033ea45ce8cf78454f3cdff7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.153682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bae066033ea45ce8cf78454f3cdff7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.154400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bae066033ea45ce8cf78454f3cdff7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.162859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bae066033ea45ce8cf78454f3cdff7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.163631 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bae066033ea45ce8cf78454f3cdff7e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.177710 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4489/8997] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:39:41 2022] DELETE /identity/v3/users/2bae066033ea45ce8cf78454f3cdff7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:41.182281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.182806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.182910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.204564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:41.205541 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:41.263266 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:41.274881 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4509/8998] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:39:41.284806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:41.286271 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:41.346186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a09744-ba2f-466e-85cc-af410b50f01f admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:41.349828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeab2b7-3be5-45d5-84c1-cdc0a17fb258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:41.350430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeab2b7-3be5-45d5-84c1-cdc0a17fb258 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.350710 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeab2b7-3be5-45d5-84c1-cdc0a17fb258 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.350985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeab2b7-3be5-45d5-84c1-cdc0a17fb258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.361220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeab2b7-3be5-45d5-84c1-cdc0a17fb258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:41.362648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeab2b7-3be5-45d5-84c1-cdc0a17fb258 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:41.372178 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4490/8999] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:41.545325 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:41.546868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:41.565849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ae47-cc2f-4000-b406-20e1b0defad3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:41.570930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:41.571606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.571890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.572213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] PATH_INFO: `/v3/projects/b9ae78f955e24f1a82fc7926cf4dc9de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.573375 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ae78f955e24f1a82fc7926cf4dc9de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:41.575310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:41.629582 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ae78f955e24f1a82fc7926cf4dc9de', 'request_id': 'req-4a3abc23-e88e-48da-b730-ed6206d2ef8f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.637079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ae78f955e24f1a82fc7926cf4dc9de', 'request_id': 'req-4a3abc23-e88e-48da-b730-ed6206d2ef8f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.645264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ae78f955e24f1a82fc7926cf4dc9de', 'request_id': 'req-4a3abc23-e88e-48da-b730-ed6206d2ef8f'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.662007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] The token cache is being invalidate because project b9ae78f955e24f1a82fc7926cf4dc9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:39:41.662933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.663629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-4a3abc23-e88e-48da-b730-ed6206d2ef8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:41.665390 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4510/9000] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:39:41 2022] DELETE /identity/v3/projects/b9ae78f955e24f1a82fc7926cf4dc9de => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:41.670241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.670536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.670814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.692222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:41.693457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:41.715274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:41.768316 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4491/9001] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:39:41.775850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.776140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.776421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.796995 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:41.798770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:41.806616 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4511/9002] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:41.810818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:41.821311 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b60c7a-4de5-4396-b203-0e30f9ee73b4 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:41.825941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:41.826548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.826830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.827123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.827744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:39:41.828049 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:41.830476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:41.842753 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4492/9003] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:39:41.847271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:41.856778 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a821b-04d0-48a8-904f-1bccf06919c4 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:41.861658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:41.862387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.862671 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.862944 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.863604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:41.865593 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:41.899032 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4512/9004] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:39:41.903369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:41.913878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c8ce4-752d-4f3c-bc11-a08b0dcd7948 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:41.972193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:41.972800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:41.973118 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:41.974025 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:41.974690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:41.977054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:42.002725 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4493/9005] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:39:41 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:39:42.006739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:42.017852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5852b-dfa2-40cc-9c08-905753d932ab admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:42.022542 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:42.023144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:42.023429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:42.023926 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:42.024588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:42.026217 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:42.036639 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4513/9006] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:39:42.040716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:42.051549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d13d9-534f-4816-b1f5-b80cf27e46f7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:42.056471 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeeea7d-3db3-4693-8abf-16af7273373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:42.057120 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeea7d-3db3-4693-8abf-16af7273373d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:42.057406 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeea7d-3db3-4693-8abf-16af7273373d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:42.057680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeeea7d-3db3-4693-8abf-16af7273373d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:42.058325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeea7d-3db3-4693-8abf-16af7273373d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:42.059925 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeeea7d-3db3-4693-8abf-16af7273373d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:42.074668 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4494/9007] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:39:42.075966 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:42.086704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544af4ef-d365-407c-afce-a07e8e722b68 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:42.091961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:42.092682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:42.093006 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:42.093286 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] PATH_INFO: `/v3/projects/3a9abddc606a498db117c0f31d5d24da/users/c45e3a6a9a294319ba4a4ce2c27c73c9/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:42.108390 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9abddc606a498db117c0f31d5d24da, user_id=c45e3a6a9a294319ba4a4ce2c27c73c9, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:42.111883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:42.126928 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4514/9008] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:39:42 2022] PUT /identity/v3/projects/3a9abddc606a498db117c0f31d5d24da/users/c45e3a6a9a294319ba4a4ce2c27c73c9/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:39:42.136600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:42.136893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:42.137200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:42.165806 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] MFA Rules not processed for user `c45e3a6a9a294319ba4a4ce2c27c73c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:42.167027 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:42.233985 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4495/9009] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:42.244756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:42.246560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:42.307984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750f7db-ca57-48a9-b410-085b7cbcaada admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:42.311887 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0793db0-4e63-4bf5-925e-67643a785511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:42.312509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0793db0-4e63-4bf5-925e-67643a785511 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:42.312794 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0793db0-4e63-4bf5-925e-67643a785511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:42.313107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0793db0-4e63-4bf5-925e-67643a785511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:42.321496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0793db0-4e63-4bf5-925e-67643a785511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:42.322919 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0793db0-4e63-4bf5-925e-67643a785511 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:42.332086 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4515/9010] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:46.617200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:46.636995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:46.689716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5120bf-49bb-45c8-9200-7c1c6798a0f3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:46.694185 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:46.694810 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:46.695093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:46.695368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] PATH_INFO: `/v3/users/c45e3a6a9a294319ba4a4ce2c27c73c9` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:46.696474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45e3a6a9a294319ba4a4ce2c27c73c9)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:46.698420 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:46.743947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45e3a6a9a294319ba4a4ce2c27c73c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:46.755748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45e3a6a9a294319ba4a4ce2c27c73c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:46.756429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45e3a6a9a294319ba4a4ce2c27c73c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:46.763760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45e3a6a9a294319ba4a4ce2c27c73c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:46.764580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45e3a6a9a294319ba4a4ce2c27c73c9'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:46.777308 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4496/9011] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:39:46 2022] DELETE /identity/v3/users/c45e3a6a9a294319ba4a4ce2c27c73c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:46.782602 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:46.783077 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:46.783211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:46.801899 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:46.803095 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:46.815677 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:46.864601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4516/9012] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:46.874393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:46.875875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:46.935833 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d64246-13ef-4fd2-a38f-0c0f728153c8 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:46.940170 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222341a7-b28a-411e-a010-63041b9f91fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:46.940774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222341a7-b28a-411e-a010-63041b9f91fa service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:46.941086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222341a7-b28a-411e-a010-63041b9f91fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:46.941390 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222341a7-b28a-411e-a010-63041b9f91fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:46.950409 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222341a7-b28a-411e-a010-63041b9f91fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:46.951837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222341a7-b28a-411e-a010-63041b9f91fa service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:46.962050 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4497/9013] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:47.134965 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.136394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:47.148938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529dfe-2ee6-4a3b-8842-ec7f1c33d091 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.153473 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.154111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.154400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.154680 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] PATH_INFO: `/v3/projects/3a9abddc606a498db117c0f31d5d24da` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.155804 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9abddc606a498db117c0f31d5d24da)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.157907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.206763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9abddc606a498db117c0f31d5d24da', 'request_id': 'req-8ec1a012-4e9f-43ca-abe5-85fe1219566a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:47.212405 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9abddc606a498db117c0f31d5d24da', 'request_id': 'req-8ec1a012-4e9f-43ca-abe5-85fe1219566a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:47.218584 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9abddc606a498db117c0f31d5d24da', 'request_id': 'req-8ec1a012-4e9f-43ca-abe5-85fe1219566a'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:47.230932 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] The token cache is being invalidate because project 3a9abddc606a498db117c0f31d5d24da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:39:47.231225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:47.231848 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-8ec1a012-4e9f-43ca-abe5-85fe1219566a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:39:47.233432 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4517/9014] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:39:47 2022] DELETE /identity/v3/projects/3a9abddc606a498db117c0f31d5d24da => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:47.240252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.240541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.240819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.261652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:47.262858 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:47.296356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:47.325790 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4498/9015] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:47.334856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.335145 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.335423 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.356158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:47.357380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:47.365461 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4518/9016] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:47.369651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.379363 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1353ab7-6bc1-4237-9474-5c84c518ceba None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.383933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.384524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.384805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.385104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.385739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:39:47.386041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.387613 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.399302 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4499/9017] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:39:47.403418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.413641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1513e-2915-4ae8-adf6-75b96d88d616 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.418552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.419237 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.419553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.419830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.420462 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.422445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.449178 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4519/9018] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:39:47 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:39:47.453303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.464019 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411346-f47d-472b-8035-86e18b4909fc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.520567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.521195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.521479 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.521750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.522379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.524272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.549314 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4500/9019] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:39:47 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:39:47.550437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.560483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fa679-c1fa-41e8-a768-528025d9f2d2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.565978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.566585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.566865 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.567135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.567805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.569421 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.579952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4520/9020] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:39:47.583770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.594856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fac487-cb22-499d-8b72-75b418470e7b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.599441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6b8e-3150-4663-858a-d3f3fa07b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.600035 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6b8e-3150-4663-858a-d3f3fa07b791 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.600315 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6b8e-3150-4663-858a-d3f3fa07b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.600592 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6b8e-3150-4663-858a-d3f3fa07b791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.601277 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6b8e-3150-4663-858a-d3f3fa07b791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.603086 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6b8e-3150-4663-858a-d3f3fa07b791 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.613696 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4501/9021] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:39:47.617835 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.627648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38187cd-73b6-4746-9d83-d6c9efad3a41 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.632267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.632935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.633221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.633502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] PATH_INFO: `/v3/projects/9c6019d6170d4feea446e485314eaf43/users/a456f2c35f924b058073a994cfdfb8c2/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.654993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6019d6170d4feea446e485314eaf43, user_id=a456f2c35f924b058073a994cfdfb8c2, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.658668 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.676948 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4521/9022] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:39:47 2022] PUT /identity/v3/projects/9c6019d6170d4feea446e485314eaf43/users/a456f2c35f924b058073a994cfdfb8c2/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:39:47.682079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd6844-9a9b-43f3-9bae-1dbec5fd2ab4 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.682549 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd6844-9a9b-43f3-9bae-1dbec5fd2ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.682856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd6844-9a9b-43f3-9bae-1dbec5fd2ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.702500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-89cd6844-9a9b-43f3-9bae-1dbec5fd2ab4 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:47.704263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-89cd6844-9a9b-43f3-9bae-1dbec5fd2ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:47.765672 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4502/9023] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:47.776213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:47.777963 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:47.821133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:47.837628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546170d6-770f-454d-acb5-0cef136ac5e8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:47.841457 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:47.842072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:47.842356 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:47.842630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:47.852079 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:47.853558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:47.862941 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4522/9024] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:52.038386 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.038897 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.039017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.070522 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] MFA Rules not processed for user `a456f2c35f924b058073a994cfdfb8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:52.071884 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:52.118559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:52.158789 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4503/9025] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:52.163990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:52.177166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cf978-a6ab-4c4e-8404-98a4cf3c2177 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:52.182934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:52.183564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.184369 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.184665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.185366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:52.187331 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:52.229944 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4523/9026] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:39:52 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:39:52.234074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:52.246229 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ba440-a101-4714-afd0-ea9fa5e39fb8 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:52.313424 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:52.314041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.314369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.314606 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.315206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:52.317133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:52.338720 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4504/9027] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:39:52 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:39:52.342696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:52.353315 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6662db-1f19-4024-9bdc-d6a9a93efbd1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:52.357830 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:52.358428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.358718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.358996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.359642 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:52.361528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:52.372021 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4524/9028] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:39:52.376759 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:52.386762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0127c99-f17c-4409-81b6-7060121fcbdf admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:52.391967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:52.392609 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.392889 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.393189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] PATH_INFO: `/v3/projects/a24322ff019143f9b6e67d9851c02a52/users/6c03fea5bbe24746bd977d5cb98af89b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.408052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24322ff019143f9b6e67d9851c02a52, user_id=6c03fea5bbe24746bd977d5cb98af89b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:52.410723 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:52.424082 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4505/9029] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:39:52 2022] PUT /identity/v3/projects/a24322ff019143f9b6e67d9851c02a52/users/6c03fea5bbe24746bd977d5cb98af89b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:52.428127 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:52.439301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2802-86a6-46b7-a5d2-efefbbc76c48 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:52.495414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717f86e-ec29-48d8-b076-630d83aba6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:52.496020 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717f86e-ec29-48d8-b076-630d83aba6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.496302 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717f86e-ec29-48d8-b076-630d83aba6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.496578 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717f86e-ec29-48d8-b076-630d83aba6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.497240 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717f86e-ec29-48d8-b076-630d83aba6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:52.498828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717f86e-ec29-48d8-b076-630d83aba6d9 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:52.508775 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4525/9030] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:39:52.513275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:52.524313 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbc0e3-01b0-400e-a667-ff5ba9f65979 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:52.529528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:52.530189 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:52.530472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:52.530750 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] PATH_INFO: `/v3/projects/a24322ff019143f9b6e67d9851c02a52/users/6c03fea5bbe24746bd977d5cb98af89b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:52.533125 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24322ff019143f9b6e67d9851c02a52, user_id=6c03fea5bbe24746bd977d5cb98af89b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:52.535776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:52.546273 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4506/9031] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:39:52 2022] PUT /identity/v3/projects/a24322ff019143f9b6e67d9851c02a52/users/6c03fea5bbe24746bd977d5cb98af89b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:39:57.225821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074bcd1-796f-4e47-97ea-d48d876c5c89 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:57.226617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074bcd1-796f-4e47-97ea-d48d876c5c89 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:57.226617 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074bcd1-796f-4e47-97ea-d48d876c5c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:57.266308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4074bcd1-796f-4e47-97ea-d48d876c5c89 None None] MFA Rules not processed for user `6c03fea5bbe24746bd977d5cb98af89b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:57.267547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4074bcd1-796f-4e47-97ea-d48d876c5c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:57.365051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4526/9032] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:39:57.383051 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:39:57.385296 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:57.494224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbfc3a-f335-4484-9894-958066390c3d admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:39:57.500000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:39:57.500665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:57.501023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:57.501305 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:57.526959 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:39:57.563284 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:39:57.564992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:39:57.574494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4507/9033] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:39:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:39:57.646753 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:39:57.647403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:39:57.647588 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:39:57.672719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] MFA Rules not processed for user `a456f2c35f924b058073a994cfdfb8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:39:57.674063 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:39:57.682615 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4527/9034] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:39:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:40:07.570140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=16 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:07.662577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:08.152000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:40:08.153648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:40:08.219922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bf3de-a545-451f-9ff2-45f82b39efa5 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:40:08.223607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4be250-d4e1-440e-98ee-ea69b6f33d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b074e2c621494cdfa6efc21e4a5c021b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:40:08.224216 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4be250-d4e1-440e-98ee-ea69b6f33d01 service cinder] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:40:08.224496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4be250-d4e1-440e-98ee-ea69b6f33d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:40:08.224773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4be250-d4e1-440e-98ee-ea69b6f33d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:40:08.234096 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4be250-d4e1-440e-98ee-ea69b6f33d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:40:08.235526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4be250-d4e1-440e-98ee-ea69b6f33d01 service cinder] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:40:08.245051 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4508/9035] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:40:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:40:15.113026 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:40:15.167368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916277c-8fc5-4720-9b04-6b60e41ece64 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:40:15.170896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:40:15.171493 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:40:15.171774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:40:15.172050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:40:15.173792 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:40:15.183011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:40:15.184417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8aabe-5e0e-4f12-861f-84951978878d service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:40:15.192369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4528/9036] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:40:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:40:18.240738 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=26 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:25.188960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=26 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:40:33.516032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6878-4108-4c79-8520-278580002213 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:40:33.516568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6878-4108-4c79-8520-278580002213 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:40:33.516568 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b6878-4108-4c79-8520-278580002213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:40:33.535761 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-097b6878-4108-4c79-8520-278580002213 None None] MFA Rules not processed for user `a456f2c35f924b058073a994cfdfb8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:40:33.536996 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-097b6878-4108-4c79-8520-278580002213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:40:33.543820 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4509/9037] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:40:43.530032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:10.350471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:10.350982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:10.351101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:10.370349 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] MFA Rules not processed for user `a456f2c35f924b058073a994cfdfb8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:41:10.371546 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:10.378909 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4529/9038] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:41:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:41:10.966092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b6878-4108-4c79-8520-278580002213 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:10.967574 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-097b6878-4108-4c79-8520-278580002213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:11.039817 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b6878-4108-4c79-8520-278580002213 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:11.045142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:11.045760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:11.046117 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:11.046949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:11.048792 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:11.060375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:11.062197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:11.072061 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4510/9039] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:41:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:41:20.365450 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:21.067985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=32 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:54.440627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:54.509851 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dca5d4-53c5-4841-9188-cd77f1719a2c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:54.514810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:54.515429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:54.515709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:54.516015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] PATH_INFO: `/v3/users/a456f2c35f924b058073a994cfdfb8c2` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:54.517185 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a456f2c35f924b058073a994cfdfb8c2)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:54.519119 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:54.571340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a456f2c35f924b058073a994cfdfb8c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.585628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a456f2c35f924b058073a994cfdfb8c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.586330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a456f2c35f924b058073a994cfdfb8c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.594702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a456f2c35f924b058073a994cfdfb8c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.595372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a456f2c35f924b058073a994cfdfb8c2'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.608500 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4530/9040] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:41:54 2022] DELETE /identity/v3/users/a456f2c35f924b058073a994cfdfb8c2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:41:54.781332 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:54.794654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4d5b-7227-4b31-be23-6b87a1195889 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:54.854736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:54.855293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:54.855576 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:54.855879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] PATH_INFO: `/v3/projects/9c6019d6170d4feea446e485314eaf43` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:54.857041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6019d6170d4feea446e485314eaf43)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:54.859704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:54.905850 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6019d6170d4feea446e485314eaf43', 'request_id': 'req-3fad037f-fd29-4516-85bf-b5b569fe552e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.912947 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6019d6170d4feea446e485314eaf43', 'request_id': 'req-3fad037f-fd29-4516-85bf-b5b569fe552e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.918526 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6019d6170d4feea446e485314eaf43', 'request_id': 'req-3fad037f-fd29-4516-85bf-b5b569fe552e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.930254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] The token cache is being invalidate because project 9c6019d6170d4feea446e485314eaf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:41:54.930550 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.931218 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:54.932720 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4511/9041] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:41:54 2022] DELETE /identity/v3/projects/9c6019d6170d4feea446e485314eaf43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:41:54.937533 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:54.938907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:54.951731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dba8a6-3431-4ff8-858f-894969f23c29 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.011204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.011836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.012118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.012392 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] PATH_INFO: `/v3/users/6c03fea5bbe24746bd977d5cb98af89b` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.013548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c03fea5bbe24746bd977d5cb98af89b)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.015658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.036564 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:55.065089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c03fea5bbe24746bd977d5cb98af89b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.076922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c03fea5bbe24746bd977d5cb98af89b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.077637 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c03fea5bbe24746bd977d5cb98af89b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.085175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c03fea5bbe24746bd977d5cb98af89b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.085856 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b6f0fa4-3d5c-42d5-a459-b003b8ce3c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c03fea5bbe24746bd977d5cb98af89b'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.098068 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4531/9042] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:41:54 2022] DELETE /identity/v3/users/6c03fea5bbe24746bd977d5cb98af89b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:41:55.273877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.275370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:55.288036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad037f-fd29-4516-85bf-b5b569fe552e admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.350345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.350981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.351259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.351788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] PATH_INFO: `/v3/projects/a24322ff019143f9b6e67d9851c02a52` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.352927 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24322ff019143f9b6e67d9851c02a52)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.354824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.391208 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:55.405483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24322ff019143f9b6e67d9851c02a52', 'request_id': 'req-eca0e68a-3c29-47f1-936e-6f6a4664309a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.412874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24322ff019143f9b6e67d9851c02a52', 'request_id': 'req-eca0e68a-3c29-47f1-936e-6f6a4664309a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.418528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24322ff019143f9b6e67d9851c02a52', 'request_id': 'req-eca0e68a-3c29-47f1-936e-6f6a4664309a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.430043 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] The token cache is being invalidate because project a24322ff019143f9b6e67d9851c02a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:41:55.430335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.430979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-eca0e68a-3c29-47f1-936e-6f6a4664309a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:41:55.432478 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4512/9043] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:41:55 2022] DELETE /identity/v3/projects/a24322ff019143f9b6e67d9851c02a52 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:41:55.438138 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.438434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.438714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.458697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:41:55.459908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:55.519111 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4532/9044] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:41:55.527823 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.528112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.528388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.548629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:41:55.549851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:55.557623 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4513/9045] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:41:55.562615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.572401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864f72-6444-458c-9d0a-f24dde3bed94 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.576937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.577522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.577801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.578074 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.578711 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81826) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:41:55.579013 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.580599 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.591937 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4533/9046] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 03:41:55.596651 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.606156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba444-3aa3-4b6c-a7e8-6aa81f1adc4d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.611370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.611960 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.612239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.612513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.613183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.615071 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.646435 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4514/9047] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:41:55 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:41:55.651041 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.661595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7f6dd-1f27-4576-b888-f4e4a3dea362 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.719414 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.719964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.720247 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.720515 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.721194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.723128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.749907 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4534/9048] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:41:55 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 03:41:55.754187 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.765941 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96655553-853b-4716-a790-f9ce63476569 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.770781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.771392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.771681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.771956 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.772601 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.774418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.785676 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4515/9049] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:41:55.789636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.800401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3a6e9-9317-4ddf-b388-26bf788d990f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.805065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11ce7-b141-4ae5-9c7e-af52f63da6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.805670 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11ce7-b141-4ae5-9c7e-af52f63da6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.805954 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11ce7-b141-4ae5-9c7e-af52f63da6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.806229 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11ce7-b141-4ae5-9c7e-af52f63da6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.806871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb11ce7-b141-4ae5-9c7e-af52f63da6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.808474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb11ce7-b141-4ae5-9c7e-af52f63da6e7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.823609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4535/9050] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:41:55.824742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.835439 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f863f-ca27-43d8-a904-14ad5e516437 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:55.840028 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:55.840669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.840985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.841261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] PATH_INFO: `/v3/projects/2e22d6e1c9a5495b8c152d7c7e5b1aff/users/cf1e0670dd7341d0a2c237722f903537/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.856362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e22d6e1c9a5495b8c152d7c7e5b1aff, user_id=cf1e0670dd7341d0a2c237722f903537, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:55.859030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:55.871643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4516/9051] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:41:55 2022] PUT /identity/v3/projects/2e22d6e1c9a5495b8c152d7c7e5b1aff/users/cf1e0670dd7341d0a2c237722f903537/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 03:41:55.877219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cbaf6-5d85-4f68-9947-2a60107bf922 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:55.877508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cbaf6-5d85-4f68-9947-2a60107bf922 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:55.877779 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cbaf6-5d85-4f68-9947-2a60107bf922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:55.885741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:41:55.898081 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-6e6cbaf6-5d85-4f68-9947-2a60107bf922 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:41:55.900110 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6e6cbaf6-5d85-4f68-9947-2a60107bf922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:55.962145 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4536/9052] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:41:55.972265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:41:55.974038 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:41:56.034623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38545fa-cd31-492d-9c46-6f4506cf0094 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:41:56.038341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:41:56.038938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:41:56.039235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:41:56.039493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:41:56.048607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:41:56.050075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:41:56.059579 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4517/9053] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:42:00.204698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.205807 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.206097 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.242536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] MFA Rules not processed for user `cf1e0670dd7341d0a2c237722f903537`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:42:00.243928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:00.316369 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4537/9054] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:42:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:42:00.320766 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:00.330970 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24ff40-ecd9-4610-91ae-336e9ecee065 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:00.335691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:00.336298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.336582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.336860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.337539 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:00.339460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:00.369646 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4518/9055] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:42:00 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:42:00.374993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:00.392018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad3f9-7963-4076-bd6a-daefd539c225 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:00.459246 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:00.459863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.460205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.460487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] PATH_INFO: `/v3/users` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.461180 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:00.463104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:00.493688 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4538/9056] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:42:00 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:42:00.495044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:00.506149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c00d1-447c-411f-a680-57d3cc7f0f50 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:00.510763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:00.511370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.511648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.511921 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.512562 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:00.514425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:00.526355 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4519/9057] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:42:00.531221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:00.541651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89e26f-abb8-4b7b-a428-245721634650 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:00.547492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:00.548166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.548448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.548723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] PATH_INFO: `/v3/projects/6c6f8ec0d066471aafb431ca38f19d8a/users/919f7ba7acb34e28b53c705db44ca26e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.564984 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6f8ec0d066471aafb431ca38f19d8a, user_id=919f7ba7acb34e28b53c705db44ca26e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:00.567636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:00.577199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:00.583423 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4539/9058] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:42:00 2022] PUT /identity/v3/projects/6c6f8ec0d066471aafb431ca38f19d8a/users/919f7ba7acb34e28b53c705db44ca26e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:42:00.587391 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:00.598164 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84f76-603f-4083-97f5-dac024560086 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:00.625571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:00.668988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096b088-5ea7-4460-8ce7-910f246f94d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:00.669603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096b088-5ea7-4460-8ce7-910f246f94d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.669881 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096b088-5ea7-4460-8ce7-910f246f94d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.670934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096b088-5ea7-4460-8ce7-910f246f94d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.671413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096b088-5ea7-4460-8ce7-910f246f94d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:00.673006 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096b088-5ea7-4460-8ce7-910f246f94d3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:00.682726 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4520/9059] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:42:00.687139 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:00.697587 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd0a82-f9ed-4e42-976e-7ac99b7048f1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:00.702522 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de045f4f-4121-451b-9fba-c8b18b0fef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:00.703187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de045f4f-4121-451b-9fba-c8b18b0fef90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:00.703471 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de045f4f-4121-451b-9fba-c8b18b0fef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:00.703750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de045f4f-4121-451b-9fba-c8b18b0fef90 admin admin] PATH_INFO: `/v3/projects/6c6f8ec0d066471aafb431ca38f19d8a/users/919f7ba7acb34e28b53c705db44ca26e/roles/61064a68b37843f5b88e6641075320de` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:00.705739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de045f4f-4121-451b-9fba-c8b18b0fef90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6f8ec0d066471aafb431ca38f19d8a, user_id=919f7ba7acb34e28b53c705db44ca26e, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:00.708418 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de045f4f-4121-451b-9fba-c8b18b0fef90 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:00.720090 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4540/9060] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:42:00 2022] PUT /identity/v3/projects/6c6f8ec0d066471aafb431ca38f19d8a/users/919f7ba7acb34e28b53c705db44ca26e/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:42:05.270259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:05.271151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:05.271500 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:05.347801 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] MFA Rules not processed for user `919f7ba7acb34e28b53c705db44ca26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:42:05.352374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:05.453323 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4521/9061] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:42:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:42:05.506548 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409893b7-fc4c-4735-a58e-d200c4edb739 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:05.507076 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409893b7-fc4c-4735-a58e-d200c4edb739 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:05.507160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409893b7-fc4c-4735-a58e-d200c4edb739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:05.593964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-409893b7-fc4c-4735-a58e-d200c4edb739 None None] MFA Rules not processed for user `c7ebd0b9ab9a48f0a5505863a7d729e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:42:05.595277 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-409893b7-fc4c-4735-a58e-d200c4edb739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:05.664270 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4541/9062] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Oct 5 03:42:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:42:05.679240 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:05.690158 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13f966-6d8b-4150-8cf5-397ca0719ecb None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:05.696426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:05.697236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:05.697598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:05.697954 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:05.806190 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:05.807669 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:05.822777 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4522/9063] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:42:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:42:06.014467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c9053-01ff-4945-b14d-713de0066928 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:06.015133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c9053-01ff-4945-b14d-713de0066928 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:06.015133 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c9053-01ff-4945-b14d-713de0066928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:06.088341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-624c9053-01ff-4945-b14d-713de0066928 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:42:06.089763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-624c9053-01ff-4945-b14d-713de0066928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:06.174979 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4542/9064] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:42:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:42:06.230721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:06.232175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:06.287445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=100 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:06.330042 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65debc5-3d14-46c4-9e90-9c451d052fad service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:06.335617 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e44278-0dc1-4b85-9823-e258a3f3ad30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:06.336236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e44278-0dc1-4b85-9823-e258a3f3ad30 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:06.336520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e44278-0dc1-4b85-9823-e258a3f3ad30 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:06.336796 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e44278-0dc1-4b85-9823-e258a3f3ad30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:06.350904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e44278-0dc1-4b85-9823-e258a3f3ad30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:06.352790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e44278-0dc1-4b85-9823-e258a3f3ad30 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:06.362116 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4523/9065] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:42:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:42:15.491783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:15.492330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:15.492437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:15.511044 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] MFA Rules not processed for user `cf1e0670dd7341d0a2c237722f903537`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:42:15.512166 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:15.519061 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4543/9066] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:42:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:42:16.358037 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=20 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:17.420656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:17.421362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:17.421362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:17.441362 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:42:17.442589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:17.451104 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4524/9067] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:42:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:42:17.468284 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:17.481437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbc124-17d5-4add-96a2-d35086da5caf None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:17.487694 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:17.488638 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:17.489011 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:17.489289 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:17.498335 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:17.499923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:17.508832 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4544/9068] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:42:19.597670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:19.599839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:19.690003 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea08b0-52d6-4155-9ac6-19df719995a6 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:19.694088 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:19.694950 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:19.695310 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:19.695589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:19.697431 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:19.778146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:19.781087 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:19.805943 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4525/9069] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:42:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:42:21.012788 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:21.022884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2932b-18dd-42c6-8b6a-9adbc3b153b6 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:21.026451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:21.027050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:21.027330 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:21.027608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:21.030211 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:21.040409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:21.046223 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:21.047979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:21.061644 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4545/9070] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:42:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:42:29.802906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=61 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:31.054960 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:42:54.895140 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:54.904952 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0e91-26a3-4b3f-8670-035369ad75e8 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:54.908567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:54.909198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:54.909483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:54.909758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:54.918791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:54.920275 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:54.929700 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4526/9071] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:42:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:42:56.505620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:42:56.507556 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:56.524860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e494a-c9ea-4d01-b932-feda9b799d3f service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:42:56.531441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:42:56.532082 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:42:56.532363 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:42:56.532647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:42:56.534982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:42:56.549294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:42:56.551310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:42:56.564794 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4546/9072] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:42:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:43:04.925640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:43:06.559109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:43:18.533354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:43:18.534787 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:43:18.615793 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0943e-2323-42bc-9199-e8a59e522e1f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:43:18.621219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:43:18.621832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:43:18.622115 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:43:18.622393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:43:18.624762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:43:18.636403 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:43:18.638059 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:43:18.649143 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4527/9073] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:43:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:43:28.644647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=36 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:44:09.417976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:44:09.434383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9363d-1347-42a7-a638-706354591a5b service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:44:09.439840 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:44:09.440486 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:44:09.440765 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:44:09.441073 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:44:09.442803 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:44:09.455703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:44:09.457355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:44:09.469351 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4547/9074] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:44:19.464629 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:45:20.109236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:45:20.128545 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83746d12-d3d9-478c-b511-407a438bedec service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:45:20.132197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:45:20.132794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:45:20.133104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:45:20.133383 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:45:20.135103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:45:20.144309 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:45:20.145763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102cd80-3724-4f9e-a19f-0683bb9278dc service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:45:20.153568 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4528/9075] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:45:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:45:30.150138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=10 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:46:45.342915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:46:45.344352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:46:45.361377 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed17797-dd9b-4c5a-8edb-3feaf8c742d5 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:46:45.367982 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:46:45.368713 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:46:45.369162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:46:45.369595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:46:45.371348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:46:45.385305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:46:45.387129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:46:45.399412 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4548/9076] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:46:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:46:55.394566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:46:57.944378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c7151-05ce-4795-b534-3bba1c86a511 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:46:57.944853 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c7151-05ce-4795-b534-3bba1c86a511 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:46:57.944981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c7151-05ce-4795-b534-3bba1c86a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:46:57.964336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-145c7151-05ce-4795-b534-3bba1c86a511 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:46:57.965536 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-145c7151-05ce-4795-b534-3bba1c86a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:46:57.972619 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4529/9077] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:46:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:46:58.013632 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:46:58.024872 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2174a65-ee65-4aa3-a71d-d79a8d8bb345 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:46:58.029894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:46:58.030510 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:46:58.030793 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:46:58.031071 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:46:58.039253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:46:58.040854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:46:58.049155 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4549/9078] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:46:58.539767 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:46:58.540134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:46:58.540506 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:46:58.562285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:46:58.563502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:46:58.571385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4530/9079] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:46:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:46:58.584309 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:46:58.594977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5db73-9eab-4c68-8d99-6e1cdbc9b6a4 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:46:58.601368 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14aeb9-d896-4ee0-8ec3-a3cd4c827927 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:46:58.601983 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14aeb9-d896-4ee0-8ec3-a3cd4c827927 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:46:58.602267 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14aeb9-d896-4ee0-8ec3-a3cd4c827927 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:46:58.602549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14aeb9-d896-4ee0-8ec3-a3cd4c827927 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:46:58.611439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14aeb9-d896-4ee0-8ec3-a3cd4c827927 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:46:58.613787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14aeb9-d896-4ee0-8ec3-a3cd4c827927 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:46:58.621912 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4550/9080] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:46:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 03:47:06.873033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:06.885933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8126dd6-2fb4-4225-924b-ad10c59a0c61 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:06.891356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:06.891895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:06.892174 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:06.892448 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:06.900612 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:06.902217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:06.911103 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4531/9081] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:47:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:47:06.981394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:06.981890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:06.982057 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:07.000714 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] MFA Rules not processed for user `cf1e0670dd7341d0a2c237722f903537`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:47:07.001955 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:47:07.008765 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4551/9082] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:47:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:47:07.270868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:07.280116 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a25df5-8c1f-4dc5-968f-0a353ec5f80d service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:07.283832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:07.284875 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:07.285192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:07.285472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:07.287211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:47:07.296368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:07.297819 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a6b6f-3545-41cd-bc87-768853dfe8a9 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:07.306044 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4532/9083] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:47:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:47:07.621332 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:07.634275 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e105ff-f01a-4733-a25a-44aab524d343 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:07.639380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:07.640012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:07.640291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:07.640586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:07.642312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:47:07.655162 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:07.656786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:07.667685 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4552/9084] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:47:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:47:08.945700 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:08.946193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:08.946395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:08.966655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:47:08.967911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:47:08.975184 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4533/9085] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:47:08.988035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:08.999105 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bae73-8927-40fd-9e81-476e3bcbfd09 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:09.004787 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:09.005437 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:09.005721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:09.005999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:09.014460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:09.016083 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:09.025024 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4553/9086] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:47:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:47:18.961361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=21 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:19.021316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=27 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:20.562425 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:20.584878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28571-da1a-48d4-927b-d619779131d7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:20.588715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:20.589384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:20.589665 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:20.589938 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:20.638709 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:20.640171 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:20.658578 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4534/9087] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:47:21.923702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:21.944537 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b83a-e0f8-4739-a903-282a9d810fb7 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:21.948220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:21.948818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:21.949171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:21.949446 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:21.959543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:21.960990 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:21.972091 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4554/9088] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:47:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:47:27.832256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:47:27.844713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82b004-3f95-4993-a5e1-ea2bee35a67f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:47:27.852079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:47:27.852926 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:47:27.853219 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:47:27.853551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:47:27.855995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:47:27.906814 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:47:27.908770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:47:27.919200 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4535/9089] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:47:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:47:31.967231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=11 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:47:37.914608 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=37 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:48:21.476296 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:48:21.487538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dce963-c94c-45c2-bca9-a0af588cb2fc service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:48:21.493654 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:48:21.494255 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:48:21.494539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:48:21.494816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:48:21.503253 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:48:21.504860 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:48:21.514440 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4555/9090] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:48:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:48:31.510413 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:14.479913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:49:14.491370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aeb27e-ff8c-45e2-ad9d-b75efe985f31 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:49:14.496924 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1fd2-ab28-4bfa-8b21-455cbb614b46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:49:14.497535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1fd2-ab28-4bfa-8b21-455cbb614b46 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:49:14.497818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1fd2-ab28-4bfa-8b21-455cbb614b46 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:49:14.498094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1fd2-ab28-4bfa-8b21-455cbb614b46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:49:14.506392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1fd2-ab28-4bfa-8b21-455cbb614b46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:49:14.508657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1fd2-ab28-4bfa-8b21-455cbb614b46 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:49:14.518464 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4536/9091] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:49:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:49:24.514293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:42.913445 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:49:42.948613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdce7a7-c07a-4d62-b252-e54e111e245c service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:49:42.957656 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:49:42.958849 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:49:42.959996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:49:42.960756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:49:42.973968 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:49:42.977386 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:49:42.993036 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4556/9092] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:49:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:49:52.985946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:49:57.630468 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:49:57.630997 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:49:57.631236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:49:57.650841 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:49:57.652064 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:49:57.659514 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4537/9093] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 03:49:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:49:57.700992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:49:57.712705 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c314c-ce76-4ee4-9837-73f76db47c4e service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:49:57.717693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:49:57.718322 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:49:57.718611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:49:57.718892 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:49:57.727579 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:49:57.729279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:49:57.737506 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4557/9094] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 03:49:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 03:49:58.086410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:49:58.095820 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3acce-37bb-4ce5-9170-ab4605579b22 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:49:58.099369 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:49:58.100557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:49:58.100836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:49:58.101137 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:49:58.171295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:49:58.172728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:49:58.191372 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4538/9095] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:01.463120 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:01.475460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e410905-c3e9-4120-9c1d-f8321bff5ff4 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:01.480661 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:01.483547 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:01.483834 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:01.484107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:01.489972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:01.525165 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:01.526915 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:01.541308 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4558/9096] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:50:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:04.503529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:04.513517 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cee27-50ad-433a-849c-345624a7028c service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:04.520033 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:04.520758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:04.521162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:04.521963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] PATH_INFO: `/v3/users/cf1e0670dd7341d0a2c237722f903537` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:04.523165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1e0670dd7341d0a2c237722f903537)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:04.525154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:04.572258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1e0670dd7341d0a2c237722f903537'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.585384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1e0670dd7341d0a2c237722f903537'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.586092 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1e0670dd7341d0a2c237722f903537'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.593519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1e0670dd7341d0a2c237722f903537'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.594149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1e0670dd7341d0a2c237722f903537'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.606933 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4539/9097] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:50:04 2022] DELETE /identity/v3/users/cf1e0670dd7341d0a2c237722f903537 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:04.783695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:04.794501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f77705-573e-473b-a9fc-bc36a6d835ab service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:04.855535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:04.856439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:04.856723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:04.857037 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] PATH_INFO: `/v3/projects/2e22d6e1c9a5495b8c152d7c7e5b1aff` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:04.858146 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e22d6e1c9a5495b8c152d7c7e5b1aff)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:04.860052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:04.906443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'request_id': 'req-9f3401c3-37d4-4188-949f-33dcd9ee3241'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.912514 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'request_id': 'req-9f3401c3-37d4-4188-949f-33dcd9ee3241'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.918745 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e22d6e1c9a5495b8c152d7c7e5b1aff', 'request_id': 'req-9f3401c3-37d4-4188-949f-33dcd9ee3241'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.943875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] The token cache is being invalidate because project 2e22d6e1c9a5495b8c152d7c7e5b1aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:50:04.944171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.944809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:04.946345 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4559/9098] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:50:04 2022] DELETE /identity/v3/projects/2e22d6e1c9a5495b8c152d7c7e5b1aff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:04.950344 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:04.951724 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:04.964597 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb23504-8c5a-44bc-b515-0291070e9b4c admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.005456 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:05.023534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.024169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.024457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.024736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] PATH_INFO: `/v3/users/919f7ba7acb34e28b53c705db44ca26e` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.025909 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919f7ba7acb34e28b53c705db44ca26e)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.027847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.074319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919f7ba7acb34e28b53c705db44ca26e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.086276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919f7ba7acb34e28b53c705db44ca26e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.086949 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919f7ba7acb34e28b53c705db44ca26e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.094483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919f7ba7acb34e28b53c705db44ca26e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.095155 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-3b965438-7c97-4b00-9cda-1fc513181989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919f7ba7acb34e28b53c705db44ca26e'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.108409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4540/9099] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 03:50:04 2022] DELETE /identity/v3/users/919f7ba7acb34e28b53c705db44ca26e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:05.283935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.285483 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:05.298620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3401c3-37d4-4188-949f-33dcd9ee3241 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.339943 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:05.359209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.359853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.360140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.360420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] PATH_INFO: `/v3/projects/6c6f8ec0d066471aafb431ca38f19d8a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.361570 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6f8ec0d066471aafb431ca38f19d8a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.363487 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.410192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6f8ec0d066471aafb431ca38f19d8a', 'request_id': 'req-fac50526-0777-4b99-99d2-0330471e3c97'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.416853 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6f8ec0d066471aafb431ca38f19d8a', 'request_id': 'req-fac50526-0777-4b99-99d2-0330471e3c97'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.423163 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6f8ec0d066471aafb431ca38f19d8a', 'request_id': 'req-fac50526-0777-4b99-99d2-0330471e3c97'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.436043 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] The token cache is being invalidate because project 6c6f8ec0d066471aafb431ca38f19d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 03:50:05.436382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.437098 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-fac50526-0777-4b99-99d2-0330471e3c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 03:50:05.438650 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4560/9100] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 03:50:05 2022] DELETE /identity/v3/projects/6c6f8ec0d066471aafb431ca38f19d8a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:05.443805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.444091 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.444366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.504143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:50:05.505484 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:05.565203 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4541/9101] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:50:05.574061 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.574347 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.574623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.594854 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:50:05.596040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:05.604757 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4561/9102] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:50:05.609430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.619290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe87ea-fa7c-4540-8b50-828fc818d78c None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.623744 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.624342 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.624623 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.624917 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.625570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 03:50:05.625877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.627476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.639324 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4542/9103] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 03:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 05 03:50:05.643447 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.653007 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918ed2e-d6f2-4d38-b32c-00ac934d35e1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.657646 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.658244 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.658526 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.658802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.659430 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.661401 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.700064 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4562/9104] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:50:05 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:50:05.704253 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.714922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9301fe-46a4-4a56-80e7-96113ac89f42 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.727374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:05.775031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.775588 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.775931 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.776215 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.776857 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.778802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.801293 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4543/9105] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:50:05 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:50:05.803992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.814220 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f63f0-b854-46eb-a608-cbd4e052f98f admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.819449 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.820050 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.820336 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.820611 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.821295 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.822894 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.832864 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4563/9106] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:50:05.837582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.847414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b508-627a-44e2-8c02-0c691d272cae admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.852542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156d5b-c54e-4723-bf8a-e94f7b20104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.853169 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156d5b-c54e-4723-bf8a-e94f7b20104d admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.853454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156d5b-c54e-4723-bf8a-e94f7b20104d admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.853735 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156d5b-c54e-4723-bf8a-e94f7b20104d admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.854373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156d5b-c54e-4723-bf8a-e94f7b20104d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.855967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156d5b-c54e-4723-bf8a-e94f7b20104d admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.866521 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4544/9107] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:50:05.870575 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:05.880372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bc726-d057-43fd-8fd4-d07d23637b5e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:05.885126 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:05.885770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.886055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.886338 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] PATH_INFO: `/v3/projects/c62f31970d95490d8329d9f1a2583256/users/830bf52116814aa283b1a5d20f643682/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.901055 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62f31970d95490d8329d9f1a2583256, user_id=830bf52116814aa283b1a5d20f643682, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:05.903712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:05.917140 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4564/9108] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:50:05 2022] PUT /identity/v3/projects/c62f31970d95490d8329d9f1a2583256/users/830bf52116814aa283b1a5d20f643682/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:05.927052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:05.927366 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:05.927742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:05.956100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] MFA Rules not processed for user `830bf52116814aa283b1a5d20f643682`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:50:05.957381 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:06.025846 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4545/9109] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 03:50:06.030532 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.092104 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984efc4-a5b9-4d25-bbc8-5f7d695ff5da admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.096728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.097354 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.097635 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.097907 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.098527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.101054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.105484 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:06.128702 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4565/9110] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 03:50:06 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:50:06.133657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.144387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a083e7-cb64-46cc-9f2c-864a623934c7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.204886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.205519 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.205799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.206072 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.206692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.208607 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.229402 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4546/9111] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 03:50:06 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 03:50:06.233776 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.244590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29aada-c586-404b-ab88-444cd01ac581 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.249199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.249791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.250069 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.250341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.250978 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.252557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.263033 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4566/9112] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 03:50:06.266964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.277119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85cd88-ff9d-46e9-83c4-45eea368f9b2 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.281704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.282352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.282637 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.282914 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] PATH_INFO: `/v3/projects/e6d2d3c05ca44f8e98aaac3205595d01/users/7a5a545b66544026bafe8941e563b19b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.294916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:06.298084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d2d3c05ca44f8e98aaac3205595d01, user_id=7a5a545b66544026bafe8941e563b19b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.301338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.315181 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4547/9113] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:50:06 2022] PUT /identity/v3/projects/e6d2d3c05ca44f8e98aaac3205595d01/users/7a5a545b66544026bafe8941e563b19b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:06.319503 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.329422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1e5a-a58e-4ceb-a939-e43eaaffcd13 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.388154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c963f-0643-4543-8e19-65066a4dfb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.388767 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c963f-0643-4543-8e19-65066a4dfb95 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.389090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c963f-0643-4543-8e19-65066a4dfb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.389372 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c963f-0643-4543-8e19-65066a4dfb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.390018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c963f-0643-4543-8e19-65066a4dfb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.391615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c963f-0643-4543-8e19-65066a4dfb95 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.402520 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4567/9114] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 03:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 03:50:06.406818 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.417142 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7238a-c864-478a-8999-b4f2c13b5bc6 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.421728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.422375 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.422657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.422935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] PATH_INFO: `/v3/projects/e6d2d3c05ca44f8e98aaac3205595d01/users/7a5a545b66544026bafe8941e563b19b/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.424837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d2d3c05ca44f8e98aaac3205595d01, user_id=7a5a545b66544026bafe8941e563b19b, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.427625 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.437864 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4548/9115] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 03:50:06 2022] PUT /identity/v3/projects/e6d2d3c05ca44f8e98aaac3205595d01/users/7a5a545b66544026bafe8941e563b19b/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 03:50:06.449270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.449558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.449839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.478054 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] MFA Rules not processed for user `7a5a545b66544026bafe8941e563b19b`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:50:06.479251 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:06.546454 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4568/9116] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:50:06.562457 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:06.564428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:06.649736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ef72-91ec-45a9-b61a-9872a809a831 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:06.655602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e3f1-2357-47b4-ac64-ab5247f2d872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:06.656223 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e3f1-2357-47b4-ac64-ab5247f2d872 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:06.656505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e3f1-2357-47b4-ac64-ab5247f2d872 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:06.656782 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e3f1-2357-47b4-ac64-ab5247f2d872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:06.717395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e3f1-2357-47b4-ac64-ab5247f2d872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:06.719015 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e3f1-2357-47b4-ac64-ab5247f2d872 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:06.728194 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4549/9117] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:50:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:10.760264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:10.761728 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:10.821536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:10.834863 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7502e-bda6-42d7-9f3e-f1b1b0d7d2c1 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:10.838441 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:10.839052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:10.839333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:10.839608 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:10.848770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:10.850913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:10.860799 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4569/9118] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:50:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:13.432603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:13.432603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:13.432603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:13.455041 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] MFA Rules not processed for user `830bf52116814aa283b1a5d20f643682`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:50:13.456291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:13.465677 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4550/9119] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:50:13.840774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:13.850550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de22908-8467-4e81-ae31-94df3cc2b78e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:13.855174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:13.855882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:13.856645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:13.856884 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:13.859389 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:13.869647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:13.871280 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:13.881137 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4570/9120] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:50:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:14.262769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:14.264241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:14.327473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:14.343712 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b384-4122-497e-a024-341bd2d62d1d None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:14.349393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:14.350009 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:14.350287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:14.350564 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:14.352463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:14.365618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:14.367463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:14.377693 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4551/9121] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:50:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:16.362276 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:50:16.372760 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ab7f-11af-4678-a02d-fca99e33cb31 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:50:16.383771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:50:16.384424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:50:16.384709 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:50:16.385015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:50:16.389956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:50:16.423829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:50:16.427947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818b9b2-c1c0-4526-8ad6-719e67b9052c service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:50:16.444309 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4571/9122] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:50:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:50:24.373380 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:50:26.439394 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=18 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:51:43.635441 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:51:43.636879 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:51:43.649491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39966-5560-4473-aa58-fbc142a2abed service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:51:43.654715 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:51:43.655333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:51:43.655611 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:51:43.655886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:51:43.657628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:51:43.670672 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:51:43.672274 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:51:43.683257 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4552/9123] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:51:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:51:49.416833 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:51:49.417443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:51:49.417443 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:51:49.437946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] MFA Rules not processed for user `830bf52116814aa283b1a5d20f643682`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:51:49.439176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:51:49.450953 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4572/9124] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:51:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:51:52.744250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:51:52.755050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e189d-f656-4a65-88cd-4bb32d1ec327 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:51:52.759022 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:51:52.760494 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:51:52.761029 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:51:52.761725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:51:52.764023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:51:52.776354 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:51:52.777886 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:51:52.787208 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4553/9125] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:51:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:51:59.432468 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:52:02.782990 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:05.136078 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:53:05.146678 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be47e-9d42-4176-b1d2-f89129399ca3 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:53:05.152269 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:53:05.153122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:53:05.153411 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:53:05.153741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:53:05.155500 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:53:05.170364 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:53:05.171797 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:53:05.193293 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4573/9126] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:53:06.447830 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:53:06.459371 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc8a6f-3109-4b55-bb3a-d56a81f6d794 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:53:06.463162 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59377008-d447-4075-966d-b04a02593360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:53:06.463768 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59377008-d447-4075-966d-b04a02593360 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:53:06.464207 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59377008-d447-4075-966d-b04a02593360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:53:06.464493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59377008-d447-4075-966d-b04a02593360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:53:06.466259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-59377008-d447-4075-966d-b04a02593360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:53:06.479598 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59377008-d447-4075-966d-b04a02593360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:53:06.481056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59377008-d447-4075-966d-b04a02593360 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:53:06.492152 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4554/9127] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:53:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:53:15.190604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:16.487640 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:53:23.464384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:53:23.486102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327bee-6ead-4982-b82b-0b3efbee66f8 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:53:23.491024 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:53:23.492149 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:53:23.492428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:53:23.492696 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:53:23.494455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:53:23.507129 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:53:23.508771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90520fe3-b943-427e-a1db-f8d336ae2fd2 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:53:23.519079 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4574/9128] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:53:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:53:33.514799 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=10 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:18.373378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59377008-d447-4075-966d-b04a02593360 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:54:18.394248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59377008-d447-4075-966d-b04a02593360 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:54:18.401261 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:54:18.402895 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:54:18.406748 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:54:18.407287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:54:18.409717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:54:18.424239 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:54:18.428548 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:54:18.465531 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4555/9129] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:54:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:54:19.354170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:54:19.354725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:54:19.354725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:54:19.375258 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] MFA Rules not processed for user `830bf52116814aa283b1a5d20f643682`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:54:19.376470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:54:19.384402 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4575/9130] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:54:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:54:27.769429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:54:27.781862 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e0888-caaa-4fb9-96cb-054b0e1dfccf service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:54:27.787578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:54:27.788180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:54:27.788462 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:54:27.788737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:54:27.790527 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:54:27.802535 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:54:27.804109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:54:27.814975 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4556/9131] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:54:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:54:29.369967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:54:37.810123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:34.024144 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:34.036964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb4a94-7bb4-4adc-8914-ad4e13800ef7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:34.042319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce100e-03ef-462a-bf96-3e78824ed4d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:34.042938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce100e-03ef-462a-bf96-3e78824ed4d7 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.043216 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce100e-03ef-462a-bf96-3e78824ed4d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.043489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce100e-03ef-462a-bf96-3e78824ed4d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.051148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce100e-03ef-462a-bf96-3e78824ed4d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:34.052857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce100e-03ef-462a-bf96-3e78824ed4d7 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:34.062096 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4576/9132] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:34.116673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:34.135717 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c28de8-c571-44c8-a928-6792e6815d7e service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:34.139353 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:34.139951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.140236 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.140513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.142254 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:34.152360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:34.153807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:34.161908 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4557/9133] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:34.291250 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9400-ac4f-4d99-8f4f-31cb81811f8f None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.291543 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9400-ac4f-4d99-8f4f-31cb81811f8f None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.291825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa9400-ac4f-4d99-8f4f-31cb81811f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.342124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-c3aa9400-ac4f-4d99-8f4f-31cb81811f8f None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:55:34.343344 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-c3aa9400-ac4f-4d99-8f4f-31cb81811f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:34.350823 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4577/9134] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:55:34.367737 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:34.369414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:34.380891 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fade-08d8-4a36-9a19-ee14c1f7f4e0 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:34.389234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:34.389859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.390149 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.390426 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.399392 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:34.400930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:34.409001 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4558/9135] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:34.487209 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9fee-bd6b-4fee-a9cd-0ab88929a3e3 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.487501 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9fee-bd6b-4fee-a9cd-0ab88929a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.487783 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9fee-bd6b-4fee-a9cd-0ab88929a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.525971 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-43cf9fee-bd6b-4fee-a9cd-0ab88929a3e3 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:55:34.527101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-43cf9fee-bd6b-4fee-a9cd-0ab88929a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:34.535734 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4578/9136] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:55:34.547145 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:34.559505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c249c-9632-43d0-9928-53126263bcae service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:34.564497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:34.565143 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.565422 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.565695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.574537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:34.576104 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:34.585792 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4559/9137] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:34.757996 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.758407 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.758784 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.797732 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:55:34.798936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:34.808653 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4579/9138] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:55:34.819267 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:34.828430 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180b7b-06f0-467f-9c2e-11b97199a2f0 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:34.831920 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:34.832508 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.832788 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.833272 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.843465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:34.844890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:34.856260 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4560/9139] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:55:34.916585 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:34.928552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23663d-915d-4f3f-ba7d-ccd5826e7597 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:34.933621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:34.934218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:34.934499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:34.934773 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:34.936489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:34.948100 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:34.949717 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:34.960210 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4580/9140] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:44.851410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=28 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:44.955341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=43 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:48.832361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:48.841930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df6363-7221-4070-b2da-cecb31994c4e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:48.846197 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:48.847465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:48.847465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:48.847701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:48.855860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:48.857341 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:48.866024 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4561/9141] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:49.270994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:55:49.283432 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1246568-2417-4c20-b170-d093bdaa1c86 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:55:49.289645 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:55:49.290249 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:55:49.290536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:55:49.290816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:55:49.292603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:55:49.305591 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:55:49.307205 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:55:49.318549 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4581/9142] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:55:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:55:58.862591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:55:59.314245 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:56:50.541878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:56:50.553720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671a27c-e36e-41bc-9628-a5a4934bd48e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:56:50.558654 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9b555-d75a-4864-83a3-aac6c6d92858 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:56:50.559252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9b555-d75a-4864-83a3-aac6c6d92858 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:56:50.559532 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9b555-d75a-4864-83a3-aac6c6d92858 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:56:50.559805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9b555-d75a-4864-83a3-aac6c6d92858 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:56:50.568252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9b555-d75a-4864-83a3-aac6c6d92858 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:56:50.570428 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9b555-d75a-4864-83a3-aac6c6d92858 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:56:50.580630 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4562/9143] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:56:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:56:53.458994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:56:53.469171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5d31f-5fb6-42bd-95b6-7ae0c3a8be8f service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:56:53.472895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:56:53.473729 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:56:53.474109 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:56:53.474476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:56:53.483636 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:56:53.485357 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:56:53.495551 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4582/9144] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:56:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:56:56.653541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:56:56.654198 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:56:56.654333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:56:56.676747 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] MFA Rules not processed for user `830bf52116814aa283b1a5d20f643682`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:56:56.678211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:56:56.701838 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4563/9145] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:56:57.066703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:56:57.086969 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a806fd1-5963-4caf-9a9b-7b3048221a6a service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:56:57.101667 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:56:57.102308 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:56:57.102595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:56:57.103056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:56:57.114686 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:56:57.117227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:56:57.133112 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4583/9146] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:56:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:56:58.514992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:56:58.529308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa838-0cba-4868-8189-9ff989bd53f9 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:56:58.536107 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:56:58.536726 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:56:58.537052 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:56:58.538280 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:56:58.548935 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:56:58.550577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:56:58.562698 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4564/9147] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:56:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 03:57:00.490270 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:57:00.500101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e4ed-ce6e-40d6-8b2f-55efcf30f6ef service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:57:00.503948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:57:00.504620 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:57:00.505000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:57:00.505290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:57:00.515194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:57:00.516658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:57:00.526805 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4584/9148] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:57:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:57:08.557429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=15 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:57:10.522124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=18 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:15.461469 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:58:15.480321 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395445f-c39e-42c9-b9a1-eb07d4d06991 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:58:15.483890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:58:15.484791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:58:15.485100 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:58:15.485374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:58:15.530639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:58:15.532083 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:58:15.546625 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4565/9149] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:58:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:58:16.735426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:58:16.753770 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b456c19-d639-444a-9b1a-10c9a894de45 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:58:16.757417 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:58:16.758012 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:58:16.758292 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:58:16.758566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:58:16.770160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:58:16.771616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:58:16.783102 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4585/9150] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:58:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:58:25.539639 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=23 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:26.483581 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:58:26.495491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49ba04-3dc1-4fb4-8f3b-4183f8cb127e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:58:26.500447 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:58:26.501075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:58:26.501361 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:58:26.501642 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:58:26.509904 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:58:26.511516 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:58:26.521154 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4566/9151] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:58:26.778527 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=11 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:58:36.517138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:20.926186 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:59:20.928616 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:59:20.966657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e3bb9-1596-4411-9b08-ee08d9f20468 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:59:20.972281 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:59:20.972890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:59:20.973299 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:59:20.980271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:59:20.982551 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:59:20.996234 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:59:20.997976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:59:21.010550 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4586/9152] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:59:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:59:21.129583 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:59:21.142046 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b610-6b76-43dd-a81b-17ff18cfa055 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:59:21.148551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7daa3-edf8-4abb-9ebb-77a406170764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:59:21.149193 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7daa3-edf8-4abb-9ebb-77a406170764 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:59:21.149483 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7daa3-edf8-4abb-9ebb-77a406170764 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:59:21.149762 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7daa3-edf8-4abb-9ebb-77a406170764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:59:21.161681 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7daa3-edf8-4abb-9ebb-77a406170764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:59:21.163273 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7daa3-edf8-4abb-9ebb-77a406170764 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:59:21.173816 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4567/9153] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:59:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:59:25.402673 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:59:25.414597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda4b85-308b-472b-a8f3-14e90c19c0fa service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:59:25.420196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:59:25.420800 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:59:25.421111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:59:25.421388 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:59:25.423108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:59:25.434999 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:59:25.436640 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:59:25.448098 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4587/9154] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:59:31.169586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:32.156195 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:59:32.156489 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:59:32.156770 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:59:32.185835 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] MFA Rules not processed for user `830bf52116814aa283b1a5d20f643682`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 03:59:32.186890 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 03:59:32.198334 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4568/9155] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 03:59:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 03:59:35.442707 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=20 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:41.348581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 03:59:41.362341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797a3b2-1a14-41c9-b8e7-41d7a3606a3d service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 03:59:41.368653 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 03:59:41.370218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 03:59:41.370605 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 03:59:41.371190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 03:59:41.381810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 03:59:41.383651 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 03:59:41.396952 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4588/9156] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 03:59:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 03:59:42.179610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 03:59:51.391555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:00:58.250668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:00:58.322384 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030a5bd-9d82-410e-90a9-e47eb70e4a09 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:00:58.327873 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:00:58.328472 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:00:58.328754 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:00:58.329074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:00:58.330893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:00:58.408559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:00:58.410173 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:00:58.429016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4569/9157] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:00:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:08.423092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:08.425451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:08.426373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=69 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:08.515179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52911dc-ca40-4f28-b651-7a4efb95a39c service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:08.520791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99361220-7d79-4b96-bd7e-9d4400622f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:08.521426 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99361220-7d79-4b96-bd7e-9d4400622f5f service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:08.521731 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99361220-7d79-4b96-bd7e-9d4400622f5f service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:08.521991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99361220-7d79-4b96-bd7e-9d4400622f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:08.531772 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99361220-7d79-4b96-bd7e-9d4400622f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:08.533400 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99361220-7d79-4b96-bd7e-9d4400622f5f service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:08.544260 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4589/9158] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:01:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:13.130212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:13.131878 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:13.228156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595a171-7c4a-4ab1-a33a-eac4057fa2dd service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:13.233319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:13.233945 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:13.234224 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:13.234496 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] PATH_INFO: `/v3/users/830bf52116814aa283b1a5d20f643682` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:13.235888 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830bf52116814aa283b1a5d20f643682)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:13.237837 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:13.283934 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830bf52116814aa283b1a5d20f643682'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.295632 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830bf52116814aa283b1a5d20f643682'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.296295 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830bf52116814aa283b1a5d20f643682'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.316461 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830bf52116814aa283b1a5d20f643682'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.317063 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830bf52116814aa283b1a5d20f643682'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.330945 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4570/9159] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 04:01:13 2022] DELETE /identity/v3/users/830bf52116814aa283b1a5d20f643682 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:13.335845 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:13.336343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:13.336469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:13.365307 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:13.366521 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:13.424018 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4590/9160] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:13.433803 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:13.435269 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:13.491704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:13.506161 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289aa9e-e268-48c2-8f4c-aa1a5a48a050 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:13.509802 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:13.510402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:13.510682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:13.510955 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:13.520798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:13.522265 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:13.532948 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4571/9161] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:13.698132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:13.699659 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:13.713644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0c4a-8a8c-4ed7-8ee4-c349dbd60ae7 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:13.719623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:13.720291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:13.720539 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:13.720820 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] PATH_INFO: `/v3/projects/c62f31970d95490d8329d9f1a2583256` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:13.721992 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62f31970d95490d8329d9f1a2583256)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:13.723962 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:13.771036 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62f31970d95490d8329d9f1a2583256', 'request_id': 'req-edfbbf31-93fd-4064-b1a5-1af552d88c43'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.776451 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62f31970d95490d8329d9f1a2583256', 'request_id': 'req-edfbbf31-93fd-4064-b1a5-1af552d88c43'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.783297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62f31970d95490d8329d9f1a2583256', 'request_id': 'req-edfbbf31-93fd-4064-b1a5-1af552d88c43'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.784974 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:13.797496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] The token cache is being invalidate because project c62f31970d95490d8329d9f1a2583256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 04:01:13.797812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.798477 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.800001 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4591/9162] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 04:01:13 2022] DELETE /identity/v3/projects/c62f31970d95490d8329d9f1a2583256 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:13.804017 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:13.813957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c5540-6309-477a-a04a-20570ffff1d6 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:13.871050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:13.871682 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:13.871969 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:13.872248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] PATH_INFO: `/v3/users/7a5a545b66544026bafe8941e563b19b` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:13.885918 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5a545b66544026bafe8941e563b19b)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:13.887854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:13.933513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5a545b66544026bafe8941e563b19b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.945580 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5a545b66544026bafe8941e563b19b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.946247 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5a545b66544026bafe8941e563b19b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.953730 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5a545b66544026bafe8941e563b19b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.954509 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-5d3bd1d6-a6b5-4785-bdee-c143cb81ad52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5a545b66544026bafe8941e563b19b'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:13.967914 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4572/9163] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 04:01:13 2022] DELETE /identity/v3/users/7a5a545b66544026bafe8941e563b19b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:14.232419 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.234072 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:14.247384 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbbf31-93fd-4064-b1a5-1af552d88c43 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.308294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.308946 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.309227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.309499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] PATH_INFO: `/v3/projects/e6d2d3c05ca44f8e98aaac3205595d01` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.319805 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d2d3c05ca44f8e98aaac3205595d01)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.321675 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.369595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d2d3c05ca44f8e98aaac3205595d01', 'request_id': 'req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:14.375798 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d2d3c05ca44f8e98aaac3205595d01', 'request_id': 'req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:14.382920 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d2d3c05ca44f8e98aaac3205595d01', 'request_id': 'req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:14.397027 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] The token cache is being invalidate because project e6d2d3c05ca44f8e98aaac3205595d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 04:01:14.397328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:14.397949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-0e782141-d37b-4e67-99b9-1b38ea8ec1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:01:14.399633 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4592/9164] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 04:01:14 2022] DELETE /identity/v3/projects/e6d2d3c05ca44f8e98aaac3205595d01 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:14.405618 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.406138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.406378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.455693 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:14.456951 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:14.478090 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:14.520412 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4573/9165] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:14.530039 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.530333 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.530618 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.551538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:14.552755 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:14.561647 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4593/9166] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:14.565987 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.576373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded578a3-5aa6-4558-a273-2933158edb88 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.580911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.581513 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.581799 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.582074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.582713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 04:01:14.583018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.584616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.596116 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4574/9167] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 04:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 04:01:14.600535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.609581 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2075-265e-4eeb-8901-e2e6b4f32a47 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.614456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.615047 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.615329 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.615604 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.616256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.618171 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.656506 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4594/9168] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 04:01:14 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 04:01:14.660774 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.671521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ede36-1989-4d4e-9ab5-a5387a98cacc admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.727794 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.728401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.728684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.728992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.729616 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.731534 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.753180 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4575/9169] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 04:01:14 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 04:01:14.757412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.768474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac883c0-10ec-4e94-99ff-ac06f87e976b admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.773154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.773756 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.774040 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.774566 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.775214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.776818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.787240 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4595/9170] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:01:14.791183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.801624 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bb4b0-d830-417a-a11e-32530351a0b7 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.806276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095d52e-e331-44f5-b0de-d6586b02cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.806872 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095d52e-e331-44f5-b0de-d6586b02cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.807157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095d52e-e331-44f5-b0de-d6586b02cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.807435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095d52e-e331-44f5-b0de-d6586b02cde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.808077 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095d52e-e331-44f5-b0de-d6586b02cde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.809713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095d52e-e331-44f5-b0de-d6586b02cde2 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.821110 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4576/9171] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:01:14.824816 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.834923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a98620-e661-4a54-b149-f4f67b5c29e2 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:14.839429 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:14.840066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.840348 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.840624 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] PATH_INFO: `/v3/projects/8270dd7d19da4edc9b1a5e7598e0e1cf/users/60d6950cfc304bebbb08fc94704b34a6/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.855196 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8270dd7d19da4edc9b1a5e7598e0e1cf, user_id=60d6950cfc304bebbb08fc94704b34a6, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:14.858434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:14.867136 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:14.871949 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4596/9172] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 04:01:14 2022] PUT /identity/v3/projects/8270dd7d19da4edc9b1a5e7598e0e1cf/users/60d6950cfc304bebbb08fc94704b34a6/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:14.877728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaf84c-ddf8-4801-ae8e-00a24c211550 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:14.878076 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaf84c-ddf8-4801-ae8e-00a24c211550 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:14.878387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaf84c-ddf8-4801-ae8e-00a24c211550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:14.897139 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-2bcaf84c-ddf8-4801-ae8e-00a24c211550 None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:14.898334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-2bcaf84c-ddf8-4801-ae8e-00a24c211550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:14.957409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4577/9173] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:14.967261 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:14.969099 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:15.026875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ebb8-f8f9-4367-9863-d1d0aaeac78e admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:15.030590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:15.031192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:15.031470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:15.031742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:15.040567 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:15.042016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:15.051970 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4597/9174] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:19.058258 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.058758 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.058882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.087301 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] MFA Rules not processed for user `60d6950cfc304bebbb08fc94704b34a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:19.088521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:19.117647 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:19.175769 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4578/9175] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:19.178672 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:19.194113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de001f24-b300-4f68-8b7b-321dd0c782a6 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:19.198993 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:19.199601 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.199879 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.200153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.200827 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:19.202924 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:19.236752 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4598/9176] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 04:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 04:01:19.238024 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:19.249629 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7abab-e917-4c8f-b7d9-51d26d0b68b7 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:19.315178 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:19.315816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.316079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.316370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.317032 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:19.319000 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:19.342333 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4579/9177] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 04:01:19 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 04:01:19.346505 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:19.357323 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eca91-7a79-484a-b201-e67ad8ddca63 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:19.362293 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:19.362910 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.363182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.363504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.364155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:19.365785 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:19.380636 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4599/9178] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 05 04:01:19.382165 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:19.393336 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53346b7-c1dc-4e4f-b500-e1c0bc0d6338 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:19.398451 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:19.399067 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.399356 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.399638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] PATH_INFO: `/v3/projects/0d98e348f5ca474581b102f8bac4ff5a/users/7d1c3de80ddd42c1a904640e3b57b42a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.417287 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d98e348f5ca474581b102f8bac4ff5a, user_id=7d1c3de80ddd42c1a904640e3b57b42a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:19.420586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:19.435065 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4580/9179] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 04:01:19 2022] PUT /identity/v3/projects/0d98e348f5ca474581b102f8bac4ff5a/users/7d1c3de80ddd42c1a904640e3b57b42a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:19.439298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:19.450174 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba216-1bee-4460-abb9-993c62b80372 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:19.520497 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21873cdb-1c04-4e67-b865-dbe978c2a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:19.521142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873cdb-1c04-4e67-b865-dbe978c2a569 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.521422 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873cdb-1c04-4e67-b865-dbe978c2a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.521693 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21873cdb-1c04-4e67-b865-dbe978c2a569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.522341 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21873cdb-1c04-4e67-b865-dbe978c2a569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:19.523948 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21873cdb-1c04-4e67-b865-dbe978c2a569 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:19.539051 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4600/9180] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:01:19.540370 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:19.552199 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483afb0d-0b88-4ed3-8845-d9933cfa1f99 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:19.557138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:19.557805 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:19.558093 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:19.558543 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] PATH_INFO: `/v3/projects/0d98e348f5ca474581b102f8bac4ff5a/users/7d1c3de80ddd42c1a904640e3b57b42a/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:19.560578 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d98e348f5ca474581b102f8bac4ff5a, user_id=7d1c3de80ddd42c1a904640e3b57b42a, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:19.563281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:19.575294 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4581/9181] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 04:01:19 2022] PUT /identity/v3/projects/0d98e348f5ca474581b102f8bac4ff5a/users/7d1c3de80ddd42c1a904640e3b57b42a/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:01:24.025358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866966-3006-4446-90aa-d9523c83eb5e None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:24.025890 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866966-3006-4446-90aa-d9523c83eb5e None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:24.026008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866966-3006-4446-90aa-d9523c83eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:24.057014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-7e866966-3006-4446-90aa-d9523c83eb5e None None] MFA Rules not processed for user `7d1c3de80ddd42c1a904640e3b57b42a`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:24.058233 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7e866966-3006-4446-90aa-d9523c83eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:24.114723 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:24.141371 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4601/9182] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:24.158966 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:24.161020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:24.240148 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac072e-cf9a-4264-995b-c4398fb43cc3 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:24.246045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:24.246552 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:24.246832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:24.247106 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:24.257157 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:24.318282 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:24.320138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:24.347339 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4582/9183] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:01:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:25.387698 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:25.388225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:25.388316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:25.408836 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] MFA Rules not processed for user `60d6950cfc304bebbb08fc94704b34a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:01:25.410088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:25.416943 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4602/9184] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:01:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:01:28.093988 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:28.162983 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e1b6c-a4f4-4e99-a6e1-afb6e062874a service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:28.166846 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:28.167912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:28.167912 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:28.168134 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:28.171183 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:01:28.182018 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:28.183742 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:28.195940 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4583/9185] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:01:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:35.403090 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=7 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:37.292726 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:01:37.303301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1fe16-0c45-4920-a01f-45c3d25adb36 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:01:37.306895 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:01:37.307495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:01:37.307781 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:01:37.308052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:01:37.317911 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:01:37.319353 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:01:37.329520 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4603/9186] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:01:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:01:38.189557 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=48 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:01:47.324610 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:03:31.472026 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:03:31.474138 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:03:31.564141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b0be-9a3e-4030-97b3-c1eed215415e service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:03:31.569702 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:03:31.570319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:03:31.570604 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:03:31.570882 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:03:31.572694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:03:31.584687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:03:31.586324 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:03:31.596043 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4584/9187] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:03:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:03:41.591906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=41 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:05.901516 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:05.902941 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:05.982558 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedbd06-493b-402f-9267-a2ba36d5c846 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:05.986160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:05.987310 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:05.987597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:05.987868 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:05.989594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:06.003898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:06.005366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf30b2-68e5-4ad3-9847-bbe51e5d3aa5 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:06.025737 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4604/9188] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:06.223222 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:06.232685 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae1543-b5cb-42a4-9dfb-63b0f34e4e7e service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:06.236259 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:06.237141 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:06.238373 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:06.238667 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:06.240733 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:06.254907 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:06.256331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:06.267158 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4585/9189] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:16.023181 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=39 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:16.262368 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:22.949112 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:22.949597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:22.949725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:23.001688 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:04:23.003734 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:23.067601 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4605/9190] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 04:04:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:04:23.113863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:23.115316 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:23.205861 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cae18a-a875-40e2-b93d-112b8a6ddbd4 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:23.210923 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:23.211529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:23.211811 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:23.212084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:23.220001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:23.222433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:23.230466 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4586/9191] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:04:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:04:28.357448 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:28.358977 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:28.376184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38537ba0-50aa-411a-8f1b-d26062b98dcd None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:28.383902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:28.384858 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:28.385187 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:28.385467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:28.387288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:28.399482 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:28.401154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17413dca-4f9e-4aa1-b064-8f4f379d9dca service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:28.413857 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4606/9192] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:33.227181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=41 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:36.486481 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:36.496101 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac6638-39fe-43f0-997b-3bff05f08b08 service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:36.499714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:36.500308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:36.500591 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:36.500869 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:36.502798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:36.513129 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:36.514634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:36.523022 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4587/9193] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:36.636137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:36.636683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:36.636683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:36.659507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] MFA Rules not processed for user `33ae6b3ef0964315be1bc1983fe65939`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:04:36.660718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:36.670112 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4607/9194] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 04:04:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:04:36.681916 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:36.692210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3085-4a5b-4317-8875-512da4b113f4 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:36.695849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:36.696520 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:36.696868 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:36.697276 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:36.708151 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:36.709720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:36.720919 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4588/9195] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:36.792615 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:36.794038 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:36.805625 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54305c-2f57-43e6-a082-2b55e4f0325a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:36.809177 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:36.809768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:36.810046 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:36.810319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:36.811938 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:36.821393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:36.822818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:36.830400 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4608/9196] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:37.915704 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:37.925521 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24014c4c-2714-4d6a-905c-9c4e9137f71a service glance] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:37.929075 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:37.929680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:37.929963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:37.930245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:37.931994 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:37.945856 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:37.947291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:37.959231 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4589/9197] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:38.020282 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:38.032000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c33b1-14e6-45ae-9ebb-9bf483c26239 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:38.037716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:38.038312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:38.038594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:38.038869 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:38.040565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:38.051928 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:38.053544 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18905d-6730-44f8-a48e-38c727200de6 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:38.063284 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4609/9198] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:40.973713 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:40.982074 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d764ca-b972-47f1-85a4-e50228c3d298 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:40.985648 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:40.986237 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:40.986514 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:40.987039 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:40.988755 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:40.998186 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:40.999602 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:41.007415 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4590/9199] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:04:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:04:42.653306 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:42.656263 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:42.656621 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:42.678846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:04:42.680130 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:04:42.687818 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4610/9200] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:04:42.700586 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:04:42.713300 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50817f-de5c-416f-8ea5-1c5866b68b7f service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:04:42.718603 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820651d-843a-4b78-bd26-26e1592950da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:04:42.719210 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820651d-843a-4b78-bd26-26e1592950da service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:04:42.719497 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820651d-843a-4b78-bd26-26e1592950da service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:04:42.719777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820651d-843a-4b78-bd26-26e1592950da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:04:42.728248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820651d-843a-4b78-bd26-26e1592950da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:04:42.729867 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820651d-843a-4b78-bd26-26e1592950da service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:04:42.738729 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4591/9201] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:04:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:04:52.673319 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=64 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:04:52.734683 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=30 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:05:00.886874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:05:00.901351 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb879cd-8995-4a76-ac96-99939cd0ca10 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:05:00.906936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:05:00.907550 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:05:00.907831 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:05:00.908107 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:05:00.909985 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:05:00.922155 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:05:00.923733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:05:00.934600 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4611/9202] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:05:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:05:02.478250 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:05:02.478749 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:05:02.478863 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:05:02.498982 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:05:02.500192 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:05:02.508087 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4592/9203] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 04:05:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:05:02.520200 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:05:02.531252 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2943b-01db-44f4-baca-2921a1d86723 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:05:02.536224 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:05:02.536825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:05:02.537141 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:05:02.537420 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:05:02.545902 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:05:02.547492 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:05:02.556169 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4612/9204] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:05:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:05:12.493906 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:05:12.552769 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:06:48.210491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:06:48.229102 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb451-bbc5-4fa3-8be4-67ac2cb7cfc3 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:06:48.232692 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f5da7-8c1e-4989-acc4-083415b7c206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:06:48.233335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5da7-8c1e-4989-acc4-083415b7c206 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:06:48.233621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5da7-8c1e-4989-acc4-083415b7c206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:06:48.233898 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5da7-8c1e-4989-acc4-083415b7c206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:06:48.242892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f5da7-8c1e-4989-acc4-083415b7c206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:06:48.244312 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f5da7-8c1e-4989-acc4-083415b7c206 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:06:48.253132 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4593/9205] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:06:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:06:49.414460 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:06:49.416702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:06:49.435283 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440331-10bb-4c43-a5f7-83f551b1b3f1 service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:06:49.443124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:06:49.444111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:06:49.444630 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:06:49.445154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:06:49.446972 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:06:49.459569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:06:49.461474 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:06:49.477558 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4613/9206] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:06:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:06:54.308279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:06:54.308798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:06:54.308798 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:06:54.329084 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] MFA Rules not processed for user `60d6950cfc304bebbb08fc94704b34a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:06:54.330290 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:06:54.337505 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4594/9207] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:06:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:06:59.471403 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:04.324133 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=13 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:09.897210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:07:09.906382 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bfb9e9-a28f-40ff-84ce-95376e58fed3 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:07:09.910000 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:07:09.910590 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:07:09.910871 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:07:09.911148 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:07:09.913358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:07:09.922439 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:07:09.923846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:07:09.932074 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4614/9208] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:07:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:07:11.390541 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:07:11.403297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687358a7-00b9-4422-8da7-8816e6339507 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:07:11.408317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:07:11.408986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:07:11.410094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:07:11.410094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:07:11.411297 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:07:11.423235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:07:11.424824 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:07:11.435409 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4595/9209] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:07:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:07:13.263305 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:07:13.274168 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57786e-6618-4b68-ad3b-b421bd981597 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:07:13.277929 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:07:13.278565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:07:13.278908 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:07:13.279294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:07:13.287428 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:07:13.289479 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:07:13.298880 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4615/9210] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:07:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 05 04:07:21.430946 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:23.294607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:33.015308 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:07:33.025168 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b043d-d8fd-43c4-bbf3-a56a2b4cbc4f service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:07:33.028668 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:07:33.029293 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:07:33.029571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:07:33.029842 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:07:33.038807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:07:33.040235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:07:33.049549 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4596/9211] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:07:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:07:34.590878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:07:34.604580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e7f4-2f4c-425e-933d-6ebf58ab1d9e service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:07:34.610179 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:07:34.610790 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:07:34.611075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:07:34.611358 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:07:34.613366 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:07:34.625942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:07:34.627649 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:07:34.639255 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4616/9212] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:07:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:07:43.045346 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:07:44.635399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:08:38.467518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:08:38.508482 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c86031-f672-4503-af83-ed33e5106e59 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:08:38.514402 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:08:38.515020 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:08:38.515302 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:08:38.515575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:08:38.524589 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:08:38.526212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:08:38.536827 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4597/9213] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:08:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:08:48.532387 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=20 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:30.273557 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:30.292314 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5214a-5b6e-4da9-9e56-e92993f63f52 service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:30.296028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:30.296623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:30.296922 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:30.297207 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:30.315091 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:30.316832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:30.328634 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4617/9214] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:31.518040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:31.527211 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd5029-35ca-4469-81bb-ca5f7dc85c8a service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:31.531537 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:31.532135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:31.532419 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:31.532698 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:31.542900 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:31.544317 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:31.555047 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4598/9215] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:33.389953 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:33.405580 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efa2b9-94c6-44da-bfe9-a31458ef77f1 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:33.410748 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:33.411326 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:33.411607 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:33.411883 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:33.421291 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:33.422875 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:33.432705 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4618/9216] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:41.550379 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:43.428491 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=20 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:09:46.058699 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:46.067911 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b9971-a928-4f69-b9f5-11a6354f2d73 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:46.071570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:46.072175 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:46.072459 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:46.072736 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:46.080111 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:46.081584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:46.089920 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4599/9217] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:47.188502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:47.198009 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a55af-90ba-4f78-84da-8f72951d53c4 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:47.202128 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:47.202724 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:47.203010 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:47.203290 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:47.213706 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:47.215150 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:47.227633 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4619/9218] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:47.288725 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:47.301825 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6fd92-a895-4f54-9e7a-29dce581d2bc service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:47.306663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:47.307285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:47.307572 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:47.307874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:47.317393 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:47.318975 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:47.329309 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4600/9219] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:55.029864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:09:55.038436 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31081e-d721-4ca9-b561-003a47e1c0e1 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:09:55.042002 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:09:55.042594 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:09:55.042880 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:09:55.043153 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:09:55.050739 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:09:55.052160 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:09:55.059913 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4620/9220] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:09:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:09:57.324790 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:10:05.056456 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=12 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:10:08.410979 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:10:08.424633 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6e40-abcc-46df-af29-f162e742b33e service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:10:08.430217 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:10:08.430827 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:10:08.431112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:10:08.431389 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:10:08.440779 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:10:08.442414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:10:08.453555 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4601/9221] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:10:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:10:18.448638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:31.043355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:31.114301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24399bb-9351-42cd-b66b-513309377e2f service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:31.117857 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:31.118459 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:31.118741 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:31.119016 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:31.120808 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:31.218424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:31.219844 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:31.240441 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4621/9222] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:11:34.165212 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:34.181901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d52e-938d-4f55-9b05-ada783313b45 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:34.186967 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:34.187570 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:34.187849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:34.188124 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:34.190530 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:34.206505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:34.211204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:34.225057 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4602/9223] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:11:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:11:37.134458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:37.149683 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb490d-63ec-4305-b9ff-0b138cbbdbc8 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:37.156227 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:37.156846 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:37.157184 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:37.157470 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:37.160075 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:37.180959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:37.182597 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:37.213728 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:37.215690 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:37.224139 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4622/9224] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:11:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:11:37.244232 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99925244-3cbc-4f56-872c-ab092fbbd646 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:37.252834 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:37.253542 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:37.253832 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:37.254112 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] PATH_INFO: `/v3/users/60d6950cfc304bebbb08fc94704b34a6` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:37.270571 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d6950cfc304bebbb08fc94704b34a6)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:37.272524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:37.319663 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d6950cfc304bebbb08fc94704b34a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.335331 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d6950cfc304bebbb08fc94704b34a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.336054 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d6950cfc304bebbb08fc94704b34a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.354023 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d6950cfc304bebbb08fc94704b34a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.354703 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d6950cfc304bebbb08fc94704b34a6'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.369984 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4603/9225] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 04:11:37 2022] DELETE /identity/v3/users/60d6950cfc304bebbb08fc94704b34a6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:37.538569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:37.549458 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4bda7-8bd2-48f1-ae3e-b2926e11b3df service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:37.605750 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=100 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:37.616256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:37.616886 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:37.617225 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:37.617499 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] PATH_INFO: `/v3/projects/8270dd7d19da4edc9b1a5e7598e0e1cf` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:37.627795 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8270dd7d19da4edc9b1a5e7598e0e1cf)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:37.629759 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:37.680455 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'request_id': 'req-6d031edb-09da-4548-b8e4-18a7b64a85f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.686065 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'request_id': 'req-6d031edb-09da-4548-b8e4-18a7b64a85f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.692757 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8270dd7d19da4edc9b1a5e7598e0e1cf', 'request_id': 'req-6d031edb-09da-4548-b8e4-18a7b64a85f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.706015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] The token cache is being invalidate because project 8270dd7d19da4edc9b1a5e7598e0e1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 04:11:37.706304 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.706947 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.708445 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4623/9226] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 04:11:37 2022] DELETE /identity/v3/projects/8270dd7d19da4edc9b1a5e7598e0e1cf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:37.712388 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:37.713773 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:37.726696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d16d3-c069-431d-9d2a-60e078326b87 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:37.784933 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:37.785565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:37.785851 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:37.786128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] PATH_INFO: `/v3/users/7d1c3de80ddd42c1a904640e3b57b42a` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:37.800538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1c3de80ddd42c1a904640e3b57b42a)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:37.802528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:37.842902 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:37.850399 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1c3de80ddd42c1a904640e3b57b42a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.863401 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1c3de80ddd42c1a904640e3b57b42a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.864320 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1c3de80ddd42c1a904640e3b57b42a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.871714 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1c3de80ddd42c1a904640e3b57b42a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.872338 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-ae3867eb-bccc-4610-832b-8dc6249bba47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1c3de80ddd42c1a904640e3b57b42a'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:37.884584 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4604/9227] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 04:11:37 2022] DELETE /identity/v3/users/7d1c3de80ddd42c1a904640e3b57b42a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:38.056313 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.057818 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:38.070555 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d031edb-09da-4548-b8e4-18a7b64a85f7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.128154 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.128801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.129113 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.129391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] PATH_INFO: `/v3/projects/0d98e348f5ca474581b102f8bac4ff5a` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.139822 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d98e348f5ca474581b102f8bac4ff5a)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.141702 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.188140 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d98e348f5ca474581b102f8bac4ff5a', 'request_id': 'req-c533f994-1b87-465b-ad50-4d2df0a653bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:38.193829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d98e348f5ca474581b102f8bac4ff5a', 'request_id': 'req-c533f994-1b87-465b-ad50-4d2df0a653bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:38.200480 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d98e348f5ca474581b102f8bac4ff5a', 'request_id': 'req-c533f994-1b87-465b-ad50-4d2df0a653bf'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:38.203023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:38.214469 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] The token cache is being invalidate because project 0d98e348f5ca474581b102f8bac4ff5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 04:11:38.214959 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:38.215623 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-c533f994-1b87-465b-ad50-4d2df0a653bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:11:38.217202 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4624/9228] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 04:11:38 2022] DELETE /identity/v3/projects/0d98e348f5ca474581b102f8bac4ff5a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:38.222908 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.223398 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.223518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.282511 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:11:38.284333 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:38.342356 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4605/9229] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:11:38.350874 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.351156 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.351427 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.370935 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:11:38.372122 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:38.379914 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4625/9230] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:11:38.384005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.394410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99e9c-5e5b-4a7d-a187-89b2afbd69fa None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.398892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.399492 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.399777 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.400055 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.400697 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 05 04:11:38.401040 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.402628 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.416583 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4606/9231] 10.222.0.16 () {58 vars in 1153 bytes} [Wed Oct 5 04:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 05 04:11:38.420786 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.430271 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b36f-5483-4c78-8237-b4bbdf06729a None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.434934 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.435530 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.435812 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.436088 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.436721 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.438658 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.475195 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4626/9232] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 04:11:38 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 04:11:38.480807 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.491374 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e607226-0253-4400-9127-47b8c9cb18e4 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.546687 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.547281 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.547566 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.547845 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.548473 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.550538 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.571016 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4607/9233] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 04:11:38 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 04:11:38.575182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.586210 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32dc1-1fc3-43bf-933b-83e82053d5f1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.590829 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.591434 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.591719 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.591998 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.592641 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.594297 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.604989 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4627/9234] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:11:38.608892 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.614400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:38.620751 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a365a61-57d6-4518-af42-8ac9f71f646b admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.626529 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067fd4a-5fc0-4628-98c6-aa985bf014e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.627156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067fd4a-5fc0-4628-98c6-aa985bf014e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.627964 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067fd4a-5fc0-4628-98c6-aa985bf014e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.628352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067fd4a-5fc0-4628-98c6-aa985bf014e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.629058 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067fd4a-5fc0-4628-98c6-aa985bf014e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.630656 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067fd4a-5fc0-4628-98c6-aa985bf014e4 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.641642 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4608/9235] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:11:38.646028 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.656768 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a1ef6-738f-431f-9c2e-860a669b3bf8 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.662534 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.663201 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.663513 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.663791 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] PATH_INFO: `/v3/projects/3f290aa28fa24d1eb2840c871ecdd853/users/d0a624b8f35f4e60a36f6fe36e189f0d/roles/c633580ee7eb4b5c829edbee3bd1ca81` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.679512 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f290aa28fa24d1eb2840c871ecdd853, user_id=d0a624b8f35f4e60a36f6fe36e189f0d, role_id=c633580ee7eb4b5c829edbee3bd1ca81)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.682254 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.694772 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4628/9236] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 04:11:38 2022] PUT /identity/v3/projects/3f290aa28fa24d1eb2840c871ecdd853/users/d0a624b8f35f4e60a36f6fe36e189f0d/roles/c633580ee7eb4b5c829edbee3bd1ca81 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:38.699864 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ccdd-baf6-481f-801f-bf39aadcfc5a None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.700156 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ccdd-baf6-481f-801f-bf39aadcfc5a None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.700463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ccdd-baf6-481f-801f-bf39aadcfc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.719285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f649ccdd-baf6-481f-801f-bf39aadcfc5a None None] MFA Rules not processed for user `ed98d68710e84d4fbf59928bc3712add`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:11:38.720505 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f649ccdd-baf6-481f-801f-bf39aadcfc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:38.779997 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4609/9237] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:11:38.790158 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:38.791850 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:38.859628 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba6d93-e7b7-4974-a060-92c2c0871a37 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:38.864152 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:38.864751 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:38.865062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:38.865343 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:38.874231 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:38.875647 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:38.885387 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4629/9238] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:11:43.330378 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.331437 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.331957 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.366760 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] MFA Rules not processed for user `d0a624b8f35f4e60a36f6fe36e189f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:11:43.368716 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:43.442617 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4610/9239] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:11:43.447279 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:43.457507 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b010da-220e-4296-b5f9-f0e4ddb2becd service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:43.462215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:43.462824 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.463115 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.463396 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.464093 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:43.466192 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:43.502320 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4630/9240] 10.222.0.16 () {60 vars in 1153 bytes} [Wed Oct 5 04:11:43 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 05 04:11:43.503582 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:43.514939 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b8bb2-d65d-4745-bb05-11b367b5f580 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:43.577303 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:43.577932 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.578220 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.578503 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] PATH_INFO: `/v3/users` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.579166 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:43.581772 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:43.605986 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4611/9241] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Oct 5 04:11:43 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 05 04:11:43.610355 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:43.624674 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9911b-94a3-4096-9608-e3421a4b02d1 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:43.631023 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:43.631644 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.631923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.632194 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.632843 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:43.634549 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:43.646808 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4631/9242] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:11:43.651323 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:43.663634 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc4a2f-a0eb-48c0-9f2c-0321042367ab admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:43.668670 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:43.669405 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.669689 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.669962 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] PATH_INFO: `/v3/projects/755eabe801f64b83b5dc6975cecb6ce0/users/f4990629adbf4bf181390b0659662eb3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.679859 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:43.688334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] RBAC: Authorizing `identity:create_grant(project_id=755eabe801f64b83b5dc6975cecb6ce0, user_id=f4990629adbf4bf181390b0659662eb3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:43.691146 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:43.707209 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4612/9243] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 04:11:43 2022] PUT /identity/v3/projects/755eabe801f64b83b5dc6975cecb6ce0/users/f4990629adbf4bf181390b0659662eb3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:43.711221 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:43.723274 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6426fa3-afbd-4e00-aedb-05b29328c747 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:43.783190 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:11:43.804952 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddf377-8bdd-45d2-8c63-7671cc459bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:43.805775 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf377-8bdd-45d2-8c63-7671cc459bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.806328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf377-8bdd-45d2-8c63-7671cc459bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.806991 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf377-8bdd-45d2-8c63-7671cc459bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.807650 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddf377-8bdd-45d2-8c63-7671cc459bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:43.810511 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddf377-8bdd-45d2-8c63-7671cc459bf4 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:43.824609 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4632/9244] 10.222.0.16 () {58 vars in 1122 bytes} [Wed Oct 5 04:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 05 04:11:43.825985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:43.837595 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d56cd3-4f6d-4ce0-a254-e310d0e804de admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:43.842707 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:43.843413 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:43.843701 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:43.843981 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] PATH_INFO: `/v3/projects/755eabe801f64b83b5dc6975cecb6ce0/users/f4990629adbf4bf181390b0659662eb3/roles/61064a68b37843f5b88e6641075320de` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:43.846638 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755eabe801f64b83b5dc6975cecb6ce0, user_id=f4990629adbf4bf181390b0659662eb3, role_id=61064a68b37843f5b88e6641075320de)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:43.850005 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:43.861577 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4613/9245] 10.222.0.16 () {60 vars in 1483 bytes} [Wed Oct 5 04:11:43 2022] PUT /identity/v3/projects/755eabe801f64b83b5dc6975cecb6ce0/users/f4990629adbf4bf181390b0659662eb3/roles/61064a68b37843f5b88e6641075320de => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:11:47.979197 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af3dc1-66d8-497f-a5da-27e021ae8b3d None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:47.979742 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af3dc1-66d8-497f-a5da-27e021ae8b3d None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:47.979964 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af3dc1-66d8-497f-a5da-27e021ae8b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:48.011771 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-28af3dc1-66d8-497f-a5da-27e021ae8b3d None None] MFA Rules not processed for user `f4990629adbf4bf181390b0659662eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:11:48.013035 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-28af3dc1-66d8-497f-a5da-27e021ae8b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:48.085464 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4633/9246] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:11:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:11:48.102345 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:48.105429 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:48.200600 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e769-be6a-4d6c-bb8f-ccce483cbd27 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:48.206800 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:48.207427 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:48.207720 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:48.207985 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:48.268619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:48.270575 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:48.281610 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4614/9247] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:11:49.391214 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:49.391722 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:49.391826 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:49.411173 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] MFA Rules not processed for user `d0a624b8f35f4e60a36f6fe36e189f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:11:49.412387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:49.419306 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4634/9248] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:11:53.213291 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:11:53.214899 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:53.233396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619e3a6-ea7f-4e80-8f57-52653e3ea359 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:11:53.240045 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:11:53.240655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:11:53.240963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:11:53.241241 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:11:53.242963 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:11:53.257828 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:11:53.259695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:11:53.271744 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4615/9249] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:11:59.405300 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=48 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:12:01.104878 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:12:01.106361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:12:01.165467 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138af33-8619-4cba-a0fd-173fbfbfecf9 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:12:01.169014 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:12:01.169619 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:12:01.169897 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:12:01.170169 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:12:01.178958 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:12:01.180387 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:12:01.190247 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4635/9250] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:12:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:12:03.266248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:12:11.185665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=26 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:13:43.444128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:13:43.446785 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:13:43.536769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f2e02-c3a8-451b-9ea8-5ae2d50357a7 service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:13:43.542330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:13:43.543016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:13:43.543304 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:13:43.543584 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:13:43.545351 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:13:43.557436 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:13:43.559011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7474b-056a-4266-b41d-38187658b395 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:13:43.569172 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4616/9251] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:13:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:13:53.564593 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=41 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:29.669294 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:29.670801 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:29.750472 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8c351-2f22-4a4d-9b9f-da1d0bff87f8 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:29.754052 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7ebd0b9ab9a48f0a5505863a7d729e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:29.754657 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:29.754939 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:29.755213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:29.756957 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:29.770796 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:29.772218 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:29.791908 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4636/9252] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:14:38.985913 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:38.986410 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:38.986577 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:39.046791 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:14:39.048001 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:39.112494 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4617/9253] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 04:14:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:14:39.161111 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:39.162538 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:39.254909 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7a679-ae82-4194-850f-9ee45d29e507 service glance] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:39.259930 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7810ce-58c8-4604-8879-ac432ad08381 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:39.260535 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7810ce-58c8-4604-8879-ac432ad08381 service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:39.260817 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7810ce-58c8-4604-8879-ac432ad08381 service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:39.261123 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7810ce-58c8-4604-8879-ac432ad08381 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:39.269134 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7810ce-58c8-4604-8879-ac432ad08381 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:39.270704 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7810ce-58c8-4604-8879-ac432ad08381 service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:39.278678 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4637/9254] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:14:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:14:40.399453 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:40.413460 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80af33-8b6c-446a-b0a3-453858569f6b None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:40.418641 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:40.419995 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:40.420418 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:40.420769 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:40.422860 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:40.436214 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:40.437836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2d79-0686-43f4-a8ca-57d97870092a service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:40.449048 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4618/9255] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:14:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:14:48.606823 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:48.607380 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:48.607496 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:48.627391 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] MFA Rules not processed for user `d0a624b8f35f4e60a36f6fe36e189f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:14:48.628595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:48.635527 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4638/9256] 10.222.0.16 () {58 vars in 958 bytes} [Wed Oct 5 04:14:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:14:48.953414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:48.953992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:48.953992 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:48.991968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:14:48.993285 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:49.000643 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4619/9257] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 04:14:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:14:49.006603 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:49.016203 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99453022-c22a-40cc-9278-3a4fa0b4eb8c None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:49.019725 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:49.020324 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:49.020606 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:49.020882 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:49.022664 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:49.032118 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:49.033586 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945dc30-11ac-4409-92d0-28230dd5996f service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:49.041334 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4639/9258] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:14:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:14:49.409839 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:49.419822 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3c49-6a66-4406-aa96-69141f627833 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:49.425252 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:49.426339 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:49.426763 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:49.427050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:49.428893 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:49.443103 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:49.444524 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:49.455946 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4620/9259] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:14:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:14:50.386529 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0584-40bc-4745-8b88-7039645f5154 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:50.387018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0584-40bc-4745-8b88-7039645f5154 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:50.387137 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e0584-40bc-4745-8b88-7039645f5154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:50.428923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-ea9e0584-40bc-4745-8b88-7039645f5154 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:14:50.430142 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-ea9e0584-40bc-4745-8b88-7039645f5154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:50.439557 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4640/9260] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Oct 5 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:14:50.451328 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:50.452706 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:50.466502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bf896-a301-4bcb-9a2a-40b0d73700e3 service neutron] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:50.471849 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:50.472490 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:50.472776 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:50.473080 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:50.482463 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:50.484094 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:50.494169 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4621/9261] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:14:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:14:53.844301 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:53.844828 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:53.845015 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:53.852490 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=99 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:14:53.866864 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:14:53.868089 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:14:53.875333 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4641/9262] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 04:14:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:14:53.888922 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:14:53.902036 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2ab1-a73a-4fb4-a184-d85857fdb2af service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:14:53.908554 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:14:53.909204 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:14:53.909493 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:14:53.909775 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:14:53.918565 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:14:53.921325 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:14:53.931342 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4622/9263] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:15:03.861994 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=2 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:03.927256 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=77 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:04.012949 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:15:04.022937 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7fda7-5f12-4d99-a67c-fb2d2684c5e8 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:15:04.026495 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:15:04.027092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:15:04.027374 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:15:04.027648 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:15:04.030318 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:15:04.039942 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:15:04.041424 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:15:04.049285 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4642/9264] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:15:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:15:10.510248 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:15:10.523756 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c613-8700-4843-80a5-fe05315aad9f service swift] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:15:10.529414 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:15:10.530016 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:15:10.530298 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:15:10.530573 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:15:10.532335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:15:10.545044 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:15:10.546673 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:15:10.557535 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4623/9265] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:15:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:15:14.045810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:20.553127 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=6 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:15:49.090956 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:15:49.099933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7f198-6019-45f2-97b9-aef338bc4c48 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:15:49.103476 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:15:49.104062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:15:49.104340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:15:49.104613 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:15:49.106334 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:15:49.117504 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:15:49.118933 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db459ae-28f5-4023-89ef-2de959245c65 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:15:49.127062 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4643/9266] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:15:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:15:59.123839 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:15.805458 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:15.819445 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb6881-d97d-4a00-8c1d-6ec86af9e19a service nova] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:15.826050 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bf255-92bd-40da-8097-f2d79c31dfaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:15.826664 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf255-92bd-40da-8097-f2d79c31dfaf service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:15.826953 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf255-92bd-40da-8097-f2d79c31dfaf service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:15.827235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf255-92bd-40da-8097-f2d79c31dfaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:15.835110 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf255-92bd-40da-8097-f2d79c31dfaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:15.836696 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf255-92bd-40da-8097-f2d79c31dfaf service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:15.846085 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4624/9267] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:17:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:17:24.594030 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:24.594577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:24.594577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:24.614716 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:17:24.616204 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:24.624485 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4644/9268] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Oct 5 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:17:24.664119 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c502-49dc-414e-862d-b818d79b834d None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:24.664610 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c502-49dc-414e-862d-b818d79b834d None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:24.664721 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7c502-49dc-414e-862d-b818d79b834d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:24.704836 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-a8a7c502-49dc-414e-862d-b818d79b834d None None] MFA Rules not processed for user `4c0d9417ce05468695abebca3b0abde3`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:17:24.706079 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-a8a7c502-49dc-414e-862d-b818d79b834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:24.714708 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4625/9269] 10.222.0.16 () {58 vars in 1040 bytes} [Wed Oct 5 04:17:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:17:24.721560 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:24.734101 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73275157-4f44-4ada-a4d6-0e4de2b338f6 None None] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:24.739409 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:24.740008 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:24.740288 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:24.740810 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:24.749463 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:24.751022 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:24.759137 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4645/9270] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:17:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:17:33.570655 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:33.571200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:33.571200 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:33.591587 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:17:33.592816 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:33.600425 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4626/9271] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 04:17:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 04:17:33.612806 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:33.624062 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad9885-0071-4730-8327-f18fe3b2e15c service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:33.629176 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:33.629774 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:33.630056 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:33.630337 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:33.638961 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:33.640577 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:33.648931 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4646/9272] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 05 04:17:34.789680 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:34.811501 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3bac8-71ce-4916-9e5e-f99083f28663 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:34.820031 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843af90-db6e-43f5-a70c-c01f7656fc89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:34.820551 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843af90-db6e-43f5-a70c-c01f7656fc89 service nova] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:34.820877 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843af90-db6e-43f5-a70c-c01f7656fc89 service nova] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:34.821154 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843af90-db6e-43f5-a70c-c01f7656fc89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:34.833980 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843af90-db6e-43f5-a70c-c01f7656fc89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:34.835579 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843af90-db6e-43f5-a70c-c01f7656fc89 service nova] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:34.846994 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4627/9273] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:17:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:17:37.136108 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:37.149832 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f2e0-045b-49d5-bed5-b452e2c8bfbc service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:37.155695 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ae6b3ef0964315be1bc1983fe65939', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:37.156565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:37.156763 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:37.157175 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:37.159328 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:37.173528 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:37.175710 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:37.187078 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4647/9274] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:17:38.545485 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabcb9d-3f83-4bed-8eab-d783ba55dac3 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:38.546030 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabcb9d-3f83-4bed-8eab-d783ba55dac3 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:38.546152 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabcb9d-3f83-4bed-8eab-d783ba55dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:38.566289 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-beabcb9d-3f83-4bed-8eab-d783ba55dac3 None None] MFA Rules not processed for user `e2750dbbaa7c460d95e1b273f1dd7166`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:17:38.567491 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-beabcb9d-3f83-4bed-8eab-d783ba55dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:38.575373 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4628/9275] 10.222.0.16 () {58 vars in 967 bytes} [Wed Oct 5 04:17:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:17:38.587718 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:38.604340 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324168c-a29f-4119-9b20-c530ab1bbfbd service nova] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:38.610509 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c0d9417ce05468695abebca3b0abde3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:38.610936 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:38.611215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:38.611488 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:38.620213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:38.621821 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:38.629852 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4648/9276] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Oct 5 04:17:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 05 04:17:42.735360 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:42.735880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:42.735880 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:42.743874 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=28 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:42.757234 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] MFA Rules not processed for user `c91c97c8ca6f457ab50e78a75b852db6`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:17:42.758435 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:42.774291 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4629/9277] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Oct 5 04:17:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 05 04:17:42.780212 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:42.789553 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92849a17-5ed3-48ab-8592-4e1dd1c024ec service swift] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:42.793135 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c91c97c8ca6f457ab50e78a75b852db6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:42.793733 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:42.794018 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:42.794298 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:42.855825 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:42.857898 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:42.868011 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4649/9278] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:17:46.042986 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:46.058518 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e617b2-255d-4f32-bb55-6d9882ce601f None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:46.069546 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:46.070181 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:46.070465 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:46.070743 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:46.072567 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:46.086474 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:46.088070 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:46.103723 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4630/9279] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:17:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:17:49.297230 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:49.306712 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=58 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:49.317536 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174acf-6f55-4e1d-a21d-de0c86352736 service neutron] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:49.323272 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:49.323891 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:49.324170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:49.324453 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:49.337697 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:49.363809 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:49.366199 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:49.370695 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:49.400144 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4650/9280] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:17:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:17:49.409666 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9df1-5fa8-4eae-a219-fe5953cf4bac service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:49.415894 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:49.417011 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:49.417330 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:49.417771 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] PATH_INFO: `/v3/users/d0a624b8f35f4e60a36f6fe36e189f0d` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:49.419235 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a624b8f35f4e60a36f6fe36e189f0d)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:49.422678 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:49.476150 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a624b8f35f4e60a36f6fe36e189f0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.498619 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a624b8f35f4e60a36f6fe36e189f0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.499433 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a624b8f35f4e60a36f6fe36e189f0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.516135 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a624b8f35f4e60a36f6fe36e189f0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.516784 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a624b8f35f4e60a36f6fe36e189f0d'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.529529 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4631/9281] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 04:17:49 2022] DELETE /identity/v3/users/d0a624b8f35f4e60a36f6fe36e189f0d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 05 04:17:49.716312 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:49.727215 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598e9f0-1aa6-47a3-8a84-e569a4127c89 service placement] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:49.788316 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:49.788923 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:49.789213 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:49.789489 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] PATH_INFO: `/v3/projects/3f290aa28fa24d1eb2840c871ecdd853` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:49.790627 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f290aa28fa24d1eb2840c871ecdd853)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:49.792565 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:49.839502 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f290aa28fa24d1eb2840c871ecdd853', 'request_id': 'req-9b388ca2-1997-475c-bba6-d167de9e5a86'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.845506 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f290aa28fa24d1eb2840c871ecdd853', 'request_id': 'req-9b388ca2-1997-475c-bba6-d167de9e5a86'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.851525 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f290aa28fa24d1eb2840c871ecdd853', 'request_id': 'req-9b388ca2-1997-475c-bba6-d167de9e5a86'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.866066 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] The token cache is being invalidate because project 3f290aa28fa24d1eb2840c871ecdd853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 04:17:49.866361 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.866986 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.868555 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4651/9282] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 04:17:49 2022] DELETE /identity/v3/projects/3f290aa28fa24d1eb2840c871ecdd853 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:17:49.872657 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:49.874073 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:49.887128 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d7a4-61c0-41ff-8361-ab4bb799f173 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:49.944847 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:49.945502 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:49.945781 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:49.946056 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] PATH_INFO: `/v3/users/f4990629adbf4bf181390b0659662eb3` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:49.947180 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4990629adbf4bf181390b0659662eb3)` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:49.949136 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:49.996334 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4990629adbf4bf181390b0659662eb3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:49.997556 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:50.010854 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4990629adbf4bf181390b0659662eb3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.011559 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4990629adbf4bf181390b0659662eb3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.020396 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4990629adbf4bf181390b0659662eb3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.021047 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.notifications [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4990629adbf4bf181390b0659662eb3'} {{(pid=81827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.033648 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4632/9283] 10.222.0.16 () {58 vars in 1224 bytes} [Wed Oct 5 04:17:49 2022] DELETE /identity/v3/users/f4990629adbf4bf181390b0659662eb3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:17:50.208399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:17:50.210976 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:17:50.224170 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388ca2-1997-475c-bba6-d167de9e5a86 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:17:50.281574 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed98d68710e84d4fbf59928bc3712add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd86c8465865f42a8aed631f648876892', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:17:50.282219 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:17:50.282508 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:17:50.282802 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] PATH_INFO: `/v3/projects/755eabe801f64b83b5dc6975cecb6ce0` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:17:50.283913 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755eabe801f64b83b5dc6975cecb6ce0)` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:17:50.285979 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:17:50.309183 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:17:50.334665 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755eabe801f64b83b5dc6975cecb6ce0', 'request_id': 'req-7c61320b-24b7-456c-a416-844e61fea0f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.340092 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755eabe801f64b83b5dc6975cecb6ce0', 'request_id': 'req-7c61320b-24b7-456c-a416-844e61fea0f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.346397 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755eabe801f64b83b5dc6975cecb6ce0', 'request_id': 'req-7c61320b-24b7-456c-a416-844e61fea0f7'} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.360967 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] The token cache is being invalidate because project 755eabe801f64b83b5dc6975cecb6ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81826) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 05 04:17:50.361264 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.361896 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.notifications [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81826) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 05 04:17:50.363374 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4652/9284] 10.222.0.16 () {58 vars in 1233 bytes} [Wed Oct 5 04:17:50 2022] DELETE /identity/v3/projects/755eabe801f64b83b5dc6975cecb6ce0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 05 04:18:00.030335 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:18:00.357595 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:18:51.450476 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:18:51.452159 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:18:51.542561 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64611-37f5-42a4-bb02-9c481ef22d14 admin admin] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:18:51.604454 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:18:51.605109 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:18:51.605395 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:18:51.605691 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:18:51.607400 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:18:51.618694 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:18:51.620263 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ab92a-b611-4ca7-9910-8be0f0e080fd service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:18:51.630391 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4633/9285] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:19:01.626203 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=67 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:19:45.363003 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Authenticating user token {{(pid=81826) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:19:45.364399 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:19:45.409182 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61320b-24b7-456c-a416-844e61fea0f7 admin admin] Validating token access rules against request {{(pid=81826) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:19:45.414256 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81826) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:19:45.414852 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] REQUEST_METHOD: `GET` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:19:45.415132 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:19:45.415406 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:19:45.417102 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:19:45.428780 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:19:45.430412 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068169eb-84b4-4f51-aaad-5ee44b35d157 service placement] RBAC: Authorization granted {{(pid=81826) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:19:45.440269 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4653/9286] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:19:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:19:55.436124 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=20 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:21:49.345708 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] REQUEST_METHOD: `POST` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:21:49.346279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:21:49.346279 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:21:49.385319 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.auth.core [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:21:49.386528 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.fernet_utils [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:21:49.404023 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4634/9287] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Oct 5 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:21:49.417131 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6534-b23a-47fa-a568-9fbbf722b962 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:21:49.417569 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6534-b23a-47fa-a568-9fbbf722b962 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:21:49.417682 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e6534-b23a-47fa-a568-9fbbf722b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:21:49.438352 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-e88e6534-b23a-47fa-a568-9fbbf722b962 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:21:49.439552 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-e88e6534-b23a-47fa-a568-9fbbf722b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:21:49.448357 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4654/9288] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Oct 5 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:21:49.454352 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:21:49.465745 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28313ade-ba17-40a4-8fd8-c4f2d8e6eb80 None None] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:21:49.471081 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:21:49.471684 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:21:49.471968 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:21:49.472245 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:21:49.481314 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:21:49.482901 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:21:49.492570 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4635/9289] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:21:53.422383 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d3bb-7fb9-442f-886f-224e07d34856 None None] REQUEST_METHOD: `POST` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:21:53.423004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d3bb-7fb9-442f-886f-224e07d34856 None None] SCRIPT_NAME: `/identity` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:21:53.423004 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d3bb-7fb9-442f-886f-224e07d34856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81826) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:21:53.442703 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.auth.core [None req-07c5d3bb-7fb9-442f-886f-224e07d34856 None None] MFA Rules not processed for user `eea06fb6c97248549e3253c032e83a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81826) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 05 04:21:53.443905 n-d-858272-3 devstack@keystone.service[81826]: DEBUG keystone.common.fernet_utils [None req-07c5d3bb-7fb9-442f-886f-224e07d34856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81826) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 05 04:21:53.453182 n-d-858272-3 devstack@keystone.service[81826]: [pid: 81826|app: 0|req: 4655/9290] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Oct 5 04:21:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 05 04:21:53.465948 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] Authenticating user token {{(pid=81827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 05 04:21:53.477652 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052333c7-cbc7-4424-985f-0e2294ac2241 service placement] Validating token access rules against request {{(pid=81827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 05 04:21:53.483007 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eacaab-97d2-404d-96ef-f10fad1a50c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea06fb6c97248549e3253c032e83a0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5462d68b9a5a4b96b2588d076fce0fb4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 05 04:21:53.483621 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacaab-97d2-404d-96ef-f10fad1a50c8 service placement] REQUEST_METHOD: `GET` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 05 04:21:53.483930 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacaab-97d2-404d-96ef-f10fad1a50c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 05 04:21:53.484206 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eacaab-97d2-404d-96ef-f10fad1a50c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 05 04:21:53.494739 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eacaab-97d2-404d-96ef-f10fad1a50c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 05 04:21:53.496337 n-d-858272-3 devstack@keystone.service[81827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eacaab-97d2-404d-96ef-f10fad1a50c8 service placement] RBAC: Authorization granted {{(pid=81827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 05 04:21:53.506385 n-d-858272-3 devstack@keystone.service[81827]: [pid: 81827|app: 0|req: 4636/9291] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Oct 5 04:21:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 05 04:22:03.437393 n-d-858272-3 devstack@keystone.service[81826]: DEBUG dbcounter [-] [81826] Writing DB stats keystone:SELECT=6 {{(pid=81826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 04:22:03.502123 n-d-858272-3 devstack@keystone.service[81827]: DEBUG dbcounter [-] [81827] Writing DB stats keystone:SELECT=27 {{(pid=81827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}